Offer summary
Qualifications:
Experience with distributed technologies like Spark/Scala., Experience handling large data volumes in cloud processing (Azure, AWS, GCP)., Familiarity with Apache Airflow and streaming analytics., Knowledge of Azure Databricks, Azure Synapse, and Azure Data Factory..Key responsabilities:
- Design and develop robust data pipelines.
- Implement and manage data storage and processing solutions for availability and quality.
- Collaborate with multidisciplinary teams to integrate data from diverse sources.
- Ensure data quality through cleaning and validation processes.
.png)
