Offer summary
Qualifications:
Minimum 10 years of data engineering experience, Strong expertise in Python and Apache Spark, Experience with Scala and Apache Airflow is desirable, Proven track record in pipeline refactoring.
Key responsabilities:
- Lead design, development, and refactoring of data pipelines
- Implement robust solutions using Python and Apache Spark
- Collaborate to identify and resolve process bottlenecks
- Define data architecture for efficiency and scalability
- Guide team on best practices in development and optimization
- Maintain clear communication with technical and business stakeholders