Offer summary
Qualifications:
Over 2 years of data pipeline design experience, Knowledge of CI/CD (Git), Experience with orchestration tools like Airflow, NiFi, Familiarity with AWS services like S3, Glue, Redshift, Experience with big data technologies: Python, Pyspark, SQL.Key responsabilities:
- Build and maintain data pipelines
- Integrate various data sources and systems
- Process mass data ingest from APIs
- Transform big data for storage solutions
- Collaborate on data architecture strategies