Offer summary
Qualifications:
4-10 years of experience in data engineering, Expertise in Python, PySpark, Hadoop ecosystem, Strong experience in Unix and shell scripting, Deep understanding of streaming data technologies, Experience with agile methodologies and CI/CD.Key responsabilities:
- Develop and optimize data processing systems using PySpark
- Work within big data platform for real-time processing