Principal DataOps AI/ML

What You Will Do:

Infrastructure Development: 

• Design and implement scalable MLOps supportive data pipelines for data ingestion, processing, and storage. 

• Support and maintain DataOps components of cloud infrastructure to support machine learning workflows. 

• Ensure data quality, availability, and reliability throughout its lifecycle. 

Model Deployment and Monitoring: 

• Collaborate with data scientists to deploy DataOps supporting the lifecycle of machine learning models into production environments. 

• Set up monitoring and alerting systems to track model performance and data drift. 

• Automate DataOps in support of model retraining and deployment processes to ensure continuous integration and delivery. 

Collaboration and Leadership: 

• Work closely with cross-functional teams, including data engineers, data scientists, and DevOps engineers. 

• Provide technical leadership and mentorship to junior engineers. 

• Drive best practices for DataOps and MLOps within the organization. 

Process Optimization: 

• Implement and optimize CI/CD pipelines for DataOps to machine learning projects. 

• Develop and enforce standards for version control, testing, and documentation. 

• Identify and address bottlenecks in data and model workflows to improve efficiency. 

Security and Compliance: 

• Ensure compliance with data privacy and security regulations. 

• Implement robust security measures to protect data and models. 

What You Bring:

• Bachelor's Degree or Advanced Degree where required
• 8+ Years of Experience
• In lieu of degree, 10+ years exp.

• Extensive experience in DataOps and MLOps, with a strong understanding of both domains. 

• Proficiency in languages such as Python, SQL, Scala, Glue, with Ab Initio a plus  

• Hands-on experience with cloud platforms (AWS, Snowflake with Ab Initio a plus) and containerization technologies such as Docker 

• Strong understanding of CI/CD for data engineering and QitHub methods 

• Strong knowledge of machine learning frameworks and libraries (Sagemaker and Snowpark ML) 

• Excellent problem-solving skills and the ability to work in a fast-paced environment. 

• Strong communication and leadership skills. 

• Strong understanding of Metadata driven workflows, data architecture, semantics and data governance 

Preferred Qualifications: 

• Experience with Snowflake cloud platform, AWS, Sagemaker, Ab Initio and Ataccama. 

• Understanding of data governance and compliance frameworks. 

• Previous experience in a leadership or principal engineer role. 

Why Join Us: 

• Opportunity to work on cutting-edge technologies and innovative projects. 

• Collaborative and inclusive work environment. 

• Competitive salary and benefits package. 

• Professional development and growth opportunities