Offer summary

Qualifications:

5 years of hands-on experience in Python and Spark., Proficient in AWS Cloud management and Databricks., Experience with ML models like XGBoost, LightGBM, and Torch., English proficiency at B2 or C1 level..

Key responsibilities:

Develop and optimize features for the ML Platform.

Design and manage data pipelines using Python and Spark.

Implement and ensure the quality of ML models and data products.

Lead discussions and drive projects independently.

Job description

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for: Data/ML Platform Engineer

Responsibilities:

Develop and optimize ML Platform features
Refactor and translate data products
Design and manage data pipelines (Python, Spark)
Work with AWS, Databricks (Lakehouse, ML, MLflow)
Implement ML models (XGBoost, LightGBM, Torch)
Ensure data quality (Parquet, Delta Lake)
Lead discussions and guide teams
Drive projects independently

Requirements:

5 years of hands-on experience in using Python, Spark
Experienced in AWS Cloud usage and management
Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow)
Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch
Fundamental understanding of Parquet, Delta Lake and other data file formats
English level: B2, C1

Nice to have:

Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes)
Experience with orchestrators such as Airflow and Kubeflow
Proficiency on an IaC tool such as Terraform, CDK or CloudFormation

Offer: