Offer summary

Qualifications:

2-5 years of experience in data engineering with a focus on ETL development and enterprise data integration., Proficiency in Python and SQL for data transformation and pipeline automation., Strong understanding of data schema design and performance tuning for large datasets., Experience with workflow orchestration tools like Apache Airflow or Azure Data Factory..

Key responsabilities:

Develop ETL pipelines to extract data from SAP and load it into Databricks and Microsoft CRM.

Automate data ingestion and transformation processes to enhance efficiency.

Monitor and troubleshoot pipeline failures to maintain data reliability.

Collaborate with data scientists to ensure data accessibility for AI-driven forecasting models.

Job description

FocusKPI is looking for a Data Engineer to join or internal team and help one of our clients with their projects.

We are seeking a Data Engineer to design and implement data pipelines linking SAP, Databricks, and Microsoft CRM while automating data flow for analytics and forecasting.

Work Location: Remote - anywhere in the US
Duration: 9+ months contract
Pay Range: $60/hr to $85/hr (on basis of experience level)

Responsibilities:

Develop ETL pipelines to extract SAP data and load it into Databricks and Microsoft CRM, ensuring accurate and structured data transfer.
Automate data ingestion and transformation processes using Python, SQL, and cloud-based tools to reduce manual intervention and improve efficiency.
Extract and process transactional, master, and historical data from SAP, including SAP HANA, SAP BW, or OData, and ensure it is properly formatted for downstream analytics.
Monitor and troubleshoot pipeline failures, ensuring minimal downtime and maintaining data reliability for analytical use cases.
Collaborate with data scientists and analysts to make data accessible for AI-driven forecasting models.
Maintain access control and security configurations to ensure sensitive business data is handled in compliance with internal policies.

Qualifications:

2-5 years of experience in data engineering, specializing in ETL development and enterprise data integration.
Proficiency in Python and SQL for data transformation, pipeline automation, and query optimization.
Strong understanding of data schema design, indexing, and performance tuning for large datasets.
Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or Azure Data Factory) to schedule and automate data tasks.
Familiarity with machine learning model deployment for forecasting and predictive analytics.
Experience with CI/CD pipelines for data engineering, including version control, testing, and deployment autoluding SAP HANA, SAP BW, OData, BAPI, or IDocs.
Experience with Databricks, including Delta Lake storage, query optimization, and structured data management.
Familiarity with Microsoft CRM (Dynamics preferred) and the data models used for customer and business analytics.
Experience implementing data governance frameworks, including data security, access controls, and logging.

**No C2C profiles are accepted**

Thank you!

FocusKPI Hiring Team

Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.

NOTICE: Please be aware of fraudulent emails regarding job postings, job offers and fake checks. FocusKPI's recruiting team will strictly reach out via @focuskpi.com email domain. If you have received fraudulent emails now or in the past, please report it to https://reportfraud.ftc.gov/ .
The domain @focuskpijobs.com is fraudulent and not related to FocusKPI. Please do not not reply or communicate to anyone with @focuskpijobs.com.

Required profile