ETL Developer

About The Job ETL Developer

Job Opportunity: ETL Developer (5.5-Month Contract)

Location: [Specify Location / Remote]

Contract Length: 5.5 months (Starting January 13, 2024)

Overview

We are seeking an experienced ETL Developer for a 5.5-month contract starting on January 13, 2024. In this role, you will be responsible for designing, developing, and maintaining ETL processes to extract, transform, and load data from various source systems into target data storage systems. Youll work closely with business analysts, data architects, and other stakeholders to ensure data integrity, consistency, and accuracy throughout the ETL pipeline.

This is an exciting opportunity for a skilled ETL professional to make a significant impact on a critical data integration project. If you have strong SQL skills, expertise in ETL tools, and a passion for data quality management, we want to hear from you!

Key Responsibilities

• ETL Process Design & Development:
• Develop and implement ETL processes to extract data from source systems, transform it according to business rules, and load it into target systems.
• Cleanse, aggregate, format, and enrich data during the transformation process.
• Design and maintain automated ETL workflows to efficiently handle large data volumes.
• SQL Query Development:
• Write complex SQL queries for data extraction, transformation, and validation.
• Optimize SQL queries for performance, particularly for large datasets.
• Troubleshoot and debug SQL issues during the ETL process.
• Data Quality Management:
• Implement data validation and quality checks at various stages of the ETL pipeline.
• Identify and resolve data quality issues, ensuring the integrity and consistency of data.
• Ensure data transformation processes align with business logic and compliance requirements.
• ETL Tool Proficiency:
• Utilize Pentaho Data Integration (PDI) or similar ETL tools (e.g., Talend, Informatica, SSIS) to design and implement ETL workflows.
• Ensure proper configuration and optimization of ETL tools for efficient data processing.
• Continuously improve ETL processes by incorporating best practices and new technologies.
• Source System Integration:
• Gain an in-depth understanding of source systems, including databases, APIs, and third-party data sources.
• Develop methods for integrating data from various source systems into the ETL pipeline.
• Ensure smooth integration of external data sources via APIs, flat files, and other methods.
• Collaboration & Communication:
• Work closely with data architects, analysts, and business teams to understand data requirements and business logic.
• Provide regular updates on ETL development progress, challenges, and milestones.
• Assist with troubleshooting issues related to data extraction, transformation, and loading.
  

Required Skillset & Expertise

• ETL Concepts & Best Practices:
• Strong understanding of ETL concepts, processes, and methodologies.
• Proven experience in designing scalable and efficient ETL systems.
• Proficiency in SQL:
• Advanced knowledge of SQL, including complex queries, joins, aggregations, and optimization techniques.
• Experience optimizing SQL queries for performance in data-heavy environments.
• ETL/Data Integration Tools:
• Proven experience with Pentaho Data Integration (PDI) or similar ETL tools such as Talend, Informatica, or SSIS.
• Familiarity with scripting and automation within ETL tools.
• Data Quality & Integrity:
• Experience implementing data quality checks and error handling within ETL pipelines.
• Exceptional attention to detail and a commitment to maintaining accurate and reliable data.
• Source Systems & API Integration:
• Strong understanding of source systems, data formats, and API integration for data extraction.
• Ability to work with various data sources such as relational databases, APIs, flat files, and cloud-based systems.
• Problem Solving & Troubleshooting:
• Strong analytical skills to identify and resolve data issues throughout the ETL process.
• Ability to troubleshoot ETL failures, performance bottlenecks, and data discrepancies.
  

What We Offer

• 5.5-month contract with the potential for future opportunities depending on project needs.
• A dynamic and collaborative environment with a focus on cutting-edge ETL technologies.
• The opportunity to work on an impactful data integration project for a defined period.
• Remote/Flexible work options to support a balanced work-life dynamic.
  
  

How To Apply

If you are an experienced ETL Developer looking for a contract role with a well-defined scope, we would love to hear from you! Please submit your CV and cover letter outlining your experience and availability to rrondi@dearx.co.za