Offer summary

Qualifications:

Strong SQL and data transformation skills are essential., Understanding of ETL/ELT process fundamentals is required., Experience with relational databases and data engineering is necessary., Knowledge of automation tools is important for this role..

Key responsibilities:

Create and manage automated tests to identify issues with the ETL process.

Collaborate with the Enterprise Data team to determine required tests and automate them.

Build and monitor automated system health checks and orchestrate data testing solutions.

Support the team during releases and investigate root causes of issues.

Job description

Company Description

AGSI was incorporated in April 2016. We are committed to supporting the goals of Arch divisions through exceptional service delivery. We pride ourselves on maintaining flexibility and responsiveness to adapt to business unit and industry demands while focusing on sound project management. We are dedicated to growing and developing our employees as we build strong teams with strategic leadership.

Job Description

Shift: Night Shift

As a Data/QA Engineer in our Enterprise Data department, you will be responsible for creating and managing automated tests to identify issues with the ETL process to ensure the quality of data in the Enterprise Data Warehouse.

The role involves working together with the onshore Enterprise Data team to decide on the required tests on the process, automate them through creating stored procedures, custom dbt tests and scheduling these as part of the ETL process which loads data from source into the EDW.

Automate the common manual testing done by the QA through creating macros
Build and monitor automated system health checks
Collaborate with Enterprise Data Engineers to investigate root cause of issues and suggest resolutions.
Orchestrate data testing solutions using airflow
Be able to support the team in doing releases
Need automation knowledge on any tool

Qualifications

Strong SQL and data transformation skills
Understanding of ETL/ELT process fundamentals
Automation knowledge on any tool
You enjoy collaborating with your team members to build solutions which improves the data quality within the data warehouse
You have a drive to automate processes that mainly focuses on ensuring data quality and process rigidity
You have experience within data engineering.
You have experience working with relational databases and investigating root cause of issues.
Your SQL and data transformation skills are a key skill of yours
You have an understanding of database management systems and scripting.