· Developing end to end ETL/ELT Pipeline working
with Data Analysts of business Function.
· Designing, developing, and implementing
scalable, automated processes for data extraction, processing, and analysis
in a Data Mesh architecture
· Mentoring Fother Junior Engineers in the Team
· Be a “go-to” expert for data technologies and
solutions
· Ability to provide on the ground
troubleshooting and diagnosis to architecture and design challenges
· Troubleshooting and resolving technical issues
as they arise
· Looking for ways of improving both what and
how data pipelines are delivered by the department
· Translating business requirements into
technical requirements, such as entities that need to be modelled, DBT models
that need to be build, timings, tests and reports
· Owning the delivery of data models and reports
end to end
· Perform exploratory data analysis in order to
identify data quality issues early in the process and implement tests to
ensure prevent them in the future
· Working with Data Analysts to ensure that all
data feeds are optimised and available at the required times. This can
include Change Capture, Change Data Control and other “delta loading”
approaches
· Discovering, transforming, testing, deploying
and documenting data sources
· Applying, help defining, and championing data
warehouse governance: data quality, testing, coding best practises, and peer
review
· Building Looker Dashboard for use cases if
required
|