Cloud Data Engineer

Job Overview

We are on an exciting journey to build and scale our advanced analytics practice. We are looking for a

Cloud Data Engineer. The suitable candidate should have demonstrated experience in designing and

implementing ETL solutions on-premises and cloud platforms to support Enterprise data warehouse,

Data Lake and advanced analytics capabilities. Success in this role comes from marrying a strong data

engineering background with product and business acumen to deliver scalable data pipeline and BI

solutions that can enable data for Self Service and Advanced Analytics at TE in a simple and standard

manner.

Primary Responsibilities:

• Design and develop ETL solutions using data warehouse design best practices for Next Generation Analytics platform on Big Data.
• Analyze data requirements, complex source data, data models, and determine the best methods in extracting, transforming, and loading the data into the data staging, warehouse, and other system integration projects.
• Document all ETL and data warehouse processes and flows.
  
• Develop and deploy ETL job workflow with reliable error/exception handling and rollback.
  
• Design, Develop, Test, Adapt ETL code & jobs to accommodate changes in source data and newbusiness requirements.
• Manage foundational data administration tasks such as scheduling jobs, troubleshooting job  errors, identifying issues with job windows, assisting with Database backups and performance tuning.
• Ensure data quality throughout entire ETL process, including audits and of truth. Create or update technical documentation for transition to support teams.
• Develop, contribute, and adhere to the development of standards and sound procedural practices.

Competencies & Experience Required/Desired:

• 3+ years of Data Engineering experience in ETL design, development & optimization using tools like Talend, AWS Glue, etc.
• 3+ years of experience on Big Data technologies like Hadoop, Spark with Scala or Python for developing flows using Batch, Realtime and Streaming processes3+ years of experience in Relational and No-SQL database design, optimization, and performanc with AWS Redshift, AWS Aurora, Oracle & SAP HANA, BW, etc.
• 3+ years of PL/SQL, Complex SQL Tuning, Stored Procedures, Data Warehousing best practices experience2+ years of experience with AWS Services like S3, EMR, Athena, Glue, Lambda, Redshift, Aurora, etc.
• Solid understanding of ETL pipeline and workflow managements tools such as AWS Glue, AWS
  
•  Kinesis, AWS App Flow, AWS Step Functions, etc.
  
• Proficiency with modern software development methodologies such as Agile, source control CI/CD, project management and issue tracking with JIRA
• Strong problem-solving capabilities. Results oriented. Relies on fact-based logic for decision making.
• Ability to work with multiple projects and work streams at one time. Must be able to deliver results based upon project deadlines
• Willing to flex daily work schedule to allow for time-zone differences for global team communications.
• Strong interpersonal and communication skills

Education

A masters or bachelors degree in computer science, applied mathematics, software engineering, physics, or related quantitative discipline.