Match score not available

Data Engineering Lead

Remote: 
Full Remote
Contract: 
Experience: 
Senior (5-10 years)
Work from: 

Offer summary

Qualifications:

US Citizen with ability to secure US Federal Security Clearance, Bachelor’s degree in Computer Science, Software Engineering or similar field. (Masters Degree a plus), Certifications in Databricks strongly preferred, 8+ years ETL processes design and development experience, 4+ years experience with Databricks, data pipeline optimization, Experience with AWS services: Glue, S3, Redshift.

Key responsabilities:

  • Build and scale advanced cloud data pipelines for effective data management
  • Implement batch and streaming data sources into cloud-based data lake and warehouses
  • Utilize AWS serverless components in data pipeline architecture
Analytica logo
Analytica Information Technology & Services SME https://www.analytica.net/
51 - 200 Employees
See more Analytica offers

Job description

Logo Jobgether

Your missions

 
Analytica is seeking a remote Data Engineering Lead to lead cloud data engineering implementations that support business intelligence, machine learning, data science and/or graph analytics on federal client projects.  

The ideal candidate will be comfortable working hands-on with technical implementations as well as working directly with clients in both a consulting and delivery capacity. You must be able to tackle complex, enterprise cloud or on-premises software and technology projects.  

Analytica has been recognized by Inc. Magazine as one of the fastest-growing 250 businesses in the US for 3 years. We work with U.S. government clients in health, civilian, and national security missions to build better technology products that impact our day-to-day lives. The company offers competitive compensation with opportunities for bonuses, employer-paid health care, training and development funds, and 401k match.    

Responsibilities include (but not limited to):  

  • Build and scale advanced cloud data pipelines that support effective data management, governance and sharing
  • Build out data pipelines in AWS for data lakes and data warehouses.
  • Implementing data pipelines, via a variety of tools including Amazon S3, AWS Glue, Amazon Textract, Amazon Comprehend, AWS Lambda, SQL and/or Python scripts, in the cloud to an existing data lake and data warehouse.
  • Implement data pipelines, for batch and streaming data sources, from external feeds into a cloud-based data lake and eventually into data warehouses;  
  • Use AWS serverless components in the data pipeline architecture;

 Basic Qualifications:  

  • US Citizen with the ability to secure US Federal Security Clearance  

  • Bachelor’s degree in Computer Science, Software Engineering or other technical field. Masters Degree a plus 

  • Certifications in Databricks (Machine Learning, etc) strongly preferred 

  • 8+ years of experience in designing and developing ETL processes and managing data pipelines  

  • 4+ years of experience with Databricks, including building and optimizing data pipelines using Databricks notebooks and clusters  

  • Experience using various AWS services, including AWS Glue, Amazon S3, and Amazon Redshift  

  • Experience designing, developing, and maintaining ETL pipelines, including data extraction, transformation, and loading processes  

  • Experience with AWS Glue Data Catalog for managing metadata, schema definitions, and data lineage  

  • Experience monitoring ETL job runs, identifying bottlenecks, and troubleshooting issues, including use of AWS CloudWatch  

  • Knowledge of performance optimization techniques for ETL jobs, such as partitioning, bucketing, and caching  

  • Ability to write Python code for ETL scripts and custom transformations  

  • Experience with Tableau, PowerBI, and/or SAS Viya business intelligence tools.  

  • Ability to effectively communicate in writing and orally with a wide range of audiences and maintain interpersonal relationships.   

  • Ability to work within time constraints and manage multiple tasks against critical deadlines. 

About ANALYTICA: Analytica is a leading consulting and information technology solutions provider to public sector organizations supporting health, civilian, and national security missions. The company is an award winning  SBA 8(a) small business that has been recognized by Inc. Magazine each of the past three years as one of the 250 fastest-growing companies in the U.S.  Analytica specializes in providing software and systems engineering, information management, analytics & visualization, agile project management, and management consulting services. The company is appraised by the Software Engineering Institute (SEI) at CMMI® Maturity Level 3 and is an ISO 9001:2008 certified provider. 
 

Analytica LLC. is an Equal Employment Opportunity and Affirmative Action employer. We value diversity at all levels. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to sex, pregnancy, race, religion or religious creed, color, gender, gender identity, gender expression, national origin, ancestry, physical or mental disability, medical condition, genetic information, marital status, registered domestic partner status, age, sexual orientation, military or veteran status, protected veteran status, or any other basis protected by federal, state, local law, ordinance, or regulation and will not be discriminated against on these bases

When receiving email communication from Analytica, please ensure that the email domain is analytica.net to verify its authenticity.

Required profile

Experience

Level of experience: Senior (5-10 years)
Industry :
Information Technology & Services
Spoken language(s):
Check out the description to know which languages are mandatory.

Soft Skills

  • Analytical Thinking
  • Social Skills
  • Time Management
  • Verbal Communication Skills

Data Engineer Related jobs