Sr Data Engineer

The Data Engineer acts as a high value steward for our modern unified data platform. This person is responsible for transforming and ingesting data into our data warehouse and providing frameworks and services for operating on that data while also maintaining high standards for quality, security, and reliability. Our data comes from a multitude of sources, including our eventing pipeline, write-ahead logs, APIs and legacy flat files. Our stakeholders rely on us daily to make data access and reliability a strength of our business.

What will you do?

• Building pipelines for a wide variety of data sources/destinations and maintaining their mapped schemas.
• Building and maintaining the core raw datasets for Machine Learning and Analytics.
• Ensuring privacy, compliance, and security protocols for our data.
• Integrating our core raw datasets into the rest of the technical organization and products.
• Delivering tooling and processes for operating on data, securing data storage, and ensuring data reliability.
• Providing technical mentorship to fellow Engineers and Analysts.
  
  

What do you need?

• 4+ years of experience working as Data Engineer
• Experience implementing, testing, debugging and deploying data pipelines using 2+ of the following tools: Prefect, Airflow, Glue, Kafka, Serverless(Lambda, Kinesis, SQS, SNS), Fivetran, Stitch Data/Singer.
• Experience with 1+ Cloud Data Warehousing technologies: Redshift, BigQuery, Spark, Snowflake, Presto, Athena, S3.
• Experience with SQL DB administration (PostgreSQL, MS SQL, etc.).
• Proficient with Python for backend and/or data pipeline development . Bonus points for contributions to open source projects.
• Proficient with cloud operations management/configuration using tools like Terraform and/or Cloudformation.
• Proficient with SQL for analytical querying and data processing.
• Familiarity with BI tools: Periscope, Tableau, Looker.
• Familiarity with containerization: Docker, ECS, Kubernetes.
• Familiarity with distributed processing: Dask and/or Spark.
  
  

Encora is an equal opportunity employer, committed to fostering, cultivating and preserving a culture of diversity equality and inclusion.

We embrace and encourage our employees and applicants/candidates' differences in age, color, disability, ethnicity, family or marital status, gender identity and/or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socioeconomic status, veteran status, and other characteristics that make our employees unique.

Every individual has the right to work in a professional atmosphere that promotes equal employment opportunities and prohibits discriminatory practices, including harassment of any kind.