Offer summary

Qualifications:

8+ years of experience in data engineering or infrastructure roles focused on pipeline development., Strong experience with Python and distributed data processing tools like Apache Spark or PySpark., Hands-on experience with orchestration frameworks like Apache Airflow, Dagster, or similar., Experience in cloud environments (AWS, Azure, or GCP) and familiarity with security tools is a plus..

Key responsibilities:

Design and build scalable batch and streaming data pipelines for ingesting telemetry, log, and event data.

Develop and maintain orchestration workflows using tools like Apache Airflow or similar schedulers.

Onboard new data sources, build connectors, and normalize security-related datasets.

Collaborate across detection, threat intel, and platform teams to align ingestion with security use cases.

Job description

Make a difference here.

UltraViolet Cyber is a leading platform-enabled unified security operations company providing a comprehensive suite of security operations solutions. Founded and operated by security practitioners with decades of experience, the UltraViolet Cyber security-as-code platform combines technology innovation and human expertise to make advanced real-time cybersecurity accessible for all organizations by eliminating risks of separate red and blue teams.

By creating continuously optimized identification, detection, and resilience from today’s dynamic threat landscape, UltraViolet Cyber provides both managed and custom-tailored unified security operations solutions to the Fortune 500, Federal Government, and Commercial clients. UltraViolet Cyber is headquartered in McLean, Virginia, with global offices across the U.S. and in India.

We’re looking for a Data Pipeline Engineer with deep experience building and orchestrating large-scale ingestion pipelines. This role is ideal for someone who enjoys working across high-volume telemetry sources, optimizing data workflows, and solving schema drift challenges in real-world distributed environments.

You’ll be part of the Security Data Platform and ML Engineering team, helping to onboard and normalize security data that powers analytics, detection, and ML workflows across Adobe.

What You'll Do:

Design and build scalable batch and streaming data pipelines for ingesting telemetry, log, and event data

Develop and maintain orchestration workflows using tools like Apache Airflow or similar schedulers

Use tools like Cribl, Logstash, Fluentd, or similar for data routing, filtering, and enrichment at scale

Onboard new data sources, build connectors (API/Kafka/file-based), and normalize security-related datasets

Monitor and manage schema drift across changing source systems and formats

Implement observability into pipelines — logging, metrics, and alerts for health and performance

Optimize ingestion for performance, resilience, and cost-efficiency

Collaborate across detection, threat intel, and platform teams to align ingestion with security use cases

What You Have:

8+ years of experience in data engineering or infrastructure roles focused on pipeline development

Strong experience with Python and distributed data processing tools like Apache Spark or PySpark

Hands-on experience with orchestration frameworks like Apache Airflow, Dagster, or similar

Deep understanding of ingestion best practices, schema evolution, and drift handling

Experience working with Kafka, S3, or cloud-native storage and messaging systems

Experience in cloud environments (AWS, Azure, or GCP)

Bonus: Familiarity with security tools (e.g., Crowdstrike, Wiz), OCSF, or compliance-related data

UltraViolet Cyber maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect our company's differing products, services, industries and lines of business. Candidates are typically placed into the range based on the preceding factors.

We sincerely thank all applicants in advance for submitting their interest in this position. We know your time is valuable.

UltraViolet Cyber welcomes and encourages diversity in the workplace regardless of race, gender, religion, age, sexual orientation, gender identity, disability, or veteran status.

If you want to make an impact, UltraViolet Cyber is the place for you!

Required profile