Senior Data Engineer - Flight Data Processing (Remote)

Seniority: Senior 
English Level: B2 / C1 / C2
Modality: Remote


Join us in revolutionizing the aviation industry through innovative data processing and analysis solutions. Our platform processes real-time flight data from multiple sources to provide actionable insights for the aviation industry. 

The Role:

We're seeking an experienced Data Engineer with expertise in complex time-series and geospatial data processing to evolve our flight data algorithms. You'll tackle challenges like multi-leg flight splitting, origin/destination detection, and integration of diverse data sources into a unified processing framework.

You'll be responsible for implementing sophisticated algorithms that analyze aircraft position, altitude, and temporal patterns to accurately determine flight states, airport proximity, and flight path segmentation. Working closely with our application team, you'll bring these algorithms from research to production.

Key Responsibilities

• Design and implement advanced flight splitting algorithms that can identify multi-leg journeys and airport stops
• Develop robust origin/destination detection systems using geospatial analysis and altitude-based airport proximity detection
• Create data normalization frameworks that handle diverse event sources (ADSB, ADSI, Scheduling, Elevation, Flight Planning etc.). 
• Implement time-series analysis for aircraft behavior patterns (takeoff, landing, cruising, etc.)
• Enhance data quality validation to handle edge cases in flight event processing
• Design test data generation systems for comprehensive algorithm validation
• Develop solutions for handling time zone differences and temporal data inconsistencies
• Create unified interfaces for multiple data source implementations
• Implement data transformation pipelines
• Document complex algorithms and data processing workflows
• Evaluate and analyze new data sets to incorporate into Flight detection

 Technical Challenges You'll Solve

• Determining when an aircraft is truly at an airport using multiple event analysis, altitude checks, and geospatial proximity
• Splitting continuous event streams into discrete flights when aircraft make stops
• Handling data quality issues in real-time event streams
• Normalizing data across different source formats
• Creating efficient algorithms for processing large volumes of time-series flight data
• Implementing testing frameworks for complex geospatial and temporal algorithms
  

Requirements

• 5+ years of experience as a Data Engineer with focus on complex algorithm implementation
• Strong Python programming skills with demonstrated experience in time-series and geospatial analysis
• Experience designing and implementing data normalization frameworks across multiple sources
• Proven track record implementing complex event processing systems
• Advanced knowledge of geospatial analysis algorithms and proximity detection
• Experience with AWS services (especially TimeStream, S3, ECS, Lambda)
• Strong background in test data generation and algorithm validation
• Experience with and enthusiasm for using AI-assisted development tools (like Cursor)
• Advanced English proficiency
• Exceptional analytical skills with the ability to solve challenging data processing problems
• Self-starter with proven expertise developing unique solutions to complex problems
  
  

It's a plus if you bring any of the following to the table:

• Experience with aviation data, ADS-B, or similar real-time positional data systems
• Background in IOT data and real-time event processing
• Knowledge of Ruby programming language
• Background in implementing multi-point consensus algorithms
• Experience with PostGIS or similar geospatial database extensions
• Previous experience implementing event filtering and validation systems
• Knowledge of flight data formats and standards
• Familiarity with test-driven development for complex algorithms


If challenges drive you and this sounds like a great match, don't hesitate to apply; we'd love to hear from you!