Data Engineer

As a Data Engineer , you will be responsible for  implementing, and maintaining scalable data pipelines and data related solutions. You will work closely with a US based team to ensure that data systems are well designed and performant. Expertise in Microsoft data solutions, .NET, SQL Server  will be essential in helping us with business solutions that support business goals.knowledge of azure and synapse are also a big added value.

Key Responsibilities:

• Data Pipeline Development: build, and manage ETL/ELT processes to ingest, transform, and load data from various sources into various destinations while applying the best practices in terms of design and development while always following business requirements.
  
• Database Development: Design and optimize database structures in SQL Server to ensure efficient data storage and retrieval.
  
• .NET Development: Implement data integration and processing solutions using .NET technologies where applicable.
  
• Analytical Platform: develop scalable solutions using MPP and distributed big data systems capable of managing big data loads efficiently.
  
• Data Governance & Quality: follow data engineering standards, including data governance, data quality, and data security practices.
  
• Collaboration: Work closely with stakeholders to understand data requirements and deliver optimal solutions.
  
• Performance Optimization: Monitor and improve the performance of data pipelines and databases, ensuring low-latency and high-availability data solutions.
  
• Documentation: create clear and comprehensive documentation of processes, data flows, and system architectures.
  
• Azure Data Services: Utilize Microsoft Azure data services, including services like Azure Data Factory, Azure Synapse Analytics,databricks, and Azure SQL Database, to develop and manage data solutions.
  
• Agile development: Utilize agile methodologies in the development process.
  

• Experience:
  • 4+ years of experience in data engineering or a related field.
    
  • Strong knowledge of SQL Server and .NET technologies.
    
  • Proven experience with Microsoft Azure data services, including Azure Synapse Analytics is a plus.
    
• Technical Skills:
  • Proficient in SQL, T-SQL, and data modeling.
    
  • Experience with ETL/ELT tools and processes.
    
  • Experience with data warehousing concepts and architectures.
    
  • Experience with data integration, transformation, and processing using .NET.
    
  • Strong understanding of data governance, data quality, and data security best practices.
    
  • Experience in azure is preferable
    
  • Knowledge of Synapse is preferable
    
  • Python knowledge is a plus
    
  • Familiarity with big data technologies is a plus (e.g.: Apache Spark) 
    
  • Familiarity with data visualization tools is a plus(e.g.: Power BI).
    
• Soft Skills:
  • Strong problem-solving skills and attention to detail.
    
  • Excellent communication and collaboration abilities.
    
  • Proven historical ability to learn new technologies.