Data Engineer_Shirlyn_Tookitaki

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Bachelor's degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent., Minimum 2 years of experience in big data systems such as Hadoop., Proficiency in Scala, Spark, Hbase, Hive, and RDBMS (MySql/Postgres/Maria) with at least 2 years of experience each., Experience with CI/CD for at least 1 year is required..

Key responsibilities:

  • Develop and maintain data processing systems using Scala and Spark.
  • Implement and manage big data solutions on Hadoop and cloud platforms.
  • Collaborate with cross-functional teams to optimize data workflows and architecture.
  • Ensure data security and integrity while working with large datasets.

CodersBrain logo
CodersBrain SME https://www.codersbrain.com/
201 - 500 Employees
See all jobs

Job description

Experience -Must have: a) Scala: Minimum 2 years of experience b) Spark: Minimum 2 years of experience c) Hadoop: Minimum 2 years of experience (Security, Spark on yarn, Architectural knowledge) d) Hbase: Minimum 2 years of experience e) Hive - Minimum 2 years of experience f) RDBMS (MySql / Postgres / Maria) - Minimum 2 years of experience g) CI/CD Minimum 1 year of experience Experience (Good to have): a) Kafka b) Spark Streaming c) Apache Phoenix d) Caching layer (Memcache / Redis) e) Spark ML f) FP (Scala cats / scalaz) Qualifications Bachelor's degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent with at-least 2 years of experience in big data systems such as Hadoop as well as cloud-based solutions

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Related jobs