PySpark developer_CBS

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Minimum 6+ years of experience in creating SPARK Jobs using Java/Scala., Strong knowledge of Big Data tools like HIVE and HBASE., Proficient in SQL and data warehouse concepts., Hands-on experience with Unix/Linux and familiarity with AWS and PySpark is a plus..

Key responsibilities:

  • Develop and implement data loading and transformation tasks using external sources.
  • Merge data, perform data enrichment, and load into target data destinations.
  • Utilize Spark Streaming for real-time data processing.
  • Analyze issues and provide solutions using strong analytical skills.

CodersBrain logo
CodersBrain SME https://www.codersbrain.com/
201 - 500 Employees
See all jobs

Job description

Location : Chennai/Hyderabad/Bangalore

Details JD:
 
1. Minimum 6+ years of experience in creating SPARK Jobs using Java/Scala 
2. Should have very good experience in developing data loading and transformation tasks using external sources, merge data, perform data enrichment and load in to target data destinations
3. Must have good knowledge on Big data tools HIVE and HBASE tables
4. Should have experience on Spark Streaming
5. Must have good knowledge on SQL
6. Must have good knowledge on Data warehouse concepts
7. Must have good analytical skills to analyse the issue
 8. Should have Hands-on Unix/Linux knowledge
9. Knowledge on AWS, PySpark will be an advantage.

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Related jobs