Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.
Go Premium

Data engineer (python/pyspark)

Remote: 
Full Remote
Contract: 
Full time
Work from: 
India

Offer summary

Qualifications:

6 to 10 years of overall IT experience., Strong hands-on experience with Big Data stack including PySpark and Core Java., Good understanding of RDBMS databases and Linux/UNIX., Experience with AWS platform and performance tuning in PySpark..

Key responsibilities:

  • Take ownership of business-critical and complex applications.
  • Design Big Data batch and real-time data services.
  • Implement reporting services on large databases.
  • Work within Agile and CI-CD processes.

CodersBrain logo
CodersBrain SME https://www.codersbrain.com/
201 - 500 Employees
See all jobs

Job description

JD for Data Engineer with Pyspark – 6+ Years, Bangalore
 
Required Skills
Ø 6 to 10 years of overall IT Experience
Ø Core Skills Ø Strong hands on working experience of Big Data stack including PySpark and Core Java
Ø Good understanding on RDMS database and Linux/UNIX .
Ø Take ownership of business-critical and complex applications.
Ø Strong knowledge of multi-threading and high volume batch processing.
Ø Able to design Big data batch and real time data services.
Ø Should be good in performance tuning skills in PySpark.
Ø Should have experience on AWS platform.
Ø Hands experience on Agile and CI-CD process.
 
Preferred skills
Ø Experience on reporting service implemented on Big database.
Ø Experience on Autosys or Control-M scheduler.
Ø Prefer experience on Kafka , Kinesis, and Streaming real time data.
Ø Experience on Python data libraries. 

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Hard Skills

Java (Programming Language)Big DataApache SparkPerformance Systems AnalysisAgile Software DevelopmentMultiprocessingLinuxRelational Database Management SystemsAWS Cloud ServicesCI/CDBatch ProcessingKinaxis (Software)Control-M (Batch Scheduling Software)Live StreamingApache KafkaSQL Server Reporting Services
Are you interested?

Data Engineer Related jobs

See more Data Engineer jobs