A. Position Introduction Type: Full time,
Location: Bangalore
Reports to: Director of Engineering
Looking for energetic, creative and hands-on Manager for Data Engineering who will be responsible for the ETL, data/report dashboards, performance, modification, integrity and security of a database and data warehouse. As a Data Engineering Manager, you will work with the solutions architecture team to understand the product intent. Design and develop highly secure and scalable database solutions to enable the platform and applications. Industry standard database management tools and practices to be employed. You will work closely with the product advocacy, technology advocacy, and solutions engineering team to ensure complete coverage of use cases. You will ensure that data remains consistent across the databases, data is clearly defined, users access data concurrently, in a form that suits their needs, there is provision for data security and recovery control (ensuring all data is retrievable in an emergency). You will also contribute to establishing the data governance practices for the organization.
You will work closely with software development team and IT Infra team for planning and development of database in cloud as well as local servers. You shall also have demonstrated very good experience with agile, scrum, CI/CD, DevOps, leading architecture / design reviews and system engineering / administration using any commercial off the shelf tools in developer productivity, build & release management space.
B. Work Title
Data Engineering Manager
C. Position Accountability 1. Contribute towards building a strong product engineering culture as the team builds new product capabilities in modern technology. 2. Your responsibility as a Data Engineering Manager will be the ETL, managing data/report dashboards, performance, integrity and security of a database and data warehouse. 3. Effectively articulate the rationale behind the data model design decisions. 4. Strategically incorporate team members feedback to produce the highest quality data models. 5. Involve in the planning and development of the database, as well as in troubleshooting any issues on behalf of the users. 6. Ensure that data remains consistent across the database, data is clearly defined. 7. Ensure that Users access data concurrently, in a form that suits their needs there is provision for data security and recovery control (ensuring all data is retrievable in an emergency).
8. Author, review and execute the queries on production environment.
9. Fulfill the data need by creating and running the queries on database.
10. Help the team to imbibe Agile values and principles effectively.
11. Work with cross functional teams within engineering, usability team, product management, operations team, and customer support engineers to
design and build solutions while mentoring and coaching junior members of the team.
12. Evaluate the technology, design of the component/feature and mentor the juniors in the team.
13. Develop a thorough understanding of the domain and influence the architecture roadmap.
D. Job Description
1. Analyze requirements, produce accurate, unambiguous technical design specifications to the appropriate detail.
2. Collaborate with cross functional squad members (product and tech teams) to help them understand and fully comply with data quality standards,
architectural guidelines and designs.
3. Recommend and implement emerging database technologies.
4. Set and maintain database standards. Develop processes for establishing and sustaining impeccable database security.
5. Install database servers, maintain with constant upgrades (including security patches, and hotfixes) and sustain the highest performance.
6. Establish the needs of users and monitor user access and security. Performance tuning of database systems.
7. Map out the conceptual design for a planned database.
8. Own and manage all changes to the data models. Create data models, solution designs and data architecture documentation for complex
information systems powering the EI product.
9. Install, upgrade, and manage database applications.
10. Diagnose and troubleshoot database errors.
11. Create and manage database reports, visualizations, and dashboards. Create automation for repeating database tasks.
12. Write database documentation, including data standards, procedures and definitions for the data dictionary (metadata). Ability to work
independently with minimal supervision and assistance.
13. Plans, designs, develops, integrates database scripts to consuming application components and helps to test software systems or applications for
software enhancements and new products. Write, debug, and deploy scripts to production; deliver timely fixes in close collaboration with
Developers and DevOps.
14. Deliver customer value in the form of high-quality software components and services in adherence with policies on security, performance, longevity
and integration testing.
15. Be well versed in the latest development methodologies like Agile, Scrum, DevOps and unit testing for database scripts during development.
16. Adhere to DOD (story definition of done) as part of the sprint, including unit tests, functional testing, code reviews, no regressions, bug fixes,
documentation and adhere to best coding practices.
17. Perform peer code reviews in order to ensure quality standards
18. Master the domain knowledge in the area of assignment
19. Take ownership of what the team builds after the release; consider customer adoption as success criteria.
20. Volunteer for work in the backlog and commit to quality delivery; Coordinate efforts across the team to ensure completion and effectiveness 21. Participate and contribute to scrum meetings i.e. daily stand-up, sprint planning, readouts and retrospectives 22. Work collaboratively across the Technology and Product organizations to ensure alignment towards business goals 23. Should understand fundamentals of iterative product development. 24. Should understand the value of commitments to delivery made by the development team.
E. Technical Experience 1. 7+ years of experience working with different databases like MySQL, Postgres, MongoDB, Redis, Elasticsearch, Redshift, Clickhouse etc. 2. Very good hands-on experience with programming language, preferred is Python 3. Excellent problem-solving and analytical skills. 4. Familiarity with the main data manipulation languages and the principles of database design. Advanced knowledge of database structure and theory. 5. Ability to write and troubleshoot complex queries in various SQL and NoSQL databases. 6. Basic understanding of disaster recovery and database backup procedures. 7. Experience with building high-quality software based upon architectural specifications. 8. Experience in NoSQL databases (e.g., MongoDB, Cassandra) 9. Very comfortable using GIT version control tool (we use Bitbucket) 10. Familiarity with reporting tools. 11. Ability to setup, monitor and troubleshoot CRON jobs 12. Ability to setup data pipelines, data lakes and data warehouses 13. Experience with data cleaning, data manipulation and data management skills 14. Certification in AWS Cloud Services is a bonus
F. Academic and Professional Expertise 1. Holds an academic degree in Computer Science, Computer Engineering or Computational Science. 2. 7+ years of working experience as hands on industry experience. 3. Ambitious individual who can work under their own direction towards agreed targets/goals. 4. Good technical knowledge of databases and query languages. 5. Ability to handle change and be open to it along with good time management and an able to work under stress. 6. Respond to technical queries / requests from various team members and customers. 7. Collaborate with various disciplines within engineering and outside such as product management, user experience, tech support and with customers to provide innovative solutions. 8. Facilitate technical decisions; incorporate feedback and emergent patterns; ensure technical cohesion in product architecture. 9. Experience in development and performance optimization of different databases and services.
10. Strong troubleshooting and problem-solving skills. 11. Proven experience in Migrating database. 12. Demonstrated ability to adapt and work with team members of various experience levels. 13. Ability to work with minimal direction with a focus on customer satisfaction. 14. Proven interpersonal skills while contributing to team effort by accomplishing related results as needed. 15. Creative problem-solving skills and superb communication skills.
INTERESTED CANDIDATE KINDLY MAIL ME THERE RESUME AT DEEPIKA@CODERBRAIN.COM