Match score not available

Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.

Start Your Free Trial Now!

Start my free trial

Staff Data Engineer

Remote: 
Full Remote
Contract: 
Full time
Experience: 
Senior (5-10 years)
Work from: 
Brazil, United States, Latin America

brightwheel logo
brightwheel Education SME https://www.mybrightwheel.com/
201 - 500 Employees
See all jobs

Job description

Our Mission and Opportunity
Early education is one of the greatest determinants of childhood outcomes, is a must for working families, and has a lasting social and economic impact. Brightwheel’s vision is to enable high quality early education for every child — by giving teachers meaningfully more time with students each day, engaging parents in the development of their kids, and supporting the small businesses that make up the backbone of the $175 billion early education market. Brightwheel is the most loved technology brand in early education globally, trusted by thousands of educators and millions of families.

Our Team
We are a fully remote team with employees across every time zone in the US. Our team is passionate, talented, and customer-focused. Our exceptional investor group includes Addition, Bessemer Venture Partners, Chan Zuckerberg Initiative, GGV Capital, Lowercase Capital, Emerson Collective, and Mark Cuban. 

We believe that everyone—from our employees to the students, teachers, and administrators we serve— should be given the opportunity to learn and thrive, whatever their background may be. We celebrate diversity in all forms because it allows our team and the communities we serve to reach their full potential and do their best work. From decision making, to how we operate, we ground ourselves in our Leadership Principles every day. 

Who You Are
Brightwheel is seeking a Staff Data Engineer to join the Data Engineering team. 

As a Staff Data Engineer at Brightwheel, you will play a key role in the implementation and evolution of our web scraping and data platform. You will be a technical leader responsible for crafting and implementing a best in class web scraping strategy and infrastructure. You will build and scale pipelines that garner millions of records, across hundreds of sites, stored as measurable data that enable insights for our Analytics team and our customers.

You are passionate about data engineering and possess deep technical skills. You have built scalable web scraping platforms from the ground up. You have experience juggling multiple projects with shifting priorities while continuing to deliver value to the business. You are a curious, detail oriented, self-starter who wants to take full ownership of high impact projects with visibility throughout the organization.


What You'll Do
  • Use modern tooling to build robust, extensible, and performant web scraping platform
  • Build thoughtful and reliable data acquisition and integration solutions to meet business requirements and data sourcing needs.
  • Deliver best in class infrastructure solutions for flexible and repeatable applications across disparate sources.
  • Troubleshoot, improve and scale existing data pipelines, models and solutions
  • Build upon data engineering's CI/CD deployments, and infrastructure-as-code for provisioning AWS and 3rd party (Apify) services.

    • Qualifications, Skills, & Abilities
  • 5+ years of work experience as a data engineer/full stack engineering, coding in Python.
  • 5+ years of experience building web scraping tools in python, using Beautiful Soup, Scrapy, Selenium, or similar tooling
  • 3-5 years of deployment experience with CI/CD
  • Strong experience of HTML, CSS, JavaScript, and browser behavior.
  • Experience with RESTful APIs and JSON/XML data formats.
  • Knowledge of cloud platforms and containerization technologies (e.g., Docker, Kubernetes).
  • Advanced understanding of how at least one big data processing technology works under the hood (e.g. Spark / Hadoop / HDFS / Redshift / BigQuery / Snowflake)
  • Excellent analytical, problem solving, and troubleshooting skills to manage complex process and technology issues without guidance

    • Preferred Experience
  • 2+ years of experience developing in Airflow
  • 2+ deploying Infrastructure as Code within AWS or similar
  • 2+ deploying microservices and/or APIs within cloud environment
  • 1+ years using ML / AI workflows for data enrichment and/or sentiment analysis by integrating scraped data into ML pipelines.

    • Brightwheel is committed to creating a diverse and inclusive work environment and is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity, gender expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

    Required profile

    Experience

    Level of experience: Senior (5-10 years)
    Industry :
    Education
    Spoken language(s):
    English
    Check out the description to know which languages are mandatory.

    Hard Skills

    Data EngineeringWeb CrawlingCI/CDPython (Programming Language)File SystemsHyperText Markup Language (HTML)Java XMLKubernetesJavaScript (Programming Language)Web CrawlingSelenium (Software)Amazon RedshiftBigQueryCascading Style Sheets (CSS)Snowflake (Data Warehouse)JSONApplication Programming Interface (API)Docker (Software)Apache SparkApache HadoopApache AirflowArtificial IntelligenceMLOps (Machine Learning Operations)MicroservicesApplication Programming Interface (API)Infrastructure as Code (IaC)

    Other Skills

    • Problem Solving
    • Analytical Skills
    • Troubleshooting (Problem Solving)
    Are you interested?

    Data Engineer Related jobs

    See more Data Engineer jobs