Sr. Director of Data Engineering

Overview

At Penn Foster Group, our purpose is to open doors to brighter futures by helping learners gain the skills they need to grow their careers. We are seeking a highly experienced and dynamic Senior Director of Data Engineering to lead and manage our data engineering team. The ideal candidate will have over 10 years of experience in the field, with a minimum of 5 years as a data architect. This role requires a deep understanding of Databricks, Azure, AI/MLops, strong leadership skills, and proficiency in managing teams of data analysts and data engineers.

Key Responsibilities

• Lead, mentor, and manage a team of 10-15 individuals made up of high-quality analysts, data engineers, and Tableau developers.
• Oversee the design and implementation of data architecture strategies.
• Partner with engineering teams to incorporate AI/ML models into our core products.
• Ensure the effective operationalization of AI/ML models.
• Manage onshore and offshore staffing models to optimize productivity and efficiency.
• Implement and maintain event streaming architectures, preferably in Azure.
• Run and support agile teams, ensuring adherence to agile methodologies and best practices.
• Set and carry out engineering standards, including coding practices, data management, and security protocols, ensuring compliance with regulatory requirements.
• Confirmed proficiency in Python, PySpark, and SQL, with a deep understanding of data processing frameworks and large-scale distributed systems.
• Collaborate with senior leadership to align data strategies and team priorities with business objectives.

Qualifications

• 10 plus years of experience in data engineering or related fields, with a minimum of 5 years as a data architect.
• 6-10 years of experience running agile teams.
• BA/BS in Computer Science, Math, Physics, or other technical fields
• Proven experience with Databricks, preferably on Azure managing its implementation and cost.
• Extensive experience managing teams of data engineers, data analysts and Tableau engineers.
• Strong leadership skills with the ability to mentor and develop team members.
• Experience with onshore and offshore staffing models.
• Proven experience managing and selecting vendors
• Proficiency in designing and implementing event streaming architectures, especially in Azure.
• Experience in operationalizing machine learning models, including live and batch inferences with integrations into production systems.

Preferred Skills

• Excellent communication and interpersonal skills.
• Ability to work in a fast-paced and dynamic environment.
• Strong problem-solving and analytical skills.
• Experience with other data platforms and tools is a plus.

Location:

Virtual, with ability to travel regularly to meet with customers, partners, and internal teams. Teams are primarily virtual, with hubs in Chandler, AZ; Boston, MA; and Scranton, PA.

About Us: At Penn Foster Group, we are transforming online learning to help learners by bringing together Penn Foster, CareerStep, Ashworth College, James Madison High School, the New York Institute of Photography, the New York Institute of Art and Design, and other education platforms. Together, we create an accelerated path to greater economic mobility through real-world skills and knowledge that enable learners to achieve long-term success in the workplaces of the future. Our history dates back to 1890 when our founder, Thomas Foster, pioneered distance education by offering training by mail for coal miners to get the necessary skills for safer jobs. Today, with the partners who use our education and training programs, we continue that mission of providing accessible training and education for in-demand skills and are building a workforce that’s prepared for the future job market.

Equal Employment Opportunity: We strive toward Diversity, Equity, and Inclusion at Penn Foster Group by intentionally building teams that are diverse – in identities, lived experiences, and ideas to create a culture where people feel connected to each other and have a sense of belonging. We value diversity, equity, and inclusion because it is the foundation that enables us to achieve what we set out to do as an organization – from maximizing the number of learners who can reach their goals while giving them the kinds of experiences we want them to have, to becoming the type of company we want to work in.

What We Offer:We offer a robust benefits package that includes medical, dental, vision, flexible spending, generous paid time off, sponsored volunteer opportunities, a 401K with a company match, plus free access to all of our online programs.

This position is fully remote in PA, FL, GA, IL, IN, NC, SC, TN, TX, UT, WI, AL, KS, LA, MA, MI, MO, NH, OH, OK, VA, AZ, CO, MN, NJ, NY only.