Content Strategy Manager, Assessments

About Us

At Udemy, we’re on a mission to improve lives through the power of learning. We’re a leading global learning company and one of the world’s largest education platforms, with more than 67 million learners. Our goal is to provide flexible, effective skill development to empower organizations and individuals. 

Talented people are everywhere, and the right opportunity can be hard to come by. That’s why we’re focused on revolutionizing learning, using our skills and expertise to help others develop theirs and reach their full potential. Individually, we bring our unique perspective to reimagine the way we share knowledge. Together, we can improve lives by making learning more accessible for our learners, our instructors, and businesses around the world.

Hybrid work 

Udemy is headquartered in San Francisco with global offices in Australia, India, Ireland, Türkiye, and other US locations. Our robust hybrid work model spans San Francisco, Denver, Ankara, Dublin, Mexico City and Melbourne.

About You 

You’re an analytical problem-solver ready to put your skills toward purposeful work that has a global impact. You want to lead the way in innovation, exploring the latest technologies and finding new solutions. You thrive in a collaborative environment and are eager to work with and learn alongside the best in Product, Design, and Engineering and a team of assessment specialists.

About this role

Udemy is seeking a dynamic Assessment Content Manager to join our growing assessment team as part of the Instructor & Content Strategy department. This role will help manage day-to-day assessment content operations, leveraging automations and AI-driven processes to enhance the development and maintenance of our assessment content at scale. For this role, you will leverage your extensive foundational knowledge of assessments to ensure the smooth operation and scalability of our assessment content while contributing to assessment innovations in support of multiple products.

As an Assessment Content Manager, you will play a pivotal role in fostering cross-functional collaboration with our Psychometric, Product, Learning Design, and Engineering teams to further establish and optimize our end-to-end assessment operations. You will contribute to and manage key aspects of our assessment content program including assessment creation and maintenance, vendor and instructor management, and assessment model development.

What you’ll be doing

• Oversee and manage the end-to-end scaled creation and maintenance of assessment content

• Drive the transition to scalable, AI-driven assessment content operations

• Manage relationships with vendors, instructors, and subject matter experts (SMEs) for project execution, exploration, and feedback.

• Collaborate with cross-functional teams to support strategic initiatives, including content strategy development and the development of new assessment models

What you’ll have

• 3 years of hands-on industry experience in an assessment development role

• You have experience in managing end-to-end assessment content operations, including development and maintenance

• You have a strong understanding of assessment fundamentals (validity, reliability, fairness) and diverse assessment models (formative, summative, diagnostic)

• You have experience with learning and assessment product design 

• You excel at analyzing results and metrics to inform data-driven decisions

• You thrive in dynamic environments and demonstrate flexibility and adaptability in response to evolving business needs

• You are highly organized with excellent project management and communication skills capable of managing multiple tasks independently

Bonus points for:

• 5 years of relevant industry experience such as leading assessment development projects,  managing assessment content operations, and/or leading assessment product teams

• Educational background in assessment, learning, and/or instructional design fields

• Experience with learning and assessment product design and development

• Experience with e-learning content and assessment management systems, platforms, and tooling.

• Strong fundamentals using generative AI in assessment contexts (e.g., prompt engineering) as well as familiarity with AI-tooling (e.g., ChatGPT)

• Familiarity with technical skills space (computer science, AI/ML, data science, etc.)