Manager of Test Development Operations

POSITION OVERVIEW

NBME is seeking a dynamic professional to join our organization as a Manager of Test Development Operations. The manager of Test Development Operations leads and directs the work of a team of editors dedicated to all aspects of test development from blueprinting and content creation to exam form building and publication. You'll be at the forefront of ensuring the timely delivery of top-notch examinations across a portfolio of products. Working collaboratively with a dedicated team of five MEs and under the guidance of a TDS Director, you'll play a pivotal role in shaping the future of test development.

This role has been designated hybrid meaning it requires on-site work at the NBME offices on occasion (approximately 20 to 30 days annually), but most of the work can be done remotely. We're open to considering candidates within 50 miles of our office location in Philadelphia, PA.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the healthcare community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community, and the broader medical education landscape.

RESPONSIBILITIES

• Manage the day-to-day exam activities to ensure smooth functioning of item development and exam construction and production. Ensure appropriate staff/resource allocation so deliverables are met on time. Supervise editorial staff within the team and provide support across teams. Develop and mentor staff at all levels.
• Review new exam content developed by editorial staff in conjunction with subject matter experts to ensure consistency, quality, and adherence to appropriate exam-specific content and style. Oversee staff facilitation of committee meetings and interaction between staff and subject matter experts to foster strong relationships.
• Recruit committee members and coordinate scheduling of committee meetings, committee member orientations, exam/item reviews, and production.Coordinate and oversee all phases of exam production and quality assurance using industry-specific software. Oversee development of ancillary materials related to exam delivery.
• Manage exam pools by coordinating the development of item-writing assignments based on content needs. Oversee item bank review for content currency. Coordinate with other MEs to develop and ensure best practices for item bank management,
• Engage with internal and external stakeholders and serve as a subject matter expert for all test development activities related to the examination portfolio.

QUALIFICATIONS

Skills and Abilities

• Advanced knowledge of test development methodology including the production of computer-based examinations
• Excellent editing skills, including knowledge of medical content and terminology
• Excellent communication skills, including public speaking skills for presenting to both internal and external stakeholders
• Experience with schedule and project management tools and principles
• Knowledge of computer systems necessary to complete tasks associated with the position

Experience

• 5 or more years of related experience

Education

• Bachelor's degree required

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine® Program and Item Writing Workshops. Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination®, which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.

As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program. Through the Stemmler Fund, Strategic Educators Enhancement Fund and Latin America Grants Program, researchers and educators can continue to improve the assessment of health care professionals around the world.

NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities.

Learn more about NBME at NBME.org.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

NBME is an equal opportunity employer as defined by the EEOC.

#LI-Hybrid

#Senior