Psychometrician

Description

Are you passionate about data and psychology? Join our dynamic team and help us develop cutting-edge assessments that make an impact! The American Registry of Radiologic Technologists (ARRT) seeks a detail-oriented Psychometrician to be an essential part of our team responsible for the psychometric integrity of ARRT's certification programs. Using your expertise, you'll drive innovative and strategic initiatives for:

• systematic evaluation of modern testing methodologies and innovative item types;
• contribution to increased understanding through psychometric research; and
• dissemination of information through publication in professional journals and presentations at professional conferences.

Psychometric Duties and Work Responsibilities

Exam Content and Eligibility Materials

• Oversee periodic practice analysis projects for assigned programs, including committee selection, survey development, data analysis, and report writing.

Examination Committees

• Determine psychometric quality assurance criteria for item statistics, exam statistics, and examinee comment review, and ensure these criteria are met.

• Review exams and comment on items prior to, and during, examination committee meetings in accordance with psychometric quality assurance criteria.

Practice Analysis Committees

• Collaborate with other staff to conduct practice analyses according to best practices.

• Train committee members on required activities.

• Present survey findings to committee, assist with interpretation, and facilitate discussion.

Standard Setting Committees

• Oversee periodic standard setting for assigned programs, including committee selection, data analysis, and report writing.

• Collaborate with other staff to conduct standard setting meetings according to best practices and train committee members on required activities.

• Analyze data and prepare reports for publication.

Examination Scoring, Analysis, and Reporting

• Determine psychometric quality assurance criteria for exam scoring, analysis, and reporting, and ensure these criteria are met.

• Periodically review item statistics, exam results, and examinee comments to ensure accuracy of keys, passing scores, and exam content.

• Perform regular exam processing and form production quality control.

• And more

Item Calibration and Test Form Scaling

• Determine psychometric quality assurance criteria for item calibration and test form scaling and ensure these criteria are met.

• Prepare and/or follow schedules for item calibration (initial, pilot, and recalibrations) for all exam programs.

• Calibrate items as needed for selected exam programs.

• Calculate cut scores scaling equations for exam forms; monitor pass rates, cut scores and other exam statistics over time.

• And more.

Minimum Qualifications: Doctorate in Psychometrics, Quantitative Methods in Psychology, Educational Measurement, Industrial and Organizational Psychology or related field is required for this position.

Preferred Qualifications: Two or more years' experience in Applied and Research Psychometrics, experience in credentialing, and intermediate R programming skills.

Requirements

Skills and Abilities:

· Proficiency in psychometric concepts, tools, techniques, and best practices.

· Proven ability to apply critical thinking and problem-solving skills to analyze, simplify, and translate complex business problems and apply the appropriate level of planning, organization, and structure to drive results to multiple levels in the organization.

· Demonstrated ability to utilize and understand the Microsoft Suite of office products.

· Experience with R, SQL, IRT calibrations, item analysis software applications (e.g., WINSTEPS), assessment engineering.

· And more.

Psychometric Duties and Work Responsibilities cont.

Psychometric Exam Security - Design psychometrically sound procedures to assess exam security risks and set criteria for flagging suspected security breaches. Implement an exam security program according to best practices, and review exam security program outcomes, potential breaches, and investigate as needed. And more.

Community Relations- Participate in activities that promote ARRT’s goodwill and commitment to the professional community. Publish research-based articles, present papers, and conduct workshops at conferences related to psychometrics and/or medical imaging. Attend national assessment-related conferences as needed.

Continuous Quality Improvement- Participate in the evaluation of the improved process and at all times, watch for areas of improvement in processes. Initiate discussions and communicate areas of improvement and seek validation of appropriateness concerns.

Miscellaneous duties as business needs may dictate.

The American Registry of Radiologic Technologists (ARRT) is the world’s largest organization offering credentials in medical imaging, interventional procedures, and radiation therapy. We certify and register technologists in a range of disciplines by overseeing and administering education, ethics, and examination requirements. Visit www.arrt.org for more information and benefits overview.

Review a full job description, which includes additional information on duties and responsibilities, skills and abilities, core competencies, and physical demands. This fulltime position is located onsite at our office in St. Paul, Minnesota with potential for hybrid onsite/telework -approximately 50/50. Relocation assistance may be available.

Salary Description:

$92,623.86 - $108,969.25 per year

Our Benefits: 

We offer competitive wages, and a variety of excellent benefits, including health insurance, retirement contributions and paid time off.

Please contact your recruiter or email human-resources@arrt.org with any questions or requests for reasonable accommodations during the interview process. 

Salary : $92,624 - $108,969