Exams Psychometrician

This is an exciting opportunity to help shape the future of assessment at the RCR in a specialist advisory role within our Exams team.

Working directly with exam managers, chairs, examiners and senior stakeholders, you’ll provide the expertise and insight that helps ensure our assessments remain valid, reliable and fair, while meeting regulatory expectations.You’ll act as the bridge between assessment data and decision-making, helping us understand what our exam performance data is telling us and using those insights to strengthen the quality of our assessment practices.

We’re looking for an experienced assessment psychometrician who combines strong technical expertise with excellent communication skills. You’ll enjoy working collaboratively, building confidence in psychometric decision-making and translating complex findings into practical recommendations. You’ll also be confident challenging existing approaches, introducing new thinking and helping us continually improve.

What you’ll do:

• Analyse exam and candidate performance data to identify trends, emerging risks and opportunities for improvement.
• Lead longitudinal analysis across our exam portfolio, looking at item, paper and candidate performance over time.
• Provide expert psychometric advice to support the review, development and improvement of RCR examinations.
• Review our assessment and standard-setting methodologies, recommending improvements that strengthen validity, reliability and fairness.
• Turn complex psychometric analysis into clear, practical insights and recommendations for examiners, Boards and senior stakeholders.
• Support examiner training, helping colleagues develop their understanding and confidence in psychometric principles and assessment decision-making.
• Provide psychometric expertise to support regulatory submissions, reviews and assurance activity.
• Strengthen our approach to assessment data, reporting and governance, ensuring information provided to internal Boards and regulators is robust and auditable.
• Keep abreast of developments in psychometric practice and identify opportunities to introduce new methodologies and approaches.

What you’ll need:

• A Master’s degree or PhD in Psychometrics, Statistics, Psychology or a related quantitative field.
• Strong experience of data analysis and reporting, including working with large datasets and statistical analysis packages.
• Strong knowledge of psychometric principles and the confidence to apply them to practical assessment challenges.
• The ability to interpret complex data, identify meaningful trends and turn your findings into clear, evidence-based recommendations.
• Excellent communication skills, with the ability to explain complex statistical concepts clearly to both technical and non-technical audiences.
• A collaborative approach and the confidence to advise, influence and constructively challenge stakeholders.
• A commitment to equality and diversity, continued professional development and maintaining a high level of specialist knowledge.

If you’re looking for a role where your expertise can make a real impact on the quality, fairness and future of assessment, we’d love to hear from you.

When you join us:

• Make a difference to the lives of Doctors and medical specialties
• Hybrid working – up to 60% remote
• Modern working environment with home‑working equipment provided
• Generous annual leave, plus the option to buy up to 5 extra days
• Enhanced family‑friendly leave (maternity, paternity and adoption) for those with 2+ years continuous service
• Excellent pension scheme
• Sabbaticals (5+ years’ service) and secondment opportunities
• Interest‑free season ticket loan and cycle to work scheme
• Employee Assistance Programme
• Long service recognition awards