Director, Free Response Rating Capability Analyst

College Board

Job Overview

Location

Remote - USA

Job Type

Full-time

Full Job Description

📋 Description

• The Director, FR Rating Capability Analyst at College Board leads the design, building, and improvement of operational and analytic capabilities that enable high-quality AP Reading scoring for millions of Advanced Placement free response exam submissions annually. This role is critical to ensuring scoring accuracy, efficiency, and scalability across the AP program.
• Day to day, the role involves defining and maintaining the FR rating capability roadmap, translating operational needs into system enhancements and reporting frameworks, partnering with Technology and Product teams to enhance scoring platforms, developing scalable frameworks for evaluating scoring effectiveness, and serving as a liaison across Scoring, Reader Management, Assessment Production, Psychometrics, and Technology teams. The role also includes supporting end-to-end AP Exam scoring workflows, monitoring scoring performance during live readings, developing analytic models and dashboards for real-time insights, and driving process standardization and continuous improvement initiatives.
• The AP Reading and Scoring team is responsible for delivering high-quality, reliable, and scalable scoring operations for millions of AP free response exam submissions annually. The team partners across Scoring, Reader Management, Psychometrics, Assessment Production, and Technology to continuously improve scoring quality, operational effectiveness, and digital scoring capabilities that support AP’s mission and growth.
• In this role, you will develop expertise in AP exam item types, rubric structures, and annual assessment changes; translate complex data into actionable insights for scoring leadership; lead retrospective reviews to synthesize findings into prioritized improvements; and contribute to long-term strategy efforts supporting digital transformation and scaling of AP Reading capabilities. You will gain experience in large-scale operational analytics, cross-functional collaboration, and mission-driven impact in education assessment.

🎯 Requirements

• Expertise in operational analytics, scoring operations, education systems, or related fields with experience supporting large-scale operational environments
• Strong analytical and systems-thinking skills, with demonstrated ability to translate data into operational improvements and scalable solutions
• Experience working with large-scale datasets and reporting tools such as Excel, SQL, BI tools, or similar technologies
• Strong project management and prioritization skills with the ability to manage competing priorities across multiple stakeholders
• Excellent written and verbal communication skills, including the ability to simplify complex analyses into actionable insights
• Experience collaborating across cross-functional teams including operations, technology, product, analytics, and research partners
• Bachelor’s degree required; advanced degree preferred
• Ability to travel 2–4 times per year to College Board offices or on behalf of College Board business

🏖️ Benefits

• Competitive hiring range of $80,000–$130,000 based on location, experience, skills, and market benchmarks
• Opportunity to work at a self-sustaining nonprofit committed to fair and competitive compensation grounded in qualifications, experience, impact, and market data
• Open, transparent conversations throughout the hiring process about compensation, benefits, and what it’s like to work at College Board
• Fully remote role with option for hybrid work (Tuesday and Wednesday in office) for candidates near College Board offices
• Access to a supportive team and comprehensive package designed to help you thrive in a meaningful career expanding educational and career opportunities
• Commitment to continuous growth and improvement through a learner’s mindset and data-informed decision-making

Skills & Technologies

Remote

Degree Required

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

College Board

Visit Website

About College Board

College Board is a nonprofit membership organization founded in 1900 that develops and administers standardized tests, curricula, and programs to expand access to higher education. It owns and operates the SAT, PSAT, AP, and CLEP examinations, supports college planning tools, and partners with schools and universities to promote college readiness. The organization also offers scholarship search services and data-driven research reports on educational trends and equity.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.