Enable America Jobs

Description: Senior Director, AP Calculus Assessment Lead

College Board - A&I

Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).

Type:This is a full-time position

About the Team

The AP Curriculum and Assessment Team at College Board (60+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP's 40+ courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level. AP's Course Leads and Assessment Leads ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills. The STEM department, which includes computer science, mathematics, the sciences, and statistics, is currently made up of 17 people supporting 15 courses in the AP portfolio.

About the Opportunity

As the Assessment Lead for AP Calculus, you are responsible for ensuring the quality and validity of all assessment content for the AP Calculus AB and AP Calculus BC exams.

The Senior Director, AP Calculus Assessment Lead serves as the leader and primary point of contact in AP for all assessment content for the two AP Calculus courses, collaborating closely with the AP Calculus Course Lead (who leads curriculum development, guides instructional support, and reviews assessment content). The Assessment Lead may provide assessment development support in other related subject areas. The Assessment Lead is responsible for all item development and management from authoring to administration; training and collaboration with subject-matter experts (SMEs), typically college professors and secondary school teachers. The Assessment Lead trains SMEs on assessment development protocols, translates between academics and technical experts (psychometricians), and collaborates to develop formative assessment materials and resources to support AP Calculus teachers worldwide.

In this role, you will:

Assessment Development and Scoring (80-85%)

• Serve as the assessment leader for AP Calculus, the primary person responsible for leading and visioning the assessment development for AP Calculus
• Be responsible for authoring/revising assessment content and training educator constituents to author assessment content, including selection of appropriate stimulus material, and applying best assessment practices
• Lead the development and management of all assessment content through iterative review stages with multiple internal and external stakeholders, including the AP Calculus Course Lead, Assessment Production team, Test Development Committee, and the Chief Reader
• Be responsible for development of all assessment forms, ensuring the AP Exam development closely aligns with approved curricula and test specifications
• Conduct multiple face-to-face and virtual meetings (during work week, evenings, or weekends) annually with each of the test development committees within the Senior Director's stewardship as well as other professional meetings in the discipline, as needed
• Ensure the successful scoring of both the AP Calculus AB and AP Calculus BC exams at the "AP Reading." Lead and facilitate the annual scoring events in person and online and produce AP Reading publica tions materials for teacher and student use

Assessment Quality & Process (10-15%)

• Contribute to current research and best practices related to assessment; participate in regular discussion with other AP Curriculum & Assessment members on the current assessment standards and practices to build a set of common, shared beliefs about AP's assessment directions within the larger educational and assessment community
• Contribute to processes for efficient, high-quality assessment development
• Refine and improve question task models as well as exam design in collaboration with and aligned to other College Board initiatives
• Monitor and improve exam validity, reliability, fairness, and quality, as well as reader reliability in accordance with established program thresholds
• Serve as a recognized and trusted resource within the community by collaboration with the AP Course Lead in engagement with the community to drive teacher satisfaction with the AP Calculus AB and AP Calculus BC Exams

Training/Mentoring of Staff and Collaboration with Teams (5-10%)

• Train and support other Assessment Leads in assessment development practices, including quality, validity, and fairness in AP assessment development and design, an understanding of the item and test development lifecycle, and proficiency with tools of assessment development, including the item authoring/item bank platform
• Mentor other Assessment Leads in best practices in collaborating with and facilitating the work of test development committees and other external stakeholders
• Collaborate with Assessment Leads across the Curriculum and Assessment team to ensure the implementation of standardized assessment procedures
• Collaborate with assessment production team and project managers to establish schedules for test item and test form development, and to monitor assessment deliverables
• Collaborate with assessment leadership in Curriculum and Assessment to support the implementation and continuous improvement of assessment development practices, standardized processes, and standard operating procedures

About You

You have:

• A master's degree in mathematics or a directly related discipline, and knowledge of current trends in the discipline (required), although a doctorate in the discipline is strongly preferred
• Prior project leadership
• At least 8 years in standardized assessment development having demonstrated high efficiency and alacrity in all test development processes (required)
• Experience with digital assessment (preferred)
• Teaching experience (preferred)
• Superior oral and written communications skills
• Excellent organizational and planning skills, including the ability to effectively manage multiple tasks simultaneously
• Meticulous attention to detail, including the ability to closely proofread
• Excellent skills in process and procedure implementation, including adhering to project plans and schedules, and maintaining project management documentation for tracking
• Technical acumen and aptitude; proficiency with Microsoft Office and use of browser-based applications and tools
• Excellent interpersonal and collaboration skills, including the ability to deal with staff at all levels
• Willingness to give, accept, and address constructive feedback with positivity
• Strong customer service orientation
• Willingness to travel 6-8 times a year (domestic), with an additional 2 weeks in May/June for the Annual "AP Reading" for AP Calculus
• You must be authorized to work in the United States

About Our Process

• Application review will begin immediately and will continue until the position is fil led
• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone screen, hiring manager interview, performance exercise and/or panel interview, and reference checks. This is an approximately 8-week process

About Our Benefits and Compensation

College Board offers a competitive benefits and compensation program that attracts top talent looking to make a difference in education. As a s