Who You Are We are looking for a motivated and conscientious Director/ Psychometrician, Exam Development who is ready to jump in and take the lead on multiple initiatives. In this role, you will manage several critical areas including developing and maintaining our national and state-specific exams and developing and implementing an exam security protocol.
To succeed in this role, you will have strong communication skills, analytical skills and excellent attention to detail. You will need technical knowledge along with planning and organizing skills and superb problem-solving skills.
The ideal candidate must have: • Master’s degree required, Ph.D. preferred, in one of these or other related fields: Psychometrics, I/O Psychology, Quantitative Psychology, Educational Psychology, or I/O Psychology • Minimum 3 years of exam development experience in the field of credentialing/licensing preferred • 2 years supervisory experience preferred • Familiar with APA/AERA/NCME exam development best practices • Familiar with NCCA and ISO 17024 accreditation standards • Proficient in WINSTEPS and SPSS • Familiar with FACETS
Who We Are We are two related nonprofit organizations with shared staff (that is, many staff working for both organizations, but with just one supervisor) located in Chicago’s River North neighborhood. We provide professional development opportunities for dental assistants and other dental auxiliaries, such as testing, professional certification and online education; we also conduct research to promote the profession and public health. We are a small, friendly office that is driven by our related public protection missions. We offer work/life balance with a 37.5-hour work week, plus benefits including health insurance, flexible benefits reimbursement, professional development assistance, generous vacation/PTO, 401(k) matching and more.
• Analytical Skills • Collaboration • Initiative • Integrity/Business Ethics • Managing People • Problem Solving • Rapport/Relationship Building • Strategic Thinking • Teamwork • Technical Knowledge and Translation
II. Essential Duties and Responsibilities: A. Exam Development (30-40%) • Supervise and assist Psychometrician in development and management of DANB national exams and item pools (for RHS, ICE, GC, CDIPC and DISIPC), and directly manage such activities for the OA, CPFDA, CRFDA and state-specific exams including but not limited to: • Maintain DANB’s exam item pools • Prepare and convert exams for DANB’s testing vendor • Prepare for, participate in and facilitate exam development committee meetings • Manage exam reference library (physical and electronic) and reference lists • Create annual copyright exam poolbooks • Review exam comments quarterly • Create item writing committee meeting summary report • Prepare item strings and scaling for IT • Create SPSS/Winsteps scoring control files • Conduct statistical item and exam analysis and review • Oversee Psychometrician in preparation for and execution of Content Validation and Standard Setting Studies, and participate in and assist with meetings • Periodically update the item writing guide, study guides and other exam preparation materials • Oversee the scoring and QC of exam results • Oversee the management of the exam reference library (physical and online) • Ensure exam history details are documented and always up to date • Ensure cumulative exam data strings are always up to date • Oversee development and maintenance of a low-stakes recertification self-assessment • Oversee the development of the annual exam publication schedule • Oversee development of monthly comment and exam history reports, • Oversee PDEP scoring and handscoring • Annually review/update Program Performance Reports and the Interpretation Guide • Assist supervisor with periodic review of test vendor contract and contract negotiations, or an RFP process if needed
B. Technical Reports, Psychometric Projects and Accreditation (25-35%) • Prepare for and manage annual NCCA and ISO accreditation and reaccreditation, in collaboration with input from other departments • Review exam meeting and technical reports as developed by the Psychometrician • Perform or oversee exam development research (e.g., reading and time studies) • Collaborate with Psychometrician in development of security/cheating detection protocols and in ensuring that these protocols are followed • Conduct periodic exam research (e.g., time studies, reading level studies) as requested by Supervisor
C. Score and QC Exams (10-15%) • Conduct or supervise scoring and QC of exam results • Supervise hand scoring process • Conduct or assist with exam rescores as needed • Direct quality control checks of exam scoring and checks of exam dishonesty • Conduct or assist with exam security checks
D. Supervisory (20%) • Supervise, coordinate and assign activities of staff in department • Interview job applicants and make hiring recommendations • Evaluate staff performance to recommend personnel actions such as hiring, retention, promotion, transfer, improvement plans or dismissal • Train, instruct and develop staff
E. Board of Directors/Trustees, Committees, Policy Activities (5%) • Serve as back-up staff liaison with Psychometrician as lead liaison for DANB’s Exam Programs Committee • At least annually review all exam development related policies, and ensure the Psychometrician also reviews the policies • Draft board reports related to exam development committees and exam development activities, and review those drafted by the Psychometrician
F. Budgetary (5%) • Oversee the development and management of annual exam development committee, exam publishing and item writing software budget • Oversee or manage tracking of invoices and expenditures related to department budget
G. Miscellaneous (10%) • Make recommendations for policy changes and continuous quality improvement • Oversee maintenance of a Standard Operating Procedures manual for Exam Development and Accreditation • Perform other tasks, as required
IV. Training Requirements: • CRM • Item banking software (e.g. ExamDeveloper)
V. Physical Demands: • Required to sit for long periods of time • Infrequent light physical effort required
VI. Work Environment: • Work performed in an office environment • Must be able to work on Saturdays and Sundays (3-8 weekends/year) • May travel 2-4 times per year to meet with state dental boards to develop exams, and association meetings • Must be able to work late evenings as required to meet with exam committees and DANB’s Exam Programs committee via conference call/webinar
Additional Salary Information: Salary is BOE
About DANB (Dental Assisting National Board) and The DALE Foundation
Who We Are
We are two affiliated national nonprofit organizations with shared office space and staff (that is, many staff working for both organizations, but with just one supervisor), located in Chicago’s River North neighborhood. We provide professional development opportunities for dental assistants and other dental auxiliaries, such as testing, professional certification and online education; we also conduct research to promote the profession and public health. We are a mid-sized, collaborative, friendly office that is driven by our related public protection missions. We offer work/life balance with a 37.5-hour work week, plus benefits including health insurance, a paired HRA and FSA, professional development assistance, generous vacation/PTO, 401(k) matching and more.