Assessment Scientist (I/O Psychologist)
Codility
Location: Remote (US / Europe)
Company Description
At Codility, we empower companies to assess, manage, and develop engineering teams more effectively. Our platform enables organizations to evaluate candidates based on the technical skills that matter, fostering better hiring decisions and empowering engineers to tackle the world’s biggest challenges. Over the past decade, we've assessed the skills of over 12 million candidates and helped thousands of engineering leaders build high-performing, diverse teams.
Role Overview
Help unlock the world’s engineering potential by shaping how companies evaluate and hire technical talent. This role sits at the center of customer impact and product innovation. As an Assessment Scientist you will guide enterprise organizations toward better, fairer hiring decisions while helping Codility embed assessment science directly into our platform. We are looking for someone that can work at the intersection of I/O psychology, AI, and engineering to build the next generation of skills-based hiring.
What You’ll Do
Partner with enterprise customers to design and implement skills-based assessment strategies that improve hiring outcomes, retention, and candidate experience.
Act as a trusted advisor on job analysis, assessment design, candidate communication, and fair hiring practices.
Translate complex assessment science concepts into clear, actionable recommendations for business stakeholders.
Conduct job analyses and define success profiles for technical roles.
Design and execute validation studies (content and criterion-related) to ensure assessments are predictive and defensible.
Apply AI/LLM tools to enhance assessment design, candidate evaluation, and insight generation.
Use AI pragmatically to scale workflows (e.g., job analysis augmentation, content generation, scoring support) while maintaining scientific rigor and fairness.
Produce clear, defensible technical documentation for customer and internal use.
Analyze assessment and platform data to generate actionable insights that improve test performance and customer outcomes.
Use both statistical methods and AI-assisted analysis to optimize hiring processes.
Build & Innovate
Collaborate with Product, Engineering, and AI teams to embed assessment science best practices into Codility’s platform.
Contribute to AI-driven assessment capabilities and scalable, productized solutions.
What You’ll Bring:
M.A./M.S. in Industrial/Organizational Psychology, Occupational Psychology, or a related field with 3–4+ years of applied experience, or a Ph.D. with 1-2+ years of applied experience.
Experience in at least one of the following areas: employee selection, talent assessment and validation, or Learning & Development (L&D), including skills frameworks or competency modeling.
Demonstrated ability to use AI tools in applied workflows, including using LLMs (e.g., ChatGPT, Claude) to support analysis, content creation, or decision-making. Ability to evaluate AI outputs critically and ensure they meet quality, fairness, and professional standards. Interest in applying AI to scale assessment science in a product environment.
Strong foundation in job analysis, validation methods (content and criterion-related), and adverse impact analysis.
Working knowledge of employment guidelines and regulations (e.g., Uniform Guidelines).
Experience using statistical tools (e.g., R or Python) and survey methodologies.
Ability to work directly with customers and communicate complex concepts clearly to non-technical audiences.
Strong ownership mindset with the ability to manage projects and operate effectively in a fast-paced, cross-functional SaaS environment.
Nice to have
Experience working with technical roles (e.g., engineering, data, IT), including designing or evaluating technical or work-sample assessments.
Experience working in a SaaS or technology company, especially in cross-functional teams with Product and Engineering.
Experience in a consulting or client-facing role advising enterprise stakeholders on talent, assessment, or workforce strategy.
Experience translating assessment science into scalable, productized solutions
Experience applying AI/LLMs in practical workflows, such as content generation, analysis, or evaluation in a business or product setting.
Experience creating thought leadership or external content, such as white papers, webinars, or conference presentations.
Why Codility?
Work on cutting-edge products that are reshaping how companies build and manage engineering teams, alongside a diverse, inclusive team that values equity and collaboration.
While we are remote-first, we understand that bringing teams together matters. Once a year, the entire company meets in person to connect, and each function holds an annual off-site to invest in team building, strategy, and a bit of fun.
We work hard to create and optimize healthcare packages for the diversity of families we have at Codility. We believe everyone should have access to quality healthcare, and we make sure this is equitable across all our countries.
Your physical, mental, and financial well-being are important to thriving at work and in life. We provide a monthly budget for well-being-related expenses such as gym memberships and financial advisors.
Resting and recharging are critical to sustaining high performance. All Codility employees receive 27 days of PTO, four mental health days, and local holidays.
You'll also benefit from competitive compensation, including salary, perks, and equity.