Hiring fairness, answered
What should I ask an AI hiring vendor before buying?
Who is this for?
- HR and talent leaders buying an AI hiring toolYou’ll use it to ask vendors the right security, fairness and audit questions before you sign.
- Procurement and legal teamsYou’ll use it to know which evidence to request in a hiring-tool contract.
The short answer
Ask what the tool measures and why it relates to the job, what validation evidence exists, what adverse impact data it has by group, and whether an independent auditor has audited it. Ask for the documents behind each answer, not a summary. A vendor's answers don't move your own obligations as the employer.
What the tool measures
What exactly does the tool output: a score, a ranking, a pass or fail? What inputs does it use? Which of those could stand in for a protected characteristic? How do you recommend the output be weighted in a decision?
The last answer matters in New York City, where how the output is used decides whether the tool is an automated employment decision tool under the DCWP rules.
Evidence that it works and is fair
What validation evidence exists, for which jobs, and does it follow the Uniform Guidelines (29 CFR 1607.5)? Can we see the study, not a summary?
What selection or scoring rates and impact ratios do you have by sex and race/ethnicity, and from whose data? Has an independent auditor audited the tool, when, and on what data? Under the NYC rules, you can rely on an audit built on other employers' data only if you provided your own data to that auditor or have never used the tool.
Documentation and support
What documentation do you provide for the EU AI Act or Colorado's SB26-189, if those apply to us? Can we export our own data to run our own checks? What happens to applicant data, and when is it deleted?
Related
Questions
- Can we rely on the vendor's bias audit for Local Law 144?
- Only in the cases the rules allow: the audit uses historical data from employers that use the tool, and you can rely on one built on other employers' data only if you provided your own historical data to the auditor or have never used the tool.
- What if the vendor won't share validation evidence?
- Treat that as an answer. Without the evidence, you can't show the tool is job-related, and you carry the risk as the employer.
Sources
This page is general information, not legal advice. Laws change and depend on facts this page can't know; talk to an employment lawyer about your situation.
Prefer to talk first? Book a free 15-minute call
From an I-O psychology consultant. Covers NYC Local Law 144, the EU AI Act and the four-fifths rule.