Hiring fairness, compared
Bias audit vs. AI hiring risk assessment
Who is this for?
- HR and compliance leadsYou’ll use it to tell which you need, a bias audit, a risk assessment, or both.
- AI governance teamsYou’ll use it to see how a risk assessment goes beyond the arithmetic of a bias audit.
The short answer
A bias audit is the specific, independent calculation New York City's Local Law 144 requires: selection or scoring rates and impact ratios by sex, race/ethnicity and both, with a summary you publish. An AI hiring risk assessment is advice: it checks a tool on your data, explains where you stand and what to fix. One firm shouldn't do both on the same tool, because an auditor shouldn't review their own advice.
What each one is for
Bias audit: meets a legal requirement in New York City. It reports the figures the rules require, signed by an independent auditor, and it doesn't certify the tool or say it passes.
Risk assessment: helps you decide. It looks at adverse impact on your data and the wider risks of how the tool is used, and ends with a written memo and recommendations.
Which one you need
If you use an automated employment decision tool for jobs in New York City, you need the bias audit, whatever else you do. If you're choosing a tool, fixing one, or hiring outside New York City, the risk assessment is usually the more useful first step.
BlissPoint offers both, but not on the same tool within 12 months: if we assessed or advised on a tool, we refer the audit to another independent auditor.
Related
Questions
- Can a risk assessment replace a Local Law 144 bias audit?
- No. The law requires a bias audit by an independent auditor. A risk assessment is a different, advisory piece of work.
- Can the same firm do both?
- Not on the same tool in BlissPoint's case: no audit of a tool we assessed or advised on in the 12 months before the audit, so the auditor never reviews their own advice.
Sources
This page is general information, not legal advice. Laws change and depend on facts this page can't know; talk to an employment lawyer about your situation.
Prefer to talk first? Book a free 15-minute call
From an I-O psychology consultant. Covers NYC Local Law 144, the EU AI Act and the four-fifths rule.