Hiring fairness, compared
Independent bias audit vs. a vendor's bias audit
Who is this for?
- Employers that must commission a bias auditYou’ll use it to decide whether a vendor's audit is enough or you need an independent one.
- HR and compliance leadsYou’ll use it to compare what each kind of audit covers before you pay for one.
The short answer
Under the NYC rules, the audit has to be performed by an independent auditor, and someone involved in developing or distributing the tool, or employed by its vendor, isn't one. A vendor can commission an independent audit of its tool, and an employer can sometimes rely on it, but only if the employer provided its own data to that auditor or has never used the tool.
Who can perform it
6 RCNY 5-300 says an auditor is not independent if the auditor is or was involved in using, developing or distributing the tool; has an employment relationship, during the audit, with the employer or the vendor; or has a direct financial interest or a material indirect financial interest in either. A vendor's own data science team can't be the independent auditor of its tool.
What data it uses, and when you can rely on it
A vendor-commissioned audit usually pools historical data from several employers that use the tool. The rules allow that, but an individual employer can rely on it only if it provided historical data from its own use of the tool to that auditor, or has never used the tool.
An audit you commission uses your own data, so the results describe how the tool performs with your applicants and your process.
Side by side
Vendor-commissioned independent audit: pooled data, one audit for many employers, you rely on it only in the cases above, and you still publish the summary and give notices.
Employer-commissioned independent audit: your data, results about your use, you control the timing, and you still publish the summary and give notices.
Related
Questions
- Is a vendor's bias audit ever enough?
- It can be, if it was performed by an independent auditor and you either provided your own historical data to that auditor or have never used the tool.
- Does BlissPoint audit tools for vendors?
- No. BlissPoint audits tools for the employers that use them, and never audits a tool it built, sold, resold, configured or recommended.
Sources
This page is general information, not legal advice. Laws change and depend on facts this page can't know; talk to an employment lawyer about your situation.
Prefer to talk first? Book a free 15-minute call
From an I-O psychology consultant. Covers NYC Local Law 144, the EU AI Act and the four-fifths rule.