Psychometric selection science: replacing gut-feel interviews with validated assessments
Structured interviews and validated, job-related assessments predict job performance better than unstructured "gut feel" interviews, so replacing or supplementing informal interviews with them improves hiring accuracy and makes decisions easier to defend.
Most hiring still relies on conversations where each interviewer asks different questions and forms an overall impression. Decades of I-O psychology research show that this is one of the weaker ways to predict performance. This guide summarizes the evidence and a practical path to better methods.

What the research shows
Schmidt and Hunter's 1998 meta-analysis summarized 85 years of research on the validity of selection methods, finding general mental ability tests and structured interviews among the stronger predictors. Sackett, Zhang, Berry and Lievens (2022) re-examined those estimates and concluded that many had been overcorrected; validities dropped overall, and structured interviews emerged as the top-ranked method. Both reviews agree that structured, job-related methods outperform unstructured ones.
Validated methods to consider
| Method | What it is | Key requirement |
|---|---|---|
| Structured interview | Same job-related questions for every candidate, scored on anchored scales | A job analysis and trained interviewers |
| Work sample | A realistic task from the job | Clear scoring criteria |
| Job knowledge test | Questions on knowledge the job needs | Content linked to the job |
| Cognitive ability test | Reasoning and problem-solving items | Evidence of job relevance and adverse impact review |
| Personality inventory | Work-related traits such as conscientiousness | Use alongside other methods |
Validity, fairness and the law
In the United States, the Uniform Guidelines on Employee Selection Procedures require that a selection procedure that has adverse impact be shown to be job-related. The SIOP Principles set out professional standards for validation. Practically: start from a job analysis, choose methods linked to it, monitor selection rates by group, and keep documentation.
Moving from gut feel to structure
- Analyze the job: list the tasks and the knowledge, skills and abilities they need.
- Write questions tied to those requirements, with scoring anchors describing poor, acceptable and excellent answers.
- Train interviewers to score independently before discussing.
- Add a work sample or test where the job warrants it.
- Track outcomes with a quality of hire index to confirm the change helps.
Organization Viewer's hiring kit drafts structured interview guides from a job description. BlissPoint's Structured Interview Program, Assessment and Test Development and Selection Procedure Validation Study are the consulting versions, led by an I-O psychology consultant.
What a structured interview question looks like
Instead of "Tell me about yourself," a structured question targets a job requirement found in the job analysis. For a role that requires handling competing deadlines: "Describe a time you had two urgent deadlines that could not both be met. What did you do, and what happened?" The scoring guide then describes what a weak, acceptable and strong answer contains, for example whether the candidate clarified priorities with stakeholders and communicated early. Every candidate gets the same question and the same guide.
Candidate experience and acceptance
Structure can feel formal, so explain the format at the start and leave time for candidates' own questions. Keep assessments relevant and reasonably short; candidates accept job-related tasks more readily than abstract ones. Offer reasonable accommodations for disability as required by law.
Common mistakes when switching
- Buying a test without checking job relevance for your roles.
- Letting interviewers drift back to unstructured questions.
- Discussing candidates before scoring, which lets one voice dominate.
- Not monitoring adverse impact after introducing a new method.
Key takeaways
- Structured, job-related methods predict performance better than unstructured interviews.
- Start from a job analysis, write anchored questions and train interviewers to score independently.
- Monitor selection rates by group and keep documentation in line with the Uniform Guidelines.
- Track results with quality-of-hire data to confirm the change helps.
Questions
Are unstructured interviews useless?
No, but they predict performance less well than structured interviews and are more open to bias.
What makes an interview structured?
The same job-related questions for every candidate, scored against predefined anchors by trained interviewers.
Do validated tests have legal risk?
Any selection method with adverse impact must be shown to be job-related under the Uniform Guidelines. Validation and monitoring reduce risk.
Which single method is best?
The 2022 re-analysis ranked structured interviews highest; combining several job-related methods is usually stronger than any one.
How long does it take to build a structured interview?
For one role, a job analysis, question set and scoring guide can often be prepared in a few working sessions; training interviewers adds a little more.
Can AI tools replace structured interviews?
Any tool used in selection must be shown to be job-related and fair. Treat it like any other selection procedure: validate it and monitor adverse impact.
Do structured interviews take longer?
Preparing them takes more effort up front. Running them often takes about the same time as an unstructured interview, and scoring is quicker because interviewers know what to look for.
Sources
- Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology. Psychological Bulletin, 124(2), 262–274
- Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection. Journal of Applied Psychology, 107(11), 2040–2068
- Society for Industrial and Organizational Psychology (2018). Principles for the Validation and Use of Personnel Selection Procedures, 5th ed.
- Uniform Guidelines on Employee Selection Procedures, 29 CFR Part 1607 (Cornell LII)