How Recruitment Agencies Compare Candidates

Once several candidates have been evaluated for the same role, an agency has to turn that into a comparison a client can follow — not just a pile of separate results. This is where a shortlist actually becomes decision-ready.

Why comparing side by side beats reading reports in sequence

Research on judgment under the evaluability hypothesis (Hsee, Organizational Behavior and Human Decision Processes, 1996) has found that people judge options more accurately when comparing them jointly than when reading the same information about each option in isolation, one after another. A recruiter who reads candidate A’s report Monday and candidate B’s report Wednesday is making the harder version of that judgment; laying both out side by side on the same criteria is the easier, more accurate one — and it’s the version a client can actually follow along with in a meeting.

Why the criteria have to match before the comparison means anything

A side-by-side layout only produces an accurate comparison if what’s being compared is actually the same thing for every candidate — comparing one candidate’s interview impression against another’s assessment score isn’t a real comparison, it’s two different kinds of evidence placed next to each other. That’s why the comparison depends on standardised evaluation upstream: the matrix format makes comparison easy to read, but it’s the shared criteria underneath that makes the comparison valid in the first place.

What a real comparison looks like

  • Same criteria applied to every candidate, so scores are actually comparable rather than describing different things
  • Strengths and risk areas placed side by side, not scattered across separate documents
  • A clear basis for why one candidate is recommended over another, stated in evidence rather than impression

See Candidate Comparison Software for how IntelligencesTest handles this, or a sample comparison matrix.

Frequently asked questions

Why compare candidates jointly instead of reading reports separately?

Research on comparative judgment shows people evaluate options more accurately when they can see them together rather than relying on memory of an earlier report.

What has to be true for a comparison to actually be valid?

The same criteria need to apply to every candidate being compared — comparing different kinds of evidence side by side isn’t a real comparison, even if it’s laid out that way visually.

Does this replace the individual evaluation report for each candidate?

No — the comparison is built from each candidate’s full evaluation report; it’s the summary view, not a replacement for the underlying detail.

Can a client follow the comparison without recruiter explanation?

That’s the goal — a side-by-side, same-criteria layout is built to be followable in a meeting, not just readable by the recruiter who built it.