Skip to content
← Knowledge
Template6 min readbeginner
Hiring

Interview Scorecard

A simple scorecard for evaluating candidates on what matters.

By SOE TEAM6 min readPublished 27 Sept 2026
Editorial photograph of a founder listening carefully to a customer across a small meeting table with an open notebook and a real product sample, natural candid wide composition. Supports the section "What the scorecard should measure" in "Interview Scorecard".
This Knowledge exists for these problems

An interview scorecard turns a hiring conversation into a comparable decision record: define the job-related criteria before the interview, ask consistent questions, record evidence, score independently, and discuss disagreements only after each interviewer has committed a view.

In short

  • • Define role-specific criteria before interviewing.
  • • Use the same core questions and anchored rating scale for comparable candidates.
  • • Require evidence for every rating.
  • • Score independently before the debrief.
  • • Treat the final recommendation as a judgment supported by evidence, not a mechanical average.

Interview Scorecard

An interview scorecard is a structured decision record for evaluating a candidate against the requirements of a specific role. It is most useful when the criteria are defined before interviews begin, the same core questions are used across candidates, ratings have clear anchors, and interviewers write the evidence behind their scores.

The point is not to turn hiring into mathematics. It is to stop an important decision from becoming a memory contest or a comparison of who made the strongest impression.

What the scorecard should measure

Start with the role, not the candidate.

Write down the small set of capabilities that actually matter for success. A useful scorecard usually contains:

  • Competency: the capability being evaluated.
  • Weight: how important that capability is relative to the others.
  • Question: the consistent prompt used to gather evidence.
  • Rating anchors: what weak, acceptable and strong evidence looks like.
  • Evidence: what the candidate actually said or demonstrated.
  • Follow-up: a specific point that needs clarification.
  • Recommendation: the interviewer's final judgment after reviewing the evidence.

Do not fill a scorecard with generic traits such as "energy", "culture fit" or "seems impressive". Translate those ideas into observable, job-related requirements.

Why structure matters

Research on employment interviews has repeatedly examined the difference between structured and less structured approaches. A structured approach can improve the consistency and reliability of evaluation, although structure does not make an interview perfectly objective.

Campion and colleagues described a highly structured approach built around job analysis, consistent questions, anchored rating scales, consistent administration and documentation. Later meta-analytic work has also examined the conditions under which structured interviews predict job performance.

The practical lesson is modest but important: make the evaluation process more comparable before asking interviewers to make a judgment.

Recent SHRM guidance similarly emphasizes that a rating scale is not enough by itself. Interviewers need clear definitions of what different ratings mean, should evaluate candidates against the role standard rather than against another candidate, and should bring concrete evidence into calibration discussions.

The SOE Interview Scorecard

1. Role

Role: [Role title]

Hiring manager: [Name]

Interview stage: [Screen / Functional / Founder / Final]

Decision required: [Advance / Hold / Reject / Final hire decision]

2. Criteria

CompetencyWeightWhat strong evidence looks like
[Competency 1][%][Observable evidence]
[Competency 2][%][Observable evidence]
[Competency 3][%][Observable evidence]
[Competency 4][%][Observable evidence]
[Competency 5][%][Observable evidence]

Use only the criteria that matter for this role. Five useful criteria are better than twelve vague ones.

3. Interview questions

For each competency, prepare a primary question and a small set of permitted probes.

Primary question: [Question]

Probe for context: "What was the situation?"

Probe for action: "What did you personally do?"

Probe for reasoning: "Why did you choose that approach?"

Probe for result: "What happened?"

Probe for learning: "What would you do differently now?"

The probes should clarify the evidence, not steer the candidate toward the answer the interviewer wants.

4. Rating scale

Use a short anchored scale rather than an unexplained number.

1 - Weak evidence The answer does not demonstrate the required capability, or the example is substantially below the role requirement.

2 - Partial evidence Some relevant evidence exists, but important gaps remain.

3 - Meets the requirement The evidence is credible and sufficient for the role at the expected level.

4 - Strong evidence The candidate demonstrates the capability clearly and with relevant depth.

5 - Exceptional evidence The evidence materially exceeds the requirement for this role.

The anchors must be adapted to the role. A "5" for a junior sales role should not mean the same thing as a "5" for a principal engineer.

5. Evidence record

For every rating, write what supports it.

Competency: [Name] Rating: [1–5] Evidence: [Specific answer, example, work sample or observable behavior] Concern: [What remains uncertain?] Follow-up needed: [Question or verification]

Avoid notes such as "Great candidate", "Very smart", "Good culture fit", "I liked them", or "Strong communication". Those are conclusions without enough evidence.

Prefer a record that identifies the situation, action, reasoning and result so the next interviewer has something inspectable.

The independent scoring rule

Each interviewer should complete their scorecard before the group debrief.

Do not announce a preferred candidate first and then ask everyone else to react. The first confident opinion can become an anchor for the room.

Instead:

  1. Interview.
  2. Record evidence.
  3. Score independently.
  4. Submit the scorecard.
  5. Compare disagreements.
  6. Investigate the evidence behind the disagreement.
  7. Make the decision.

A disagreement is useful information. If one interviewer gives a 5 and another gives a 2, do not immediately average it to 3.5. Ask why the evidence was interpreted differently.

What the scorecard cannot solve

A scorecard does not remove bias.

It also does not prove that the chosen competencies are the right predictors of performance. A beautifully structured interview can still be measuring the wrong things.

Review the scorecard when the role changes, the team's expectations change, new evidence shows a criterion is weakly related to success, interviewers consistently disagree about an anchor, a criterion produces vague evidence, or candidates are being rejected for reasons that are not job-related.

Hiring is a learning system. The scorecard should improve as the company learns what actually predicts good work.

Final recommendation

Overall recommendation: [Strong hire / Hire / Hold / No hire / Strong no hire]

Evidence supporting the recommendation: [1–3 sentences]

Biggest unresolved risk: [Risk]

What would change my mind? [Evidence that would materially change the decision]

Reference checks or work samples required: [Yes / No + details]

Sources and methodology

This template is an editorial synthesis of research and professional guidance on structured employment interviews, rating scales and evidence-based calibration. It is not a guarantee of hiring validity and should be adapted to the role, jurisdiction and organization's hiring policy.

  • Campion, Palmer & Campion, *Structured Interviewing: Raising the Psychometric Properties of the Employment Interview*, Personnel Psychology.
  • Schmidt & Zimmerman, *A counterintuitive hypothesis about employment interview validity and some supporting evidence*, Journal of Applied Psychology.
  • Society for Human Resource Management, *Build Consistent Hiring Decisions with Job Interview Rating Scales*, 20 August 2026.
  • Society for Human Resource Management, *Non-Standardized Interview Prompts Can Lead to Bias*, 18 March 2008.

Image: "Hiring bias with solution" by Ayushi-Cognitiv, Wikimedia Commons, CC BY 4.0.

Related reading: \2 · \2

How to use this scorecard

Choose the capabilities that matter for the actual role before interviewing. Define observable evidence for each criterion, use the same core criteria across candidates, record evidence separately from impressions, and document the final decision and remaining uncertainty.

How to use this tool

  1. Fill it with one real situation rather than hypothetical inputs.
  2. Record the evidence behind each important field.
  3. Make the smallest decision the tool is designed to support.
  4. Set a review date and update the tool when the evidence changes.

Good output: another person should be able to understand what was decided, why, what remains uncertain, and what happens next without needing a separate founder explanation.

Take it into your work

Do something with what you just read.

Save it for later, mark the passage that matters, or open your SOE workspace and keep thinking.

Open your SOE ↗

Takeaways

What to carry forward

  • → A score without evidence is an opinion with a number attached.
  • → A structured process can improve consistency without pretending to remove judgment.
  • → Calibration should focus on the evidence behind disagreement, not on forcing everyone to match.

The scorecard is not the decision. It is the structure that makes the decision easier to inspect, compare and improve.