Quick answer
Use one approved scorecard per role: derive competencies and questions from job analysis; ask every candidate the same core questions in the same order under comparable accessible conditions; use only necessary, consistent probes; record exact response evidence; have trained interviewers rate independently against predefined anchors; preserve insufficient evidence, accommodation, and disagreement states; adjudicate material differences with citations; and monitor the whole selection process for validity, reliability, accessibility, impact, corrections, and complaints.
Build the scorecard contract before interviewing
Role, competency, and question map
For every question, record the approved role version, essential function, competency definition, critical incident or task basis, question type, allowed probes, evidence expected, and why it is necessary. Remove preference-only criteria.
Comparable administration and accommodation
Define sequence, time range, materials, interviewer instructions, note method, accessible formats, interpreters or assistive routes, technology fallback, and permitted adjustments. Accommodation changes access—not the job-related construct being assessed.
Anchors, reviewers, and decision rights
Define behavioral evidence for each rating state, not adjectives about the person. Train reviewers, require source citations, capture conflicts, prohibit protected/proxy signals, and name who can adjudicate, correct, stop, and make the final decision.
Ten evidence-based interview criteria
This is a design library, not a universal weighting scheme. Activate and weight only criteria supported by the approved job analysis; rewrite questions and anchors for the actual role, validate them, and version changes before interviews begin.
Job knowledge applied to the role
Interview question: Can the candidate explain and apply the approved role-specific concepts, tools, standards, or regulations to a representative task?
- Strong evidence anchor
- Names relevant principles, selects them for a stated reason, applies them accurately, checks limits, and connects the answer to the job context.
- Insufficient or prohibited basis
- Repeats terminology without application, guesses beyond evidence, or relies on an unrelated credential. Missing exposure may require an equivalent evidence route—not an automatic zero.
Problem framing and clarification
Interview question: Can the candidate identify the actual task, stakeholders, constraints, unknowns, and success criteria before proposing a solution?
- Strong evidence anchor
- Restates the problem accurately, asks necessary questions, separates facts from assumptions, identifies missing authority or data, and defines a verifiable outcome.
- Insufficient or prohibited basis
- Jumps to a polished answer, invents context, asks protected or irrelevant questions, or treats interviewer hints as facts.
Evidence use and verification
Interview question: Does the candidate support key claims, test the source, and state what would confirm or disprove the conclusion?
- Strong evidence anchor
- Cites source or observation, evaluates freshness and reliability, seeks counterevidence, distinguishes inference, and proposes a proportionate verification step.
- Insufficient or prohibited basis
- Uses confidence as proof, fabricates a source, cherry-picks one example, or refuses to revise when evidence conflicts.
Judgment, tradeoffs, and escalation
Interview question: Can the candidate compare realistic options, explain tradeoffs, respect authority limits, and escalate when risk exceeds the role?
- Strong evidence anchor
- Considers benefit, cost, reversibility, time, safety, customer impact, uncertainty, and approval; chooses conditionally and names a stop or escalation trigger.
- Insufficient or prohibited basis
- Presents one universal answer, hides risk, optimizes only speed, claims authority they do not have, or escalates everything without prioritization.
Role-relevant communication
Interview question: Can the candidate make the required message accurate, understandable, audience-appropriate, and accessible while preserving uncertainty?
- Strong evidence anchor
- Structures the answer, defines necessary terms, adapts detail, checks understanding, distinguishes known and unknown, and creates a usable handoff or record.
- Insufficient or prohibited basis
- Score only role-required communication—not accent, charisma, eye contact, facial expression, camera behavior, grammar variation, disability-related speech, or resemblance to the interviewer.
Collaboration and disagreement
Interview question: Can the candidate coordinate roles, surface disagreement, share context, and reach or document a decision without erasing dissent?
- Strong evidence anchor
- Maps participants and authority, invites relevant input, explains a disagreement, tests alternatives, records the decision and unresolved risk, and maintains an accountable handoff.
- Insufficient or prohibited basis
- Rewards “culture fit,” social similarity, uninterrupted agreement, referral status, dominance, or willingness to accept unsafe instructions.
Stakeholder and customer responsibility
Interview question: Can the candidate identify who is affected, protect commitments and rights, communicate limitations, and close the loop?
- Strong evidence anchor
- Names stakeholder need and authority, verifies impact, avoids overpromising, gives a truthful checkpoint, preserves privacy and accessibility, and defines acceptance and correction.
- Insufficient or prohibited basis
- Uses emotional performance as empathy, withholds material limits, applies pressure, exposes restricted data, or assumes the most senior stakeholder represents everyone.
Execution and accountable ownership
Interview question: Can the candidate convert a decision into sequenced work with owners, dependencies, checkpoints, verification, and recovery?
- Strong evidence anchor
- Defines next actions, responsible roles, inputs, due dates, dependencies, acceptance evidence, status communication, exception route, and what happens after failure.
- Insufficient or prohibited basis
- Uses activity volume as outcome, claims team results as personal work, omits dependencies, or promises a deadline without evidence.
Safety, controls, and error recovery
Interview question: When relevant to the role, can the candidate follow controls, recognize unsafe boundaries, record incidents, and recover from error?
- Strong evidence anchor
- Identifies required control and authority, prevents irreversible harm, contains an incident, preserves evidence and notices, corrects the record, tests recovery, and proposes prevention.
- Insufficient or prohibited basis
- Rewards blanket risk avoidance, secrecy, blame shifting, bypassing controls for speed, or unsupported assumptions about honesty or background.
Learning, feedback, and adaptation
Interview question: Can the candidate learn a relevant capability, use feedback, and adapt responsibly when evidence or requirements change?
- Strong evidence anchor
- Describes an initial gap, learning plan, feedback source, changed behavior or artifact, verification, remaining limitation, and how future updates will be monitored.
- Insufficient or prohibited basis
- Do not proxy learning with age, graduation date, tool fashion, hobby access, job-change frequency, speed alone, or agreement with feedback.
Rate evidence independently, then adjudicate
Demonstrated
The cited response directly meets the role-specific anchor under comparable conditions, and no material contrary evidence remains unresolved.
Partially demonstrated
Relevant evidence exists but one defined dimension—scope, complexity, ownership, verification, or recovery—falls short. Record the gap, not a vague impression.
Insufficient evidence or not assessed
The response does not yet support a rating, or comparable evidence was not gathered. Do not convert missing evidence into failure; use an approved consistent follow-up or mark not assessed.
Accommodation pending, contradicted, or not applicable
Pause the affected criterion when access may be unequal; preserve conflicting evidence for adjudication; and remove any criterion not supported by the current job analysis.
Worked example: polished delivery does not replace incident evidence
This hypothetical example is not a real candidate or validated hiring result. Two interviewers assess an incident-response role. The candidate speaks smoothly and proposes immediate action, but does not identify authorization, evidence preservation, containment boundaries, customer notice, or recovery verification. One interviewer gives a high global score for confidence; the other cites missing control evidence.
- Discard the global impression. The scorecard prohibits charisma and confidence as proxies. Reviewers score only the role-defined criteria.
- Return to exact evidence. Both reviewers cite the same response spans and anchors. Problem framing is partial; safety/control is insufficient evidence; communication is demonstrated only for the role-required clarity dimension.
- Use a consistent probe if authorized. If the interview plan permits it, every candidate receives the same control-focused probe. Otherwise the missing dimension remains insufficient rather than guessed.
- Adjudicate without averaging away the risk. The panel records disagreement and criterion-level reasons. The authorized owner applies the validated decision rule; an AI mean does not erase the missing safety evidence.
How OpenMax can coordinate structured interviews
OpenMax can coordinate approved scorecard versions, interview schedules and accessible formats, standardized question packages, permitted probes, evidence-linked notes, independent reviewer assignments, sealed ratings before discussion, discrepancy alerts, accommodation holds, adjudication, corrections, notices, audit samples, and monitoring. Humans retain job analysis, legal scope, validation, accommodation decisions, sensitive information, interview judgment, decision rules, and final employment decisions.
Legal, fairness, privacy, and accessibility boundaries
- Do not use the template until qualified counsel and assessment experts determine applicable employment, discrimination, disability, privacy, labor, automated-decision, notice, audit, recordkeeping, and candidate-rights duties for every role, location, entity, interview mode, and tool.
- Do not ask about or infer protected traits, medical or disability information, family status, religion, age, nationality, pregnancy, genetic information, or proxies. Redirect volunteered information and score only the approved job evidence.
- Provide an accessible interview and a clear accommodation process; requesting or using accommodation must not lower a rating. Test platforms, timing, questions, note-taking, interpreters, and alternatives for different disabilities.
- Do not treat structure, interviewer agreement, a vendor claim, AI summary, bias audit, impact ratio, or human approval click as proof of validity, legality, or fairness. Validate role relevance, evaluate reliability and impacts, inspect the whole funnel, preserve corrections and challenges, and stop harmful use.
Sources, editorial method, and limitations
OpenMax editors reviewed current U.S. Office of Personnel Management materials on structured interviews, standardized questions, rating scales, job-related competencies, individual panel ratings, and discrepancy discussion; U.S. EEOC materials on prohibited selection practices; U.S. DOJ guidance on disability and accommodation in algorithmic hiring; and NIST AI RMF Core guidance on human roles, documentation, testing, and impact. We synthesized the ten-criterion library, rating states, and hypothetical incident example. Sources were rechecked September 3, 2026.
- U.S. OPM — Structured Interviews
- U.S. OPM — Structured interview considerations
- U.S. EEOC — Prohibited employment policies and practices
- U.S. DOJ — Algorithms, AI, and disability discrimination in hiring
- NIST — AI RMF Core
Frequently asked questions
Should every candidate receive exactly the same follow-up probes?
Use the same core questions and preapproved probe rules. Ask a probe only for its defined condition and apply that condition consistently; document why it was used.
Should interviewers discuss a candidate before rating?
Prefer independent evidence notes and ratings first, then discuss material discrepancies with citations. Preserve dissent and avoid averaging away a required criterion.
Can “culture fit” be a criterion?
Avoid vague fit. Replace it with validated, observable job behaviors such as accountable collaboration or stakeholder communication, with anchored evidence and prohibited proxies.
Does a panel eliminate interview bias?
No. Panels need validated questions, comparable administration, trained independent ratings, documented adjudication, accessibility, impact review, correction, and monitoring.
What can OpenMax automate?
It can coordinate approved questions, schedules, accessible formats, evidence-linked notes, sealed ratings, discrepancy review, corrections, and monitoring while people retain validation and employment decisions.