← PanelDrill

The rubric, in full

Version 0.1.0 · 2026-09-18 · published before you pay, and the same for everyone

Every board you run is scored on these six dimensions, 1 to 5, against the wording below. Each score has to point at a sentence you actually said. The model scores the same transcript three times and we keep the median, so a repeat run lands on the same number more often.

PanelDrill scores the answer, not the person. No dimension describes your character, your readiness or your chances, and nothing here analyses your voice — only the transcript and its timing.

1. Problem identification

The degree to which the response names the actual problem, separates the presenting issue from the underlying one, identifies what information is missing, and recognizes who and what is affected before moving to action.

What this is not: Speed of answering, or the volume of facts recalled. A fast answer to the wrong problem scores low.

Score 1 — No problem statement. The response starts with actions.

What an assessor hears

  • The response opens with a solution ('I would write him up') without ever naming what is wrong.
  • The presenting symptom is treated as the whole problem: a complaint is treated only as paperwork, not as a possible performance or process issue.
  • No mention of any information the speaker does not yet have; every fact is assumed.
  • Affected parties beyond the immediate person are never named.

Score 3 — A clear, single-layer problem statement with some gaps named.

What an assessor hears

  • An explicit sentence framing the issue: 'The immediate issue is X, and I need to know Y before I act.'
  • At least two concrete unknowns named: what the recording shows, what the officer says, what prior documentation exists.
  • The obvious stakeholders are listed: the officer, the complainant, the shift.
  • The response distinguishes an urgent piece (something that must be handled today) from a non-urgent piece, even if the split is rough.

Score 5 — Layered problem statement, explicit unknowns, and the pattern behind the incident.

What an assessor hears

  • Two levels named in one breath: 'The incident is the immediate problem. The underlying problem is that we have no consistent handoff at shift change, and this is the third version of the same failure.'
  • Unknowns are named with the source that would resolve each one, and the response says which unknowns change the decision and which do not.
  • Stakeholders are mapped beyond the room: the involved officer, the complainant, the rest of the squad watching how this is handled, the next shift, the records that will outlive everyone.
  • Scope is bounded out loud: 'What is mine to solve today is A and B. C belongs to the division commander and I will forward it with what I have.'

Common mistakes

What a strong answer sounds like

2. Decision making

The degree to which the response commits to a defensible course of action, shows the reasoning and the alternatives considered, sequences the steps, and states what would change the decision.

What this is not: Reaching the 'right' answer. There is no answer key. A well-reasoned decision that is stated, sequenced and revisable scores high even when a rater would have chosen differently.

Score 1 — No decision, or a decision with no reasoning behind it.

What an assessor hears

  • The response stays in analysis and never commits: 'It depends', 'I would have to see', with no decision offered under any assumption.
  • Or a decision arrives with no path to it: 'I would suspend him', with no reasoning, no alternatives, no sequence.
  • The decision is deferred entirely upward: 'I would send it to the lieutenant' as the whole answer, with nothing the speaker would do first.
  • No timeframe. Everything happens at an unspecified point.

Score 3 — A stated decision with reasoning and a rough order of operations.

What an assessor hears

  • An explicit commitment: 'Here is what I would do', followed by three to four steps in order.
  • One alternative is named and set aside with a reason: 'I considered handling it informally, but the third occurrence means that is no longer available.'
  • Basic sequencing, with the safety or time-critical item first.
  • At least one condition named: 'If the recording contradicts the report, this becomes a different matter and it goes up the chain.'

Score 5 — Committed decision, visible trade-off, sequenced plan with owners and times, and a named tripwire.

What an assessor hears

  • A decision stated in one clean sentence before the detail, so the panel knows where the answer is going.
  • Two real alternatives weighed against each other on a stated criterion, not straw men — and the cost of the chosen path acknowledged out loud.
  • Steps carry an owner and a timeframe: 'I secure the recording before end of shift. I interview him at the start of his next tour with a union representative present if he requests one. I have my documentation to the lieutenant within 48 hours.'
  • A tripwire: 'If the interview turns up a second uninvolved officer, I stop, I do not expand this myself, and I hand it over — because at that point I am a witness, not the investigator.'

Common mistakes

What a strong answer sounds like

3. Communication

The degree to which the spoken response is structured, appropriately paced, sized to the question, and adapted to the listener — and whether the speaker answers the question that was actually asked.

What this is not: Accent, vocabulary size, or speaking style. This dimension rates structure, responsiveness and clarity, never how someone sounds.

Score 1 — The listener has to reconstruct the answer.

What an assessor hears

  • No structure — the response wanders between the incident, an unrelated war story, and back, without a signpost.
  • The question asked is not the question answered; a follow-up about the conversation with the officer is answered with more detail about the original call.
  • Heavy filler and unfinished sentences, or a two-word answer to a question that needed a plan.
  • Jargon and radio codes used with a listener who would not have them, with no plain-language equivalent.

Score 3 — Organized, responsive, and roughly the right length.

What an assessor hears

  • An frame at the start: 'Three things — the immediate safety piece, the conversation, and the documentation.'
  • The first sentence lands on the question that was asked before the detail begins.
  • Length matches the question: a short probe gets a short answer, not a restart of the whole scenario.
  • Terms a civilian listener would not know are translated the first time they are used.

Score 5 — Structured, sized, listener-adapted, and clean under interruption.

What an assessor hears

  • Answer first, then support: the position is stated in one sentence, then the reasoning, then the close — so an interruption at any point still leaves a complete answer behind.
  • Register shifts visibly with the listener: precise and procedural to the HR representative, plain and non-defensive to the community member, without the substance changing between the two.
  • An interruption is absorbed without losing the thread — the new question is answered directly, then the speaker returns with 'Coming back to the second piece I mentioned.'
  • Deliberate pauses instead of filler, and a real close rather than a trailing off: 'That is my approach, and the part I would want your read on is the timing.'

Common mistakes

What a strong answer sounds like

4. Leadership and accountability

The degree to which the response takes ownership appropriate to the rank, sets and holds a standard, develops rather than only corrects, follows through, and accepts responsibility for outcomes including the speaker's own part in them.

What this is not: Toughness, or willingness to discipline. Severity is not leadership. Consistency, follow-through and ownership are.

Score 1 — Ownership sits everywhere except with the speaker.

What an assessor hears

  • The problem is always someone else's: prior supervision, the academy, the administration, the officer's character.
  • Correction is either avoided ('I would keep an eye on it') or is only punitive, with nothing that would change the behavior.
  • No standard is ever stated, so nothing in the answer can be enforced consistently.
  • No follow-through — the conversation happens and the response ends there.

Score 3 — Clear ownership, a stated standard, and a follow-up point.

What an assessor hears

  • 'This is mine to handle' stated plainly, with the part that belongs above the rank named separately.
  • An explicit standard: 'The expectation is that reports are submitted before end of tour. That applies to everyone on the shift, including when we are short.'
  • Correction paired with development: the conversation, plus something that makes the next occurrence less likely.
  • A stated follow-up: a check-in date, a documented note, a second look in 30 days.

Score 5 — Ownership including the speaker's own contribution, a standard applied to the speaker first, and visible development over time.

What an assessor hears

  • The speaker's own share is named without being asked: 'Before I hold him to it, I have to ask whether I ever told him this in a way he could act on. If I did not, that is mine and I say so to him.'
  • The standard is applied upward and inward, not only downward: 'If I want them to document, my own documentation has to be the cleanest on the shift.'
  • A development path with a horizon: what happens this week, what is checked in thirty days, and what happens if it recurs — stated before it recurs, so it is not improvised later.
  • Consistency named as the point: 'The reason I do this the same way for the officer I like and the one I do not is that the squad can tell the difference, and the day they can is the day the standard is gone.'

Common mistakes

What a strong answer sounds like

5. Ethics and integrity

The degree to which the response recognizes the ethical dimension of the situation, acts consistently whether or not anyone is watching, keeps confidences appropriately, discloses conflicts of interest, and holds the line under social or hierarchical pressure.

What this is not: Legal analysis or policy citation. Raters do not assess whether an action is lawful or compliant with a particular agency's rules; they assess whether the response recognizes the integrity question and handles it consistently.

Score 1 — The ethical dimension is not seen, or is traded away.

What an assessor hears

  • An obvious conflict of interest is not mentioned — a friendship, a family relationship, a prior involvement in the same matter.
  • The response makes the answer depend on who is watching or who is involved: different handling for a friend than for a stranger, without acknowledging the difference.
  • Confidential information is spread casually — discussing a personnel matter with the rest of the shift 'so they know'.
  • Pressure is absorbed: the response changes when the scenario adds a senior officer who disagrees, with no reason for the change other than the disagreement.

Score 3 — The ethical dimension is named and handled consistently.

What an assessor hears

  • The integrity question is stated out loud: 'The issue here is not the value of the gift, it is what accepting it would mean the next time that business calls us.'
  • A conflict is disclosed and handed off: 'He and I are close. I would say that to my lieutenant and ask that someone else handle it.'
  • Confidentiality is bounded: who needs to know, who does not, and why.
  • Position holds under mild pressure, with a reason given rather than simple stubbornness.

Score 5 — The principle is stated, the cost of holding it is acknowledged, and the position survives real pressure.

What an assessor hears

  • The principle is separated from the instance: 'The question is not this one meal. It is whether there is a category of people who get a different response from us, and the moment that category exists it does not stay small.'
  • The cost of the decision is named honestly: 'This will make my week harder and it will cost me with two people on the shift. I would still do it, and here is why that trade is the right one.'
  • Under a hard push — a respected senior figure saying 'let it go' — the answer holds, engages the other person's reasoning seriously, and offers a path that does not require capitulation.
  • The speaker names what they would do if they turned out to be wrong: 'If the facts come back different, I say so publicly, because I made this call publicly.'

Common mistakes

What a strong answer sounds like

6. Team and community focus

The degree to which the response considers the people affected — the squad, the wider organization, and the members of the public involved — treats the community as a party with legitimate standing rather than an obstacle, and balances the needs of the team against the needs of the public.

What this is not: Agreeing with anyone who is upset, or promising whatever the community asks for. Acknowledging a concern honestly while declining to over-promise scores higher than agreement.

Score 1 — One audience only. Everyone else is an obstacle.

What an assessor hears

  • The public appears only as a source of complaints to be managed, defended against, or waited out.
  • Or the reverse: the squad is thrown over entirely to make a complaint go away, with no reason given to the officer involved.
  • The wider organization is invisible — no mention of the next shift, other units, or anyone who will inherit the consequences.
  • Language that groups people by category rather than treating them as individuals in the situation.

Score 3 — Both audiences are considered and addressed separately.

What an assessor hears

  • The concern is acknowledged in the speaker's own words before any explanation: 'Her frustration is reasonable given what she experienced.'
  • The officer is treated fairly in parallel: heard before conclusions, told what is happening and why.
  • Something concrete is offered to the public party: a specific next step, a name, a timeframe — rather than 'we will look into it'.
  • Downstream effects on the shift or the next tour are mentioned at least once.

Score 5 — Both audiences are served without either being sacrificed, and the answer holds a boundary honestly.

What an assessor hears

  • Acknowledgement arrives before defense, and is specific enough that it could only apply to this situation.
  • A boundary is held without hiding behind it: 'I cannot tell you what happens to that officer, and I am not going to pretend the reason is procedural rather than that it is not mine to share. What I can tell you is when you will hear from us and who will call.'
  • The squad is protected and corrected at the same time: the officer hears what was wrong from the speaker first, not from the public version of events.
  • The second order is named: 'The reason I want to close this properly is not this one resident. It is the twelve people she is going to tell, and what they believe about us the next time we need something from that block.'

Common mistakes

What a strong answer sounds like

The scale

{"min":1,"max":5,"type":"behaviorally_anchored_rating_scale","labels":{"1":"Well below the standard for the rank","2":"Below the standard (between anchors 1 and 3)","3":"Meets the standard for the rank","4":"Above the standard (between anchors 3 and 5)","5":"Clearly exceeds the standard for the rank"},"half_points_allowed":false,"rating_rule":"Rate only what is present in the transcript. Levels 2 and 4 are used when the response sits between two written anchors. When evidence for a dimension is absent from the transcript, rate 1 and state in the justification that the dimension was not addressed."}

PanelDrill is a product of Schlee LLC · not affiliated with any agency, commission or testing vendor · AI disclosure