Assessment & evidence

Articles about designing, interpreting, and using evidence to assess capabilities with sound judgment.

38 articles

Latest articles

  1. Wood-and-metal mechanism with exposed gears and a circular magnifying lens at the top.

    The leader who assesses without observing

    PRYSMAP

    The authority to assess comes with the role. The quality of the judgment comes from the evidence. When the two are confused, familiarity, reputation, and visible results take the place of observation.

  2. The yellow cover of Noise on a wooden table beside two white paper shapes.

    Noise — why two assessors see different results

    PRYSMAP

    Noise brings an uncomfortable idea to talent decisions: two competent assessors can apply the same criteria and reach different conclusions for reasons the system never deliberately chose to accept.

  3. White pitcher on a circular base, viewed from three sides through round lenses.

    Perception is not reality, but it should not be ignored

    PRYSMAP

    A perception does not capture reality like a camera. It does, however, record how someone interprets what they could observe within a particular relationship, at a particular moment, and against specific expectations. That limitation does not make perception irrelevant; it determines how perception should be read.

  4. Three measuring instruments aimed at the same metal component.

    Pulse, Check, Interview, and Target answer different questions

    PRYSMAP

    Pulse, Check, Interview, and Target can coexist within the same assessment architecture, but they are not longer or shorter versions of the same instrument. Each mode answers a different question, produces a different kind of evidence, and supports conclusions with a distinct scope.

  5. Three shoots at different stages of growth planted in the same container.

    When to reassess after a development action

    PRYSMAP

    Reassessing too soon can mistake a recent activity for a developed capability. Reassessing too late leaves unanswered a question that could already be resolved. The right time depends not only on the calendar, but also on opportunities to practice, the quality of the evidence, and the stability of the change.

  6. Three clear cylinders holding puzzle fragments; the last is frosted and conceals its contents.

    What to do when evidence is insufficient to decide

    PRYSMAP

    Missing evidence, conflicting evidence, and uncertainty are not the same problem. When they are collapsed into a generic category, an organization may manufacture certainty, defer a decision indefinitely, or treat something it has not yet observed as a gap.

  7. Wooden path diagram starting from five cards, merging, then branching toward several markers.

    What people should receive after an assessment

    PRYSMAP

    An assessment that returns only a score provides less information than it used to reach its conclusion. The person needs to understand the result, the evidence behind it, its limitations, and what they can do with it.

  8. Two compartment trays filled with gray discs, except for one section holding a single blue disc.

    The average can hide the most important gap

    PRYSMAP

    An average can accurately represent the center of several results while concealing the difference that matters most to the decision. Its usefulness depends on which components it combines and which of them may compensate for one another.

  9. A divided wooden tray holding cylinders and metal pieces of different sizes.

    How to design a scale that reduces differences in interpretation

    PRYSMAP

    A scale reduces differences in interpretation when it requires assessors to recognize the same evidence—not when it replaces vague words with more elegant labels. Designing one means defining what will be observed, making the boundaries between levels explicit, and testing those boundaries with cases that reveal where disagreement begins.

  10. Five different object prototypes arranged in a circle and connected to a common center by blue lines.

    Assessing a skill is not asking whether someone has it

    PRYSMAP

    A skill is a useful construct for organizing capabilities, but it never appears as a complete object to the person assessing it. What we see are partial manifestations in specific tasks, decisions, and contexts.