Check job descriptions against the levelling framework

For: Reward or organisation design lead maintaining a job architecture across functions

Pattern: Hierarchical decompositionNeeds scaleDesigned for 30 to 500 agents

The pain today

Hundreds of job descriptions drift from the levelling framework. The same title carries different scope in different functions, and pay transparency reporting depends on the mapping being defensible.

The ask

I attached our levelling framework and all job descriptions by function and job family. For each job description, show which level criteria its text supports, where the text is missing or contradicts its assigned level, and where the same title is described differently.

Plain words, as you would say it to a colleague. Edit it to fit your case before you send it.

What you attach or connect

  • Levelling framework with criteria per level
  • Job descriptions by function and job family
  • Current title to level mapping

The unit of work

One worker task per one job description against one level's criteria.

Why a swarm fits

The work is a tree: function, job family, job description, criterion. Each leaf needs one description and one level's criteria. Families are independent, and each level of the tree can be verified before it rolls up.

Not for

Evaluating people or setting pay. It reads role documents only, and a job description can be wrong about the real job.

The decision tree

6 typed decisions, each with an action for every answer

At fixed moments in a run, the engine puts one narrow question to a decision model. The decision model never writes text: it answers yes or no with a probability, picks from listed options, or gives a score, about a small slice of the material. The engine then does exactly what this tree says, which is what makes the run auditable. The thresholds are the template's design values, not measured results.

  1. Planner, while planning

    Split or keep serialYes or no, with a probability

    While planning

    Do the job descriptions in this function fall into job families that can be checked against the framework without reading each other?

    Sees only: The function's list of job titles and families, with description lengths

    Why: Splits only where families are truly independent, so coordination cost is not paid for nothing.

    • Yes: 0.60 or higherthenSplit the work
    • Unsure: 0.40 up to 0.60thenKeep serial
    • No: below 0.40thenKeep serial
  2. Split or keep serialYes or no, with a probability

    While planning

    Is this job description long enough, and the level's criteria separate enough, that each criterion should be checked as its own task?

    Sees only: One job description's outline and one level's list of criteria

    Why: Short descriptions are cheaper read once than split into many tiny tasks.

    • Yes: 0.60 or higherthenSplit the work
    • Unsure: 0.40 up to 0.60thenKeep serial
    • No: below 0.40thenKeep serial
  3. Scope checkYes or no, with a probability

    Before work starts on a unit

    Is this document a description of a role, containing no information about a named person, their performance or their pay?

    Sees only: The first page of one supplied document

    Why: Keeps personal data out of the run; the job is about role texts only.

    • Yes: 0.85 or higherthenAccept
    • Unsure: 0.60 up to 0.85thenSkip this unit
    • No: below 0.60thenSkip this unit
  4. After workers, the judge checks

    Evidence checkYes or no, with a probability

    After a worker answers

    Does the quoted sentence from the job description describe scope, autonomy or accountability at the standard this level criterion sets out in its own words?

    Sees only: One level criterion and the quoted job description sentence

    Why: Prevents a level mapping from resting on a sentence that only sounds senior.

    • Yes: 0.85 or higherthenAccept
    • Unsure: 0.50 up to 0.85thenEscalate to a strong model
    • No: below 0.50thenReject and retry
  5. Reconciler, while merging

    Conflict checkYes or no, with a probability

    While reconciling

    Do these two job descriptions with the same title describe materially different scope against the same level criteria?

    Sees only: Two criterion-by-criterion summaries for one job title, with quotes

    Why: Surfaces title inconsistency, the finding the reward lead most needs, without deciding which is right.

    • Yes: 0.70 or higherthenMark unresolved
    • Unsure: 0.30 up to 0.70thenEscalate to a strong model
    • No: below 0.30thenAccept
  6. Accountable person, before anything is settled

    Person decidesYes or no, with a probability

    Before anything is reported as settled

    Does this finding suggest that a role's assigned level, and so the pay range of the people in it, might need to change?

    Sees only: One job description's findings and its assigned level

    Why: Level changes affect pay, so the reward lead and function head decide, never the run.

    Accountable: The reward lead and function heads decide any level change. The run reviews role documents, never individuals.

    • Yes: 0.30 or higherthenAsk a person
    • Unsure: 0.10 up to 0.30thenAsk a person
    • No: below 0.10thenAccept

The fleet: who does what

Model tiers by role, not brands: you choose the models. Strong reasoning models plan and reconcile, small fast models do the wide work, and the judge is a decision model from a different family, so it does not share the workers' blind spots.

  1. Planner

    A strong reasoning model builds the tree from function to criterion and sets what each leaf may read.

    Decisions here:1. Split or keep serial2. Split or keep serial3. Scope check

  2. Workers

    Small fast workers from an open-weight family, one per job description and level, quoting the supporting text.

    Designed for 30 to 500 agents, one worker task per one job description against one level's criteria. Each worker receives only its own unit.

  3. Judge, from a different model family

    A decision model from a different family checks that the quoted text meets the criterion as written.

    Decisions here:4. Evidence check

  4. Reconciler

    A strong reasoning model rolls leaves up per family and function and lists titles described inconsistently.

    Decisions here:5. Conflict check

  5. Accountable person

    The reward lead and function heads decide any level change. The run reviews role documents, never individuals.

    Decisions here:6. Person decides

Checked before anything is accepted

  • Every supported criterion carries a quote from the job description
  • Missing criteria are rechecked against the full description before being reported
  • Each job family is verified before it rolls up to its function
  • Only role documents are read; no person, performance or pay data is accepted as input

What comes back

  • Per job description: criteria supported, missing or contradicted
  • Titles whose descriptions differ across functions, side by side
  • Job families where the framework itself is ambiguous
  • Review list for function heads, with quotes

What to measure

  • Share of flagged descriptions that function heads agree need rework
  • Reviewer hours per job family
  • Framework ambiguities raised and resolved
  • Cost per job description checked

Names of measures only. No result is claimed for this template.

Templates open in the workspace chat with the ask filled in. Nothing runs until you send it.

Get early accessSign in to use

Check country handbooks against group people policy

For: Head of people policy or HR compliance lead in a company with staff in many countries

Each country has its own handbook and local policies, written at different times.

Pattern: Map, verify, reduceNeeds scale6 decisionsDesigned for 40 to 600 agents

Watch employment law changes against local policies

For: HR compliance lead or employment counsel covering many jurisdictions

Statutory leave, notice, working time and whistleblowing rules change country by country.

Pattern: WatchtowerNeeds a connector5 decisionsDesigned for 20 to 400 agents

Stress-test payroll rules drawn from collective agreements

For: Payroll manager or labour relations lead configuring pay rules from collective agreements

Overtime, shift premiums and allowances are configured from long collective agreements.

Pattern: Adversarial reviewNeeds live models6 decisionsDesigned for 12 to 240 agents