Sampling assessor decisions is the core evidence-gathering activity of internal quality assurance, and getting the method right in 2026 is what keeps an awarding organisation's confidence in your centre intact. This guide walks through the sampling process step by step, from planning your strategy to writing up feedback that stands up to external scrutiny.
TL;DR
Learning how to sample assessor decisions as an IQA means applying a risk-based sampling strategy across assessors, learners, units and assessment methods, then checking assessment decisions against the standard rather than against your own opinion. A new assessor typically needs 100% sampling for their first 3-6 months; an experienced, consistent assessor can move to 10-20% sampling once track record supports it. Use direct observation, evidence review and interviews with learners as your three sampling methods. Verdict: build a written sampling plan before you touch a single portfolio — sampling without a plan is the single biggest reason centres fail external quality assurance visits in 2026.
Why this matters
An awarding organisation doesn't just check learner certificates — it checks whether your Internal Quality Assurer (IQA) function is actually catching poor assessment decisions before they reach a learner's file. If your sampling is thin, inconsistent or undocumented, the external quality assurer (EQA) has no reason to trust the rest of your centre's decisions.
Getting this wrong has consequences: sanctions, suspended registrations, or a full re-sample of every learner on a qualification. Getting it right protects assessors from unfair criticism and protects learners from bad decisions slipping through. If you're working towards the qualification that covers this role, the Level 4 IQA qualification sets out exactly what standard your sampling needs to meet.
What you'll need
- A current sampling plan template (spreadsheet or LMS-based tracker)
- Access to each assessor's assessment records, learner portfolios and observation reports
- The qualification's assessment strategy or sector-specific guidance from the awarding organisation
- A record of each assessor's experience, qualifications and track record (CAVA, TAQA, or equivalent)
- Time allocated for direct observation of at least one live assessment per assessor per sampling cycle
- A feedback form or IQA report template that separates strengths, development points and required actions
If you're new to the role or unsure what the underlying assessor qualification actually covers, it helps to revisit how to become a qualified assessor with CAVA — sampling only works if you understand what standard the assessor was trained against.
The steps
1. Build a risk-based sampling plan
Risk-based sampling means you don't treat every assessor the same. A newly qualified assessor, someone assessing a unit for the first time, or an assessor with a history of inconsistent judgements should sit in your high-risk category — sample 100% of their decisions until confidence is established.
An experienced assessor with 2+ years in post and a clean track record across previous EQA visits can move to a lower sampling rate, often 10-20%, but never zero. Map every assessor, every qualification, every unit and every assessment method (observation, professional discussion, portfolio review, witness testimony) across a grid so nothing gets missed. Common mistake: sampling only the paperwork-heavy units and skipping observation-based assessments because they take longer to schedule.
2. Sample across the full range of methods
Don't rely on one sampling method. Combine direct observation of the assessor in action, review of completed assessment records and portfolios, and short interviews with learners to check they understood the feedback they received.
Direct observation catches things a paper trail never shows — tone, fairness, whether questioning actually probes competence or just ticks boxes. Aim for at least one live observation per assessor per sampling cycle in 2026, particularly for anyone assessing practical or workplace-based units. If you need a refresher on what a well-run assessment observation looks like, see how to conduct an observation as a vocational assessor.
3. Check decisions against the standard, not your opinion
Every sample should be checked against three questions: was the evidence valid, authentic and sufficient? Did the assessor's judgement match the assessment criteria exactly as written? Was feedback to the learner clear enough that they could act on it?
Your job isn't to re-mark the work your way — it's to confirm the assessor's decision was defensible against the qualification standard. This distinction matters because EQA visitors will ask you to justify sampling outcomes, not personal preferences. Common mistake: IQAs who substitute their own assessment style for the standard, which creates inconsistency across assessors rather than resolving it.
4. Record the outcome immediately
Write up your sampling decision the same day, while the evidence and observation notes are fresh. Include what was sampled, the method used, the outcome (met standard / development needed / action required) and the date.
A sampling record with vague notes like "looks fine" won't survive an EQA audit. Specific notes — "Unit 302, learner witness testimony cross-checked against observation notes dated 14 January 2026, judgement confirmed sound" — demonstrate real scrutiny.
5. Give feedback that changes practice
Feedback to the assessor should separate what worked, what needs to change, and what the deadline is for any correction. Vague praise ("good job") teaches nothing; specific feedback ("questioning in the professional discussion didn't probe underpinning knowledge for criterion 2.3 — add two follow-up questions next time") changes behaviour.
Where a decision doesn't meet standard, agree a timeframe for the assessor to correct it and re-sample that specific piece of evidence before it's signed off. Common mistake: giving feedback verbally only, with nothing written down for the audit trail.
6. Track trends across your whole sampling cycle
After each round, look across all your samples together, not just assessor by assessor. Are certain units consistently weak? Is one type of evidence — say, witness testimony — routinely thin across multiple assessors?
Patterns like this point to a training gap in your team rather than an individual assessor problem, and they're exactly what an EQA will ask about. If patterns show up around quality assurance roles themselves, it's worth checking IQA vs EQA to make sure your centre's internal and external quality assurance responsibilities aren't blurring into each other.
7. Adjust the sampling plan as evidence builds
Sampling isn't static across a qualification cycle. As an assessor demonstrates consistent, standard-matching decisions across several sampling rounds, reduce their sampling rate gradually — but document the justification for the change.
Conversely, if a new unit or assessment method is introduced mid-cycle, treat it as high-risk again regardless of the assessor's overall track record. The plan should flex with the evidence, not sit frozen from January to December.
Troubleshooting
Assessor disputes a sampling outcome. Go back to the assessment criteria in writing and walk through where the evidence fell short line by line — disputes usually resolve once the standard is shown rather than argued.
Sampling backlog builds up before an EQA visit. Stop adding new samples and prioritise finishing the ones already started; an EQA would rather see fewer complete, well-documented samples than many rushed ones.
Learner evidence is thin or ambiguous. Interview the learner directly and record their answers against the specific criteria in question — a short professional discussion often resolves ambiguity faster than re-reading the same portfolio.
Two IQAs sample the same assessor differently. Standardise your sampling forms and run a joint standardisation meeting before the next cycle so both IQAs are checking against the same criteria interpretation.
Sampling plan doesn't reflect actual risk. Rebuild the grid from scratch using current assessor experience levels rather than last year's data — risk changes as people gain experience or take on new units.
EQA flags inconsistent feedback across assessors. Introduce a shared feedback template with mandatory fields (strength, gap, action, deadline) so every assessor receives feedback in the same format regardless of which IQA sampled them.
Tools and resources
- A written sampling plan grid covering assessor, unit, method and risk level
- Observation report templates for live assessment sampling
- Learner interview question banks aligned to assessment criteria
- The Level 4 Award in Internal Quality Assurance syllabus, which covers sampling strategy in depth
- A working understanding of roles and responsibilities of a vocational assessor so sampling feedback speaks the assessor's own language
What to do next
Once your sampling plan is running, the next skill to build is standardisation — getting every assessor and IQA in your centre interpreting the same criteria the same way. That's a separate discipline from sampling itself, and it's worth mapping out before your next EQA visit lands in 2026.
FAQ
What is sampling in IQA? Sampling is the process of checking a proportion of an assessor's assessment decisions against the qualification standard to confirm they're valid, consistent and fair, rather than checking every single piece of learner evidence.
How much sampling does a new assessor need? A newly qualified or newly appointed assessor typically needs 100% sampling for their first 3-6 months in post, dropping only once a consistent track record is demonstrated across multiple units.
Is direct observation better than paper-based sampling? Direct observation catches things paperwork can't, such as tone, fairness and real-time questioning quality, so it should always form part of your sampling mix rather than being the whole method or being skipped entirely.
How often should an IQA sample an experienced assessor? An experienced assessor with a clean track record can move to 10-20% sampling per cycle, but should never drop to zero, since risk can change with new units or assessment methods.
What happens if a sampled decision doesn't meet standard? The assessor is given specific written feedback and a deadline to correct the evidence, and the corrected piece is re-sampled before final sign-off — the outcome is never just noted and left.
Does sampling cover learner feedback too? Yes — part of sampling checks whether the feedback the learner received was clear enough to act on, which is why learner interviews are one of the three core sampling methods.
How is IQA sampling different from EQA sampling? IQA sampling happens inside the centre on an ongoing basis across the qualification cycle, while EQA sampling is an external check, usually annual, that reviews whether the centre's internal sampling has actually caught the right issues.
What qualification do you need to sample assessor decisions as an IQA? Most awarding organisations require the Level 4 Award or Certificate in Internal Quality Assurance, alongside assessor experience, before someone can take on sampling responsibilities.
One last thing
The centres that pass EQA visits smoothly in 2026 aren't the ones with the most sampling — they're the ones whose sampling plan can be explained in one sentence and justified with dated evidence for every entry. If you can't explain why an assessor is sampled at 20% rather than 50% off the top of your head, the plan needs rebuilding before the next cycle starts.
