QA-ing QA When You’re a Big Trust

As trusts grow, it can become difficult to be confident that school-level QA is consistent, reliable and leading to better decisions.

In a small trust, that confidence can come from proximity. Central leaders know each school well, can spot drift quickly, and can test what they are hearing against what they see. In a bigger trust, that gets harder. Different schools may use different processes, collect different evidence, and apply different standards of challenge. The result is a familiar frustration: lots of QA activity, but limited trust-wide oversight.

That matters even more now. In January 2026, the government announced plans to introduce academy trust inspections, with a focus on leadership, governance and impact.

So the question for large trusts is: “How do we know that school QA is strong enough to trust?”

That is where the idea of QA-ing your QA comes in.

What “QA-ing QA” Really Means

At trust level, QA-ing QA is a form of meta-evaluation.

It means looking beyond individual monitoring activities and asking bigger questions:

  • Are schools using sound QA processes?
  • Are leaders drawing fair conclusions from the evidence?
  • Do we have a clear idea of how the strengths and weakness of each school differ?
  • Are standards being applied consistently across the trust?
  • Is QA leading to support, intervention and improvement?
  • Can trustees and executives see risk early enough to act?

This fits with the wider direction of travel in the sector. The DfE says governance in academy trusts exists to provide strategic leadership, accountability and assurance, and that boards need a whole-trust approach to risk and assurance.

In other words: trust oversight should not just collect information, it should also create confidence.

Why Big Trusts Find This Difficult

  1. Too much local variation

    Schools often use different forms, frameworks, thresholds and language. That makes trust-wide comparison difficult and the provision of targeted support and professional development harder as common threads can be difficulty to spot.

  2. Too much information, not enough assurance

    Central teams can be flooded with visit notes, reports and action plans without a clear way to judge which findings are robust and which are weak.

  3. Strong QA in some schools, weaker QA in others

    Some leaders are highly skilled at self-evaluation. Others are newer, less confident, or less consistent.

  4. Oversight becomes reactive

    Without a clear trust-wide view, central teams can end up responding to obvious problems rather than spotting patterns early.

  5. The centre becomes another layer of workload

    If trust oversight is poorly designed, schools experience it as “more checks” rather than clearer support.

That last point matters. The DfE’s risk guidance explicitly says risk management should not be about bolting on extra processes, but about integrating assurance into how the trust already works.

What Good Trust-Level Oversight Looks Like

The strongest sector guidance and research points in the same direction: effective trust oversight is layered, risk-based and evidence-informed.

Ofsted’s MAT summary evaluation guidance looks at the trust’s arrangements for overseeing, challenging and supporting academies, while the DfE frames assurance as part of whole-trust governance and risk management. Research by Toby Greany found that some larger trusts use school risk ratings, regular central review cycles and differentiated levels of support and autonomy. More recent CST work describes trusts using live databases, clear success criteria and externally reviewed studies to strengthen improvement activity.

So, in practice, good oversight usually has these features:

  • a common trust-wide definition of strong QA
  • a standard evidence set that schools report against
  • moderation to test consistency and quality
  • a risk-based review cycle rather than a one-size-fits-all model
  • clear links from QA findings to support, intervention and professional development
  • some form of independent or peer assurance, so the trust is not relying only on its own internal view

A Practical 6-Part Model

Layer Purpose What it looks like in practice
1. Define Agree what “good QA” means Common trust expectations, templates, thresholds and review questions
2. Capture Gather comparable evidence Standardised school QA summaries, action plans, linked evidence and review dates
3. Moderate Test consistency Cross-trust reviews, central moderation, peer validation, sampling
4. Analyse Spot patterns and risk Trust dashboards, trend analysis, recurring strengths/concerns, school risk profiles
5. Act Turn oversight into improvement Support plans, coaching, intervention, resourcing, trust-wide training
6. Assure Check the system itself Board scrutiny, intern
This layered approach mirrors the broader assurance logic in the DfE’s risk guidance, which points trusts toward a “four lines of defence” model: operational management, board oversight, internal scrutiny and external assurance.

What Should a Trust Actually Standardise?

A big trust does not need every school to look identical, but it does need some common architecture.
Standardise these things:
  • the core purpose of QA
  • the main QA activity types
  • the language used for findings
  • the required evidence fields
  • the reporting timetable
  • how actions are recorded and reviewed
  • what triggers escalation
  • what gets reported upward to trustees and executives
Allow flexibility in these things:
  • the exact timing of local activity
  • who leads each strand in each school
  • school-specific priorities
  • the balance of review methods
  • the format of local implementation, where it still produces comparable evidence
This balance matters. Research into school improvement in multi-school groups suggests that trusts often become more systematic as they grow, but too much systematisation can create bureaucracy and reduce professional trust.

How Flourish can help:

If you need more consistency without forcing every school into exactly the same process, Flourish can provide a useful middle ground.

Trusts can manage QA document structures centrally where common architecture is needed, while still allowing schools autonomy where appropriate.

What Central Teams Should Review Termly

Review areaKey trust-level questions
QA coverageHave planned QA activities actually happened across all schools?
Evidence qualityAre findings supported by evidence, or are they vague and anecdotal?
ConsistencyAre similar issues being identified similarly across schools?
Action qualityAre actions specific, owned, timed and reviewed?
ImpactIs QA changing practice, not just producing paperwork?
InclusionCan the trust see the experience of disadvantaged pupils, pupils with SEND and other groups clearly enough?
CapacityWhich schools can self-improve securely, and which need stronger central support?
RiskWhere are the early warning signs? Where is confidence too high or too low?

That focus on understanding impact, strengths and weaknesses, and the quality of education for all pupils is closely aligned with Ofsted’s MATSE emphasis.

How Flourish can help:

Flourish makes it easier to bring trust-wide QA information together in one place. Central teams can use reporting dashboards to review coverage, spot trends across schools, then open individual forms when they want to validate a concern or understand the evidence behind the pattern.

Five Practical Ways to QA Your QA

1. Create a trust-wide QA quality rubric

If you want better oversight, start by defining what strong QA looks like.

Your rubric might include prompts such as:

  • Is the QA activity clearly linked to a priority?
  • Is there enough evidence to support the judgement?
  • Are leaders distinguishing between symptoms and causes?
  • Are actions specific enough to improve practice?
  • Is follow-up built in?
  • Is the evaluation fair across different contexts and pupil groups?

This is where many trusts go wrong: they standardise the form, but not the quality of thinking behind it.

The EEF’s work on QA at scale is useful here. Its guidance stresses the importance of defining core components, fidelity and quality criteria so organisations can maintain impact as they scale.

Action for trusts

Build a simple 1-page moderation rubric and use it whenever central teams review school QA submissions.

2. Move from document collection to evidence sampling

Collecting reports is not the same as assuring quality.

A better approach is to sample intelligently:

  • one school with strong outcomes
  • one school with mixed outcomes
  • one school causing concern
  • one sample focused on a trust-wide priority
  • one sample focused on a pupil group

Then test:

  • Does the evidence support the conclusion?
  • Would another reviewer reach the same view?
  • Is the school overstating or understating the issue?
  • Are actions proportionate?

Action for trusts

Instead of reading every page from every school, sample deeply and moderate the quality of judgement.

3. Use risk ratings to differentiate oversight

Not every school needs the same level of scrutiny.

Greany’s research found examples of large trusts using risk-rating approaches to determine the level of support and autonomy each school received, with some central teams reviewing risk regularly.

That does not mean reducing oversight to a traffic-light. It means combining evidence such as:

  • QA findings
  • attendance and behaviour indicators
  • staff turnover
  • safeguarding concerns
  • implementation drift
  • leadership stability
  • improvement capacity
  • external outcomes

Action for trusts

Create a trust risk conversation each half term or term:

  • Which schools need validation?
  • Which need support?
  • Which need intervention?
  • Which can operate with lighter-touch oversight?

4. Make moderation part of the model

If each school evaluates itself in isolation, trust-wide comparability will always be weak.

Moderation can take several forms:

  • central review of a sample of school QA
  • peer review across schools
  • trust-wide thematic reviews
  • joint visits or joint evidence reviews
  • cross-school discussion of standards

This matters because trust oversight is not only about challenge; it is also about building stronger shared professional judgement across the organisation.

Action for trusts

Choose one priority each term and moderate it across several schools using the same questions and quality criteria.

5. Add independent assurance

Even strong central teams have blind spots.

That is why layered assurance matters. The DfE risk guidance describes assurance beyond day-to-day management, and the CST recommends a three-year cycle of board assurance using internal assurance in years one and two, then external assurance in year three.

Independent assurance could include:

  • internal scrutiny commissioned by the audit and risk committee
  • peer review between schools or regions
  • an external review of governance
  • an externally reviewed study
  • external moderation of a trust-wide QA theme

Action for trusts

Ask once a year: Who is quality-assuring our own trust-level view?

If the answer is “only us”, your assurance model probably needs strengthening.

What Not to Do

Large trusts can accidentally create weak oversight by doing too much of the wrong thing, so be careful to avoid the following traps.

Trap Why it causes problems
Collecting huge volumes of reportsCreates noise without confidence
Over-standardising every local processIncreases burden and weakens ownership
Relying only on dashboardsMisses nuance and evidence quality
Relying only on visits and relationshipsMakes comparison difficult at scale
Escalating too lateTurns oversight into firefighting
Separating QA from supportMakes schools feel judged, not helped
Keeping trustees too far from assuranceWeakens governance and accountability

The best systems combine structured data, professional judgement, moderation and follow-through.

A 90-Day Starting Plan for Trusts

If your trust wants to strengthen oversight without redesigning everything, start here.

In the next 30 days

  • Agree the small number of things all school QA must show
  • Define what high-quality QA looks like
  • Simplify reporting templates so evidence is comparable

In the next 60 days

  • Pilot central moderation on one trust-wide priority
  • Introduce a termly school QA summary
  • Build or refine a simple trust-wide oversight dashboard

In the next 90 days

  • Add a risk-based review conversation
  • Identify where peer review or external assurance could add value
  • Report the findings and follow-up actions clearly to trustees

In summary: start with clear success criteria, make the evidence usable, and use it to drive decisions rather than simply to document activity.

Final Takeaway

For a big trust, good oversight is built on a system that helps the trust answer five simple questions:

  1. Are schools evaluating the right things?
  2. Are they doing it well?
  3. Are conclusions consistent and evidence-based?
  4. Are we spotting risk and acting early enough?
  5. Who is assuring our assurance?

When a trust can answer those questions confidently, QA stops being a collection of disconnected activities and becomes something much more useful: a reliable engine for improvement.

For trusts trying to move from scattered QA activity to clearer trust-wide oversight, the right systems matter. A platform like Flourish cannot replace professional judgement or assurance, but it can make QA evidence more structured, more visible and easier to act on.

     

    To download this resource as a PDF, please provide your details below.