Along with secondary school league tables, multi-academy trust (MAT) league tables have been published today.

The role that MATs play is large and only getting larger. It seems reasonable, therefore, to try and set accountability at this level – but the MAT league tables are not without problems.

These chiefly stem from issues with the school progress (or value added) measures which form a key component of the MAT league tables. These are points that we’ve raised numerous times before, but they include the fact that the progress measures take no account of pupil characteristics, bar prior attainment, and the fact that – more or less – they only take into account pupils who remain on-roll at the end of Year 11.

But, bearing these points in mind, what do today’s figures show?

2017 v 2018

After the publication of provisional Key Stage 4 data in the autumn, we wrote that some trusts looked to have been hit hard by the removal of the European Computer Driving Licence, or ECDL, from the list of qualifications eligible for school league tables.

While changes in MAT Progress 8 scores from 2017 to 2018 will be due to a combination of factors, this does seem to have been borne out.

The chart below compares 2017 and 2018 P8 scores for all trusts which featured in both years’ MAT league tables. Highlighted in blue are the five trusts we identified where more than 80% of KS4 pupils had entered the ECDL in 2017.

It’s worth saying that, under the rules determining how the MAT league tables are produced [PDF], some schools newly entered the scope of the exercise this year, and a few left the scope of the exercise. Overall, the impact of this changing population of schools was not large, but in the case of some individual trusts it made a bigger difference.

The Department for Education has talked in the past of introducing an ‘improvement’ measure, showing how MAT’s results have changed over a period of years – but this remains something for the future, owing to a lack of comparable enough data, in the DfE’s own words.

Source [PDF]

Disadvantage

Finally, a look at the P8 scores of disadvantaged pupils within these trusts.

The chart below shows this, again for 2017 and 2018.

As we can see, there are just small handful of MATs for which disadvantaged pupils on average had positive progress scores in one or both years. But, of course, the disadvantage gap is a challenge far from unique to MAT schools.

Want to stay up-to-date with the latest research from FFT Education Datalab? Sign up to Datalab’s mailing list to get notifications about new blogposts, or to receive the team’s half-termly newsletter.