A brief and important submission to HEFCE from Sir David Spiegelhalter. If you need a really brief version:
- Indicators indicate, they do not measure what you really want to know, like the quality of someone’s work. What do you mean you haven’t written a definition of quality for me yet?
- As the indicators get simpler (or are simplified into one mega-index or league table), they become all the more amenable to gaming and create more perverse incentives.
Or as I have not yet tired of saying, statistics is no substitute for thinking.