Background Chris Williams

The NHS Matrix: where Æther came from

From 2015, three Matrix tools gave NHS mental health services in the south of England a current view of their own practice. Four of the views they offered are redrawn here with made-up data.

Æther began life as an internal project called SOMAT, short for "Son of Matrix". The Matrix was a family of assessment tools built for NHS mental health services in the south of England from 2015, and much of what Æther does was first worked out there. The screenshots we have from that time show real services' figures, so the four views below have been redrawn with made-up data.

The three Matrix tools

ToolForCommissioned byRecognition
EIP Matrix
2015
Early intervention in psychosis teams in Time4Recovery, the south of England's EIP programme, assessed against NICE guidanceOxford Academic Health Science NetworkIts reports were used in parliamentary discussion by Norman Lamb MP, and it was central to the programme team's nomination for a BMJ Award in 2017
PMH Matrix
2017
Perinatal mental health across maternity, health visiting, talking therapies, specialist perinatal and adult community mental health services, recording how the NICE quality standard was being put into practiceThames Valley Strategic Clinical NetworkEndorsed by NICE, and a finalist and runner-up in the NICE Shared Learning Awards 2019
CYP Matrix
2018
Children and young people's mental health services in Surrey, Sussex and Kent, run by the NHS, county councils and charities, looking at caseload, workforce, skills, capacity and confidenceA group of clinical commissioning groups, led by Guildford and Waverley CCGDesigned with commissioners, clinicians and managers from the services that used it

Before the Matrix, this information came from data that was collected, put together and written up into a report, often published months later, when it was too late to act on or to inform decisions about funding. The Matrix let services and commissioners see it while they could still do something about it.

Few questions, all relevant

The Matrix was deliberately light for the clinicians and managers who filled it in. There were few questions, and each one was something the person answering knew or could look up easily from their own service's records.

In the perinatal Matrix, each service was asked only about the parts of the NICE quality standard that applied to it. A maternity service answered questions about booking appointments and antenatal contacts, and a talking therapies service answered questions about how quickly treatment started. Neither saw the other's questions. Sessions stayed short, so they were finished. Because nobody was guessing at questions about someone else's service, the answers were accurate, and there were no sections left blank because they didn't apply.

Perinatal mental health quality statements, by type of provider
Quality statementMaternityHealth visitingMental healthTalking therapies (IAPT)
1. Valproate not prescribed to women who could become pregnantNot askedNot askedAskedNot asked
2. Information about mental health in pregnancy at annual reviewNot askedNot askedAskedNot asked
3. Asked about mental health at the booking appointmentAskedNot askedNot askedNot asked
4. Asked about emotional wellbeing at each routine contactAskedAskedNot askedNot asked
5. Assessed when a mental health problem is suspectedAskedAskedNot askedNot asked
6. Psychological treatment starts within six weeks of referralNot askedNot askedNot askedAsked
Each type of provider answered only the statements that applied to its own work: between one and three of the six. Statements shortened.

Results before review

At the end of a session, the team saw its own results straight away, each rated against national guidance, before sending them on for review. The team didn't need to work out what good looked like, because the rating told them, and the programme could mark an area it wanted every team to concentrate on that year.

End of a team's session · early intervention in psychosis · illustrative
MeasurePeopleRateRating
Physical health and support
Physical health check completed41 of 5279%Close to standard
Smokers offered help to stop18 of 18100%Priority area, met
Families offered family intervention30 of 5258%Close to standard
Carers offered an education programme33 of 4083%Meets standard
Outcomes
Admitted to hospital9 of 5217%Meets standard
Admissions under the Mental Health Act6 of 967%Below standard
Readmitted within a year1 of 911%Meets standard
A team's results as it would have seen them before sending them for review. Made-up figures and thresholds.

Policy and practice

For each NICE quality standard, the perinatal Matrix asked two separate questions. Does the service have a policy in place, and, in a random sample of ten records from the quarter, did the thing actually happen? The answers often differed. Some areas had a policy and little sign of it in the records, and others were doing it without a written policy.

If a service couldn't answer, it was asked why, so the gaps were recorded too. A record held by another organisation or a system with no field for the answer is worth knowing about, and before this it would simply have been missing from the report.

Asked about emotional wellbeing at each antenatal appointment · illustrative

Reasons given where records couldn't be checked: Area D, "notes held on paper at another site"; Area E, "our record system has no field for this".

Area B has a policy and little evidence of it in practice; Area C is doing it without one. Made-up data.

Measured against the standard

Most charts showed the recommended level alongside the actual one, so the question was how far a service was from where it should be, and not just how it compared with its neighbours. The perinatal workforce charts showed each role's whole-time equivalents in post each quarter against the level recommended for that area's number of births, and a team losing staff showed up within a quarter or two instead of in next year's report.

Specialist perinatal team staffing, whole-time equivalents · illustrative

Consultant psychiatrist

01.53Q1Q2Q3Q4Q5Q6Recommended 21 in postQ1: 2 in post, 2 recommendedQ2: 2 in post, 2 recommendedQ3: 2 in post, 2 recommendedQ4: 1 in post, 2 recommendedQ5: 1 in post, 2 recommendedQ6: 1 in post, 2 recommended

Community psychiatric nurse

06.513Q1Q2Q3Q4Q5Q6Recommended 104 in postQ1: 9 in post, 10 recommendedQ2: 9 in post, 10 recommendedQ3: 9 in post, 10 recommendedQ4: 3 in post, 10 recommendedQ5: 2 in post, 10 recommendedQ6: 4 in post, 10 recommended

Nursery nurse

03.57Q1Q2Q3Q4Q5Q6Recommended 52 in postQ1: 2 in post, 5 recommendedQ2: 2 in post, 5 recommendedQ3: 2 in post, 5 recommendedQ4: 2 in post, 5 recommendedQ5: 2 in post, 5 recommendedQ6: 2 in post, 5 recommended
Staff in post each quarter (solid line) against the recommended level for the area (dashed line). Hover over or tab to a quarter for its values. Made-up data.

One view across organisations

Perinatal mental health care in one area can involve a hospital trust's maternity service, a community trust's health visitors, a separate talking therapies provider and a specialist team, each covering a different patch. The perinatal Matrix brought them into one structure, so a clinical network could compare regions and then click through to the providers in a region and the services within each provider.

Records where the quality standard was met, from a sample of 10 per service · illustrative
All regions
South West (NHS England)
Placeholder Bay Talking Therapies
Talking therapies60% · 6/10
Testbury Community Trust
Health visiting40% · 4/10
Specialist perinatal team70% · 7/10
Testbury Hospitals Trust
Maternity50% · 5/10
South East (NHS England)
Mockford Parent–Infant Charity
Parent–infant service90% · 9/10
Exampleford Hospitals Trust
Maternity60% · 6/10
Sampleton Talking Therapies
Talking therapies50% · 5/10
Anyshire Community Trust
Health visiting80% · 8/10
Specialist perinatal team90% · 9/10
Anyshire Hospitals Trust
Maternity90% · 9/10
The chart opens South East as an example. Select a region, then a provider, to see what's inside it. Made-up data and organisations.

What Æther keeps

  • Results go back to the person who gave them, then to review. In Æther, an evaluator reviews each session and can record their own answer beside the original, so both are kept.
  • Each person is asked only what they can answer. Short, relevant sessions get finished, and the answers can be relied on.
  • Results are measured against an agreed standard, and not only against each other.
  • Gaps in the records count as findings. An answer that can't be given is worth knowing about.
  • The organisation's structure decides what each person sees. Permission for a region covers the providers and teams within it, and you can click from a chart through to what's behind it.
  • Rates take account of size, whether per 10,000 births or per flight observed, so large and small services can be compared fairly.

The difference in Æther is that the questions, the wording and the structure are no longer built into the software for one service. They're set for each organisation, which is how the same approach works on a flight deck now and could work on a customer call or a housing inspection.

All articles Arrange a walkthrough