Skip to main content

Main menu

  • Home
  • Our journals
    • Clinical Medicine
    • Future Healthcare Journal
  • Subject collections
  • About the RCP
  • Contact us

Clinical Medicine Journal

  • ClinMed Home
  • Content
    • Current
    • Ahead of print
    • Archive
  • Author guidance
    • Instructions for authors
    • Submit online
  • About ClinMed
    • Scope
    • Editorial board
    • Policies
    • Information for reviewers
    • Advertising

User menu

  • Log in

Search

  • Advanced search
RCP Journals
Home
  • Log in
  • Home
  • Our journals
    • Clinical Medicine
    • Future Healthcare Journal
  • Subject collections
  • About the RCP
  • Contact us
Advanced

Clinical Medicine Journal

clinmedicine Logo
  • ClinMed Home
  • Content
    • Current
    • Ahead of print
    • Archive
  • Author guidance
    • Instructions for authors
    • Submit online
  • About ClinMed
    • Scope
    • Editorial board
    • Policies
    • Information for reviewers
    • Advertising

Outliers from national audits: their analysis and use by the Care Quality Commission in quality assurance and regulation of healthcare services in England

Helen Grote, Keiko Toma, Laura Crosby, Catherine Robson, Clare Palmer, Claire Land, Jessica Ball and Edward Baker
Download PDF
DOI: https://doi.org/10.7861/clinmed.2020-0695
Clin Med September 2021
Helen Grote
ACare Quality Commission, London, UK
Roles: national medical director’s clinical fellow to the chief inspector of hospitals 2018–2019
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: helen.grote@nhs.net
Keiko Toma
BCare Quality Commission, London, UK
Roles: hospital provider analytics manager 2026–2020
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Laura Crosby
CCare Quality Commission, London, UK
Roles: analyst team leader
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Catherine Robson
DCare Quality Commission, London, UK
Roles: hospital inspector
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Clare Palmer
EKing’s College Hospital NHS Foundation Trust, London, UK
Roles: head of patient outcomes
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Claire Land
FCare Quality Commission, London, UK
Roles: policy manager
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jessica Ball
ACare Quality Commission, London, UK
Roles: national medical director’s clinical fellow to the chief inspector of hospitals 2018–2019
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Edward Baker
GCare Quality Commission, London, UK
Roles: head of hospital inspections
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
Loading

Article Figures & Data

Figures

  • Tables
  • Additional Files
  • Fig 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Fig 1.

    Mean adjusted glycated haemoglobin values for children and young people with type 1 diabetes cared for by paediatric diabetes units in England and Wales: an example of ‘alarm’ level outliers. Units outside the upper three standard deviation control limit are designated ‘alarm’ level outliers. Adapted with permission from the Healthcare Quality Improvement Partnership. HbA1c = glycated haemoglobin; PDUs = paediatric diabetes units; SDs = standard deviations.

  • Fig 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Fig 2.

    Interval from decision to operate to arrival in theatre (expedited): an example of special cause variation. The black line represents the month-by-month national benchmark hospital performance on the time interval from decision to operate to the patient arriving in theatre. The teal line illustrates the data for this particular hospital. The teal dots represent individual patients. There are three outliers (dots) above the upper control limit (red line), indicating patients who waited longer than the upper control limit. Adapted with permission from National Emergency Laparotomy Audit.

Tables

  • Figures
  • Additional Files
    • View popup
    Box 1.

    Case studies

    Case study 1: The provider experience: King’s College Hospital NHS Foundation Trust
    The national clinical audit programme is a significant component of the quality improvement programme at King’s College Hospital NHS Foundation Trust (KCH). The trust has two large acute hospital sites: 87 national audits and confidential enquiries are relevant to the King’s College Hospital (Denmark Hill) site and 64 to the Princess Royal University Hospital (Bromley) site.
    Reviewing the results of national audits is a significant undertaking and happens both within the clinical teams and centrally. There is no standardisation in the reporting of the national audits, so the patient outcomes team analyses each report and summarises, with input from the clinical leads, the key messages in relation to successes, concerns and required improvement. This enables the busy clinical teams, clinical governance structures, executive team and board to understand quickly and easily the implications of the results and use the information to drive improvement.
    As with all NHS organisations, excellent patient outcomes and experience are the key aims, so to get most value out of the effort expended, the trust particularly focuses the efforts on national audit indicators relating to patient outcomes and experience. Where the trust does not perform well against these indicators, the trust targets a detailed review of the processes through internal investigations. The trust embeds the improvement actions into existing care group-, division- and trust-level action plans, ensuring that the work is joined up with other organisational priorities and improvement actions.
    The trust is currently working with the business intelligence unit to develop an application to enable the capture of these data for use within the trust’s data warehouse. This will support clinical teams to use data from the national audits alongside performance and activity data to provide a holistic picture of their service. In addition, this will enable the trust to analyse themes occurring across the national audits, such as those relating to complications, pain management and provision of services.
    Case study 2: The inspector experience: working with Calderdale and Huddersfield NHS Foundation Trust
    From an inspector perspective, outcomes from externally validated data are an important part of engagement, monitoring and on-site inspections; as they help the Care Quality Commission (CQC) to objectively measure how an organisation is performing.
    The approach to managing outlier alerts from national audits can also be an indicative of an organisation’s responsiveness and culture; for example, Calderdale and Huddersfield NHS Foundation Trust recently experienced an outlier alert in relation to a National Paediatric Diabetes Audit measure. The trust informed the CQC relationship owner (inspector) of this at the point at which they were alerted. This indicated that the trust was open and proactively managing alerts. It also enabled the inspector to have timely oversight of potential areas of concern, greater awareness of trust investigations to determine why the alert occurred (for example, from audit peer review) and knowledge of any immediate actions taken. Ongoing work includes reviewing the completion of action plans and discussing performance during regular engagement meetings. The proactive approach taken by the trust helped to provide assurance to CQC that the organisation was not merely collecting data but was actively using it to drive quality improvements, a marker of being well led.9

Additional Files

  • Figures
  • Tables
  • Supplementary material

    Files in this Data Supplement:

    • Supplementary material S1
Back to top
Previous articleNext article

Article Tools

Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Citation Tools
Outliers from national audits: their analysis and use by the Care Quality Commission in quality assurance and regulation of healthcare services in England
Helen Grote, Keiko Toma, Laura Crosby, Catherine Robson, Clare Palmer, Claire Land, Jessica Ball, Edward Baker
Clinical Medicine Sep 2021, 21 (5) e511-e516; DOI: 10.7861/clinmed.2020-0695

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Outliers from national audits: their analysis and use by the Care Quality Commission in quality assurance and regulation of healthcare services in England
Helen Grote, Keiko Toma, Laura Crosby, Catherine Robson, Clare Palmer, Claire Land, Jessica Ball, Edward Baker
Clinical Medicine Sep 2021, 21 (5) e511-e516; DOI: 10.7861/clinmed.2020-0695
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • ABSTRACT
    • Introduction
    • The use of data from national audits
    • How audits identify outliers
    • The CQC actions following notification of an audit outlier and the response expected from providers
    • How hospitals can use audit data to inform quality improvement initiatives
    • Does the use of data from national audits and assessment of outliers improve patient care?
    • Ongoing challenges with the use of audit data in the regulatory process
    • Conclusion
    • Supplementary material
    • Acknowledgements
    • References
  • Figures & Data
  • Info & Metrics

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Immune checkpoint inhibitor-mediated hypophysitis: no place like home
  • Enhanced neurotrauma services: physician input into traumatic brain injury care
  • Implementation of the Antimicrobial Review Kit (ARK) to optimise antimicrobial prescribing at the Royal Cornwall Hospital: a behavioural change odyssey
Show more Quality improvement

Similar Articles

FAQs

  • Difficulty logging in.

There is currently no login required to access the journals. Please go to the home page and simply click on the edition that you wish to read. If you are still unable to access the content you require, please let us know through the 'Contact us' page.

  • Can't find the CME questionnaire.

The read-only self-assessment questionnaire (SAQ) can be found after the CME section in each edition of Clinical Medicine. RCP members and fellows (using their login details for the main RCP website) are able to access the full SAQ with answers and are awarded 2 CPD points upon successful (8/10) completion from:  https://cme.rcplondon.ac.uk

Navigate this Journal

  • Journal Home
  • Current Issue
  • Ahead of Print
  • Archive

Related Links

  • ClinMed - Home
  • FHJ - Home
clinmedicine Footer Logo
  • Home
  • Journals
  • Contact us
  • Advertise
HighWire Press, Inc.

Follow Us:

  • Follow HighWire Origins on Twitter
  • Visit HighWire Origins on Facebook

Copyright © 2021 by the Royal College of Physicians