Skip to main content

Main menu

  • Home
  • Our journals
    • Clinical Medicine
    • Future Healthcare Journal
  • Subject collections
  • About the RCP
  • Contact us

Clinical Medicine Journal

  • ClinMed Home
  • Content
    • Current
    • Ahead of print
    • Archive
  • Author guidance
    • Instructions for authors
    • Submit online
  • About ClinMed
    • Scope
    • Editorial board
    • Policies
    • Information for reviewers
    • Advertising

User menu

  • Log in

Search

  • Advanced search
RCP Journals
Home
  • Log in
  • Home
  • Our journals
    • Clinical Medicine
    • Future Healthcare Journal
  • Subject collections
  • About the RCP
  • Contact us
Advanced

Clinical Medicine Journal

clinmedicine Logo
  • ClinMed Home
  • Content
    • Current
    • Ahead of print
    • Archive
  • Author guidance
    • Instructions for authors
    • Submit online
  • About ClinMed
    • Scope
    • Editorial board
    • Policies
    • Information for reviewers
    • Advertising

Identifying reasons for delays in acute hospitals using the Day-of-Care Survey method

Erica Reid, Andrew King, Alex Mathieson, Thomas Woodcock and Simon W Watkin
Download PDF
DOI: https://doi.org/10.7861/clinmedicine.15-2-117
Clin Med April 2015
Erica Reid
ANHS Lanarkshire, UK;
Roles: associate nurse director for quality improvement
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew King
BQuEST, Scottish Government, Edinburgh, UK;
Roles: assistant statistician
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alex Mathieson
CEdinburgh, UK;
Roles: freelance writer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas Woodcock
DCLAHRC, Imperial College, London, UK;
Roles: research fellow
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Simon W Watkin
EDepartment of Respiratory Medicine, Borders General Hospital, Melrose, UK
Roles: consultant physician
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: simon.watkin@borders.scot.nhs.uk
  • Article
  • Figures & Data
  • Info & Metrics
Loading

ABSTRACT

This paper describes a new tool called ‘Day-of-Care Survey’, developed to assess inpatient delays in acute hospitals. Using literature review, iterative testing and feedback from professional groups, a national multidisciplinary team developed the survey criteria and methodology. Review teams working in pairs visited wards and used case records and bedside charts to assess the patient's status against severity of illness and service intensity criteria. Patients who did not meet the survey criteria for acute care were identified and delays were categorised. From March 2012 to December 2013, nine acute hospitals across Scotland, Australia and England were surveyed. A total of 3,846 adult general inpatient beds (excluding intensive care and maternity) were reviewed. There were 145 empty beds at the time of surveys across the nine sites, with 270 definite discharges planned on the day of the survey. The total number of patients not meeting criteria for acute care was 798/3,431 (23%, range 18−28%). Six factors accounted for 61% (490/798) of the reasons why patients not meeting acute care criteria remained in hospital. This survey gives important insights into the challenges of managing inpatient flow using system level information as a method to target interventions designed to address delay.

KEYWORDS 
  • Inpatient flow
  • access block
  • bed utilisation
  • appropriateness of hospital stay

Introduction

Ensuring emergency access to acute health services is a challenge for many countries. Emergency access efficiency is commonly measured through emergency department overcrowding statistics. International evidence suggests that lack of timely access to inpatient beds is one of the main reasons for emergency department overcrowding: this problem has been termed ‘access block’.

Timely emergency access is commonly considered a managerial rather than a clinical issue, but retrospective analysis of emergency department attendance and admissions in recent years has shown that overcrowding is associated with increased risk of readmission and mortality.1,2 While causal relationships have yet to be established, reducing access block is clearly not only an imperative for managers but also for clinicians.

Addressing access block requires improvements in systems and processes across the continuum of care to ensure patients receive timely clinical treatment from appropriate teams in the correct location. Improving inpatient flow is part of this continuum and dependent upon action at many levels within acute, community and social care sectors.

Objective data to inform hospital operational teams dealing with patient flow is an important part of this process. The aim was to develop an easy, reliable and consistent method to assess acute hospital inpatients that would identify those no longer likely to benefit from acute hospital care, and to determine the reasons why patients remain in hospital after the purpose of the acute admission has been achieved.

Literature review

On review of the literature, the appropriateness evaluation protocol (AEP) developed by Gertman and Restuccia in 1981 was identified as a ‘technique for assessing unnecessary days of hospital care’.3 This provides objective criteria-based assessment of the clinical appropriateness of admissions to hospital and subsequent days of care.

In the literature, the AEP criteria have been applied at a single point in time, such as a single day, or used multiple times on sequential days with the same patients.4–6 The criteria have also been shown to reliably identify acuity of medical illness and, in one study, the presence of positive AEP criteria reflected increased morbidity and mortality.5

Since 1981, the AEP criteria have been used, or modified for local use, in Italy,6 France,7 Belgium,8 Holland,9 Spain,10,11 Germany,12 Denmark5 and Turkey.13,14 Assessments in the UK include the 1997 national study of acute medical admissions conducted by the Royal College of Physicians of London,4 which reviewed 4,885 days of hospital care against the AEP criteria. In this study, 45% were judged ‘inappropriate’, most commonly because of patients remaining in hospital after the medical purpose of hospitalisation had been accomplished.

Methodology

To deepen understanding of delays in unscheduled inpatient emergency access, a national multidisciplinary working group was established. This group reviewed the relevant literature and developed criteria and methodology for use (initially) in NHS Scotland. The working group reviewed the AEP and found it to be useful but needed updating to reflect contemporary inpatient care. A variety of methods was used to update the criteria, including collecting expert opinion and testing and receiving feedback from a range of professional groups, including doctors, nurses, allied health professionals, managers and social care colleagues. This resulted in the development of a set of criteria with 12 ‘severity of illness’ variables, covering derangements in physiological parameters, and 16 ‘service intensity’ variables, reflecting levels of clinical interventions, prescribed treatments and clinical characteristics according to history (see supplementary material online for list of criteria).

The criteria and methodology were developed though iterative testing in four hospitals. This included feedback sessions at the sites surveyed followed by review by the national group. The criteria were further assessed by reviewing 89 consecutive patients admitted to an acute hospital and measuring them against the criteria on a daily basis until discharge. The adaptations to the criteria were tested prospectively.

In addition to the acute care criteria we developed a list of ‘reasons not discharged’ for patients not meeting the revised criteria. This was aligned to Scotland's national delayed-discharge codes, providing 19 reasons reflecting acute and community/social care services. Examples include ‘awaiting social work assessment’, ‘awaiting community hospital bed’ and ‘awaiting consultant decision/review’.

We identified research in Spain11 which had demonstrated that location of patients outside of the relevant specialty unit (usually known as ‘outliers’ or ‘boarders’) had a significant association with a higher incidence of inappropriate stay. Testing of the criteria in Scotland revealed a similar pattern, with outlying/boarding patients often not meeting the criteria for acute care. This element was therefore added to the data collection method.

Only one criterion for acute care needs to be satisfied for the day of care to be deemed ‘appropriate’: patients who do not meet a single criterion are deemed ‘inappropriate’. Survey teams have the option of overriding the protocol in either direction if the objective criteria appear to give a result that is clinically counterintuitive.

Having developed and tested the criteria and methodology for completing the survey, we provided guidance, documentation, on-site support and data analysis for the local teams who conducted individual hospital surveys.

Results

The Day-of-Care Survey (DoCS) was used between March 2012 and December 2013 to survey 3,846 acute hospital beds in nine hospitals internationally (these included district general hospitals and tertiary hospitals in the UK and Australia). All adult general inpatients at each site (excluding intensive care, obstetric and mental health units) were reviewed using the DoCS criteria set. Patients were defined as inpatients if they had been accepted for admission and waiting in the emergency department for more than four hours. Unfunded/surge capacity beds were included in the numerator, but not the denominator. Each hospital review took 1−2 hours to complete and data were made available the same day.

The total number of patients across the nine hospitals was 3,701, with bed occupancy at the individual hospitals ranging from 85–104% at the time of survey. Each survey commenced at 8 am and was completed within a two-hour period. Patients identified for definite discharge on the day of the survey totalled 270 across the nine hospitals and were excluded from further analysis. A total of 798 patients out of the total of 3,431 (23%, range 18–28%) did not meet acute care criteria (Table 1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1.

 Hospitals surveyed, date of surveys, total patients surveyed and those not meeting Day-of-Care Survey criteria (numbers and percentage).

For patients not meeting DoCS criteria, the reviewer selected the primary reason the patient had not yet been discharged from the list provided. This usually required discussion with the ward manager or medical team. A breakdown of ‘reasons not discharged’, split by in-hospital/out-of-hospital for all patients not meeting the criteria, is shown in Table 2.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2.

 Top three reasons patients were not discharged split by in-hospital/out-of-hospital, for all patients not meeting the Day-of-Care Survey criteria.

The top three in-hospital reasons for not being discharged accounted for 32% of total delays, and the top three out-of-hospital reasons accounted for 28% of delays. All other specified reasons accounted for the 22% of the total with 18% not categorised, but individual reasons were identified in the narrative.

Over half the patients included in the surveys were over 70 years of age. As Fig 1 shows, the proportion of patients not meeting the criteria rose with age. There was also a consistent finding across all sites and countries surveyed that the proportion of patients who did not meet the DoCS criteria increased with length of stay (Fig 2).

Fig 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig 1.

Age profile of patients who met and did not meet the DoCS criteria, excluding patients discharged on the survey day. DoCS = Day-of-Care Survey.

Fig 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig 2.

Length of stay for all patients who met and did not meet the DoCS criteria, excluding patients discharged on the survey day. DoCS = Day-of-Care Survey.

Surveying using the DoCS criteria is a simple, reproducible process that can be conducted by a combination of clinicians and personnel who are not necessarily directly involved in frontline acute care (non-health care professionals such as social workers and managers). Preparation of staff involved in the survey is crucial, but a 15-minute briefing on the afternoon prior to the survey is sufficient. The survey process itself is not lengthy, taking up to one hour per ward of 30 beds.

The overall proportion of patients not meeting the criteria (23%, n = 798) is less than the 36% reported in Australia by Dempsey,15 but not as low as the 7% found in a study of 2,180 hospital days in France,7 although the latter excluded patients who stayed less than one day.

Many published studies using the AEP document reasons for patients remaining in hospital despite not meeting survey criteria. These vary, possibly reflecting the different international models of health and social care. For example in a study from Belgium,8 the most frequent reasons were ‘waiting for an examination (investigation)’ (22%) and ‘lack of extra-hospital structures’ (31%). A French study7 stated non-availability of ‘outside’ care or resources accounted for 61% of the reasons for inappropriate stays in medical units and 83% of surgical stays (68% overall).

Our survey found six of the top-10 reasons for non-discharge were influenced by factors outside the acute hospital (lack of community hospital bed, for instance), but four were hospital-related (awaiting allied health professional assessment or consultant decision and review, for example). This reinforces the understanding that delays to discharge are not exclusively related to factors external to the hospital (as is often assumed), but indicate delays within hospital systems that need to be addressed.

The AEP was found to be useful in older patients, with high reliability and moderate validity.16 Our DoCS showed that the older patients were, the less likely they were to meet the criteria for acute care. When inpatients were grouped in 10-year age bands, it was found consistently that advancing age was associated with an increasing proportion not meeting the criteria (Fig 1). This possibly reflects not only the complex health and community needs of older people, but also their increased vulnerability to hospital admission due to comorbidities. A study in Italy17 showed that while comorbidity increased the likelihood of an appropriate admission in young patients, the converse was true for older people.

Length of stay was also found to be an important factor, with the proportion of patients not meeting a criterion increasing with length of stay (Fig 2). Many patients with stays in hospital of greater than 14 days were outliers/boarders or in unfunded capacity (such as that used to accommodate increased admissions over the winter); as in the study of Soria-Aledo et al,11 which found that outlying/boarding was significantly associated with inappropriate stay (29.7% for outliers/boarders vs 21.8% for non-outliers/boarders), these patients were less likely to meet the criteria. Patients being cared for outside their specialty area and those in hospital due to a surge-capacity response require a focused, multidisciplinary, proactive case management approach to ensure their needs for acute hospital care are met appropriately.

Discussion

The DoCS provides a snapshot of hospitals’ inpatient status at a particular point in time that enables organisations to identify the sources of delay in inpatient flows and take appropriate action. Experience to date has shown that the DoCS method:

  •  offers a simple, easily understandable approach that involves little preparation for staff and can be carried out over short time periods with minimum disruption to clinical services

  •  provides immediate access to core data, such as age spread of the hospital population and length of stay

  •  creates useful insights, such as recognition that patients who have been in hospital for 14 days have a higher chance of not meeting the DoCS criteria, and that criteria are less likely to be met with increasing patient age

  •  presents opportunities to improve patient flows by identifying sites of delays and supporting the development of solutions

  •  creates local ownership of data and, subsequently, solutions.

DoCS have now been undertaken in acute hospitals of differing size and character in Scotland, England and Australia. Expertise to support future iterations is developing at hospital level and understanding of the reasons for delays to inpatient flows is increasing locally and nationally. The hospitals are now planning to embark on an iterative process of regular surveys to inform patient-flow management and care co-ordination.

Acknowledgements

The authors would like to thank the members of the Short Life Working Group: Karen Anderson, Gordon Birnie, Jillian Galloway, Anne Hendry, Jim Hutton, Michael Kelly, Gillian McCready, Johanne Simpson and Clare Smith, who each made significant contributions to the survey criteria and methodology; and the hospitals who participated in the survey. Dr Restuccia offered helpful comments during the development phase. TW is supported by an Improvement Science Fellowship with the Health Foundation and the National Institute for Health Research (NIHR) under the Collaborations for Leadership in Applied Health Research and Care programme for north-west London. The views expressed in this publication are those of the author(s) and not necessarily those of the Health Foundation, the NHS, the NIHR or the Department of Health.

  • © 2015 Royal College of Physicians

References

  1. 1 .↵
    1. Plunkett PK
    , Byrne DG, Breslin T, Bennett K, Silke B. Increasing wait times predict mortality for emergency medical admissions. Eur J Emerg Med 2011;18:192–6.
    OpenUrlCrossRefPubMed
  2. 2 .↵
    1. Guttmann A
    , Schull MJ, Vermeulen MJ, Stukel TA. Association between waiting times and short term mortality and hospital admission after departure from emergency department: population based cohort study from Ontario, Canada. Br Med J 2011;342:d2983.
    OpenUrlAbstract/FREE Full Text
  3. 3 .↵
    1. Gertman PM
    , Restuccia JD. The appropriateness evaluation protocol: A technique for assessing unnecessary days of hospital care. Med Care 1981;19:855–71.
    OpenUrlCrossRefPubMed
  4. 4 .↵
    1. Smith HE
    , Pryce A, Carlisle L, Jones JM, Scarpello J, Pantin C. Appropriateness of acute medical admissions and length of stay. J R Coll Physicians London 1997;31:527–32.
    OpenUrlPubMed
  5. 5 .↵
    1. Brabrand M
    , Knudesn T, Hallas J. The characteristics and prognosis of patients fulfilling the appropriateness evaluation protocol in a medical admission unit; a prospective observational study. BMC Health Serv Res 2011;11:152–8.
    OpenUrlPubMed
  6. 6 .↵
    1. Apolone G
    , Tampieri FA, Bonanoni E, et al. Appropriateness of hospital use: report from an Italian study. Eur J Public Health 1997;7:34–9.
    OpenUrlAbstract/FREE Full Text
  7. 7 .↵
    1. D’Alche-Gautier M
    , Maiza D, Chastang F. Assessing the appropriateness of hospitalisation days in a French University hospital. Int J Health Care Qual Assur 2004;17:87–91.
    OpenUrl
  8. 8 .↵
    1. Fontaine P
    , Jacques J, Gillain D, Sermeus W, Kolh P, Gillet P. Assessing the causes inducing lengthening of hospital stays by means of the appropriateness evaluation protocol. Health Policy 2011;99:66–71.
    OpenUrlCrossRefPubMed
  9. 9 .↵
    1. Panis LJGG
    , Verheggen FWSM, Pop P. To stay or not to stay: the assessment of appropriate hospital stay: a Dutch report. Int J Qual Health Care 2002;14:55–67.
    OpenUrlAbstract/FREE Full Text
  10. 10 .↵
    1. De la Fuente OD
    , Peiro S, Marchan C, et al. Inappropriate hospitalisation. Eur J Public Health 1996;6:126–32.
    OpenUrlAbstract/FREE Full Text
  11. 11 .↵
    1. Soria-Aledo V
    , Carillo-Alcaraz A, Campillo-Soto A, et al. Associated factors and cost of inappropriate hospital admissions and stays in a second-level hospital. Am J Med Qual 2009;24:321–32.
    OpenUrlAbstract/FREE Full Text
  12. 12 .↵
    1. Sangha O
    , Schneeweiss S, Wildner M, et al. Metric properties of the appropriateness evaluation protocol and predictors of inappropriate hospital use in Germany: an approach using longitudinal patient data. Int J Qual Health Care 2002;14:483–92.
    OpenUrlAbstract/FREE Full Text
  13. 13 .↵
    1. Kaya S
    , Erdem Y, Dogrusoz S, Halici N. Relaibility of a hospital utilisation review in Turkey. Int J Qual Health Care 1998;10:53–8.
    OpenUrlAbstract/FREE Full Text
  14. 14 .↵
    1. Dizdar O
    , Karadag O, Kalyoncu U, et al. Appropriate utilisation of hospital beds in internal medicine: evaluation in a tertiary care hospital. J Eval Clin Pract 2007;13:408–11.
    OpenUrlCrossRefPubMed
  15. 15 .↵
    1. Dempsey J
    . The appropriateness of admissions and the influences on a decision to admit. J Qual Clin Pract 2000;20:95–9.
    OpenUrlPubMed
  16. 16 .↵
    1. Sanchez-Garcia S
    , Juarez-Cedillo T, Mould-Quevedo JF, et al. The hospital appropriateness evaluation protocol in elderly patients: a technique to evaluate admission and hospital stay. Scand J Caring Sci 2008;22:306–13.
    OpenUrlCrossRefPubMed
  17. 17 .↵
    1. Gamper G
    , Wiedermann W, Barisonzo R, Stockner I, Wiedermann CJ. Inappropriate hospital admission: interaction between patient age and co-morbidity. Intern Emerg Med 2011;6:361–7.
    OpenUrlPubMed
Back to top
Previous articleNext article

Article Tools

Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Citation Tools
Identifying reasons for delays in acute hospitals using the Day-of-Care Survey method
Erica Reid, Andrew King, Alex Mathieson, Thomas Woodcock, Simon W Watkin
Clinical Medicine Apr 2015, 15 (2) 117-120; DOI: 10.7861/clinmedicine.15-2-117

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Identifying reasons for delays in acute hospitals using the Day-of-Care Survey method
Erica Reid, Andrew King, Alex Mathieson, Thomas Woodcock, Simon W Watkin
Clinical Medicine Apr 2015, 15 (2) 117-120; DOI: 10.7861/clinmedicine.15-2-117
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • ABSTRACT
    • Introduction
    • Literature review
    • Methodology
    • Results
    • Discussion
    • Acknowledgements
    • References
  • Figures & Data
  • Info & Metrics

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Is "boarding" appropriate to help reduce crowding in emergency departments?
  • Google Scholar

More in this TOC Section

  • The Francis Crick Institute
  • The new UK internal medicine curriculum 
  • ‘Every breath we take: the lifelong impact of air pollution’ – a call for action
Show more Professional Issues

Similar Articles

FAQs

  • Difficulty logging in.

There is currently no login required to access the journals. Please go to the home page and simply click on the edition that you wish to read. If you are still unable to access the content you require, please let us know through the 'Contact us' page.

  • Can't find the CME questionnaire.

The read-only self-assessment questionnaire (SAQ) can be found after the CME section in each edition of Clinical Medicine. RCP members and fellows (using their login details for the main RCP website) are able to access the full SAQ with answers and are awarded 2 CPD points upon successful (8/10) completion from:  https://cme.rcplondon.ac.uk

Navigate this Journal

  • Journal Home
  • Current Issue
  • Ahead of Print
  • Archive

Related Links

  • ClinMed - Home
  • FHJ - Home
clinmedicine Footer Logo
  • Home
  • Journals
  • Contact us
  • Advertise
HighWire Press, Inc.

Follow Us:

  • Follow HighWire Origins on Twitter
  • Visit HighWire Origins on Facebook

Copyright © 2021 by the Royal College of Physicians