Skip to main content

Main menu

  • Home
  • Our journals
    • Clinical Medicine
    • Future Healthcare Journal
  • Subject collections
  • About the RCP
  • Contact us

Future Healthcare Journal

  • FHJ Home
  • Content
    • Current
    • Ahead of print
    • Archive
  • Author guidance
    • Instructions for authors
    • Submit online
  • About FHJ
    • Scope
    • Editorial board
    • Policies
    • Information for reviewers
    • Advertising

User menu

  • Log in

Search

  • Advanced search
RCP Journals
Home
  • Log in
  • Home
  • Our journals
    • Clinical Medicine
    • Future Healthcare Journal
  • Subject collections
  • About the RCP
  • Contact us
Advanced

Future Healthcare Journal

futurehosp Logo
  • FHJ Home
  • Content
    • Current
    • Ahead of print
    • Archive
  • Author guidance
    • Instructions for authors
    • Submit online
  • About FHJ
    • Scope
    • Editorial board
    • Policies
    • Information for reviewers
    • Advertising

Including a wider range of values in healthcare policy: how can public value evaluation help?

Lorelei Jones
Download PDF
DOI: https://doi.org/10.7861/fhj.2022-0109
Future Healthc J November 2022
Lorelei Jones
ABangor University, Bangor, UK
Roles: lecturer in healthcare organisation and governance
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: lorelei.jones@bangor.ac.uk
  • Article
  • Figures & Data
  • Info & Metrics
Loading

ABSTRACT

To meet future healthcare challenges a broader range of values need to be included in analysis, debate and policy. Different modes of governance foreground and facilitate different values. Collaboration, the governing principle of the newly formed integrated care systems, values the contribution of diverse stakeholders in discussions and decisions, to foster creativity and produce durable solutions to complex problems. Approaches to evaluation reinforce particular values, as captured in the adage ‘what's measured is what matters’. New approaches are needed to support the collaborative aims of integrated care systems. Public value evaluation proceeds through values inquiry, establishing what is important to different stakeholders (including policy makers, healthcare staff, patients and communities) as a backdrop to understanding the effects of policies and programmes.

KEYWORDS:
  • healthcare governance
  • NHS
  • values
  • evaluation

Introduction

It is increasingly recognised that meeting future healthcare challenges requires policy and systems to incorporate a wider range of values. The philosopher Alan Cribb, for example, has argued for more ‘expansive’ healthcare policy, beyond a narrow concern with technical solutions, cost control and clinical effectiveness.1 While these dimensions of healthcare remain important, and a legitimate concern of governments, healthcare policies and systems need to include the values of the people who make them work and who they are meant to serve. From this vantage point, staff, patients and communities are not problems for implementation, but valuable sources of knowledge and potential solutions; and collaboration with stakeholders is important for creativity and durable innovations.2,3

The COVID-19 pandemic has exposed the way that health policies and systems can exclude many things that people value: the wellbeing of children and young people, the presence of friends and family, and the rituals (such as funerals) that provide comfort for the grieving and are essential for healing in the long term. New approaches to healthcare analysis and evaluation are incorporating a wider range of values, such as person-centred care, the emotional wellbeing of staff and justice.4–6 These approaches consider not just what is of value to individuals but those values that are shared by communities; for example, recent research published in this journal has analysed hospital services not just in terms of cost, efficiency and quality, but also in terms of the contribution to the broader social and economic fabric of the communities in which they sit.7 Herein, I explore how values are manifested in healthcare governance in England, and how public value evaluation can support more inclusive and expansive healthcare analysis, debate and policy.

Values in healthcare governance

Different modes of healthcare governance (hierarchy, competition and collaboration) foreground and facilitate different values. Each implies different practices and is embedded in a broader system of ideas about how to administer and organise healthcare: hierarchy in bureaucracies, competition in markets and collaboration in networks.

In a hierarchically organised bureaucratic welfare state, importance is given to assuring citizens' rights to access services. Even those aspects of bureaucracy that are often seen as downsides (such as inertia and ‘red tape’) are valued for the way that they protect citizens' rights from the vagaries of political interests and the subjective decisions of staff.9 Bureaucracies value political and professional knowledge. Politicians are assumed to represent citizens interests and professionals are trained to take citizens' needs into account. Authority sits with government and decisions are implemented from the top down through hierarchical layers of distributed responsibilities. Service change and quality improvement is initiated through top-down strategic planning and new professional standards.10 Hierarchy has been a feature of the NHS in England since its inception, and even when national policy has introduced different governance mechanisms (such as competition or collaboration), it has remained as an important cultural template that influences what happens and what is done at different levels.11 The persistence of hierarchy is a feature of tax-funded systems (such as the NHS) where citizens and their representatives ‘will, in one way or another, sooner or later, insist on accountability on the part of those who act in their name using resources appropriated from them.’12

The widespread use of competition in healthcare governance dates from the 1980s, prompted by concerns over public expenditure.13 Competition is the core governance mechanism of markets and is valued for its potential to secure efficiency. Markets value management knowledge, particularly as it relates to the practices of the private sector. Politicians act as ‘meta-governors’ ensuring the conditions are in place to support competition. In theory, service change and improvement are driven by the choices made by citizens between different services. In practice, the nature of healthcare markets mean that insurers or commissioners tend to act as a ‘proxy consumer’. Elements of competition have featured in national policies in the NHS in England since 1990, becoming a statutory obligation in the Health and Social Care Act 2012.14 This obligation was removed in the Health and Care Act 2022, as collaboration replaced competition as a key governance mechanism in national healthcare policy.15

Integrated care systems (ICSs), formally established in the NHS in England in July 2022, are an example of networks, in this case, locality-based networks that bring together health and social care partners (including commissioners, providers, and local authorities) to collectively plan health and care services to meet the needs of the population. A key objective of ICSs is to reduce the long-standing problem of fragmentated care experienced by patients. The key governing mechanism of networks is collaboration. Collaboration is often seen as beneficial to durable public-sector innovation in the way that it supports the incorporation of diverse perspectives, essential for creativity and real-world effectiveness of programmes and interventions.3 Collaborative networks value the knowledge of a range of stakeholders, which in healthcare may include different health and social care providers, other public sector agencies, private sector organisations, and patients and citizens. As with competition, the role of politicians in collaborative networks is as ‘meta-governors’ ensuring the necessary conditions are in place to support collaboration. The role of professionals is as experts, working collaboratively with other stakeholders to create new policies and solutions to complex problems. For collaboration to be successful, all relevant stakeholders need to be included, there needs to be trust between different stakeholders, and an appreciation of different interests and values. Importantly, there needs to be commitment to the process of good faith bargaining for mutual gain and consensus-orientated decision making.16

ICSs have, however, been introduced into local settings that still bear the remnants of earlier modes of governance, namely a previous policy commitment to the use of healthcare markets and enduring forms of hierarchy. Historical shifts in healthcare governance have left behind layers of practices and ideas that have accumulated over time and become ‘sedimented’, creating a complex mix of governance mechanisms and forms of valuation.11 The effects of policies and programmes are shaped by how these different mechanisms interact in local settings; for example, networks are often introduced to engender local flexibility, innovation and pace of change. The effect of hierarchies on networks, however, is to reduce their autonomy, distinctiveness and effectiveness.17

The relative influence of different modes of governance on activities varies across localities, dependent, in part, on local culture and traditions. In some localities, the NHS hierarchy continues to be the main influence on the priorities of healthcare managers, even in the absence of bureaucratic structures.11 In these instances, the NHS hierarchy continues to work through hard forms of power (such as budgets and central targets) but also through ‘soft power’ (such as forms of data collection, analysis and evaluation). In the example of integrated care networks, research has shown how the requirements of data collection and analysis direct the focus of local staff to central government priorities (such as activity and cost savings) rather than network objectives (such as improved patient experience and care coordination).11 Evaluation can work the same way, foregrounding and reinforcing some values and excluding others, as captured in the expression ‘what's measured is what matters’.

Public value evaluation

Different governing arrangements need different approaches to evaluation. New approaches are needed to support the objectives of ICSs for inclusive decision making and durable innovation, and as a check against the tendency for the priorities of the NHS hierarchy to displace local plans. Public value evaluation is one approach that can be used to include a wider range of values in analysis. Public value evaluation is based on the scholarship of John Moore who produced a policy implementation framework based on a study of the real-world work of public sector managers.18 In this framework, public sector organisations produce ‘public value’, a concept analogous to that of shareholder value in the private sector. This is done within the limits set by the authorising environment and organisational capacity (Fig 1).18

Fig 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig 1.

The public value implementation triangle.

Fig 1 draws our attention to key analytical components of public sector policies and programmes.

  • They create something that is valued by stakeholders. As the inevitable product of politics, this is not an absolute standard but necessarily historically and geographically emergent.

  • The authorising context for management strategy requires that this is seen to be legitimate and politically sustainable, ie able to attract sufficient ongoing support and resources from political and other stakeholders.

  • Management strategies must be operationally and administratively feasible.

The framework is empirically grounded and has strong face validity with public sector managers.19 This suggests that it is a potentially useful evaluation framework. To the extent that it foregrounds important features of the empirical reality of policy implementation, it is especially useful for identifying contingencies that can explain the effects of any given policy and programme. The concept of public value has been interpreted in different ways, so researchers must be clear about how they are using the term.19 What follows is my own interpretation of how the implementation triangle can be used in policy and programme evaluation.

Orthodox approaches to policy and programme evaluation in healthcare often proceed by identifying the objectives or eliciting the ‘programme theory’ of a policy.20 In contrast, a public value evaluation begins by exploring what is important to relevant stakeholders. When I use the term ‘stakeholders’, I am referring to all social groups who have a stake in the policy or programme. In healthcare contexts, this may include policy makers, managers, clinicians, patients and communities. What I am suggesting is an approach to evaluation that asks the following questions.

  • What do different stakeholders value? And what are the effects of the policy or programme for these values?

  • What outcomes or attributes of the policy or programme do different stakeholders value?

The proposed approach, therefore, combines a ‘bottom up’ and ‘top down’ perspective. The ‘bottom up’ perspective considers what is important to different stakeholders, as a backdrop for analysis of the effects of the policy or programme. This broad lens can capture the full range of effects: benefits and disbenefits, both intended and unintended, for participants and non-participants. The ‘top-down’ perspective considers how a specific policy or programme is experienced, interpreted and adopted by different stakeholders, which is essential for understanding and explaining effects. This perspective considers both processes and outcomes. This is important because care processes are often highly valued by people, especially patients and families.21

A key feature of the approach I am proposing is that it includes not just the benefits to individuals but also broader social and collective benefits. It also includes more intangible benefits, such as social capital. Social capital has been defined as ‘features of social organization, such as networks, norms, and trust, that facilitate coordination and cooperation for mutual benefit.’22 Some notion of social benefits is often included in orthodox approaches to evaluation. In the Kellogg logic model, for example, it is included under long-term ‘impacts’. Nevertheless, in practice, the focus is predominantly on individual outcomes, and while the causal pathway to longer-term impacts is often specified, these are not themselves measured.23 Public value evaluation is particularly well-suited to public sector policies and programmes where there are distinctly public values, such as fairness, justice, equality and the production of public goods.23

An additional benefit of using Moore's implementation triangle as a framework for evaluation is that it identifies important constraints on policy implementation, namely features of the authorising environment and organisational capacity. This avoids the problem of ‘thin’ analyses comprising lists of well known ‘barriers and facilitators’. Instead, analysis focuses on how benefits are produced in public sector settings. Here social science-based analysis can explain how and why programme effects are produced and the necessary conditions for success.24,25 While this is often touched on in orthodox approaches to evaluation, especially input evaluation and process evaluation, there is often insufficient attention to the capacity of the delivery organisation to produce public value.23

What different stakeholders value in any given setting is not absolute, but historically and geographically emergent. Public value evaluation strategies are, therefore, flexible to fit the particular circumstances. There are lots of different methods to choose from when designing an evaluation strategy, with a ‘mixed methods’ approach likely to support a more complete picture of what different stakeholders value and the range of policy and programme effects. Qualitative methods (such as individual or group interviews) could be used for initial exploration of stakeholder values. Arts-based approaches or appreciative inquiry may be useful here. I have recently used vignettes (scenarios) to open conversations with patients about what they value about NHS dentistry.26 Systematically collecting qualitative data could also be used to capture programme effects, for example, by using the Community Capitals Framework, which identifies seven forms of capital (cultural, human, social, political, financial, built and natural), or Ripple Effect Mapping, a form of mind mapping that helps a group reflect on the broader effects of a programme.23,27 There are also an increasing choice of innovative quantitative methods and forms of economic evaluation (such as social network analysis and sophisticated cost-benefit analysis).

The broader lens afforded by public value evaluation has many benefits. Importantly, it can be used to include the values of stakeholders previously excluded from analysis; for example, the wellbeing of healthcare staff, what is important to hospital inpatients, what communities value about healthcare facilities, and what is important to children and young people who are the target of policies and programmes.7,28–30 The contribution is in broadening and deepening analysis; for example, it might include the social and human needs of workers, the importance of good working relationships and meaningful work. By mapping the range of stakeholders, and what is important to them, the evaluation is more relevant to stakeholders. There will be tensions between different values, these are inevitable in decisions about public services. It is, nevertheless, important to make a wider range of values visible to enhance conversations and support collaborative processes.

Conclusion

ICSs have the opportunity to include a wider range of voices and values in healthcare planning, with the potential to produce creative and durable solutions to complex problems. However, ICSs are vulnerable to being captured by the values of markets and top-down concerns with cost and activity. Public value evaluation can act as a check on these tendencies by including multiple stakeholders and assessing policies and programmes against a wider range of values.

  • © Royal College of Physicians 2022. All rights reserved.

References

  1. ↵
    1. Cribb A
    . Healthcare in transition: Understanding key ideas and tensions in contemporary health policy. Policy Press, 2017.
  2. ↵
    1. Biehl J
    , Petryna A (eds). When people come first: critical studies in global health. Princeton University Press, 2013.
  3. ↵
    1. Ansell C
    , Torfing J (eds). Public innovation through collaboration and design. Routledge, 2014.
  4. ↵
    1. De Foo C
    , Haldane V, Jung AS, et al. Isolation facilities for COVID-19: towards a person centred approach. BMJ 2022;378:e069558.
    OpenUrlFREE Full Text
  5. ↵
    1. Jones L
    , Fulop N. The role of professional elites in healthcare governance: Exploring the work of the medical director. Soc Sci Med 2021;277:113882.
    OpenUrlPubMed
  6. ↵
    1. Cribb A
    , O'Hara JK, Waring J. Improving responses to safety incidents: we need to talk about justice. BMJ Qual Saf 2022;31:327–30.
    OpenUrlFREE Full Text
  7. ↵
    1. Vaughan L
    , Edwards N. The problems of smaller, rural and remote hospitals: separating facts from fiction. FHJ 2020;7:38.
    OpenUrl
    1. Weber M
    . The theory of social and economic organisation. Collier Macmillan Publishers, 1948
  8. ↵
    1. Du Gray P
    . In praise of bureaucracy: Weber, organization, ethics. Sage, 2000.
  9. ↵
    1. Boch Waldorff S
    , Sodervist K, Vind Ebbesen B. The complexity of governance: challenges for public sector innovation. In: Ansell C, Torfing J (eds). Public innovation through collaboration and design. Routledge, 2014.
  10. ↵
    1. Jones L
    . Sedimented governance in the English National Health Service. In: Bevir M, Waring J (eds). Decentring health policy: learning from British experiences in healthcare governance. Routledge, 2017.
  11. ↵
    1. Lynn L
    . The persistence of hierarchy. In: Bevir M (ed). The sage handbook of governance. Sage, 2011.
  12. ↵
    Health and Social Care Act 2012, c.7. www.legislation.gov.uk/ukpga/2012/7/contents/enacted
  13. ↵
    Health and Care Act 2022, c.31. www.legislation.gov.uk/ukpga/2022/31/contents/enacted
  14. ↵
    1. Hood C
    . A public administration for all seasons? Public Administration 1991;69:3–19.
    OpenUrlCrossRef
  15. ↵
    1. Ansell C
    , Gash A. Collaborative governance in theory and practice. Journal of Public Administration Research and Theory 2008;18:543–71.
    OpenUrlCrossRef
  16. ↵
    1. Rhodes RAW
    . Understanding governance: ten years on. Organization Studies 2007;28:1243–64.
    OpenUrlCrossRef
  17. ↵
    1. Moore M
    . Creating public value: Strategic management in government. Harvard University Press, 1995.
  18. ↵
    1. Hartley J
    , Alford J, Knies E, Douglas S. Towards an empirical research agenda for public value theory. Public Management Review 2017;19:670–85.
    OpenUrl
  19. ↵
    1. Manzano A
    , Pawson R. Evaluating deceased organ donation: a programme theory approach. J Health Organ Manag 2014;28:366–85.
    OpenUrl
  20. ↵
    1. Mol A
    . The logic of care: Health and the problem of patient choice. Routledge, 2008.
  21. ↵
    1. Putnam R
    . The prosperous community: Social capital and public life. The American Prospect 1993;13:35–42.
    OpenUrl
  22. ↵
    1. Chazdon S
    , Paine N. Evaluating for public value: clarifying the relationship between public value and program evaluation. Journal of Human Sciences and Extension 2014;2:100–19.
    OpenUrl
  23. ↵
    1. Jones L
    , Pomeroy L, Robert G, et al. Explaining organisational responses to a board-level quality improvement intervention: findings from an evaluation in six providers in the English National Health Service. BMJ Qual Saf 2019;28:198–204.
    OpenUrlAbstract/FREE Full Text
  24. ↵
    1. Burgess N
    , Currie G, Crump B, Dawson A. Leading change across a healthcare system: How to build improvement capability and foster a culture of continuous improvement. Warwick Business School, 2022.
  25. ↵
    1. Jones L
    . What do patients value in value-based health care? 13th Organisational Behaviour in Health Care conference, Birmingham University, 2022.
  26. ↵
    1. Flora C
    , Flora J. Rural communities: Legacy and change. Westview Press, 2008.
  27. ↵
    1. Lawton R
    , Thomas EJ. Overcoming the ‘self-limiting’ nature of QI: can we improve the quality of patient care while caring for staff? BMJ Qual Saf 2022 [Epub ahead of print].
  28. ↵
    1. Pannick S
    , Archer S, Long SJ, et al. What matters to medical ward patients, and do we measure it? A qualitative comparison of patient priorities and current practice in quality measurement, on UK NHS medical wards. BMJ Open 2019;9:e024058.
    OpenUrlAbstract/FREE Full Text
  29. ↵
    1. Mulgan G
    , Breckon J, Tarrega M, et al. Public value: how can it be measured, managed and grown? Nesta, 2019.
Back to top
Previous articleNext article

Article Tools

Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Citation Tools
Including a wider range of values in healthcare policy: how can public value evaluation help?
Lorelei Jones
Future Healthc J Nov 2022, 9 (3) 222-225; DOI: 10.7861/fhj.2022-0109

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Including a wider range of values in healthcare policy: how can public value evaluation help?
Lorelei Jones
Future Healthc J Nov 2022, 9 (3) 222-225; DOI: 10.7861/fhj.2022-0109
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • ABSTRACT
    • Introduction
    • Values in healthcare governance
    • Public value evaluation
    • Conclusion
    • References
  • Figures & Data
  • Info & Metrics

Related Articles

  • No related articles found.
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Values and value in patient and public involvement: moving beyond methods
  • Taking one step further: five equity principles for hospitals to increase their value as anchor institutions
Show more Value and values

Similar Articles

FAQs

  • Difficulty logging in.

There is currently no login required to access the journals. Please go to the home page and simply click on the edition that you wish to read. If you are still unable to access the content you require, please let us know through the 'Contact us' page.

  • Can't find the CME questionnaire.

The read-only self-assessment questionnaire (SAQ) can be found after the CME section in each edition of Clinical Medicine. RCP members and fellows (using their login details for the main RCP website) are able to access the full SAQ with answers and are awarded 2 CPD points upon successful (8/10) completion from:  https://cme.rcplondon.ac.uk

Navigate this Journal

  • Journal Home
  • Current Issue
  • Ahead of Print
  • Archive

Related Links

  • ClinMed - Home
  • FHJ - Home

Other Services

  • Advertising
futurehosp Footer Logo
  • Home
  • Journals
  • Contact us
  • Advertise
HighWire Press, Inc.

Follow Us:

  • Follow HighWire Origins on Twitter
  • Visit HighWire Origins on Facebook

Copyright © 2021 by the Royal College of Physicians