Intended for healthcare professionals

Education And Debate Understanding controlled trials

What outcomes should be measured?

BMJ 1998; 317 doi: https://doi.org/10.1136/bmj.317.7165.1075 (Published 17 October 1998) Cite this as: BMJ 1998;317:1075
  1. Martin Roland, director of research and developmenta,
  2. David Torgerson, senior research fellowb
  1. aNational Primary Care Research and Development Centre, University of Manchester, Manchester M13 6PL
  2. bCentre for Health Economics, University of York,York YO1 5DD
  1. Correspondence to Dr Roland

    Many types of clinical, patient related, and economic outcomes can be measured in trials. The choice of one or more outcomes will depend on the nature of the study and the question it is trying to answer. Objectives can relate to different levels of observation and analysis,from the individual to the family, the community, and society as a whole.

    If a trial is “explanatory”1then a single main measure of clinical outcome may be appropriate. For example, if a trial is designed to determine which of two antihypertensive agents is more effective at lowering blood pressure then hypertensive control will be the main outcome. Traditionally, clinical trials have used physiological or biomedical outcomes, but these may not be well related to clinical outcomes. One example of a surrogate outcome measure which misled investigators was the CD4 count in AIDS trials: this turned out to be a poor predictor of survival.2 Thus the use of physiological surrogates which are not clearly related to health outcomes must be viewed with caution.

    A range of health status measures have been developed to address the poor relation which may exist between clinical outcomes and outcomes that are important to patients. These attempt to capture the patient's experience using valid and reliable quantitative scales. 3 4They generally aim to quantify the extent to which an illness affects a patient's ability to carry out a range of normal activities. They may be related to abilities across a wide range of activities or targeted at problems associated with specific diseases. A common approach is to use both a general and a disease specific measure within one trial.

    In pragmatic trials a single outcome measure may be inadequate for clinicians and other healthcare decision makers to weigh up the risks, costs, and benefits of a given intervention. Several outcome measures are therefore commonly included. For example, in trials of back pain, the Cochrane Collaboration recommends that outcomes should include pain, functional status, ability to work, and satisfaction with treatment.5 In another example a recent trial sought to compare evening and night care given by doctors from commercial deputising services with that given by a doctor from the patient's own practice; the outcomes included whether the patient was actually visited, what prescriptions were given, whether there was any difference in health outcome for patients, and whether care from one type of doctor was more likely to increase subsequent use of health services. 6 7 The use of a wide range of outcomes is likely to be more informative for decision makers than a single outcome measure.

    The impact of a disease may extend beyond the individual to the family or carers —for example, in dementia8 —so the outcomes measured might need to be extended to a wider group. Similarly, at a societal level, if an aim of the study is to influence resource allocation between different types of treatment then economic outcomes will need to be included.9

    Although it is often advisable to use several different outcome measures, some have advocated that the very large trials needed to answer certain types of clinical problem should focus on a small number of very simple outcomes.10 There is also a statistical drawback to using multiple outcome measures. Increasing the number of measures in a trial increases the probability that one will reach statistical significance on the basis of chance alone. When a research question requires that several separate outcomes should be separately assessed, this needs to be taken into account in the sample size calculation. In general, more subjects are needed when several outcomes are being measured.

    References

    View Abstract