Journal Information
Vol. 22. Issue 3.
Pages 175-176 (01 May 2018)
Share
Share
Download PDF
More article options
Vol. 22. Issue 3.
Pages 175-176 (01 May 2018)
Editorial
Full text access
The importance of determining the clinical significance of research results in physical therapy clinical research
Visits
3650
Susan Armijo-Olivoa,b
a University of Alberta, Faculty of Rehabilitation Medicine, Faculty of Medicine and Dentistry, Edmonton, Canada
b Institute of Health Economics, Edmonton, Canada
This item has received
Article information
Full Text
Bibliography
Download PDF
Statistics
Full Text

Clinical research in physical therapy is fundamental to generate new knowledge and validate our therapies. The evaluation of research findings is crucial to help clinical decision making and to comply with the principles of evidence based-practice. Statistical significance testing has dominated the way researchers typically report their results and evaluate their significance.1,2 This approach has been commonly used to determine the importance and generalizability of research results and to demonstrate the effect of an intervention in health research. However, this approach has limited use for clinicians and decision makers trying to offer the best possible treatment to patients.

Statistical significance is based on hypothesis testing (i.e. null hypothesis vs. alternative hypothesis).3 The decision to accept or reject the null hypothesis is based on predetermined levels of probability (i.e. p<0.05 or 0.01) used to test the strength of the evidence against the null hypothesis.4 The dichotomous choice that emerges from the hypothesis testing procedure (i.e. null hypothesis rejected or accepted) does not provide any insights whether the results of the study are important for different stakeholders such as patients, clinicians, and decision makers.5,6

Statistical significance does not assure that the results are clinically relevant. Indeed, the use of null hypothesis significance testing rarely determines the practical importance or clinical relevance of findings.1,7 In addition, statistical significance can also provide misleading results to the clinical community since a statistical difference between groups could be found if the sample size was large and/or if the inter-subject variability was low, even though the difference between groups was small to be considered clinically important by the patients or clinicians.5 This has been exemplified in one of our studies, where a difference between subjects with TMD and healthy controls on head and cervical posture was statistically significant but that difference was only 3.3°, [95%CI 0.15, 6.41], which according to any clinician working on the field, would not be clinically relevant since clinicians generally use clinical observation or in some cases, photographs to evaluate posture and it is unlikely that this assessment would allow to consistently detect such a small difference.

Given the limitations of statistical significance, it is relevant for physical therapy practice that results of clinical research are analyzed having in mind the clinical relevance of the results. The question whether a patient has improved in a meaningful way is fundamental to improve clinical decision making regarding treatment management. Since clinicians are interested in whether or not the intervention had an impact on clinical outcomes and also in the magnitude of such impact, relying solely on statistical significance to conclude about relevance of results seems to be limited and insufficient.

Clinical relevance (also known as clinical significance) indicates whether the results of a study are meaningful or not for several stakeholders.7 A clinically relevant intervention is the one whose effects are large enough to make the associated costs, inconveniences, and harms worthwhile.8 Clinical relevance facilitates the understanding and interpretation of results for clinicians. In physical therapy, the assessment of this approach has become a popular method to assist the transfer of knowledge into clinical practice.1,7,9

Diverse methodologies have been developed in the attempt to determine the clinical significance of an intervention. The most common methods are the “distribution-based methods” and the “anchor-based methods”. The calculation of the effect size (ES), the minimum detectable change (MDC)/difference (MDD),10 and the standard error of measurement (SEM) are examples of the distribution-based methods.1,7 Anchor-based methods involve the client's perspective using an anchor, commonly the use of the Global Rating Scale of Change (GRSC)2 to define the minimal important difference (MID). Researchers and clinicians interested in these methods are encouraged to see Jaeschke et al.,2 Armijo-Olivo et al.,7 Musselman,1 as well as De Vet et al.,10 for a complete description.

Researchers conducting clinical trials in the field of physical therapy have the obligation to report the clinical relevance of results to the clinical community to adhere to the principles of evidence based practice. This will help disseminate evidence in a useful and understandable way for end-users such as patients, health care clinicians, and policy/decision-makers. The information of “p” values is insufficient to achieve these requirements and because it provides insufficient and limited information, clinical researchers needed to present the clinical relevance of their results to help busy clinicians with interpretation and easy uptake of research results in clinical practice.

References
[1]
K.E. Musselman.
Clinical significance testing in rehabilitation research: what, why, and how?.
Phys Ther Rev, 12 (2007), pp. 287-296
[2]
R. Jaeschke, J. Singer, G.H. Guyatt.
Measurement of health status ascertaining the minimal clinically important difference.
Control Clin Trials, 10 (1989), pp. 407-415
[3]
R.E. Kirk.
Practical significance: a concept whose time has come.
Educ Psychol Meas, 56 (1996), pp. 746-759
[4]
J.A.C. Sterne, G.D. Smith.
Sifting the evidence – whats wrong with significance tests?.
Br Med J, 322 (2001), pp. 226-231
[5]
S.R. Millis.
Emerging standards in statistical practice: implications for clinical trials in rehabilitation medicine.
[6]
B.M. Ogles, K.M. Lunnen, K. Bonesteel.
Clinical significance: history, application, and current practice.
Clin Psychol Rev, 21 (2001), pp. 421-446
[7]
S. Armijo-Olivo, S. Warren, J. Fuentes, D. Magee.
Clinical relevance vs. statistical significance: using neck outcomes in patients with TMD as an example.
Man Therapy, 16 (2011), pp. 563-572
[8]
M.L. Ferreira, R.D. Herbert.
What does clinically important really mean?.
Aust J Physiother, 54 (2008), pp. 229-230
[9]
M.L. Ferreira, P.H. Ferreira, R.D. Herbert, J. Latimer.
People with low back pain typically need to feel ‘much better’ to consider intervention worthwhile: an observational study.
Aust J Physiother, 55 (2009), pp. 123-127
[10]
H.C. de Vet, C.B. Terwee, R.W. Ostelo, H. Beckerman, D.L. Knol, L.M. Bouter.
Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change.
Health Qual Life Outcomes, (2006), pp. 4
Copyright © 2018. Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia
Idiomas
Brazilian Journal of Physical Therapy
Article options
Tools
en pt
Cookies policy Política de cookies
To improve our services and products, we use "cookies" (own or third parties authorized) to show advertising related to client preferences through the analyses of navigation customer behavior. Continuing navigation will be considered as acceptance of this use. You can change the settings or obtain more information by clicking here. Utilizamos cookies próprios e de terceiros para melhorar nossos serviços e mostrar publicidade relacionada às suas preferências, analisando seus hábitos de navegação. Se continuar a navegar, consideramos que aceita o seu uso. Você pode alterar a configuração ou obter mais informações aqui.