Journal Information
Vol. 21. Issue 1.
Pages 69-73 (01 January 2017)
Share
Share
Download PDF
More article options
Visits
2499
Vol. 21. Issue 1.
Pages 69-73 (01 January 2017)
Original Research
Full text access
Construct and discriminant validity of STarT Back Screening Tool – Brazilian version
Visits
2499
Bruna Pilza,b,
Corresponding author
brunapilzm@yahoo.com.br

Corresponding author at: Instituto Wilson Mello, Fisioterapia, Rua José Rocha Bonfim, 214, Condomínio Praça Capital, Ed. Chicago, 1° andar, Santa Genebra, CEP: 13080-650 Campinas, SP, Brazil.
, Rodrigo A. Vasconcelosa,b, Paulo P. Teixeiraa,c, Wilson Melloa,c, Freddy B. Marcondesa,d, Jonathan C. Hille, Débora B. Grossib
a Núcleo de Estudos e pesquisa, Instituto Wilson Mello, Campinas, São Paulo, Brazil
b Programa de Pós-graduação em Reabilitação e Desempenho Funcional, Faculdade de Medicina de Ribeirão Preto (FMRP), Universidade de São Paulo (USP), Ribeirão Preto, SP, Brazil
c Departamento de Ortopedia, Grupo do Joelho de Campinas (GJC), Campinas, SP, Brazil
d Departamento de Ciências da Cirurgia, Faculdade de Ciências Médicas, Universidade Estadual de Campinas (UNICAMP), Campinas, SP, Brazil
e Research Institute for Primary Care & Health Sciences, Keele University, Keele, Staffordshire, United Kingdom
Highlights

  • SBST-Brazil showed a moderate to good correlation with disability tools.

  • SBST-Brazil demonstrated weak correlations with fear-avoidance beliefs.

  • SBST-Brazil discriminates LBP patients with disability and fear-avoidance beliefs.

This item has received
Article information
Abstract
Full Text
Bibliography
Download PDF
Statistics
Tables (3)
Table 1. Subjects’ demographic and clinical characteristics.
Table 2. Construct validity of the SBST-Brazil total and psychosocial subscale scores.
Table 3. Discriminant validity: AUC for screening SBST-Brazil total scores and psychosocial subscale scores. Against reference cases at baseline.
Show moreShow less
Abstract
Background

The STarT Back Screening Tool (SBST) was developed to stratify low back pain patients according to their risk of future physical disability so that prognostic subgroups can receive matched treatments in primary care.

Objective

To measure the construct and discriminative validity of the SBST-Brazil questionnaire.

Method

A hundred and fifty one patients were recruited to test the construct and discriminative validity comparing the SBST-Brazil to the Brazilian Version of the Oswestry Disability Index (ODI), Roland Morris Disability Questionnaire (RMDQ) and Fear-Avoidance Beliefs Questionnaire-Work (FABQ-W) and Physical Activity (FABQ-PA) subscales at baseline. Spearman's rank-order correlation and area under the curve (AUC) derived from receiver operating curves (ROC) for total scores and psychosocial subscale score of the SBST-Brazil were used for construct and discriminant validity analysis, respectively.

Results

The SBST-Brazil total and psychosocial subscale scores had good and moderate correlation with ODI (r=0.61; r=0.56, respectively) and good with RMDQ (r=0.70; r=0.64, respectively). Both scores of the SBST-Brazil total and psychosocial subscale correlated weakly and moderately with the FABQ-PA (r=0.28; r=0.34, respectively) and weakly with the FABQ-W (r=0.18; r=0.20, respectively). The discriminant validity with AUCs for the total and psychosocial subscale scores against reference standard ranged from 0.66 for kinesiophobia to 0.88 for disability.

Conclusion

The SBST-Brazil showed a moderate to good correlation with the disability tools, but a weak correlation with fear-avoidance beliefs. The results of discriminant validity suggest that SBST-Brazil is able to discriminate low back pain patients with disability and fear-avoidance beliefs.

Keywords:
Physical therapy
Low back pain
STarT Back Screening Tool
Outcome measurement
Validity
Full Text
Introduction

The high prevalence of low back pain (LBP) and its socioeconomic implications have led to a search for improved methods of diagnosis, treatment, and especially assessment of physical disability, which may be either temporary or permanent.1 Currently, LBP is the primary cause of years lived with disability in Brazil, as well as in most developed and developing countries.2 Many psychosocial factors, such as fear, kinesiophobia, depression, pain catastrophizing, and bothersomeness, can influence the prognosis of LPB patients, increasing the chance of developing chronic pain over time.3–7

The early identification of individuals who are at risk of poor clinical outcomes is an important component in the management of LBP. Identification of elevated psychosocial factors has been strongly linked to poor clinical outcomes in a variety of health care settings.3,6,8,9 The optimal method of assessing psychosocial factors is the subject of debate.10

More recently, the STarT Back Screening Tool (SBST) was developed and validated by Hill et al.11 to identify subgroups of patients and to guide initial treatment decision-making in primary care.8,11–13 The SBST has already been translated and cross-culturally adapted to Brazilian Portuguese (SBST-Brazil).12 Its reliability (measured by intraclass correlation coefficient) has been tested, showing acceptable results of 0.79 (95% CI 0.63–0.95) for the classification score, Standard Error Measurement (SEM) of 1.9%, and internal consistency of 0.74 for the SBST total score and 0.70 for the SBST psychosocial subscale score.12 The Brazilian version also showed good correlation with OMPSQ (r=0.73), as well as with the Tampa Scale of Kinesiophobia (TSK) (r=0.60) and with the Roland Morris Disability Questionnaire (RMDQ) (r=0.76). However, when correlated with pain intensity at the time of assessment, it demonstrated moderate correlation (r=0.31).14 Some other versions of the SBST have also been translated and have had their psychometric properties tested.1,11,15–19 It is adequate that the Brazilian version of the SBST has its construct and discriminative validity established, as this will increase its applicability and external validity.

The aim of this study is to measure the construct and discriminative validity of the SBST-Brazil questionnaire by assessing its association with the Oswestry Disability Index (ODI), the Roland Morris Disability Questionnaire (RMDQ), and the Fear-Avoidance Beliefs Questionnaire-Work (FABQ-W) and Physical Activity (FABQ-PA) subscales in a sample of low back pain patients.

MethodSample

One hundred and fifty one patients were conveniently recruited at a private clinic called Instituto Wilson Mello in Campinas, SP, Brazil. All subjects had low back pain of any duration, with or without nerve root compromise, were at least 18 years old, and could read and speak Brazilian Portuguese. As part of a standard examination procedure, patients were screened and excluded from the study if they had potentially serious spinal pathology (e.g., cauda equina compression, lumbar fracture, malignancy, and cognitive, neurological, or rheumatological disorders), pregnancy, or history of spinal surgery in the past 6 months.

All participants provided written informed consent and the study protocol was approved by the Research Ethics Committee of Pontifícia Universidade Católica de Campinas (PUC-Campinas), Campinas, São Paulo, Brazil (number 150.139).

Description of the SBST questionnaire

The SBST is based on the presence of modifiable physical and psychosocial factors for persistent and disabling symptoms, measured by nine questions. Of these, the first four items are related to referred leg pain, disability, and comorbid shoulder or neck pain, and the other five items make up a psychosocial subscale (items 5–9) that investigates bothersomeness, pain catastrophizing, fear, anxiety, and depression. The patients are classified as having a high risk of poor prognosis (high levels of psychosocial prognostic factors are present with or without the physical factors present); medium risk (physical and psychosocial factors are present, but not a high level of psychosocial factors); or low risk (few physical or psychosocial prognostic factors are present).8,11–13

Instruments used to measure construct and discriminative validityOswestry Disability Index (ODI)

The ODI includes 10 six-point scales, and the results vary from 0 to 100%, where higher scores represent worst function. The items are related to intensity of pain, personal care (washing, dressing, etc.), lifting, walking, sitting, standing, sleeping, sex life, social life, and traveling. The Brazilian version of this tool was tested in accordance with the internationally recommended methodology and showed good internal consistency (Cronbach's alpha of 0.87) and good reliability (ICC of 0.99).20 The ODI showed moderate correlation with pain intensity (r=0.66) and d relatively high correlation with the RMDQ scores (r=0.81). A significant correlation (P0.01) was also found between the ODI scores and the 8 scales of the SF-36.20

Roland Morris Disability Questionnaire (RMDQ)

The RMDQ is a 24-item questionnaire related to normal activities of daily living21,22 and the results vary from 0 to 24 points, where higher scores represent worst function. The ICC score was 0.94 for the test-retest reliability and 0.95 for the inter-rater reliability. The correlation coefficient was 0.80 (P<0.01) between the Pain Scale and the RMDQ score and 0.79 (P<0.01) between the Visual Analog Scale and the RMDQ score.21

Fear-Avoidance Beliefs Questionnaire (FABQ)

This instrument assesses how beliefs and fear of individuals with lower back pain affect two subscales related to physical activities (FABQ-PA) and work (FABQ-W). The results of the FABQ-PA vary from 0 to 24 points, where higher scores represent more fear avoidance related to physical activities. In addition, the results of the FABQ-W vary from 0 to 42 points, where higher scores represent more fear avoidance related to work. The test–retest intraclass correlation coefficients (ICC=0.84 and 0.91) and the internal consistency (Cronbach's alpha=0.80 and 0.90) for the FABQ-PA and FABQ-W, respectively, were acceptable. The correlation coefficient (Pearson correlation) between the FABQ-W and RMDQ-Brazil was r=0.72; P<0.01, and r=0.35; P<0.01 for the FABQ-PA and the same questionnaire. It was also correlated with the numeric pain scale (r=0.76; P<0.01 for FABQ-Work r=0.35; P<0.05 for FABQ-PA).23

Construct and discriminant validity

Construct validity was tested by comparing the SBST-Brazil total and psychosocial subscale scores with the Brazilian Portuguese version of the ODI, RMDQ, and FABQ-W and FABQ-PA subscales applied at baseline. For discriminant validity, AUCs derived from receiver operating Curves for the SBST-Brazil total and subscale scores were calculated against reference standards for disability (ODI and RMDQ), fear-avoidance beliefs related to physical activity (FABQ-PA subscale), and fear-avoidance beliefs related to work (FABQ-W subscale).

The hypothesis is that the SBST-Brazil will demonstrate a good correlation with the Brazilian version of the RMDQ and ODI as the SBST-Brazil has two disability items that are related to these measures (Items 3 and 4) and because other versions have already demonstrated good correlations1,17 and excellent discriminant validity with disability reference standards.18,19 Another hypothesis is that the SBST-Brazil psychosocial subscale should correlate well with the Brazilian version of the FABQ-PA, as both are sensitive to change in the individual's fear-avoidance beliefs regarding physical activity.23

Statistical analysis

All analyses were calculated using the software PASW Statistics 18.0 (SPSS Inc., Chicago, IL, USA), with a significance level (α) of 5%. Construct validity was evaluated by correlating the SBST-Brazil with the ODI, RMDQ, and Physical Activity and Work subscales of the FABQ at baseline, using Spearman's Rank Order Correlation. According to Fleiss24r<0.30 indicates weak correlation, r0.30 and <0.60 indicates moderate correlation, and r0.60 indicates good correlation. A score of 0.70 has been recommended for instruments that measure the same construct. When similar constructs are compared, scores lower than 0.70 should be accepted.25,26

The discriminative validity of the SBST-Brazil was described using the AUC statistic derived from receiver operating curves for the total score and the psychosocial subscale score of the SBST-Brazil against baseline reference standards. These instruments were dichotomized to provide cases and non-cases using established cutoffs from the available literature. The definitions for reference standard were: Disability (RMDQ>711 and ODI>1327), kinesiophobia (FABQ-PA>13)27 fear related to work activities (FABQ-W>25).28 Strength of discrimination was classified according to the following descriptors: 0.70–0.80 indicated acceptable discrimination, 0.80–0.90 indicated excellent discrimination, and 0.90 indicated outstanding discrimination.11

Results

A total of 151 eligible patients were recruited and Table 1 shows the characteristics of the study participants for construct and discriminant validity.

Table 1.

Subjects’ demographic and clinical characteristics.

Characteristic  Baseline (n=151) 
Gender: N (%)
Male  69 (45.7) 
Female  82 (54.3) 
Body mass index (kg/m2): mean (SD)  26.1 (3.78) 
Age (years): Mean (SD); range [min-max]  47.4 (14.4); [19–81] 
Pain NRS: Mean (SD); range [min-max]  5.6 (2.2); [1–10] 
Education level, N (%)
Elementary Level  0 (0%) 
High School Level  27 (17.8%) 
University Level  124 (82.2%) 
FABQ-W: Mean (SD); range [min–max]  10.4 (9.5); [0–39] 
FABQ-PA: Mean (SD): range [min–max]  14.5 (6.2); [0–28] 
RMDQ: Mean (SD); range [min–max]  10 (5.3); [0–23] 
ODI: Mean (SD); range [min–max]  26 (15); [2–70] 
SBST-Brazil: Mean (SD); range [min–max]  3.97 (1.97); [0–9] 
Low risk (n, %)  68 (45%) 
Medium risk (n, %)  61 (40.5%) 
High risk (n, %)  22 (14. 5%) 

SD, standard deviation; Pain NRS, Pain numerical rating scale; FABQ-W, Fear-Avoidance Beliefs Questionnaire-Work Subscale, Brazilian version; FABQ-PA, Fear-Avoidance Beliefs Questionnaire Physical Activity Subscale, Brazilian version; RMDQ, Roland Morris Disability Questionnaire, Brazilian version; ODI, Oswestry Disability Index, Brazilian version.

Construct validity

Table 2 presents the construct validity of the SBST-Brazil total and psychosocial subscales. The scores of the SBST-Brazil total and psychosocial subscales correlated better with the RMDQ (r=0.64, r=0.70), respectively, but weakly with FABQ-W (r=0.18, r=0.20), respectively.

Table 2.

Construct validity of the SBST-Brazil total and psychosocial subscale scores.

  Spearman correlation coefficient (r)
SBST Brazil total score 
Spearman correlation coefficient (r)
SBST Brazil psychosocial scale score 
FABQ-W  0.18*  0.20* 
FABQ-PA  0.28*  0.34* 
RMDQ  0.70*  0.64* 
ODI  0.61*  0.56* 
*

P<0.05.

Discriminant validity

The discriminant validity of the screening tool is presented in Table 3, with AUCs for SBST-Brazil total and psychosocial subscale scores against reference standard cases, which ranged from 0.66 for kinesiophobia to 0.88 for disability.

Table 3.

Discriminant validity: AUC for screening SBST-Brazil total scores and psychosocial subscale scores. Against reference cases at baseline.

Reference standards  Case definition  SBST-Brazil total score
ROC (95%CI) 
SBST-Brazil psychosocial subscale score
ROC (95% CI) 
FABQ-W (fear related to work)  >25  0.71 (0.54–0.87)*  0.70 (0.56–0.84)* 
FABQ-PA (kinesiophobia)  >13  0.66 (0.56–0.77)*  0.68 (0.58–0.78)* 
RM (disability)  >7  0.88 (0.81–0.95)*  0.84 (0.77–0.92)* 
ODI (disability)  >20  0.81 (0.72–0.89)*  0.78 (0.70–0.86)* 
*

P<0.05.

Discussion

The aim of this study was to analyze the construct and discriminant validity of the Brazilian version of the STarT Back Screening Tool so it can be used with Brazilian low back pain patients. Our first hypothesis was that the SBST-Brazil would correlate well with the tools for disability (RMDQ and ODI), as it contains two specific items for this construct (items 3 and 4). Similar to the French,1 Iranian,17 and Brazilian versions,14 our results showed good to moderate correlations on both the total score (r=0.70 with RMDQ and r=0.61 with ODI) and the psychosocial subscale score (r=0.64 with RMDQ and r=0.56 with ODI). For discriminant validity, our findings for disability reference standards ranged from 0.78 to 0.88, being classified as acceptable to excellent discrimination.11 These findings are consistent with the psychometric studies of the English11 (0.92 for disability – RMDQ), Chinese18 (0.87 and 0.89 for disability – RMDQ), and Danish19 versions (0.84 and 0.85 for disability – RMDQ), suggesting that the SBST-Brazil appropriately discriminates disability for patients with low back pain.

On the other hand, our second hypothesis was that the SBST-Brazil would be correlated with the FABQ, mostly with its physical activity subscale (FABQ-PA). However, our results showed weak correlations. These correlations with the FABQ-W were expected because the SBST does not have any item related specifically to fear about work. In addition, it must be noted that our sample did not have many patients with work-related problems. In a previous report, the original English version has showed a similar weak correlation with the FABQ-W15 (r=0.23), but no other translated version had its correlation checked with the FABQ scale. The correlation of the Brazilian SBST version and the TKS was also good (r=0.60), which has the same construct as the FABQ-PA.14

Our analyses for discriminant validity showed better results for the SBST-Brazil total and psychosocial subscale scores against the FABQ-PA (0.66 and 0.68, respectively) and also against the FABQ-W (0.71 and 0.70, respectively), suggesting that even though the correlations were weak, the SBST-Brazil was still able to discriminate low back pain patients with fear-avoidance beliefs.

Conclusion

The SBST-Brazil showed a good to moderate correlation with the disability tools (RMDQ and ODI); however, it demonstrated weak correlations with the FABQ-PA and FABQ-W subscales. The discriminant validity ranged from 0.66 to 0.88, representing acceptable to excellent results and suggesting that the SBST-Brazil is able to discriminate low back pain patients with disability and fear-avoidance beliefs.

Conflicts of interest

The authors declare no conflicts of interest.

References
[1]
O. Bruyère, M. Demoulin, C. Beaudart, et al.
Validity and reliability of the French version of the STarT Back Screening Tool for patients with low back pain.
Spine (Phila Pa 1976), 15 (2014), pp. 123-128
PMid: 24108286
[2]
Global Burden of Disease Study 2013 Collaborators.
Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013.
The Lancet, 386 (2015), pp. 743-800
PMid: 26063472
[3]
S.J. Linton, W.S. Shaw.
Impact of psychological factors in the experience of pain.
Phys Ther, 91 (2011), pp. 700-711
PMid: 21451097
[4]
S.R. Currie, J. Wang.
Chronic back pain and major depression in the general Canadian population.
Pain, 107 (2004), pp. 54-60
PMid: 14715389
[5]
N. Schmitz, J. Wang, A. Malla, A. Lesage.
Joint effect of depression and chronic conditions on disability: results from a population-based study.
Psychosom Med, 69 (2007), pp. 332-338
PMid: 17470668
[6]
D.G. Guclu, O. Guclu, A. Ozaner, O. Senormanci, R. Konankan.
The relationship between disability, quality of life and fear-avoidance beliefs in patients with chronic low back pain.
Turk Neurosurg, 22 (2012), pp. 724-731
PMid: 23208904
[7]
A.T. Apeldoorn, H. Bosselaar, R.W. Ostelo, et al.
Identification of patients with chronic low back pain who might benefit from, additional psychological assessment.
Clin J Pain, 28 (2012), pp. 23-31
PMid: 21677570
[8]
J.M. Fritz, J.M. Beneciuk, S.Z. George.
Relationship between categorization with the STarT Back Screening Tool and prognosis for people receiving physical therapy for low back pain.
Phys Ther, 91 (2011), pp. 722-732
PMID: 21451094
[9]
J.C. Hill, J.M. Fritz.
Psychosocial influences on low back pain, disability, and response to treatment.
Phys Ther, 91 (2011), pp. 712-721
PMid: 2145109
[10]
M.D. Bishop, J.M. Fritz, M.E. Robinson, N.R. Asal, A.N. Nisenzon, S.Z. George.
The STarT Back Screening Tool and individual psychological measures: evaluation of prognostic capabilities for low back pain clinical outcomes in outpatient physical therapy settings.
Phys Ther, 93 (2013), pp. 321-333
PMid: 23125279
[11]
J.C. Hill, K.M. Dunn, M. Lewis, et al.
A primary care back pain screening tool: identifying patient subgroups for initial treatment.
Arthritis Rheum, 59 (2008), pp. 632-641
PMid: 18438893
[12]
B. Pilz, R.A. Vasconcelos, F.B. Marcondes, S.S. Lodovichi, W.A. Mello, D.B. Grossi.
The Brazilian version of STarT Back Screening Tool – translation, cross-cultural adaptation and reliability.
Braz J Phys Ther, 18 (2014), pp. 453-461
PMid: 25185032
[13]
J.C. Hill, D.G.T. Whitehurst, M. Lewis, et al.
Comparison of stratified primary care management for low back pain with current best practice (STarT Back): a randomized controlled trial.
Lancet, 378 (2011), pp. 1560-1571
PMid: 21963002
[14]
F.F. Fuhro, F.R. Fagundes, A.C. Manzoni, L.O. Costa, C.M. Cabral.
Örebro Musculoskeletal Pain Screening Questionnaire – Short Form and Start Back Screening Tool: Correlation and Agreement Analysis.
Spine (Phila Pa 1976), (2015),
PMid: 26720177 [Epub ahead of print]
[15]
A.N. Nisenzon, S.Z. George, J.M. Beneciuk, L.D. Wandner, C. Torres, M.E. Robinson.
The role of anger in psychosocial subgrouping for patients with low back pain.
Clin J Pain, 30 (2014), pp. 501-509
PMid: 24281272
[16]
J.C. Hill, K.M. Dunn, C.J. Main, E.M. Hay.
Subgrouping low back pain: a comparison of the STarT Back Tool with the Örebro Musculoskeletal Pain Screening Questionnaire.
Eur J Pain, 14 (2010), pp. 83-89
PMid: 19223271
[17]
P. Azimi, S. Shahzadi, S. Azhari, A. Montazeri.
A validation study of the Iranian version of STarT Back Screening Tool (SBST) in lumbar central canal stenosis patients.
J Orthop Sci, 19 (2014), pp. 213-217
PMid: 24343300
[18]
S. Luan, Y. Min, G. Li, et al.
Cross-cultural adaptation, reliability and validity of the Chinese version of the STarT Back Screening Tool in patients with low back pain.
Spine (Phila Pa 1976), 39 (2014), pp. E974-E979
PMid: 24827520
[19]
L. Morsø, H. Albert, P. Kent, C. Manniche, J. Hill.
Translation and discriminative validation of the STarT Back Screening Tool into Danish.
Eur Spine J, 20 (2011), pp. 2166-2173
PMid: 21769444
[20]
R. Vigatto, N.M.C. Alexandre, H.R. Correa Filho.
Development of a Brazilian Portuguese Version of the Oswestry Disability Index cross-cultural adaptation, reliability, and validity.
Spine (Phila Pa 1976), 32 (2007), pp. 481-486
PMid: 17304141
[21]
L. Nusbaum, J. Natour, M.B. Ferraz, J. Goldenberg.
Translation, adaptation and validation of the Roland-Morris questionnaire – Brazil Roland-Morris.
Braz J Med Biol Res, 34 (2001), pp. 203-210
PMid: 11175495
[22]
L.O.P. Costa, C.G. Maher, J. Latimer, et al.
Clinimetric testing of three self-report outcome measures for low back pain patients in Brazil which one is the best?.
Spine (Phila Pa 1976), 33 (2008), pp. 2459-2463
PMid: 18923324
[23]
A.M. Abreu, C.D.C.M. Faria, S.M.V. Cardoso, L.F. Teixeira-Salmela.
Versão brasileira do Fear Avoidance Beliefs Questionnaire.
Cad Saúde Pública, 24 (2008), pp. 615-623
[24]
R.L. Fleiss.
The Design and Analysis of Clinical Experiments.
John Wiley & Sons, (1986),
[25]
C.B. Terwee, S.D.M. Bot, M.R. Boer, et al.
Quality criteria were proposed for measurement properties of health status questionnaires.
J Clin Epidemiol, 60 (2007), pp. 34-42
PMid: 17161752
[26]
L.O. Costa, C.G. Maher, J. Latimer, P.H. Ferreira, G.C. Pozzi, R.N. Ribeiro.
Psychometric characteristics of the Brazilian–Portuguese versions of the functional rating index and the Roland Morris Disability Questionnaire.
Spine (Phila Pa 1976), 32 (2007), pp. 1902-1907
PMid: 17762300
[27]
J.C.T. Fairbank, P.B. Pynsent.
The Oswestry Disability Index.
Spine (Phila Pa 1976), 25 (2000), pp. 2940-2953
PMid: 11074683
[28]
M.M. Wertli, E. Rasmussen-Barr, S. Weiser, L.M. Bachmann, F. Brunner.
The role of fear avoidance beliefs as a prognostic factor for outcome in patients with nonspecific low back pain: a systematic review.
Spine J, 14 (2014),
816–36.e4
Copyright © 2017. Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia
Idiomas
Brazilian Journal of Physical Therapy
Article options
Tools
en pt
Cookies policy Política de cookies
To improve our services and products, we use "cookies" (own or third parties authorized) to show advertising related to client preferences through the analyses of navigation customer behavior. Continuing navigation will be considered as acceptance of this use. You can change the settings or obtain more information by clicking here. Utilizamos cookies próprios e de terceiros para melhorar nossos serviços e mostrar publicidade relacionada às suas preferências, analisando seus hábitos de navegação. Se continuar a navegar, consideramos que aceita o seu uso. Você pode alterar a configuração ou obter mais informações aqui.