Open Access Research

Performance of the Dutch SF-36 version 2 as a measure of health-related quality of life in patients with rheumatoid arthritis

Peter M ten Klooster1*, Harald E Vonkeman12, Erik Taal1, Liseth Siemons1, Lidy Hendriks3, Alphons J L de Jong4, Ellen A J Dutmer5, Piet L C M van Riel6 and Mart A F J van de Laar12

Author Affiliations

1 Department of Psychology, Health and Technology, University of Twente, PO Box 217, Enschede, AE 7500, The Netherlands

2 Department of Rheumatology and Clinical Immunology, Medical Spectrum Twente, Enschede, The Netherlands

3 Department of Rheumatology, Medical Center Leeuwarden, Leeuwarden, The Netherlands

4 Department of Rheumatology, Rijnstate Hospital, Arnhem, The Netherlands

5 Department of Rheumatology, Gelderse Vallei Hospital, Ede, The Netherlands

6 Department of Rheumatology, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands

For all author emails, please log on.

Health and Quality of Life Outcomes 2013, 11:77  doi:10.1186/1477-7525-11-77


The electronic version of this article is the complete one and can be found online at: http://www.hqlo.com/content/11/1/77


Received:5 April 2013
Accepted:5 May 2013
Published:8 May 2013

© 2013 ten Klooster et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The aim of this study was to examine the measurement properties of the Dutch SF-36 version 2 (SF-36v2) health survey in patients with rheumatoid arthritis (RA).

Methods

Scaling assumptions, internal reliability, and internal construct validity were examined using available data from 1884 RA patients included in the Dutch Rheumatoid Arthritis Monitoring (DREAM) registry. External construct validity and responsiveness to change were examined using baseline and 6-month follow-up data from a subset of 387 early RA patients participating in the DREAM remission induction cohort.

Results

The individual items of the SF-36v2 adequately met scaling assumptions, although four items correlated too highly with items from different scales. Internal consistency was high for all eight scales and the physical and mental health components underlying the scales were replicated, supporting the use of the standard scoring algorithms. The SF-36v2 scales demonstrated minimal floor effects and ceiling effects were noteworthy only for the role-physical, social functioning, and role-emotional scales. Correlations with other core measures were as expected and the SF-36v2 showed excellent known-groups validity in distinguishing between patients with low or moderate-high disease activity. All scales related to physical health showed moderate to large responsiveness to change in patients that achieved low disease activity at six months.

Conclusion

The SF-36v2 appears to be a psychometrically sound tool for the assessment of health-related quality of life of Dutch patients with RA.

Background

Health-related quality of life (HRQOL) questionnaires are increasingly used to measure the impact of disease and the effects of treatment from the perspective of the patient. A well-known questionnaire for the assessment of HRQOL is the 36-Item Short-Form (SF-36) Health Survey [1]. The SF-36 is a multidimensional questionnaire that assesses eight different aspects of health. It is generic by nature which means that it, as opposed to disease-specific measures, can be used to measure and compare outcomes across different diseases and treatments. This feature has made generic measures of HRQOL increasingly popular among researchers and clinicians and the SF-36 has become the most frequently used measure across a wide range of range of conditions, including rheumatic diseases [2,3]. A review of patient-reported outcomes in recently published rheumatoid arthritis (RA) trials [4] showed that the SF-36 was used in 80% of the studies that reported the use of a HRQOL measure, while traditional disease-specific measures were used much less frequently.

The SF-36 has been extensively validated for use in both general and condition-specific populations in many languages and countries, including several studies in patients with RA [5-10]. These studies have generally shown the SF-36 to be a psychometrically sound measure of HRQOL in RA. Although generic measures are often assumed to be potentially less sensitive in detecting changes over time in specific diseases [11,12], studies in RA found that the different scales of the SF-36 were as responsive to changes over time as disease-specific measures within the same health domains [10,13-15].

In 1996, a new version of the questionnaire (SF-36v2) was introduced which included improvements in the instructions, the wording of some of the items, and the number of response options for two of the eight scales [16,17]. Several general population studies have confirmed the improved precision, reliability, and validity of the SF-36v2 over the original version [18,19]. To date, however, the psychometric properties of the SF-36v2 have not yet been thoroughly validated in RA patients. Therefore, the objective of this study was to examine the scaling assumptions, reliability, construct validity, and responsiveness of the SF-36v2 in a clinically diverse sample of Dutch patients with RA.

Methods

Patients and study design

Data for this study were derived from the Dutch Rheumatoid Arthritis Monitoring (DREAM) registry. The DREAM registry is an observational multicenter cohort study that monitors the course of RA patients undergoing different treatment regimens in the Netherlands [20]. Clinical, laboratory, and patient-reported outcomes are routinely collected and stored. Patient-reported outcomes are generally completed online. Within DREAM, 1884 unique patients from different hospital rheumatology clinics completed the SF-36v2 at least once. For the assessment of scaling properties and internal reliability and construct validity, the most recently completed SF-36v2 was selected from each patient, resulting in a sample of 1884 RA patients that completed the SF-36v2 between March 2005 and December 2012. The majority of the sample was female (64.0%) and mean (SD) age and disease duration of the patients at the time of completion were 58.3 (13.2) and 4.2 (7.6) years, respectively.

External construct validity and the responsiveness to change of the SF-36v2 were examined in a subset of early RA patients participating in the DREAM remission induction cohort [21]. The remission induction cohort consists of patients with early RA participating in a treat-to-target strategy aimed at achieving fast remission. The strategy has been shown to be highly effective, with the largest improvement in disease activity observed in the first 6 months of treatment [21]. Baseline and 6-month follow-up SF-36v2 data were available from 387 patients. Similar to the total DREAM sample, 62.4% of the patients in this subset was female and the mean age at baseline of the patients was 58.6 (14.1) years. Median symptom duration at baseline was 14.0 weeks.

The study protocol for the DREAM registry was submitted to the ethics committee of each participating hospital. Because the DREAM registry collects data for daily clinical practice, the ethics committees determined, in accordance with Dutch law, that no approval was required. Nonetheless, patients were fully informed and informed consent was obtained.

Measures

The standard 4-week recall Dutch version of the SF-36v2 (QualityMetric Inc.) was used, which was developed using an extensive translation process which has its origins in the International Quality of Life Assessment (IQOLA) project approach [16,22]. This translation process consists of multiple forward and backward translations and cognitive debriefing interviews with native speakers of the target language. The SF-36v2 assesses different aspects of health represented in 8 scales: physical functioning (PF: 10 items), bodily pain (BP: 2 items), social functioning (SF: 2 items), mental health (MH: 5 items), general health (GH: 5 items), vitality (VT: 4 items), role physical (RP: 4 items), and role emotional (RE: 3 items) [16,17]. The PF items were intended to constitute a hierarchical Guttman scale, in which each item consistently decreases in severity or difficulty. All items are rated on Likert-type or frequency response scales, ranging from 3 response categories for the PF items to 6 categories for a BP item. Using the standard scoring algorithm [17], scales scores are linearly transformed to range from 0 to 100, with higher scores representing better health status. Additionally, the scale scores can be aggregated into two distinct (orthogonal) higher-order summary scores: a physical component summary (PCS) and a mental component summary (MCS). The component summary scores are standardized using normative data from the 1998 US general population with a mean score of 50 and a standard deviation of 10.

Beside the SF-36v2, several simultaneously collected clinical and patient-reported variables were used for analyses in the remission induction cohort sample. For all patients, disease activity was calculated using the Disease Activity Score 28 (DAS28) [23]. The DAS28 combines a 28 swollen joint count, a 28 tender joint count, the erythrocyte sedimentation rate (ESR), and a patient global assessment (PGA) of well-being on a visual analog scale into an overall continuous index. Total scores range between 0 and 10, with higher scores indicating higher disease activity. Validated cutoff scores have been defined for low disease activity (≤3.2), moderate disease activity (3.2-5.1) and high disease activity (>5.1) [24]. Patient-reported disability was measured with the Health Assessment Questionnaire Disability Index (HAQ-DI) on a scale from 0 to 3, in which higher scores indicate more disability [25,26].

Statistical analyses

All analyses were performed using IBM SPSS Statistics version 20. Scaling assumptions and internal reliability of the SF-36v2 were examined in the first dataset (N = 1884) following the approach of the International Quality of Life Assessment project [27]. First, item-level descriptive statistics were used to evaluate the score distributions [17]. Next, correlations of each item with its own scale as well as with other scales were examined using a multi-trait/multi-item correlation matrix approach. For each scale, item internal consistency was considered satisfactory if items correlated ≥0.40 with their own scale after correction for item-scale overlap. Item discriminant validity was supported when an item correlated significantly higher (≥2 standard errors) with its own scale than with the other scales. Scaling success rates were calculated as the percentage of item scaling tests passed.

The reliability of the scales was calculated with Cronbach’s coefficient α and considered adequate for group-level and person-level comparisons when ≥0.70 and ≥0.90, respectively.

To test the internal construct validity of the scales and the hypothesized physical and mental dimensions of health underlying these scales, 0–100 transformed scale scores were computed and the pattern of correlations between the eight scales was examined. It was hypothesized that scales that were conceptually related (physical or mental health, respectively) would correlate substantially (r ≥0.40). High correlations (>0.70) were considered undesirable because this would question the distinctiveness of the scales. Further, the scale’s reliability estimates should be greater than the correlations with the other scales.

To examine the plausibility of the physical and mental dimensions, a principal component analysis with varimax rotation was performed. Two components were extracted, and the scale’s correlations with the rotated factors were examined [28]. Based on the measurement model of the SF-36 [16,17], the PF, RP, and BP scales were hypothesized to correlate most highly with the physical component and lowest with the mental component, whereas the MH, RE, and SF scales should correlate most highly with the mental component and lowest with the physical component. The GH and VT scales were expected to show substantial correlations with both components and the SF scale was expected to show a substantial cross-loading on the physical component.

External construct validity and responsiveness were examined using the 6-month data of patients participating in the remission induction cohort. External construct validity was examined by means of convergent/discriminant validity and known-groups validity [29]. For convergent/discriminant validity it was expected that the SF-36v2 scales related to physical health would be associated moderately (r ≥0.30) to strongly (r ≥0.60) with disability and well-being, moderately with the tender joint count, and weakly (r <0.30) or not at all with the swollen joint count and ESR. Overall, a similar hierarchy of weaker associations was expected for the GH and VT scales and mental scales. For known-groups validity it was examined whether the SF-36v2 was able to distinguish between patients with low (DAS28 ≤3.2) and moderate to high levels of disease activity. One-way analysis of variance (ANOVA) was employed to test for the statistical significance of group differences. The physical scales and PCS were expected to be most discriminative.

Responsiveness [30] of the scales and component scores was examined by their ability to detect changes between baseline and 6-month follow-up using paired t-tests. To examine the magnitude of change, standardized response means (SRMs) were calculated as the ratio of the mean change to the SD of that change for all scores in both the total sample and separately for patients who did or did not achieve low disease activity. Values of 0.20, 0.50, and 0.80 or greater were considered small, medium, and large, respectively [31]. Bootstrapping with 1000 samples was applied to obtain 95% confidence intervals (CIs) for the SRMs.

Results

Item-level descriptive statistics

The median time needed to complete the SF-36v2 was 5 minutes. The full range of responses to each item was observed (Additional file 1: Table S1). Item means clustering and ordering were comparable to those of the general population [17] and items within each scale had similar standard deviations. Mean item scores, especially for items addressing physical health, were generally lower than those in the general population. More difficult PF items generally had higher mean scores, confirming the Guttman-type properties of this scale.

Additional file 1: Table S1. Distribution of responses for each item (N = 1884).

Format: DOC Size: 62KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Scaling assumptions

Corrected correlations between the items and their hypothesized scales ranged from 0.36 to 0.91 (Additional file 2: Table S2). Except for one VT item (item 9a), all items passed the test for item internal consistency with correlations between the items and their scales ≥0.40 (Table 1). Additionally, all items from the RP, BP, RE, and MH scales passed the test for item discriminant validity with significantly higher correlations between the items and their scales than with the other scales. The other four scales all had one item that failed one or more scaling tests.

Additional file 2: Table S2. Item descriptive statistics and Pearson item-scale correlations (N = 1884).

Format: DOC Size: 62KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Table 1. Scaling assumptions of the SF-36v2 (N = 1884)

Reliability and internal construct validity

Reliability estimates ranged from 0.79 for GH and VT to 0.95 for RP, exceeding the 0.70 standard for group comparisons for all scales and the 0.90 standard for individual comparisons for three scales (Table 2). Correlations between the scales ranged from 0.37 (PF and MH) to 0.71 (PF and RP), the latter being the only correlation exceeding the 0.70 limit for distinctiveness. Generally, the highest correlations between scales were observed between scales within either the physical or mental dimension, although several correlations between scales from the different dimensions were also substantial. All scales had higher correlations with themselves (Cronbach’s α) than with the other scales.

Table 2. Pearson correlations between the SF-36v2 scales, internal consistency estimates, and correlations with the two rotated factor components (N = 1884)

In the principal component analysis, the two factors explained 73.45% of the variance. Correlations between the scales and their rotated components confirmed the measurement model of the SF-36v2. As shown in Table 2, the physical scales had clearly higher correlations with the physical component (range: 0.78-0.84) than with the mental component (range: 0.19-0.42). The mental scales showed the opposite pattern (range of correlations with physical component: 0.18-0.58, range of correlations with mental component 0.63-0.91). GH and VT correlated substantially with both components, although the latter correlated more strongly with the physical component and less strongly with the mental component than expected. In accordance with the measurement model, the SF scale demonstrated a noteworthy cross-loading on the physical component.

Statistics for scales and summary scores

Table 3 summarizes descriptive statistics and features of scale score distributions for the eight SF-36v2 scales and component summaries. The full range of the score distribution was observed for all scales. Scores tended to be negatively skewed for the scales measuring mental health (SF, RE, and MH), indicating distributions with more patients scoring among the more positive health states. Floor effects were negligible for all scales but notable ceiling effects were observed for the SF and RE scales, although these ceiling effects were less pronounced than in the general population [17], The mean PCS was almost one SD below the general population norm, whereas the MCS scores were similar to those for the general population.

Table 3. Descriptive statistics of the transformed SF-36v2 scale scores and normed summary scores (N = 1884)

External construct validity

The scales and component summaries demonstrated the expected pattern of associations with patient-reported disability and disease activity parameters (Table 4). As hypothesized, scales related to physical health generally correlated moderately to strongly with disability and well-being, moderately with number of tender joints, and weakly or not at all with the swollen joint count and ESR. A similar hierarchy of weaker associations was observed for the mental scales.

Table 4. Convergent/discriminant validity and known-groups validity of the SF-36v2 scales and summary scores (N = 387)

Scores on all scales and the components were significantly higher for people with low disease activity, supporting strong known-groups validity of the SF-36v2 (Table 4). The physical scales and PCS were most discriminative. The PF scale performed somewhat worse than the disease-specific HAQ-DI, which obtained an F-value of 84.55 in distinguishing between the disease activity groups.

Responsiveness to change

Mean scores on the DAS28 improved from 4.42 (1.47) at baseline to 2.73 (1.15) after six months. All eight scales and the PCS significantly improved between baseline and six months (Table 5). SRMs in the total sample were moderate for the BP scale and PCS. In the group achieving low disease activity, SRMs were at least moderate for all physical scales and large for the BP scale and PCS. All SRMs were small in the group that did not achieve low disease activity. The PF scale was slightly less responsive than the disease-specific HAQ-DI which had an SRM of 0.56 (95% CI: 0.47 to 0.66) in the total group and 0.75 (95% CI: 0.62 to 0.88) in the low disease activity group. However, these differences in SRMs were not significant in either the total group (mean difference 0.08; 95% CI: -0.01 to 0.18) or the low disease activity group (mean difference 0.03; 95% CI: -0.08 to 0.15).

Table 5. Responsiveness of the SF-36v2 scales and summary scores (N = 387)

Discussion

This is the first study to examine the measurement properties of the generic SF-36v2 in Dutch patients with RA. The scaling assumptions of the SF-36v2 were generally supported and the questionnaire demonstrated internal reliability and internal construct validity similar to those found in the general US population. The individual scales and components demonstrated the expected pattern of associations with patient-reported and clinical outcome measures and were able to discriminate well between patients with low and moderate to high levels of disease activity. Especially the physical scales were adequately responsive to changes in disease activity. Overall, the findings suggest that the SF-36v2 is a psychometrically robust measure of HRQOL in Dutch patients with RA.

Excellent scaling success rates were found for four of the SF-36 scales (RP, BP, RE, and MH), which corresponds with findings from the original SF-36 version in the general Dutch population and in chronic disease populations [32]. All items of the SF-36v2 passed the test for item internal consistency, except for item 9a (Did you feel full of life?). This item correlated too weakly with the other vitality items and slightly more strongly with the mental health scale. Although this finding is not too surprising given the item phrasing, it has not been reported in previous studies. Given that the overall internal consistency of the vitality scale was acceptable, however, it did not substantially affect the performance of this scale. The finding that the overall general health item (item 1) also correlated substantially with several other scales corresponds with previous studies in specific patient samples [9,32,33] which also showed the lowest percentage of scaling successes for item discriminant validity of the GH scale in these populations. Despite these deviations, all eight scales met the internal reliability standards required for comparing groups of patients, and the physical function, role-physical, and role-emotional scales appear to be suitable for monitoring individuals.

In general, the observed high percentage of scaling successes lends strong support to the hypothesized scale structure of the SF-36v2 in patients with RA. The internal construct validity was further supported by the scales’ correlations with the physical and mental components of health. Principal component analysis supported the existence of the two hypothesized dimensions underlying the SF-36v2. Together the two dimensions accounted for a significant proportion (73.45%) of the reliable variance in the eight scale scores. The correlations of the scales with their principal components were as expected and were fairly similar to the hypothesized measurement model of the SF-36v2 in the general population [16,17] and those found for the original SF-36 in previous studies in patients with RA [7,9].

The vitality scale, however, correlated evenly strong with both components, whereas it correlated most strongly with mental health in the general population. Apparently, vitality is closely related to the other physical problems associated with RA, such as pain and physical functioning, a finding that is supported by the recent attention focused on the issue of increased fatigue in RA [34-36]. Similar problems with the vitality scale have also been observed in patients with severe functional somatic syndromes [33] and in people with ischemic stroke [37]. Other studies have also challenged the assumption that the way in which the eight scales relate to the physical and mental component is uniform across both diseased and healthy individuals. Findings from these studies generally suggest that the vitality scale in particular may relate to physical and mental health differently, depending upon whether a patient’s main condition is a physical or mental illness [38]. The finding that all other scales were associated with the two dimensions as expected and the high percentage of scaling successes for all scales, however, does support the legitimacy of generating scores for the eight scales and two summary measures using the standard algorithms. Moreover, using the standard US-based scoring algorithm, the PCS and MCS were negligibly correlated (r = 0.16), further supporting the orthogonal nature of the US-based component summary scores.

One of the aims of the developers of the SF-36v2 was to increase the internal reliability and to reduce the floor and ceiling effects that have been reported in the literature for the role-emotional and role-physical scales by increasing the number of response options for these scales from two to five [16]. The findings in this study suggest that these scales are indeed more reliable than in the previous version [16,32] and that especially their floor effects have been strongly reduced. Both role scales and the social functioning scale still demonstrated substantial ceiling effects, although these were much smaller than those observed in the general population [17,18]. These improvements are likely to have increased the ability of the SF-36v2 scale to discriminate between groups and to detect changes over time as compared with the original version.

The SF-36v2 demonstrated excellent convergent/discriminant and known-groups validity. The DREAM registry data allowed for a direct comparison of SF-36v2 scores with simultaneously collected self-reported and clinical core disease activity parameters [39]. The different scales of the SF-36v2 correlated as expected with the core measures of disease activity. All scales were additionally able to distinguish between patients with low disease activity and those with moderate to high disease activity as measured with the DAS-28. The DAS-28 is currently the standard-of-care measure of disease activity in RA [40] and the best determinant of the physician’s clinical judgment of response to treatment [41]. As expected, the physical scales, including bodily pain, were most discriminative. However, the physical functioning scale did not perform as well as the HAQ-DI, which over the years has become the standard measure of self-reported disability in many rheumatic conditions [42]. The HAQ-DI was still about 53% more effective in distinguishing between known groups, a finding similar to the one recently observed in patients with gout [43].

The finding that the SF-36v2 was able to discriminate well between patients with low and moderate to high disease activity, but also to detect improvements over the first six months of treatment, suggests that it can be useful for both discriminative and evaluative purposes [11] in patients with RA. The generic nature of the SF-36v2 additionally offers the opportunity of comparing the HRQOL of RA patients with those in other rheumatic and non-rheumatic conditions and with general population norms. These advantages, however, come with a potential loss of responsiveness and relevance to specific patient groups [2,11,12]. Nevertheless, in accordance with previous studies examining the original SF-36 in RA [10,13-15], this study showed that the generic nature of the SF-36v2 did not result in substantially reduced responsiveness. Especially the physical and bodily pain scales showed moderate or large improvements in those patients achieving low disease activity. Moreover, although the disease-specific HAQ-DI had better known-groups validity than the physical functioning scale, it was only slightly and non-significantly more responsive to improvements over time.

The finding that the SF-36v2 meets psychometric criteria does not necessarily mean that the questionnaire covers all issues specifically relevant to patients with RA. For instance, the physical functioning scale of the SF-36v2 mainly covers functions related to mobility and other activities requiring the use of the lower extremities, whereas finger function is not captured at all and arm function only by three items related to daily activities [44]. A recent review further indicated that the scale has limited content validity as it has no content relevant to the assessment of domestic life [45]. Therefore, for a thorough and comprehensive assessment of health-related quality of life the common recommendation to use both disease-specific and generic measures if possible [15,46] still holds.

In this light, recent initiatives to integrate and cross-calibrate generic and disease-specific measures of health-related quality of life using applications of item response theory and computerized adaptive testing are particularly interesting. Based on existing questionnaires, the NIH Patient-Reported Outcomes Measurement Information System (PROMIS) project has developed large calibrated item banks that can be used to measure key symptoms and health concepts across a wide variety of chronic diseases and in the general population [47]. This blended approach is likely to overcome the limitations of the current generation of disease-specific and generic questionnaires and may allow for more relevant, precise, and efficient assessment of health status and comparability of experiences across diseases.

Finally, it should be noted that in the current study several comparisons were made with normative data from the US general population as no Dutch norms are currently available for version 2 of the SF-36. The US norms, however, are not necessarily generalizable to other countries or cultures. Some studies comparing the US norms with those of other countries have suggested that although the magnitude of differences is generally small, for some scales they are close to or just above the difference of 5 points considered to be clinically meaningful [48-50].

In conclusion, the SF-36v2 demonstrated adequate psychometric properties in patients with RA. Using the SF-36v2 along with disease-specific measures, will allow the identification of HRQOL issues and changes in HRQOL that are important to patients and will facilitate comparisons across different disease states.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

MVDL conceived of the study. PTK performed the statistical analyses and drafted the manuscript. HV, ET, PVR and MVDL supervised the study and the interpretation of the results. LS, LH, ADJ and ED critically reviewed and revised the manuscript. All authors read and approved the final manuscript.

References

  1. Ware JE Jr, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection.

    Med Care 1992, 30:473-483. PubMed Abstract | Publisher Full Text OpenURL

  2. Garratt A, Schmidt L, Mackintosh A, Fitzpatrick R: Quality of life measurement: bibliographic study of patient assessed health outcome measures.

    BMJ 2002, 324:1417. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Busija L, Pausenberger E, Haines TP, Haymes S, Buchbinder R, Osborne RH: Adult measures of general health and health-related quality of life: medical outcomes study short form 36-item (SF-36) and short form 12-item (SF-12) health surveys, nottingham health profile (NHP), sickness impact profile (SIP), medical outcomes study short form 6D (SF-6D), health utilities index mark 3 (HUI3), quality of well-being scale (QWB), and assessment of quality of life (AQOL).

    Arthritis Care Res 2011, 63:S383-S412. Publisher Full Text OpenURL

  4. Kalyoncu U, Dougados M, Daures JP, Gossec L: Reporting of patient-reported outcomes in recent trials in rheumatoid arthritis: a systematic literature review.

    Ann Rheum Dis 2009, 68:183-190. PubMed Abstract | Publisher Full Text OpenURL

  5. Birrell FN, Hassell AB, Jones PW, Dawes PT: How does the short form 36 health questionnaire (SF-36) in rheumatoid arthritis (RA) relate to RA outcome measures and SF-36 population values? A cross-sectional study.

    Clin Rheumatol 2000, 19:195-199. PubMed Abstract | Publisher Full Text OpenURL

  6. Koh ET, Leong KP, Tsou IY, Lim VH, Pong LY, Chong SY, Seow A: The reliability, validity and sensitivity to change of the Chinese version of SF-36 in oriental patients with rheumatoid arthritis.

    Rheumatology (Oxford) 2006, 45:1023-1028. Publisher Full Text OpenURL

  7. Kosinski M, Keller SD, Hatoum HT, Kong SX, Ware JE Jr: The SF-36 health survey as a generic outcome measure in clinical trials of patients with osteoarthritis and rheumatoid arthritis: tests of data quality, scaling assumptions and score reliability.

    Med Care 1999, 37:MS10-MS22. PubMed Abstract | Publisher Full Text OpenURL

  8. Linde L, Sorensen J, Ostergaard M, Horslev-Petersen K, Hetland ML: Health-related quality of life: validity, reliability, and responsiveness of SF-36, 15D, EQ-5D [corrected] RAQoL, and HAQ in patients with rheumatoid arthritis.

    J Rheumatol 2008, 35:1528-1537. PubMed Abstract | Publisher Full Text OpenURL

  9. Loge JH, Kaasa S, Hjermstad MJ, Kvien TK: Translation and performance of the norwegian SF-36 health survey in patients with rheumatoid arthritis. I. Data quality, scaling assumptions, reliability, and construct validity.

    J Clin Epidemiol 1998, 51:1069-1076. PubMed Abstract | Publisher Full Text OpenURL

  10. Ruta DA, Hurst NP, Kind P, Hunter M, Stubbings A: Measuring health status in British patients with rheumatoid arthritis: reliability, validity and responsiveness of the short form 36-item health survey (SF-36).

    Br J Rheumatol 1998, 37:425-436. PubMed Abstract | Publisher Full Text OpenURL

  11. Guyatt GH, Feeny DH, Patrick DL: Measuring health-related quality of life.

    Ann Intern Med 1993, 118:622-629. PubMed Abstract | Publisher Full Text OpenURL

  12. Patrick DL, Deyo RA: Generic and disease-specific measures in assessing health status and quality of life.

    Med Care 1989, 27:S217-S232. PubMed Abstract | Publisher Full Text OpenURL

  13. Hagen KB, Smedstad LM, Uhlig T, Kvien TK: The responsiveness of health status measures in patients with rheumatoid arthritis: comparison of disease-specific and generic instruments.

    J Rheumatol 1999, 26:1474-1480. PubMed Abstract OpenURL

  14. Veehof MM, ten Klooster PM, Taal E, van Riel PL, van de Laar MA: Comparison of internal and external responsiveness of the generic medical outcome study short form-36 (SF-36) with disease-specific measures in rheumatoid arthritis.

    J Rheumatol 2008, 35:610-617. PubMed Abstract | Publisher Full Text OpenURL

  15. Tugwell P, Wells G, Strand V, Maetzel A, Bombardier C, Crawford B, Dorrier C, Thompson A: Clinical improvement as reflected in measures of function and health-related quality of life following treatment with leflunomide compared with methotrexate in patients with rheumatoid arthritis: sensitivity and relative efficiency to detect a treatment effect in a twelve-month, placebo-controlled trial. Leflunomide rheumatoid arthritis investigators group.

    Arthritis Rheum 2000, 43:506-514. PubMed Abstract | Publisher Full Text OpenURL

  16. Ware JE Jr: SF-36 health survey update.

    Spine 2000, 25:3130-3139. PubMed Abstract | Publisher Full Text OpenURL

  17. Ware JE, Kosinski M, Dewey JE: How to score version 2 of the SF-36 health survey. Lincoln, RI: QualityMetric Incorporated; 2000. OpenURL

  18. Jenkinson C, Stewart-Brown S, Petersen S, Paice C: Assessment of the SF-36 version 2 in the United Kingdom.

    J Epidemiol Community Health 1999, 53:46-50. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  19. Taft C, Karlsson J, Sullivan M: Performance of the Swedish SF-36 version 2.0.

    Qual Life Res 2004, 13:251-256. PubMed Abstract OpenURL

  20. Kievit W, Fransen J, Oerlemans AJ, Kuper HH, van de Laar MA, de Rooij DR, De Gendt CM, Ronday KH, Jansen TL, van Oijen PC: The efficacy of anti-TNF in rheumatoid arthritis, a comparison between randomized controlled trials and clinical practice.

    Ann Rheum Dis 2007, 66:1473-1478. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  21. Vermeer M, Kuper HH, Hoekstra M, Haagsma CJ, Posthumus MD, Brus HL, van Riel PL, van de Laar MA: Implementation of a treat to target strategy in very early rheumatoid arthritis: results of the DREAM remission induction cohort.

    Arthritis Rheum 2011, 6:2865-2872. OpenURL

  22. Bullinger M, Alonso J, Apolone G, Leplege A, Sullivan M, Wood-Dauphinee S, Gandek B, Wagner A, Aaronson N, Bech P: Translating health status questionnaires and evaluating their quality: the IQOLA project approach. International quality of life assessment.

    J Clin Epidemiol 1998, 51:913-923. PubMed Abstract | Publisher Full Text OpenURL

  23. Prevoo ML, van ‘t Hof MA, Kuper HH, van Leeuwen MA, van de Putte LB, van Riel PL: Modified disease activity scores that include twenty-eight-joint counts: development and validation in a prospective longitudinal study of patients with rheumatoid arthritis.

    Arthritis Rheum 1995, 38:44-48. PubMed Abstract | Publisher Full Text OpenURL

  24. Gestel v AM, Haagsma CJ, van Riel PL: Validation of rheumatoid arthritis improvement criteria that include simplified joint counts.

    Arthritis Rheum 1998, 41:1845-1850. PubMed Abstract | Publisher Full Text OpenURL

  25. Fries JF, Spitz PW, Young DY: The dimensions of health outcomes: the health assessment questionnaire, disability and pain scales.

    J Rheumatol 1982, 9:789-793. PubMed Abstract OpenURL

  26. ten Klooster PM, Taal E, van de Laar MA: Rasch analysis of the dutch health assessment questionnaire disability index and the health assessment questionnaire II in patients with rheumatoid arthritis.

    Arthritis Rheum 2008, 59:1721-1728. PubMed Abstract | Publisher Full Text OpenURL

  27. Ware JE Jr, Gandek B: Methods for testing data quality, scaling assumptions, and reliability: the IQOLA project approach. International quality of life assessment.

    J Clin Epidemiol 1998, 51:945-952. PubMed Abstract | Publisher Full Text OpenURL

  28. McHorney CA, Ware JE Jr, Raczek AE: The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs.

    Med Care 1993, 31:247-263. PubMed Abstract | Publisher Full Text OpenURL

  29. Fayers PM, Machin D: Scores and measurements: validity, reliability, sensitivity. In Quality of Life: the assessment, analysis and interpretation of patient-reported outcomes. 2nd edition. Edited by Fayers PM, Machin D. Chichester: John Wiley & Sons; 2007:77-108. OpenURL

  30. Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations.

    J Clin Epidemiol 2000, 53:459-468. PubMed Abstract | Publisher Full Text OpenURL

  31. Cohen J: Statistical power analysis for the behavioural sciences. 2nd edition. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988. OpenURL

  32. Aaronson NK, Muller M, Cohen PD, Essink-Bot ML, Fekkes M, Sanderman R, Sprangers MA, te Velde A, Verrips E: Translation, validation, and norming of the dutch language version of the SF-36 health survey in community and chronic disease populations.

    J Clin Epidemiol 1998, 51:1055-1068. PubMed Abstract | Publisher Full Text OpenURL

  33. Schröder A, Oernboel E, Licht RW, Sharpe M, Fink P: Outcome measurement in functional somatic syndromes: SF-36 summary scores and some scales were not valid.

    J Clin Epidemiol 2012, 65:30-41. PubMed Abstract | Publisher Full Text OpenURL

  34. Pollard LC, Choy EH, Gonzalez J, Khoshaba B, Scott DL: Fatigue in rheumatoid arthritis reflects pain, not disease activity.

    Rheumatology (Oxford) 2006, 45:885-889. Publisher Full Text OpenURL

  35. Belza BL: Comparison of self-reported fatigue in rheumatoid arthritis and controls.

    J Rheumatol 1995, 22:639-643. PubMed Abstract OpenURL

  36. Wolfe F, Hawley DJ, Wilson K: The prevalence and meaning of fatigue in rheumatic disease.

    J Rheumatol 1996, 23:1407-1417. PubMed Abstract OpenURL

  37. Hobart JC, Williams LS, Moran K, Thompson AJ: Quality of life measurement after stroke: uses and abuses of the SF-36.

    Stroke 2002, 33:1348-1356. PubMed Abstract | Publisher Full Text OpenURL

  38. Hann M, Reeves D: The SF-36 scales are not accurately summarised by independent physical and mental component scores.

    Qual Life Res 2008, 17:413-423. PubMed Abstract | Publisher Full Text OpenURL

  39. Felson DT, Anderson JJ, Boers M, Bombardier C, Chernoff M, Fried B, Furst D, Goldsmith C, Kieszak S, Lightfoot R: The american college of rheumatology preliminary core set of disease activity measures for rheumatoid arthritis clinical trials.

    Arthritis Rheum 1993, 36:729-740. PubMed Abstract | Publisher Full Text OpenURL

  40. Fransen J, van Riel PL: Outcome measures in inflammatory rheumatic diseases.

    Arthritis Res Ther 2009, 11:244. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  41. Vander Cruyssen B, Van Looy S, Wyns B, Westhovens R, Durez P, Van den Bosch F, Veys EM, Mielants H, De Clerck L, Peretz A: DAS28 best reflects the physician’s clinical judgment of response to infliximab therapy in rheumatoid arthritis patients: validation of the DAS28 score in patients under infliximab treatment.

    Arthritis Res Ther 2005, 7:R1063-R1071. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  42. Bruce B, Fries JF: The stanford health assessment questionnaire: dimensions and practical applications.

    Health Qual Life Outcomes 2003, 1:20. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  43. Ten Klooster PM, Oude Voshaar MA, Taal E, van de Laar MA: Comparison of measures of functional disability in patients with gout.

    Rheumatology (Oxford) 2011, 50:709-713. Publisher Full Text OpenURL

  44. Kvien TK, Kaasa S, Smedstad LM: Performance of the Norwegian SF-36 Health Survey in patients with rheumatoid arthritis. II. A comparison of the SF-36 with disease-specific measures.

    J Clin Epidemiol 1998, 51:1077-1086. PubMed Abstract | Publisher Full Text OpenURL

  45. Oude Voshaar MA, ten Klooster PM, Taal E, van de Laar MA: Measurement properties of physical function scales validated for use in patients with rheumatoid arthritis: A systematic review of the literature.

    Health Qual Life Outcomes 2011, 9:99. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  46. Fletcher A, Gore S, Jones D, Fitzpatrick R, Spiegelhalter D, Cox D: Quality of life measures in health care. II: Design, analysis, and interpretation.

    BMJ 1992, 305:1145-1148. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  47. Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse D, Choi S: The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008.

    J Clin Epidemiol 2010, 63:1179-1194. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  48. Hawthorne G, Osborne RH, Taylor A, Sansoni J: The SF36 version 2: critical analyses of population weights, scoring algorithms and population norms.

    Qual Life Res 2007, 16:661-673. PubMed Abstract | Publisher Full Text OpenURL

  49. Hopman WM, Towheed T, Anastassiades T, Tenenhouse A, Poliquin S, Berger C, Joseph L, Brown JP, Murray TM, Adachi JD: Canadian normative data for the SF-36 health survey. Canadian multicentre osteoporosis study research group.

    CMAJ 2000, 163:265-271. PubMed Abstract | PubMed Central Full Text OpenURL

  50. Scott KM, Tobias MI, Sarfati D, Haslett SJ: SF-36 health survey reliability, validity and norms for New Zealand.

    Aust N Z J Public Health 1999, 23:401-406. PubMed Abstract | Publisher Full Text OpenURL