Skip to main content

Psychometric validation of the revised SCOPA-Diary Card: expanding the measurement of non-motor symptoms in parkinson's disease

Abstract

Background

To identify key non-motor symptoms of Parkinson's disease (PD) to include in a daily diary assessment for off-time, revise the Scales for Outcomes of Parkinson's disease Diary Card (SCOPA-DC) to include these non-motor symptoms, and investigate the validity, reliability and predictive utility of the Revised SCOPA-DC in a U.S. population.

Methods

A convenience sample was used to recruit four focus groups of PD patients. Based on findings from focus groups, the SCOPA-DC was revised and administered to a sample of 101 PD patients. Confirmatory factor analysis was conducted to test the domain structure of the Revised SCOPA-DC. The reliability, convergent and discriminant validity, and ability to predict off-time of the Revised SCOPA-DC were then assessed.

Results

Based on input from PD patients, the Revised SCOPA-DC included several format changes and the addition of non-motor symptoms. The Revised SCOPA-DC was best represented by a three-factor structure: Mobility, Physical Functioning and Psychological Functioning. Correlations between the Revised SCOPA-DC and other Health-Related Quality of Life scores were supportive of convergent validity. Known-groups validity analyses indicated that scores on the Revised SCOPA-DC were lower among patients who reported experiencing off-time when compared to those without off-time. The three subscales had satisfactory predictive utility, correctly predicting off-time slightly over two-thirds of the time.

Conclusions

These findings provide evidence of content validity of the Revised SCOPA-DC and suggest that a three-factor structure is an appropriate model that provides reliable and valid scores to assess symptom severity among PD patients with symptom fluctuations in the U.S.

Background

Parkinson's disease (PD) is the second most prevalent neurodegenerative disease in the U.S., afflicting about one million Americans over age 60 [1]. Motor symptoms associated with PD include bradykinesia (slowness of movement), tremor of resting muscles, postural instability or impaired balance, and gait disturbances [2]. In addition to motor symptoms, a wide range of non-motor symptoms are also associated with PD. The most common include neuropsychiatric symptoms (depression, anxiety, cognitive impairment, etc.), sleep dysfunction, autonomic dysfunction (bladder dysfunction, excessive sweating, etc.), gastrointestinal dysfunction (constipation, hypersalivation, difficulty swallowing, etc.), and sensory symptoms (pain, olfactory dysfunction) [3–9].

PD treatment typically targets dopamine replacement with levodopa and agents to improve its bioavailability [10]. However, after several years of dopaminergic therapy, most patients experience fluctuations between "off-time" and "on-time" in both motor and non-motor symptoms as much as 2-3 hours a day [11]. Off-time refers to periods when PD symptoms return despite medication. Conversely, on-time refers to periods when PD medications are working well and symptoms are under control [12–14]. Off-time may be predictable, such as the recurrence of symptoms preceding a scheduled medication dose (often referred to as "wearing off") [14, 15]. Sometimes, however, spontaneous symptoms may recur unrelated to nearing next medication dose [14].

Assessing off-time is important for researchers as well as clinicians, who monitor off-time for needed changes in medication schedule, dose, or additional treatments needed [14, 16]. Off-time events vary in duration, intensity, frequency, and timing. As such, measuring off-time requires a daily diary format, which may provide a more accurate reflection of changing clinical status for fluctuating symptoms than static instruments [12, 17]. Diary format assessments are most practical when designed to be patient self-administered. There are many widely used assessments available to measure motor symptom severity associated with PD, and to a lesser extent non-motor symptom severity [4, 12, 18], but these tools are predominantly static, lacking the ability to measure symptom fluctuations [11]. One recent review [12] found no currently available patient-reported daily diary that would measure both fluctuating motor and non-motor PD symptoms, despite a breadth of literature citing the tremendous debilitating impact of fluctuating symptoms [11, 19–21].

Currently, the Scales for Outcomes of Parkinson's disease Diary Card (SCOPA-DC), a seven time-point assessment of motor symptoms, is the only validated daily diary instrument designed to measure both motor symptom severity and motor symptom fluctuations in PD patients [22]. The SCOPA-DC was validated in a sample of cognitively unimpaired PD patients recruited from Leiden University Medical Center, in the Netherlands, and has not been validated in the U.S. In addition, non-motor symptoms are absent from the SCOPA-DC, thus missing an increasingly important area of PD symptomatology [7]. The intent of this study was to identify key non-motor symptoms to include in a daily diary assessment for off-time, revise the SCOPA-DC to include these non-motor symptoms, and investigate the validity, reliability and predictive utility of the Revised SCOPA-DC in a U.S. population.

Methods

Phase I - qualitative study

Phase I of the study consisted of several steps designed to: 1) establish the content validity and appropriateness of the (original) SCOPA-DC in a U.S. population; 2) determine the feasibility of adding new items/domains that measure non-motor functions; 3) evaluate the content validity of the Revised SCOPA-DC in a U.S. population.

Literature review

The first step in the process of refining the SCOPA-DC was to gain a sound understanding of the full spectrum of PD symptoms, their interconnections and impact on Health-Related Quality of Life (HRQOL), and association with off -time. The literature review phase further served to help define inclusion and exclusion criteria for the study, and to develop interviewer guide materials for the focus groups. PubMed was searched using text words: "rating scale", "non-motor", "nonmotor", "daily diary", "on/off", "on-off", "quality of life", or "SCOPA" in combination with ''Parkinson's", or ''Parkinson". Abstracts were reviewed for content and reference lists were used to obtain additional relevant references.

Focus groups

Focus groups took place between April and May, 2009 across 3 locations in the U.S. A convenience sample was used to recruit PD patients for 3 initial focus groups (N = 8 per focus group) and one cognitive debrief focus group (N = 9) according to the following criteria: age 30 and older; off-time symptoms between 1% and 25% of the day or more; at least 2 of the following 3 PD symptoms on a typical day: 1) slowed ability to start and continue movements, 2) resting tremors or shakiness, and 3) rigidity or inability to complete a movement; currently on dopaminergic therapy; never had brain surgery to treat PD; fluent in English.

The first 3 focus groups were used to assess the original SCOPA-DC for comprehension and validity, obtain general information on patients' experience with PD symptoms, including their ability to identify when they were experiencing off-time, and to elicit non-motor symptoms considered to be important to patients with off-time. The first part of the 90-minute focus groups followed a discussion guide but elicited open discussion. Mid-way through the groups, patients were asked in more detail about the non-motor symptoms that occur with off-time, including giving examples of off-time experiences and how these impacted their lives. Patients were then asked to rate the importance of all the symptoms listed that occurred with off-time. Finally, patients were asked about meaning, relevance, and clarity of the original SCOPA-DC, including the instructions, item content, and response options.

The last focus group was a cognitive debrief [23] of the Revised SCOPA-DC. The interviews followed a discussion guide developed specifically for the SCOPA-DC evaluation and cognitive review. Ethics approval was granted by the New England Institutional Review Board (NEIRB) and written consent was obtained prior to interviews.

Phase II - psychometric evaluation of the Revised SCOPA-DC

Study design

Recruitment

The psychometric evaluation of the Revised SCOPA-DC was a cross-sectional, non-randomized study that surveyed non-institutionalized adults age 30 and older with self-reported doctor-confirmed PD. Patients were recruited online through Knowledge Networks' (KN) Health Profile panel [24], between October and December, 2009. The recruitment and baseline data collection was followed by an at-home data collection effort which included the completion of the Revised SCOPA-DC over the course of 3 consecutive days. The following inclusion criteria were applied: 1) ever experienced resting tremors and at least one of the following symptoms due to PD: slowed ability to start and continue movements; rigidity or inability to complete a movement; difficulty with balance or instability; stooped, forward-leaning posture; freezing or sudden, brief inability to move the feet; 2) willing to provide informed consent. A subject was excluded if either of the following applied: 1) self-reported history of brain surgery to treat PD; 2) declined consent. PD patients who were eligible to participate in the study were mailed study packets containing: study instructions; 2 copies of the informed consent; instructions on how to identify off-time; an instructional DVD on how to complete the Revised SCOPA-DC; 5 copies of the Revised SCOPA-DC; an end of study questionnaire to capture patients' feedback on participating in the study; a prepaid return envelope to mail completed forms. Ethics approval was granted by the NEIRB.

Study measures

General demographic information was collected online. Specific information on clinical characteristics included questions regarding the type of PD symptoms they experienced, time since PD diagnosis, types of PD treatments and whether they experienced off-time. In addition, the following instruments were used in the online portion of the study: 1) Short Form-12 version 2 (SF-12v2) [25], a general HRQOL instrument that consists of 12 items from which two composite measures can be derived: the Physical Component Summary (PCS) and the Mental Health Component Summary (MCS), measuring overall physical and mental health, respectively [25, 26]; 2) Parkinson's Disease Questionnaire-8 (PDQ-8) [27], a questionnaire comprised of 8 questions about the physical and psychosocial impact of PD such as difficulty concentrating or dressing; 3) Wearing Off Questionnaire-9 (WOQ-9) [28], a 9-item survey that asks about the reduction of or improvement of motor and non-motor symptoms in relation to the timing of medication taking.

The following instruments were mailed to study participants to be completed in paper-and-pencil form: 1) Revised SCOPA-DC, a diary card to be completed 7 times per day for 3 consecutive days; 2) the end-of-study feedback questionnaire, a global debriefing of the participant's experience with completing the Revised SCOPA-DC that consisted of an open-ended question and 14 scaled and yes/no items.

Statistical analysis

Scoring of the Revised SCOPA-DC

Single-item scores were evaluated for the 11 symptom items in the Revised SCOPA-DC by summing responses over the 21 time periods. This 3-day sum score was transformed to a 0-100 scale, allowing for a maximum of 2 missing time periods per day.

Multi-item scores were evaluated for the three subscales derived from factor analyses by taking the average of the 3-day item scores for the items within the respective subscale. If at least one of the 3-day item scores was missing the subscale score was set to missing. In all cases, higher scores indicate greater difficulty, while the complement reflects "good functioning."

The coefficient of variation (CV) and standard deviation (SD) were used as measures of the stability of symptoms experienced by patients. The CV was evaluated by dividing the SD by the mean of the 21 time period scale scores. Similar to the original SCOPA-DC, [22] CV scores were not evaluated if the time period scale mean was below one. When the mean value is small, the ratio of these two quantities becomes unstable and its interpretation becomes difficult. While the CV is an informative statistic when the variability (stability of symptoms) tends to change with the mean (severity of symptoms), the sample SD is not affected by small mean values, which occurred frequently in our sample. Thus, in the current study both measures of variability were used to describe the stability of patients' symptoms.

Factorial structure of the Revised SCOPA-DC

It was hypothesized that the factorial structure of the Revised SCOPA-DC would be best represented by a 2-factor structure, corresponding to motor and non-motor symptom domains. One factor consisted of 4 items related to motor function and symptoms (walking, changing position, using your hands, uncontrollable movements) and the second factor consisted of the 7 non-motor items (feelings of exhaustion or fatigue, difficulty concentrating or remembering, feelings of anxiety or panic, unexplained pains, difficulty swallowing, frequent or urgent urination, sweating too much). Due to sample size (N = 101) limitations, the stability of results obtained from confirmatory and exploratory factor analyses was evaluated using a method akin to k-fold cross validation [29]. The sample was divided into 10 subsets of approximately equal size (9 subsets of size 10 and one of size 11) and factor analyses were carried out after exclusion of each of the ten subsets. Confirmatory factor analysis (CFA) was carried out to test the fit of the hypothesized 2-domain structure 10 times, with each subset removed in turn. CFA solutions were extracted using the robust maximum likelihood (MLR) estimator in Mplus 5.1 [30]. The CFA model fit was assessed using several indicators: comparative fit index (CFI), Tucker-Lewis Index (TLI), root mean square error of approximation (RMSEA) and standardized root mean residual (SRMR). Hu and Bentler's [31] guidelines were used to interpret the values of CFI and TLI (≥ .95), RMSEA (< .06) and SRMR (< .09) indicating close fit. If model refinement was deemed necessary, standard use of modification indices was undertaken [32], with a cutoff value of 10 [30].

Based on CFA results, exploratory factor analysis (EFA) was carried out with a maximum of 3 factors to explore alternative domain structures. EFA was conducted using the weighted least squares means and variance adjusted (WLSMV) under the specification of a censored normal distribution [30] for each of the items to account for distributional characteristics [32]. The promax rotation [33] was used to extract the number of factors. The recommended number of factors was based on goodness of fit indices (Chi-Square, RMSEA and SRMR) and the magnitude (≥ 0.4) of factors loadings. The final structure was recommended based upon the stability of factor loadings across the 10 runs. Upon determination of the number of factors that best represented the latent model of the Revised SCOPA-DC, CFA was carried out using the entire sample of 101 observations.

Item-level psychometrics

Item-total correlations (corrected for overlap) were evaluated by calculating the Spearman correlation coefficient between the subscale total and the 3-day item score. Item-total correlations ≥ 0.40 and small (< 10% increase) alpha-removed statistics were considered indicative of sufficient correlation with the underlying trait [34].

Reliability

Each subscale's coefficient alpha was interpreted against the standard criteria for sufficiency (≥ 0.80) [35]. Model-based reliability was also evaluated using unstandardized loadings and error variances obtained from the final CFA model [32].

Convergent and discriminant validity

Spearman correlations between the 3 Revised SCOPA-DC subscale scores and scores on the PDQ-8 Summary Index, the percentage of symptoms from the WOQ-9 and the SF-12v2 composite scores (PCS and MCS) were considered supportive of convergent validity if they were ≥ 0.40 [36]. Given the disease specific nature of the PDQ-8, it was hypothesized that Revised SCOPA-DC scores would be more strongly correlated with PDQ-8 and WOQ-9 scores than with SF-12v2 scores. Furthermore, the Psychological Functioning subscale would be more strongly correlated with MCS scores than with PCS scores and the Mobility and Physical Functioning subscales would be more strongly correlated with PCS scores than with MCS scores in order to be suggestive of discriminant validity.

Known-groups validity

Construct validity was examined using the framework of known-groups validity [37]. This type of analysis compares mean scale scores across groups known to differ on a clinical criterion measure. Groups were based on: 1) the presence or absence of off-time at baseline and 2) time since PD diagnosis (up to 5 years versus more than 5 years; 5 years was the sample median disease duration). Scale scores were compared across these groups and statistical significance was assessed using the independent samples t-test if the scores were normally distributed and the Mann-Whitney test otherwise.

Measurement of symptom fluctuations

It was hypothesized that patients who reported off-time at baseline would experience more symptom fluctuations than patients without off-time. Statistical significance of group differences in mean CV and SD scores was tested using the Mann-Whitney test. Significance testing was not conducted if the sample size was less than 5.

Prediction of off-time

Longitudinal binary logistic regression using generalized estimating equations (GEE) [38] was used to assess the relationship between single-period scale scores and the probability of experiencing off-time. The dependent variable was the binary response for off-time (for each time period), and the independent variable was the Revised SCOPA-DC score (for each time period). An exchangeable covariance structure was specified. The percentage of correctly predicted cases was evaluated using a cutoff probability ≥ 0.5.

Results

Phase I - qualitative study

Domains identified through literature review

The literature review indicated that non-motor symptoms have a strong impact on the HRQOL of PD patients [39–42], and that they are associated with experiencing off-time [19, 21]. Based on these findings, the following symptoms were anticipated domains for discussion in the focus groups of PD patients with off-time: feelings of anxiety, mood swings, loss of interest, fatigue and autonomic or gastrointestinal symptoms (such as excessive sweating, salivation, and incontinence).

Characteristics of focus groups participants

Patients who participated in the focus groups were mostly white (82%), male (67%) and retired (70%). Most experienced off-time between 1% and 25% of the day (75%). Education level varied among the participants, from high school or GED (6%) to graduate degree (18%). Nearly half (45%) had been diagnosed with PD for more than 5 years.

Content validity of original SCOPA-DC in the U.S. population

All but two of the items in the original SCOPA-DC were intuitive and well comprehended by PD patients. The uncontrollable movements item caused a limited amount of confusion for some patients, indicating that the wording of this item may need to be modified. However, difficulties with this item were not constant across focus groups. Further, many patients had difficulty understanding the way the multi-part sleep item was presented. Finally, many patients felt that the instructions could be clarified, the day segment labels removed, and the response options streamlined.

Domain elicitation

Patients spoke about the emotional effects of PD and identified non-motor symptoms that interfered with their ability to complete daily activities or to engage in work or social situations. Patients commented on their inability to complete almost any activities due to the unexpected and overwhelming effect of fatigue and described how the physical challenges of being in public were often the precursor to feelings of anxiety. Feelings of frustration over the inability to recall simple facts and to retain recent information indicated problems in the areas of concentration and memory. Patients also described how they would be awakened by sudden pains during the night or when resting. Autonomic symptoms such as difficulty swallowing, having to take frequent and uncontrollable restroom breaks, and excessive sweating as a result of very simple tasks such as walking while shopping were also frequently mentioned by patients.

There was strong endorsement of these symptoms appearing in association with off-time episodes. Patients explained how off-time experiences varied widely in terms of place (at home, while driving, while shopping), time of the day, and symptoms. While motor symptoms were the most noticeable, non-motor symptoms were also strongly identified as occurring specifically with off-time, and going away after the off-time episode had passed. Patients believed they could reliably tell when they were experiencing off-time, and that their physicians and nurses had taught them about off-time early on in their treatment.

Changes to original SCOPA-DC

Based on the findings of the 3 focus groups, a Revised SCOPA-DC instrument was created by: 1) modifying the instructions and labels for day segments and response options as well as the format of the sleep item; 2) the addition of 7 non-motor symptom items (fatigue; memory; anxiety; pain; difficulty swallowing; urgent urination; sweating); and 3) replacement of the X's (within boxes) with circles around the numbers to denote the patient's responses. A single item assessing off-time (yes/no) at each time point was included for validation purposes.

Participants of the cognitive debrief indicated that the Revised SCOPA-DC was an improvement over the original SCOPA-DC. First, they felt that the new format was easier to use as they were better able to focus on the items and select a valid response for each time frame. Furthermore, participants felt that the original SCOPA-DC did not adequately capture their experiences with PD throughout the day and they valued the addition of the non-motor symptoms. During the cognitive debrief patients indicated that all non-motor symptoms added to the Revised SCOPA-DC were relevant and related to off-time experiences, suggesting good content validity.

Phase II - psychometric evaluation of the Revised SCOPA-DC

Recruitment

Based on screening questions, 401 PD patients were identified as being eligible to participate in the study. Among these 401, 165 (41%) consented to be in the study, answered all required questions and were mailed the Revised SCOPA-DC; 101 (61%) returned completed forms for the Revised SCOPA-DC.

Sample characteristics

The mean (SD) age of patients was 66.3 (12.5) years (Table 1). Half (50.5%) were male, and the vast majority were white (88.1%). Most (80.2%) had been diagnosed with PD for one year or longer (average = 7.4 years). Sixty-one percent of patients were taking levodopa at the time they answered the survey and 82.3% of these had been taking it for at least one year.

Table 1 Sample Characteristics (N = 101)

Patients who completed the study (N = 101) differed from those who did not return the complete diary (N = 64) only with respect to employment status; retirees made up a larger proportion of the former group (63% versus 48%). No other statistically significant differences were found between completers and non-completers with respect to the characteristics shown in Table 1.

Factorial structure of the Revised SCOPA-DC

CFA models for the hypothesized 2-factor structure resulted in goodness of fit indices that remained above the desired cutoff values for acceptable model fit. Model refinement was undertaken by excluding items with lower loadings (items 4 and 9) and by allowing residual error correlations to be estimated between items 6 and 7, but goodness of fit indices remained above the recommended values of moderate fit (Table 2).

Table 2 Standardized Factor Loadings from Alternative Confirmatory Factor Analyses Models

EFA was then undertaken to determine whether a different domain structure would better represent the measurement model of the Revised SCOPA-DC. A 3-factor structure was found to be a better fit, as indicated by sizeable reductions in the values of goodness of fit indices, and a CFA was conducted with the domain specification shown in Table 2. The final domain structure excluded item 9 (difficulty swallowing), which failed to achieve a loading ≥ 0.40 in the majority of cross-validation runs. All goodness of fit indicators suggested that the 3-factor model was a good fit to the data (CFI/TLI = 0.97/0.96; RMSEA = 0.06; SRMR = 0.05). No modification indices above 10 were observed.

In the final 3-factor structure, factor 1 consists of the walking and changing position items, both of which may be seen as related to mobility impairments. The items in factor 2 may be seen as representing symptoms that interfere with common daily activities and assess general physical functioning, but do not necessarily involve mobility. The items in factor 3 - difficulty concentrating or remembering and feelings of anxiety or panic - are distinct from the remaining items in that they fall strictly into the sphere of psychological (rather than physical) impairment.

Item-level psychometrics

Item-scale correlations, which ranged between 0.59 and 0.83, indicated that each item was more strongly correlated with the total score of the hypothesized domain than with the total scores of either of the two remaining domains (Table 3), supporting the proposed model. Cronbach's Alpha values obtained after removing an item from the Physical Functioning domain indicated that most items contributed similarly to this scale.

Table 3 Item-Scale Correlations Corrected for Overlap and Reliability Statistics for Three-Factor Model

Reliability

All three subscales showed good to excellent Cronbach's Alpha values (Table 3), confirming the reliability evaluated based on CFA model parameters.

Convergent and discriminant validity

The subscales of the Revised SCOPA-DC were generally more strongly correlated with the PDQ-8 and the SF-12v2 than with the WOQ-9 (Table 4). The correlation between the Mobility subscale scores and PCS (0.54) scores were greater than those with MCS scores (0.47). Conversely, the correlation between the Psychological Functioning subscale scores and MCS (0.58) scores were greater than those with PCS scores (0.39). However, contrary to what was hypothesized, the Physical Functioning scores were more strongly correlated with MCS (0.60) scores than with PCS (0.46). These results are suggestive of good convergent validity for all 3 Revised SCOPA-DC subscales and good discriminant validity for 2 Revised SCOPA-DC subscales.

Table 4 Convergent/Discriminant and Known-Groups Validity

Known-groups validity

Mean scores on all three subscales of the Revised SCOPA-DC (Table 4) were lower for patients who reported experiencing no off-time than for patients who reported experiencing off-time on a normal day, at baseline. Similarly, all three means were lower among patients who were diagnosed with PD up to 5 years prior to the study compared to those who had been diagnosed with PD for more than 5 years. However, none of these differences reached statistical significance, except for the Psychological Functioning subscale when using off-time as the criterion variable (the average score for patients with off-time was 6.7 points higher than for patients without off-time; p = 0.023).

Measurement of off-time

There were no significant differences between patients with and without baseline off-time in mean CV scores based on the Mobility or Physical Functioning subscales (Table 5). Significance testing was not evaluated for the Psychological Functioning due to insufficient sample size (N = 2 in the absence of off-time group). Using an alternative measure of symptom variability, patients with baseline off-time had significantly higher SDs on the Psychological Functioning (0.65 versus 0.33; p = 0.018) and Physical Functioning (1.73 versus 1.32; p = 0.053) subscales as compared to those without baseline off-time.

Table 5 Comparison of Symptom Fluctuations on the Revised SCOPA-DC Subscales Across Patients with and without Baseline Off-time

Prediction of off-time

All 3 Revised SCOPA-DC subscales performed in a similar manner with respect to their ability to predict the presence of off-time (Table 6), as captured at each time period. The odds of experiencing off-time were approximately 30% (Physical Functioning subscale) to 50% (Mobility subscale) higher for patients with a 1-point higher score. About two thirds of the observations were correctly classified by each of the subscales.

Table 6 Estimated Coefficients for GEE Logistic Regression Predicting the Probability of Off-time

Discussion

This study aimed to evaluate the validity of a modified version of the SCOPA-DC [22], a diary card originally developed in the Netherlands to measure motor disability among PD patients with symptom fluctuations. Literature review and qualitative findings indicated support for the addition of non-motor symptoms and changes to the format and wording of response choices of the original SCOPA-DC. Based on these findings, a Revised SCOPA-DC was developed and subsequently administered to a sample of non-institutionalized U.S. subjects with self-reported PD. Factor analysis indicated that the measurement model of the Revised SCOPA-DC was best represented by a 3-factor structure. The first factor (Mobility) tapped into issues of mobility (walking and changing position), the second factor (Physical Functioning) included 6 items that covered a broader range of symptoms, including impairment in fine motor skills (using your hands, uncontrollable movements), autonomic dysfunction (frequent or urgent urination and sweating too much) and other well recognized PD symptoms such as pain (unexplained pains), and fatigue (feelings of exhaustion or fatigue), while the third factor (Psychological Functioning) addressed psychological factors (difficulty concentrating or remembering and feelings of anxiety or panic). One item (difficulty swallowing) was excluded due to consistently weak factor loadings.

Correlations between the Revised SCOPA-DC and other HRQOL scores indicated good convergent validity. Contrary to what we had hypothesized, correlations between the Revised SCOPA-DC and PD-specific measures were not higher than correlations with the SF-12v2. Although statistical significance was not always achieved, findings from known-groups validity analyses indicated that scores on the Revised SCOPA-DC were lower among participants whom did not report experiencing baseline off-time when compared to those whom reported experiencing off-time, further supporting the construct validity of the revised instrument.

Due to the relative scarcity of high severity ratings on certain Revised SCOPA-DC items, CV scores could not be evaluated for a number of patients, yielding a set of values with insufficient variation to effectively test the validity of this measure. Nevertheless, patients whom reported experiencing off-time at baseline, did have, on average, higher SD values in all three subscales, than patients without off-time, with two of these differences being statistically significant. All three subscales performed satisfactorily with respect to their ability to predict off-time (Mobility and Psychological Functioning: 69%; Physical Functioning: 68%).

The end-of-study feedback questionnaire indicated that study participants had a very positive experience using the Revised SCOPA-DC. Despite a few reports of uncertainty over whether the 3-day period was sufficient to capture periods of off-time, patients were extremely receptive at the idea of using the Revised SCOPA-DC during and beyond the study period. The written comments and numerical ratings indicated that the content of the Revised SCOPA-DC was meaningful to these patients, that the form was easy to complete and did not impose an excessive burden on their daily routine.

Some study limitations should be noted. First, online recruitment of patients could have introduced a bias because individuals lacking appropriate skills and/or resources were not invited to participate. Second, the diagnosis of PD was self-reported which could have caused misclassification. Third, a standardized scale of non-motor symptoms was not administered, which prevented further testing of convergent validity. Finally, although we used various methods to assess the robustness of results, it is possible that goodness of fit statistics were below the desired thresholds as a result of the size of the sample, an effect that has been previously reported [43]. It is important to keep in mind that this could have led to the better performance of the 3-factor structure over the pre-hypothesized motor versus non-motor 2-factor structure. Although our results indicated the 3-factor model to be a better fit to our data, the PD literature most often classifies symptoms as motor or non-motor, which is in alignment with the 2-factor structure. Thus, additional research is needed to test whether the results presented in the current study can be generalized to other samples of PD patients.

Despite increasing awareness that non-motor symptoms may have a greater impact on the HRQOL of PD patients than motor symptoms [7, 44], the number of studies that have concurrently evaluated the full spectrum of non-motor symptoms is small. Until recently, the evaluation of the wide range of non-motor symptoms in PD required a large number of tools. This may explain the relative paucity of comprehensive assessments of both motor and non-motor symptoms in PD, both in observational studies as well as studies involving treatment efficacy assessments. As a result, recent efforts [4, 17, 45, 46] have been made to create questionnaires that provide a unified assessment of non-motor and motor PD symptoms severity, but none of these instruments were designed for multiple daily self-reported assessment. For example, although the Unified Parkinson's Disease Rating Scale (UPDRS) was revised and expanded [46] to reflect a greater focus on non-motor symptoms, it is not meant to be entirely answered by the patient and still requires physician input. Thus, to our knowledge, the Revised SCOPA-DC (Additional File 1: Appendix) fills an important gap in the assessment of PD symptoms.

Conclusions

The results of the current study provided preliminary evidence of the domain structure of the Revised SCOPA-DC. Although use of the Revised SCOPA-DC in future studies is needed to confirm the results encountered in our study, our findings indicated that the Revised SCOPA-DC is a valid and reliable instrument for measuring the impact of PD symptoms and the severity of off-time. Longitudinal studies that allow for the assessment of specific properties such as test-retest reliability and responsiveness will provide further insight into other aspects of the Revised SCOPA-DC that could not be evaluated in the current study. Furthermore, future studies should continue to examine the instrument's domain structure, its ability to measure the severity of symptom fluctuations and to explore alternative measures of variation that can be applied to the entire range of PD severity.

Abbreviations

CFA:

Confirmatory factor analysis

CFI:

comparative fit index

CV:

coefficient of variation

EFA:

exploratory factor analysis

GEE:

generalized estimating equations

HRQOL:

Health-Related Quality of Life

KN:

Knowledge Networks

MCS:

Mental Health Component Summary

NEIRB:

New England Institutional Review Board

PCS:

Physical Component Summary

PD:

Parkinson's disease

PDQ-8:

Parkinson's Disease Questionnaire-8

RMSEA:

root mean square error of approximation

SCOPA-DC:

Scales for Outcomes of Parkinson's disease Diary Card

SD:

standard deviation

SE:

Standard Error

SF-12v2:

SF12v2 Health Survey

SRMS:

standardized root mean residual

TLI:

Tucker-Lewis Index

UPDRS:

Unified Parkinson's Disease Rating Scale

WLSMV:

weighted least squares means and variance adjusted

WOQ-9:

Wearing Off Questionnaire-9.

References

  1. de Lau LM, Breteler MM: Epidemiology of Parkinson's disease. Lancet Neurol 2006,5(6):525–535. 10.1016/S1474-4422(06)70471-9

    Article  PubMed  Google Scholar 

  2. Nussbaum RL, Ellis CE: Alzheimer's disease and Parkinson's disease. N Engl J Med 2003,348(14):1356–1364. 10.1056/NEJM2003ra020003

    Article  CAS  PubMed  Google Scholar 

  3. Adler CH: Nonmotor complications in Parkinson's disease. Mov Disord 2005,20(Suppl 11):S23-S29.

    Article  PubMed  Google Scholar 

  4. Chaudhuri KR, Martinez-Martin P, Schapira AH, Stocchi F, Sethi K, Odin P, Brown RG, Koller W, Barone P, MacPhee G, Kelly L, Rabey M, MacMahon D, Thomas S, Ondo W, Rye D, Forbes A, Tluk S, Dhawan V, Bowron A, Williams AJ, Olanow CW: International multicenter pilot study of the first comprehensive self-completed nonmotor symptoms questionnaire for Parkinson's disease: the NMSQuest study. Mov Disord 2006,21(7):916–923. 10.1002/mds.20844

    Article  PubMed  Google Scholar 

  5. Cheon SM, Ha MS, Park MJ, Kim JW: Nonmotor symptoms of Parkinson's disease: prevalence and awareness of patients and families. Parkinsonism Relat Disord 2008,14(4):286–290. 10.1016/j.parkreldis.2007.09.002

    Article  PubMed  Google Scholar 

  6. Martinez-Martin P, Schapira AH, Stocchi F, Sethi K, Odin P, MacPhee G, Brown RG, Naidu Y, Clayton L, Abe K, Tsuboi Y, MacMahon D, Barone P, Rabey M, Bonuccelli U, Forbes A, Breen K, Tluk S, Olanow CW, Thomas S, Rye D, Hand A, Williams AJ, Ondo W, Chaudhuri KR: Prevalence of nonmotor symptoms in Parkinson's disease in an international setting; study using nonmotor symptoms questionnaire in 545 patients. Mov Disord 2007,22(11):1623–1629. 10.1002/mds.21586

    Article  PubMed  Google Scholar 

  7. Simuni T, Sethi K: Nonmotor manifestations of Parkinson's disease. Ann Neurol 2008,64(Suppl 2):S65-S80.

    PubMed  Google Scholar 

  8. Snyder CH, Adler CH: The patient with Parkinson's disease: part I-treating the motor symptoms; part II-treating the nonmotor symptoms. J Am Acad Nurse Pract 2007,19(4):179–197. 10.1111/j.1745-7599.2007.00211.x

    Article  PubMed  Google Scholar 

  9. Zesiewicz TA, Sullivan KL, Hauser RA: Nonmotor symptoms of Parkinson's disease. Expert Rev Neurother 2006,6(12):1811–1822. 10.1586/14737175.6.12.1811

    Article  PubMed  Google Scholar 

  10. Gallagher DA, Schrag A: Impact of newer pharmacological treatments on quality of life in patients with Parkinson's disease. CNS Drugs 2008,22(7):563–586. 10.2165/00023210-200822070-00003

    Article  CAS  PubMed  Google Scholar 

  11. Racette BA, Hartlein JM, Hershey T, Mink JW, Perlmutter JS, Black KJ: Clinical features and comorbidity of mood fluctuations in Parkinson's disease. J Neuropsychiatry Clin Neurosci 2002,14(4):438–442. 10.1176/appi.neuropsych.14.4.438

    Article  PubMed  Google Scholar 

  12. Buck PO, Trautman H, Clark J: Scales for assessing nonmotor symptom severity changes in Parkinson's disease patients with symptom fluctuations. International Journal of Neuroscience 2010,120(8):523–530. 10.3109/00207454.2010.489725

    Article  PubMed  Google Scholar 

  13. Quinn NP: Classification of fluctuations in patients with Parkinson's disease. Neurology 1998,51(2 Suppl 2):S25-S29.

    Article  CAS  PubMed  Google Scholar 

  14. Hou JG, Lai EC: Overview of Parkinson's disease: clinical features, diagnosis, and management. In Neurorehabilitation in Parkinson's Disease: An Evidence Based Treatment Model. Edited by: Trail M, Protas EJ, Lai EC. NJ: Slack Incorporated; 2008:1–40.

    Google Scholar 

  15. Brooks DJ, Agid Y, Eggert K, Widner H, Ostergaard K, Holopainen A: Treatment of end-of-dose wearing-off in parkinson's disease: stalevo (levodopa/carbidopa/entacapone) and levodopa/DDCI given in combination with Comtess/Comtan (entacapone) provide equivalent improvements in symptom control superior to that of traditional levodopa/DDCI treatment. Eur Neurol 2005,53(4):197–202. 10.1159/000086479

    Article  CAS  PubMed  Google Scholar 

  16. Trail M, Protas EJ, Lai EC: Neurorehabilitation in Parkinson's Disease: An Evidence Based Treatment Model. NJ: Slack Incorporated; 2008.

    Google Scholar 

  17. Stacy M, Hauser R, Oertel W, Schapira A, Sethi K, Stocchi F, Tolosa E: End-of-dose wearing off in Parkinson disease: a 9-question survey assessment. Clin Neuropharmacol 2006,29(9):312–321.

    Article  PubMed  Google Scholar 

  18. Chaudhuri KR, Martinez-Martin P, Brown RG, Sethi K, Stocchi F, Odin P, Ondo W, Abe K, MacPhee G, MacMahon D, Barone P, Rabey M, Forbes A, Breen K, Tluk S, Naidu Y, Olanow W, Williams AJ, Thomas S, Rye D, Tsuboi Y, Hand A, Schapira AH: The metric properties of a novel non-motor symptoms scale for Parkinson's disease: Results from an international pilot study. Mov Disord 2007,22(13):1901–1911. 10.1002/mds.21596

    Article  PubMed  Google Scholar 

  19. Pursiainen V, Haapaniemi TH, Korpelainen JT, Sotaniemi KA, Myllyla VV: Sweating in Parkinsonian patients with wearing-off. Mov Disord 2007,22(6):828–832. 10.1002/mds.21422

    Article  PubMed  Google Scholar 

  20. Witjas T, Kaphan E, Regis J, Jouve E, Cherif AA, Peragut JC, Azulay JP: Effects of chronic subthalamic stimulation on nonmotor fluctuations in Parkinson's disease. Mov Disord 2007,22(12):1729–1734. 10.1002/mds.21602

    Article  PubMed  Google Scholar 

  21. Witjas T, Kaphan E, Azulay JP, Blin O, Ceccaldi M, Pouget J, Poncet M, Cherif AA: Nonmotor fluctuations in Parkinson's disease: frequent and disabling. Neurology 2002,59(3):408–413.

    Article  PubMed  Google Scholar 

  22. Marinus J, Visser M, Stiggelbout AM, Rabey JM, Bonuccelli U, Kraus PH, van Hilten JJ: Activity-based diary for Parkinson's disease. Clin Neuropharmacol 2002,25(1):43–50. 10.1097/00002826-200201000-00008

    Article  PubMed  Google Scholar 

  23. Strauss A, Corbin J: Grounded Theory Methodology: an overview. In Strategies of Qualitative Inquiry. Edited by: Denzin N, Lincoln Y. London: Sage; 2003:273–285.

    Google Scholar 

  24. KnowledgePanel® Design Summary. Knowledge Networks 2010. [http://www.knowledgenetworks.com/knpanel/KNPanel-Design-Summary.html]

  25. Ware JE Jr, Kosinski M, Turner-Bowker DM, Gandek B: How to Score Version 2 of the SF-12® Health Survey (With a Supplement Documenting Version 1). RI: QualityMetric Incorporated; 2002.

    Google Scholar 

  26. Kosinski M, Bjorner JB: Evaluation of the validity of BDI scores estimated from the SF-36 mental health scale. Quality of Life Research 2009, 1416: A24.

    Google Scholar 

  27. Jenkinson C, Fitzpatrick R, Peto V, Greenhall R, Hyman N: The PDQ-8: development and validation of a short-form Parkinson's disease questionnaire. Psycho Health 1997, 12: 805–814. 10.1080/08870449708406741

    Article  Google Scholar 

  28. Stacy MA, Murphy JM, Greeley DR, Stewart RM, Murck H, Meng X: The sensitivity and specificity of the 9-item Wearing-off Questionnaire. Parkinsonism Relat Disord 2008,14(3):205–212. 10.1016/j.parkreldis.2007.07.013

    Article  CAS  PubMed  Google Scholar 

  29. Burman PA: A comparative study of ordinary cross validation, k fold cross validation and repeated learning tested methods. Biometrika 1989, 503–514.

    Google Scholar 

  30. Muthen B: Tobit factor analysis. British Journal of Mathematical and Statistical Psychology 1989, 42: 241–250. 10.1111/j.2044-8317.1989.tb00913.x

    Article  Google Scholar 

  31. Hu L, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6: 1–55.

    Article  Google Scholar 

  32. Brown T: Confirmatory Factor Analysis for Applied Research. New York: The Guilford Press; 2006.

    Google Scholar 

  33. Hendrickson AE, White PO: Promax: A quick method for rotation to oblique simple structure. British Journal of Mathematical and Statistical Psychology 1964, 17: 65–70.

    Article  Google Scholar 

  34. Muthen LD, Muthen BO: MPlus User's Guide. 5th edition. CA: Muthen & Muthen; 2007.

    Google Scholar 

  35. Nunnally JC, Bernstein IH: Psychometric Theory. 3rd edition. New York: McGraw-Hill; 1994.

    Google Scholar 

  36. Clark LA, Watson D: Constructing validity: Basic issues in objective scale development. Psychological Assessment 1995,7(3):309–319.

    Article  Google Scholar 

  37. Kerlinger F: Foundations of Behavioral Research. New York: Holt, Rinehart & Winston; 1973.

    Google Scholar 

  38. Diggle P, Heagerty P, Liang K: Analysis of Longitudinal Data. second edition. Oxford: University Press; 2002.

    Google Scholar 

  39. Visser M, van Rooden SM, Verbaan D, Marinus J, Stiggelbout AM, van Hilten JJ: A comprehensive model of health-related quality of life in Parkinson's disease. J Neurol 2008,255(10):1580–1587. 10.1007/s00415-008-0994-4

    Article  CAS  PubMed  Google Scholar 

  40. Visser M, Verbaan D, van Rooden S, Marinus J, van Hilten J, Stiggelbout A: A Longitudinal evaluation of health-related quality of life of patients with Parkinson's disease. Value Health 2009,12(2):392–396. 10.1111/j.1524-4733.2008.00430.x

    Article  PubMed  Google Scholar 

  41. Forsaa EB, Larsen JP, Wentzel-Larsen T, Herlofson K, Alves G: Predictors and course of health-related quality of life in Parkinson's disease. Mov Disord 2008,23(10):1420–1427. 10.1002/mds.22121

    Article  PubMed  Google Scholar 

  42. Reuther M, Spottke EA, Klotsche J, Riedel O, Peter H, Berger K, Athen O, Kohne-Volland R, Dodel RC: Assessing health-related quality of life in patients with Parkinson's disease in a prospective longitudinal study. Parkinsonism Relat Disord 2007,13(2):108–114. 10.1016/j.parkreldis.2006.07.009

    Article  CAS  PubMed  Google Scholar 

  43. Jackson DL: Sample Size and number of parameter estimates in Maximum Likelihood Conformatory Factor Analysis: a Monte Carlo investigation. Structural Equation Modeling 2001,8(2):205–223. 10.1207/S15328007SEM0802_3

    Article  Google Scholar 

  44. Park A, Stacy M: Non-motor symptoms in Parkinson's disease. J Neurol 2009,256(Suppl 3):293–298.

    Article  PubMed  Google Scholar 

  45. Lee MA, Walker RW, Hildreth AJ, Prentice WM: Individualized assessment of quality of life in idiopathic Parkinson's disease. Mov Disord 2006,21(11):1929–1934. 10.1002/mds.21099

    Article  PubMed  Google Scholar 

  46. Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, Poewe W, Sampaio C, Stern MB, Dodel R, Dubois B, Holloway R, Jankovic J, Kulisevsky J, Lang AE, Lees A, Leurgans S, LeWitt PA, Nyenhuis D, Olanow CW, Rascol O, Schrag A, Teresi JA, van Hilten JJ, LaPelle N: Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord 2008,23(15):2129–2170. 10.1002/mds.22340

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Johan Marinus, PhD for his permission to use and revise the Scales for Outcomes of Parkinson's disease Diary Card, as well as Mark Stacy, MD for his feedback during the preparation of this manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philip O Buck.

Additional information

Competing interests

POB and JCH are employees of Teva Neuroscience, Inc., the sponsor of this study. RRB and MKW have served as consultants for Teva Neuroscience, Inc.

Authors' contributions

RRB co-led the organization and execution of the validation project, conducted the statistical analyses, and contributed to writing and revising the manuscript. POB conceptualized the validation project, assisted with the organization and execution, and contributed to writing and revising the manuscript. MKW co-led the organization and execution of the validation project and contributed to writing and revising the manuscript. JCH conceptualized the validation project and contributed to writing and revising the manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Rendas-Baum, R., Buck, P.O., White, M.K. et al. Psychometric validation of the revised SCOPA-Diary Card: expanding the measurement of non-motor symptoms in parkinson's disease. Health Qual Life Outcomes 9, 69 (2011). https://doi.org/10.1186/1477-7525-9-69

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1477-7525-9-69

Keywords