Anticoagulation can reduce quality of life, and different models of anticoagulation management might have different impacts on satisfaction with this component of medical care. Yet, to our knowledge, there are no scales measuring quality of life and satisfaction with anticoagulation that can be generalized across different models of anticoagulation management. We describe the development and preliminary validation of such an instrument – the Duke Anticoagulation Satisfaction Scale (DASS).
The DASS is a 25-item scale addressing the (a) negative impacts of anticoagulation (limitations, hassles and burdens); and (b) positive impacts of anticoagulation (confidence, reassurance, satisfaction). Each item has 7 possible responses. The DASS was administered to 262 patients currently receiving oral anticoagulation. Scales measuring generic quality of life, satisfaction with medical care, and tendency to provide socially desirable responses were also administered. Statistical analysis included assessment of item variability, internal consistency (Cronbach's alpha), scale structure (factor analysis), and correlations between the DASS and demographic variables, clinical characteristics, and scores on the above scales. A follow-up study of 105 additional patients assessed test-retest reliability.
220 subjects answered all items. Ceiling and floor effects were modest, and 25 of the 27 proposed items grouped into 2 factors (positive impacts, negative impacts, this latter factor being potentially subdivided into limitations versus hassles and burdens). Each factor had a high degree of internal consistency (Cronbach's alpha 0.78–0.91). The limitations and hassles factors consistently correlated with the SF-36 scales measuring generic quality of life, while the positive psychological impact scale correlated with age and time on anticoagulation. The intra-class correlation coefficient for test-retest reliability was 0.80.
The DASS has demonstrated reasonable psychometric properties to date. Further validation is ongoing. To the degree that dissatisfaction with anticoagulation leads to decreased adherence, poorer INR control, and poor clinical outcomes, the DASS has the potential to help identify reasons for dissatisfaction (and positive satisfaction), and thus help to develop interventions to break this cycle. As an instrument designed to be applicable across multiple models of anticoagulation management, the DASS could be crucial in the scientific comparison between those models of care.
Oral anticoagulation is indicated for a number of conditions, including prevention of systemic embolism in patients with mechanical heart valves, valvular heart disease, myocardial infarction, and atrial fibrillation . It is often intended that anticoagulation be maintained over the long term; for example, one of the considerations in placing a mechanical heart valve is the ability of the patient to comply with a regimen of anticoagulation for the remainder of his of her lifetime.
Long-term anticoagulation can be provided in various fashions; for example, under the direction of a generalist physician such as an internist, under the direction of a specialist physician such as a cardiologist, under the direction of an anticoagulation service managed by a pharmacist or nurse, or primarily through patient self-management. Blood can be obtained for testing using a vein or a fingerstick, and results can be made available immediately (using a point-of-care testing device) or can be provided subsequently through an outside laboratory. Contact between the provider and the patient can be in-person, by telephone, by mail, or through the internet.
Regardless of the model of care, there are a number of characteristics of anticoagulation that can potentially induce dissatisfaction and reduce quality of life. Among these characteristics are the need for regular blood testing and other contacts with the medical system, lifestyle limitations (e.g., restrictions on diet and activities), and possible worry about bleeding and/or bruising. Anticoagulation might also have a number of positive effects; for example, the reassurance provided by effective treatment and contact with supportive providers.
There are two basic approaches to measuring health-related quality of life among patients receiving anticoagulation: generic and condition-specific. Generic scales assess constructs that are common to a wide range of individuals. For example, the eight subscales of the widely used SF-36 instrument are physical function, physical role, bodily pain, general health, vitality, social function, emotional role, and mental health. Generic instruments not only facilitate comparisons with other populations (e.g., between patients undergoing anticoagulation and those with asthma), but their comprehensiveness can help identify aspects of the condition under study that might not have been anticipated by the developers of condition-specific scales.
In contrast to generic scales, condition-specific scales are intended to be much more narrowly focused toward those aspects of health-related quality of life that are of the greatest salience for that condition. For example, an arthritis-specific scale might include questions about joint pain, the number of joints that are swollen or tender, and so forth. Ideally, generic and condition-specific scales can provide information that is complementary; the former being broad although not necessarily detailed, and the latter being detailed but not necessarily broad. The text by McDowell and Newell provides an excellent introduction to generic and condition-specific scales, including a description of various scales such as the SF-36 .
There are relatively few extant condition-specific scales that measure quality of life and satisfaction with anticoagulation, and to our knowledge none of these scales can be generalized across models of medical care. For research purposes, having such a scale would be particularly important in support of studies designed to determine which approach to anticoagulation management is superior. In clinical practice, being able to measure quality of life and satisfaction with anticoagulation management could help support interventions that increase time in therapeutic range and reduce adverse thromboembolic or bleeding events.
Our goal was to develop and validate a scale that could be administered to anticoagulation patients generally; that is, across indication for anticoagulation and across models of anticoagulation management. This report describes the development and preliminary validation of this scale – the Duke Anticoagulation Satisfaction Scale (DASS).
We began by identifying various dimensions of anticoagulation-related quality of life, using as sources the literature, patient focus groups, and expert opinion. The literature review involved a Medline search, from 1985–2000, using the terms "anticoagulation" and "quality of life". The articles resulting from this initial search were supplemented by a review of their bibliographies, a review of the reports from various large randomized trials of warfarin, and a hand-review of the Archives of Internal Medicine (this journal being particularly noteworthy for its attention to issues of anticoagulation) from 1985–2000 [3-9].
After Institutional Review Board approval, two patient focus groups were organized to help identify the domains of interest and also to record the phrasing of the patients' comments (so as to reflect this phrasing, if possible, in the actual wording of the DASS items). Patients were recruited from local anticoagulation services. A majority of these patients had undergone anticoagulation for an extended period of time.
We conducted initial interviews with five experts (a physician assistant, a pharmacist, and three physicians, all of whom are widely experienced in anticoagulation practice), then asked these experts to comment on the proposed dimensions and item wording.
Once a preliminary set of items was developed, we administered an initial draft of the instrument in "talk-through interviews" with nine patients. Items were modified, and the process was repeated with another set of nine patients.
We then administered the resulting 26-item instrument to 122 patients in the Duke anticoagulation service. Of these, 105 had a single interview, and 17 also had a second interview approximately one month later. The results of this study were examined: (a) at the item level, with frequency distributions, means and standard deviations; and (b) at the scale level, in order to determine which items seemed to group together. Briefly, most items had sufficient variation and grouped into the expected dimensions. Five to seven items did not, and were thus the strongest candidates for deletion or revision.
To create the current version of the DASS, the above version was revised, paying particular attention to the items that had performed poorly in the previous study. In addition, the wording of the items was reviewed by a linguistic consultant, in order to help simplify the instrument as much as possible.
Description of the DASS
The resulting 27 items, 25 of which are included in the final version of the DASS, are provided in 1. All items have seven response categories: "not at all", "a little", "somewhat", "moderately", "quite a bit", "a lot", and "very much". The pattern of the questions is arranged to roughly correspond to three possible dimensions pertaining to anticoagulation: limitations (e.g., limitations on physical activities due to fear of bleeding, dietary restrictions); hassles and burdens (e.g., both daily hassles such as remembering to take the medicine, as well as occasional hassles such as having to wait while visiting a provider for blood testing), and positive psychological impacts (e.g., reassurance because of anticoagulation treatment).
Item content in the DASS varies from specific (e.g., "How much does the possibility of bleeding or bruising limit you from taking part in physical activities?") to general (e.g., "Overall, how much does the possibility of bleeding or bruising affect your daily life?"). A few items (e.g., "How much does anti-clot treatment limit the alcoholic beverages you might wish to drink?") apply to a subset of patients (e.g., those that consume alcohol); when an item does not apply, the patient is requested to answer "not at all".
Validation study design
The above 27-item version of the DASS was administered to 262 patients, 125 of whom were managed by a physician assistant in an anticoagulation service within the Department of Veterans Affairs, and 137 of whom were managed by physicians in general community practices. In addition to the DASS, we recorded various demographic and clinical characteristics (table 1) as well as three other scales: the SF-36 (generic quality of life), the PSQ-18 (satisfaction with medical care), and the SDS-5 (tendency to give socially desirable responses) [10,11]. Two of the above 27 items were subsequently dropped, yielding a final instrument containing 25 items.
Table 1. Demographic characteristics, clinical characteristics, co-administered scales
We then performed an additional study in order to assess the test-retest reliability of the final 25-item version of the DASS. For this study, 105 subjects were surveyed approximately 7–14 days apart, 103 of whom completed both interviews and are included in the analysis. One item ("Overall, how much has anti-clot treatment had a negative impact on your life?") was inadvertently excluded from the instrument.
The statistical analysis began with assessment of the pattern of missing values among the DASS items. Among patients that completed all the DASS items, we then assessed the degree of variability among individual items using frequency distributions, means and standard deviations. In order to assess internal consistency, we then examined the factor structure of the DASS, using the techniques of exploratory factor analysis with orthogonal rotations. Cronbach's alpha and item-total correlations were calculated for the overall DASS, treating the scale as a simple summation of the items, and also for its various possible subscales. Finally, in order to assess concurrent validity both the summated DASS scale score, as well as its subscales, were correlated with demographic variables, clinical characteristics, and scores on the above scales. Test-retest reliability, as applied to the overall summated DASS score, was assessed using the intra-class correlation coefficient, and also by summary statistics (mean, standard deviation) describing the differences between the DASS scores at the two time periods. The items from the first time point in the test-retest study were also used as inputs into a confirmatory factor analysis.
For consistency of presentation, all analyses involved first reverse-coding six items, as noted in the legend of 1. (After this reverse-coding, for all items lower scores indicate greater satisfaction.)
Table 1 describes the demographic and clinical characteristics of the subjects. A typical subject was a married white male, aged 69 years, having been receiving anticoagulation for over 4 years and taking multiple medications. Approximately three quarters of the sample completed high school. Various indications for anticoagulation were represented, of which atrial fibrillation was the most common (57%). Table 1 also presents the results of the co-administered scales. Of particular note, the SF-36 scales describing physical functioning were lower than those describing social functioning. The SDS-5 scores showed that the subjects had a tendency to give socially desirable responses; the PSQ-18 indicated generally high satisfaction with the medical care system as a whole.
Table 2 summarizes the DASS data at the level of the item. Of 262 subjects, 1 did not fill out any of the DASS items, 41 had at least one missing item, and 220 had complete data on the DASS. The items most commonly left missing pertained to work limitations, alcohol limitations, overall positive impact and, to a lesser extent, overall confidence, difficulty in managing anticoagulation, and whether the subject would recommend their current model of anticoagulation to others. We believe it is likely that that, for the questions about work and alcohol limitations, most of those with missing responses did not drink alcohol or were not currently working, and failed follow the directions to answer "not at all" under those circumstances. Based on the talk-through interviews, the other items listed above tended to be those which at least some respondents had difficulty in conceptualization. All items evidenced a noteworthy degree of variation (e.g., standard deviations of approximately one unit or more).
Table 2. DASS Item-level summary statistics
Tables 3 and 4 present a summary of the factor analysis. The six eigenvalues exceeding unity were 8.73, 3.25, 1.66, 1.43, 1.16, and 1.04. These latter two eigenvalues were close to unity, suggesting that no more than four factors should be considered.
Table 3. DASS factor analysis results: 2-factor solution
Table 4. DASS factor analysis results: 3-factor solution
Accordingly, rotated factor solutions were fit with 2, 3 and 4 factors. The 4-factor solution had inconsistent loadings (i.e., multiple items loaded on more than one factor), and is not considered further. The two items pertaining to "worry about anti-clot treatment" and "worry about the bad things anti-clot treatment is intended to prevent" had inconsistent loadings in the 3-factor solution, and were dropped. (In part, this decision was made because these items addressed a different construct than other items in the limitations, hassles and burdens factor(s) on which they would have been placed. In the 2-factor solution, the two items in question clearly loaded onto the "negative impacts" scale.)
Considering the 2-factor solution, 24 of the 25 items showed "simple structure" by having the rotated factor loading exceed 0.40 for only one of the factors. The only exception was the item pertaining to alcohol, which had a loading of only 0.26, perhaps because of the difficulties induced by having large numbers of patients respond "not at all". All items grouped onto their anticipated factors. The variance explained by the "negative" and "positive" factors was 7.97 (32% of 25) and 3.22 (13% of 25), respectively.
Considering the 3-factor solution, the anticipated grouping of items into the factors of "limitations", "hassles", and "positive impacts" was observed; in essence, the items in the "negative" factor in the 2-factor model were disaggregated into two sub-factors. This delineation was reasonably consistent, albeit not always completely clear-cut; for example, the item asking about the hassle of the daily anti-coagulation related tasks had a rotated factor loading of 0.60 onto "hassles" and 0.51 onto "limitations". The variance explained by the hassles, limitations and positive impact factors was 5.05, 4,82 and 2.96, respectively.
The various Cronbach's alpha coefficients were as follows: 0.88 for the overall DASS summary score, 0.78 for the positive impact sub-scale, 0.91 for the negative impact sub-scale, 0.87 for the limitations sub-scale, and 0.88 for the hassles sub-scale.
In the confirmatory factor analysis on the test-retest sample, the original 2-factor solution was replicated, to a notably high degree of fidelity (data not shown). The results of the 3-factor solution were roughly similar to the previous factor analysis in the sense that all of the six items from the positive impact sub-scale were as before, and that most of the negative items disaggregated themselves into two other scales. The placement of items into the "hassles" versus "limitations" factors was mostly, but not entirely, consistent with the results of the previous factor analysis. However, simple structure was not maintained, as some items appeared to load onto both the "hassles" and "limitations" factors.
Table 5 reports correlations between the DASS summary scale, its sub-scales, and various subject characteristics and co-administered scales. The overall DASS score, the negative impacts sub-scale, the hassles sub-scale, and the limitations sub-scale behaved similarly; in particular, these were consistently correlated with the sub-scales of the SF-36. Also, these scales were positively correlated with the experience of being hospitalized for bleeding during the last year and of having more than one dosage adjustment during that period of time. The positive impact sub-scale was less strongly correlated with the other quality-of-life measures, although it was more strongly correlated with age and time on anticoagulation.
Table 5. Correlation with DASS total score and subscales
The 103 subjects used in the test-retest study were similar to those of the main study for the SF-36 scales and most demographic characteristics (data not shown). By way of exception, the test-retest subjects were more likely to be female (38%) and to have completed high school (93%). Approximately 91% reported no significant changes in health between the two interviews. The mean DASS scores (standard deviation in parentheses) were 53.4 (17.6) and 54.9 (18.9) at interviews 1 and 2, respectively. Table 6 describes the distribution of the difference scores summarizing the changes in the DASS over the approximately 2-week period between measurements. The majority of scores were within 10 units of the initial score, and the intra-class correlation coefficient (estimated from a random effects model using subject, visit and error) was 0.80.
Table 6. Difference Scores on Re-administration, Approximately Two Weeks Apart
We have described the development and preliminary validation of the DASS, a scale to measure satisfaction and quality of life with anticoagulation. Individual DASS items showed sufficient variation, and the large majority of items clearly grouped into scales reflecting positive and negative impacts of anticoagulation. This latter scale can, if desired, be further sub-divided into sub-scales reflecting limitations imposed by anticoagulation versus the hassles and burdens of anticoagulation management. The internal consistency of the overall scale is good (Cronbach's alpha 0.88), with the sub-scales falling into a similar range (alpha 0.78 to 0.91). The sub-scales correlate with various measures of health status and satisfaction with medical care. The level of variation from test to test (intra-class correlation 0.80) is higher than the ideal, but acceptable.
Although these initial results appear promising, various limitations should be noted. Validation is a multi-step process, requiring numerous positive findings, across a variety of applications, before a scale can be invested with full confidence. Some natural follow-up studies would include, among others, administration across a broader cross-section of patients. The DASS does not yet have norms to quantify, for example, clinically significant differences in quality of life, although generic methods might be used as at least a first approximation .
Another limitation pertains to the definition of the sub-scales. Although the overall pattern of the data was consistent with the ideal of simple structure, some items did load onto their respective sub-scales less strongly than others. For some items, this might reflect a moderate ceiling effect. In other cases, this might reflect a tendency for different respondents to conceptualize these items differently. The willingness to accept differing interpretations of the various items was consistent with the philosophy under which the DASS was developed; namely, that in order to be relevant to individual patients and extendable across a wide variety of applications, the scale should address its constructs as generically as possible.
How best to conceptualize quality of life associated with anticoagulation management was an ongoing challenge during the scale development process, a particular difficulty being that our experts (as well as the literature) tended to make somewhat finer distinctions (e.g., between limitations versus hassles and burdens) than were typically made by patients. Our solution was to structure the instrument with into separate sets of questions representing these fine distinctions (e.g., "limitations" comprising one such set), but to retain the option of combining the items in these sets into more general sub-scales. When applying the DASS to other models of anticoagulation management, the questions themselves could be retained (e.g., as they were designed to be applicable across models of care), but some of the text in their stems might be changed. For example, the list of possible daily and occasional tasks would likely differ according to the model of care.
The primary decision for the user that wishes to apply the DASS at the level of the sub-scale is whether to break the "negative impact" scale into two component parts. As discussed above, the structure of the instrument and, indeed, our original expectations regarding the factor analysis, was based on the notion that the negative impact scale would be sub-divided. However, both the original factor analysis and a subsequent confirmatory factor analysis showed somewhat stronger support for the simpler model including positive and negative factors only. The size of the test-retest sample (i.e., 103 subjects) was near the lower limit for a factor analysis, so we do not interpret this confirmatory factor analysis as definitive; nevertheless, its conclusions were quite similar to those of the original factor analysis. Taken as a whole, our interpretation is that a 2-factor solution may be the most natural, but that a user with a specific need to utilize three factors could reasonably do so. The current comparison between the 2- and 3-factor solutions is not definitive and, indeed, it is quite conceivable that choice of sub-scale could differ according to the patient population or the model of anticoagulation management under study.
When considering the sub-scales, the internal consistency, as measured by Cronbach's alpha, approached 0.90 for the negative impacts, hassles and limitations sub-scales, but was closer to 0.80 for the positive impact scale. The lower figure for the positive impact sub-scale might in part be a result of the number of items (i.e., on average, the more items the higher the alpha coefficient), but also because the items address a construct that is broader, and perhaps more subject to individual interpretation, than is the case for the items pertaining to the negative impact of anticoagulation. Authorities disagree on the precise benchmarks that should be applied to psychometric measures such as alpha coefficients (these benchmarks in part depending on the application; for example, with lower correlations being acceptable for scales that are intended to compare groups than for scales use to measure change within individuals). Nevertheless, the internal consistency evidenced by the DASS, both in terms of the rotated factor loadings and the Cronbach's alpha coefficients of its sub-scales, is quite consistent with usual practice for measures that are intended to be used at the level of the group. A similar interpretation applies to the test-retest analysis.
A final challenge in the item development process involved the strong socialization of patients undergoing long-term anticoagulation. Often, patients have been informed that long-term anticoagulation is a medical necessity, without an equally good alternative. (One of the conditions for receiving a heart valve is acceptance of anticoagulation for the remainder of the patient's life. In other circumstances, such as atrial fibrillation, alternatives such as aspirin that are less burdensome yet less effective are available, thus implying that patients that receive anticoagulation have self-selected, at least initially, as perceiving the burdens of this therapy as being less than its benefits.) Any life style modifications (such as eliminating activities likely to result in bleeding and bruising) required by this therapy may have been made long ago, and the effects of these modifications, although initially distressing, may no longer be considered by the patient as reducing quality of life. Nevertheless, it is quite reasonable to speculate that if the patient were managed using a less burdensome model of care, perceived quality of life would improve. Some of the final items in the DASS (e.g., whether the patient would recommend this form of anticoagulation) are an attempt to address this issue, but our talk-through interviews suggested that a non-trivial number of patients found such an exercise in visualization to be conceptually difficult. We know of no ideal solution to this problem, which is by no means limited to the present application.
The clinical relevance of the DASS lies in its ability to summarize satisfaction with anticoagulation and in particular to help identify aspects of anticoagulation that may hinder individual patients from maintaining a PT-INR within therapeutic range. Some of these aspects might be amenable to direct intervention; for example, those patients that find anticoagulation management to be extraordinarily complicated might benefit from either additional anticoagulation-related education, or perhaps from a mode of management that requires less regular testing. Other aspects might not be as directly amenable. For example, those patients who had experienced an outcome such as hospitalization for bleeding or multiple dosage changes during the past year also tended to report higher scores for hassles and limitations; in effect, becoming more sensitized to anticoagulation's potentially negative aspects. However, even in the absence of a more direct intervention, providers might at least maintain increased vigilance for such patients.
In this spirit, providers need not only focus on the negative aspects of anticoagulation, but might also choose to especially reinforce those positive aspects that are considered to be particularly salient by each individual patient. In any event, the ultimate goal is that from identifying the limitations, hassles and burdens, and positive psychological impacts experienced by patients, the cycle of dissatisfaction, leading to poor adherence, leading to poor INR control, leading to poor clinical outcomes, can be broken. The scientific relevance of the DASS is that when interventions to break this cycle are designed, a standard of comparison will be required that is applicable across all the models of care being compared. Our intention is that the DASS can help provide a way forward in developing such a standard. Additional research is needed in order to better understand the relationship between anticoagulation-related quality of life and adherence to treatment regimens, as well as how these regimens can be improved.
Using the DASS we were able to identify less-than-complete satisfaction among outpatients receiving anticoagulation. An initial psychometric analysis of the statistical properties of the DASS is encouraging. The clinical relevance of the DASS lies in its ability to summarize satisfaction with anticoagulation and to identify aspects of anticoagulation that may hinder individual patients from maintaining a PT-INR within therapeutic range. From identifying the limitations, hassles and burdens, and positive psychological impacts experienced by patients, many interventions can potentially be designed to improve anticoagulation quality of care, and thus reduce the time spent outside therapeutic range and, ultimately, thromo-embolic and bleeding events. The scientific relevance of the DASS is that when such interventions are designed, a standard of comparison will be required that is applicable across all the models of care being compared. Our intention is that the DASS can help provide a way forward in developing such a standard. Recognizing that instrument development and validation is by no means a one-time event, efforts at assessing and improving the DASS are ongoing.
List of abbreviations
DASS Duke Anticoagulation Satisfaction Scale
PSQ-18 Satisfaction with Medical Care Scale
SDS-5 Socially Desirable Response Set Scale
SF-36 Short-Form 36 Generic Health-Related Quality of Life Scale
Conceptualization and study design GS, DBM, RJD, IW, OH
Data collection GS, DBM, RJD
Statistical analysis GS
Manuscript preparation GS
Critical comment GS, DBM, RJD, IW, EH, GW, OH, CM, RE
Financial support was provided by AstraZeneca Pharmaceuticals. During the development of the scale, Peter Sawicki MD graciously shared an unpublished version of his instrument, and Meg McCormack PA-C RN, Bill Rock PharmD, Seth Landefeld MD, Tom Oertel MD and Jack Ansell MD provided expert commentary on the conceptualization of the instrument.
We would like to thank the following practices for participating in this study: Durham Veterans Affairs Medical Center, Duke General Internal Medicine, Durham Medical Center, and Roxboro Medical Associates. Coordinators responsible for data collection, database creation, or data entry include: Audrey Broome ANP, Kathlene Chmielewski, Sheila Cole RN, Nancy Covington RN, Pamela Gentry RN, Mira Gloss, Carly Miller, Lynn Harrington RN, Lisa Pulley RN, Leslie Walker RN, and Heather Zuleba.
Lancaster TR, Singer DE, Sheehan MA, Oertel LB, Maraventano SW, Hughes RA, Kistler JP, for the Boston Area Anticoagulation Trial for Atrial Fibrillation Investigators: The impact of long-term warfarin therapy on quality of life: evidence from a randomized trial.
J Am Med Assn 1999, 281(2):145-150. Publisher Full Text
Lakartidningen 1999, 96(20):2485-2487.
Eval Planning 1983, 6:247-263. Publisher Full Text
Samsa GP, Edelman D, Rothman ML, Williams GR, Lipscomb J, Matchar DB: Determining clinically important differences in health status measures: a general approach with illustration to the Health Utilities Index Mark II.
PharmacoEconomics 1999, 15:141-155. PubMed Abstract