Skip to main content

Are treatment benefits in neuropathic pain reflected in the self assessment of treatment questionnaire?

Abstract

Background/objective

The Self Assessment of Treatment (SAT) questionnaire was developed to reflect key patient reported outcomes of Neuropathic Pain (NP) treatments. This study aimed to understand how patients perceived the relevance and ease of understanding of the questions in the SAT and to recommend modifications based on patient and clinician interviews.

Methods

Semi-structured interviews were conducted with clinicians and NP patients to provide information regarding treatment attributes and the impact of pain. Patients were debriefed on the SAT, a 5-item scale evaluating pain, activity level, quality of life (QoL) and satisfaction with treatment (recommend treatment and undergo treatment again). The SAT has a recall period reflecting back to the start of treatment. The qualitative analysis software ATLAS.ti 5.0 was used to analyze patient transcripts. Changes to the SAT were integrated into the questionnaire for a second round of debriefing interviews.

Results

Three NP clinicians and 44 patients (20 painful diabetic neuropathy, 16 HIV-associated neuropathy and 8 post herpetic neuralgia) with a mean age of 60.3 (12.3) years and an even gender distribution were interviewed. Patient treatment experience included anticonvulsants (73%), antidepressants (34%), opioids (25%), and topical medications (41%). Pain descriptors and treatment attributes were similar across the three NP groups. Pain relief was judged the most important treatment attribute, followed by ability to undertake activities. Sleep improvement was another important attribute. Activity limitations and QOL were perceived as too broad and non-specific, and were split into 3 concepts each (activity limitations was split into self care, daily and physical activities and QOL was split into sleep, emotions, and social function). A 7-day recall period was introduced. The item stem and response options were made consistent, and a baseline and follow-up questionnaires were developed (except for the satisfaction items) to enable monitoring onset of treatment benefit and change over time.

Conclusions

The content validity of the revised SAT was improved by the qualitative research, and NP treatment benefits are reflected in a more consistent fashion by the changes. Baseline and follow-up versions make it possible to perform assessments of change over time.

Background

Neuropathic pain (NP) is one of the most prevalent pain etiologies [1]. It is a disorder of the peripheral nerves—the motor, sensory and autonomic nerves that connect the spinal cord to muscles, skin and internal organs [2, 3], and is a complex type of pain which requires a demonstrable lesion as defined by the updated pain terminology and definitions provided by the International Association for the Study of Pain (IASP); ( http://www.iasp-pain.org/AM/Template.cfm?Section=Pain_Definitions) [4]. Recently, Treede and colleagues [5] redefined NP as “pain arising as a direct consequence of a lesion or disease affecting the somatosensory system.” Damage to the peripheral nervous system can occur as a result of several disorders including diabetes, infections such as herpes zoster (shingles) or HIV, trauma, and autoimmune disorders [1, 6]. While NP can occur in any location, it often manifests in the extremities such as the hands, feet, or legs. The overall prevalence of NP varies from between 0.9 % to 8% in a general population [7, 8]. Among HIV patients between 15% and 35% have NP, whilst the prevalence is 15% in patients with painful diabetic neuropathy or post herpetic neuralgia [9].

The NP symptom experience and the evolution of the condition are highly idiosyncratic with individual experiences varying widely between patients [1, 6]. The course of NP can be episodic and recurrent, slowly progressing over many years, or it can quickly become severe and debilitating. Both direct and indirect costs of NP to society are substantial [1014]. The consequences to the individual patient profoundly impair emotional and physical functioning with consequences such as movement limitation, an inability to perform major activities of daily living, needing help for personal care, frequent use of health care services, and work productivity losses [10, 11, 15, 16]. The disease burden is also substantial as shown in a comparison of the world wide burden to patients of suffering from NP assessed in a cross national study [17]. The intensity of the pain as well as the duration of the pain contributes to the distress associated with NP.

Important outcome domains were identified in a survey of people with pain conducted by the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) [18]. These domains formed the basis of the IMMPACT group’s recommendations on a core set of outcome domains to be included in evaluation of treatment benefits [19]. Whilst pain relief measures are used to determine whether the patient has actually benefited from an intervention, and provide valuable information on how effectively pain is being managed, patient satisfaction measures capture the personal evaluation of the intervention provided [20].

Despite newer treatment modalities NP remains difficult to treat. Treatment of NP in the past mainly consisted of regular analgesics, suggesting patients are receiving suboptimal treatment options [21]. However, recently, the European Medicines Agency [22] and the US Food and Drug Administration [23] approved the use of a high-concentration capsaicin topical patch 8% (QUTENZA™). Capsaicin, in high concentrations like the QUTENZA™ patch, is a transient receptor potential vanilloid 1 (TRPV1) agonist that is useful in relieving pain. Whilst the QUTENZA™ EU label covers the treatment of peripheral NP in non-diabetic adults, either alone or in combination with other medicinal products for pain, the US label is licensed for the management of neuropathic pain associated with post herpetic neuralgia [22, 23].

The five-item Self Assessment of Treatment (SAT) questionnaire was developed internally by Neurogesx for use in clinical trials to measure key areas of treatment benefit (i.e. pain, activities, quality of life and treatment satisfaction) recommended by IMMPACT [18]. Since psychometric documentation of the SAT was lacking, a post hoc analysis was conducted using trials data to validate the SAT [24]. The results indicated that the three pain and impact items were reliable and valid, whilst the satisfaction items performed less well [24]. The SAT has been used as a secondary end-point in two trials assessing treatment with Capsaicin in human immunodeficiency virus (HIV)-associated peripheral neuropathy (HIV-PN) with beneficial results for QUTENZA™ cited in the medical review conducted by the FDA [25], as well as by [26] for the treatment of post herpetic neuralgia [22].

The psychometric performance suggested that the SAT items could be further improved with additional patient input to ensure that items are clearly phrased, relevant and comprehensive, easy to understand, and that the response options and recall period are adequate to better assess pain related treatment benefits when used in clinical trials. Therefore, the purpose of this study was to better understand how well the SAT questionnaire reflects what patients perceived as relevant aspects of pain treatment and to document patient understanding of the individual SAT questions. Additionally, recommendations were provided on how to modify the instrument to be better suited to assess the benefits of pain treatment by changing the recall period, based on the information gained in the semi-structured patient interviews.

Methods

Clinician interviews

Clinicians were interviewed to derive information from the clinical perspective on the most relevant neuropathic pain symptoms as well as the benefits and drawbacks of neuropathic pain treatments. A total of 3 clinicians with expertise in pain therapy, anesthesia intensive care, neurology and endocrinology participated in one-on-one telephone interviews. On average, the experts reported seeing 20 patients per week with NP. This consultation/interview was conducted up-front to ensure that patient interview questions would be appropriately addressed in the semi-structured interview guide.

Patient interviews

General inclusion criteria applied to all study participants were as follows: male or female; 18 years of age or older; presence of painful diabetic peripheral neuropathy (PDPN) or NP due to either post herpetic neuralgia (PHN) or painful HIV associated neuropathy (HIV-AN); presence of painful symptoms due to neuropathic pain with a numerical pain rating score (NPRS) of ≥4 at the time of screening; on a stable (not as needed, i.e., PRN) treatment for neuropathic pain for at least the past 3 months prior to screening; able to participate in a 90-minute, in-person interview; fluent in English (able to read and write); and willing and able to complete informed consent prior to study entry. Specific inclusion criteria for each pain group were as follows: PDPN, a diagnosis of painful, distal, symmetrical, sensorimotor polyneuropathy that is due to diabetes and made by the primary treating physician or Investigator at least one year prior to the screening visit; PHN, a diagnosis of PHN made by the primary treating physician or Investigator with at least 6 months of pain since shingles vesicle crusting; and HIV-AN, prior medical history of HIV-1 infection and prior diagnosis of HIV-DSP or antiretroviral toxic neuropathy documented by the consulting neurologist or investigator.

Exclusion criteria applied to all participants were as follows: parenteral opioid medication use; active substance abuse or history of chronic substance abuse within the past year, or prior chronic substance abuse (including alcoholism); neuropathic pain areas located only on the face, above the hairline of the scalp, and/or in proximity to mucous membranes; significant pain of an etiology other than one type of neuropathic pain (PHN, PDPN, or HIV-AN); significant ongoing pain from other cause(s) that may interfere with judging neuropathic pain, any implanted medical device (spinal cord stimulator, intrathecal pump, or peripheral nerve stimulator) for the treatment of neuropathic pain; recent history of a significant medical-surgical intervention; a clinically-relevant medical or psychiatric condition which, in the opinion of the investigator and/or coordinator, would interfere with completing the study including but not limited to sensory problems, cognitive impairment, acute mental illness, or inadequately treated depression or anxiety.

Because the SAT was developed for use in trials assessing the efficacy of the QUTENZA™ patch, efforts were taken to recruit a subset of patients who had experience with QUTENZA™ treatment. Similarly, efforts to recruit patients from the USA with a variety of socio-demographic backgrounds, as well as varied disease and treatment experiences, were implemented to ensure a diverse population was involved. Protocols were approved by an institutional review board, and patient consent was obtained prior to discussion of study related materials. Clinicians completed an enrollment and clinical form documenting each participant’s eligibility and treatment history.

During the semi-structured one-on-one qualitative interviews, participants were asked to describe their experience with NP, their treatment history, and how and why they value available treatment options. Interviews included questions and exercises designed to elicit participant discussion of salient pain treatment attributes and levels. Participants were asked to rate the importance of treatment attributes on a scale from 0 (Not Important) to 5 (Very Important). All interviews were led by a trained moderator. The interview guide included both structured and open-ended question.

During the interviews, patients were asked to complete the SAT and were then debriefed on each of the questions to uncover any issues with the SAT questions. The SAT was revised after the first round of interviews and additional debriefing interviews were conducted to ensure all changes were perceived as relevant improvements to the SAT.

Measures

During the qualitative interview, in addition to the SAT, participants completed a NPRS, and a brief socio-demographic questionnaire with questions regarding age, gender, ethnicity, employment, education, and co-morbid conditions.

Self Assessment of Treatment (SAT) questionnaire

The SAT evaluation form included 3 questions with 5-point response options to assess the impact of treatment on three areas (pain relief; activity level; and quality of life), and 2 additional items regarding: 1) whether the patient would undergo the treatment again, and 2) a comparison of the study treatment to previous treatments for pain. For each question, the subject checked a box on a 5-point scale, where the middle option (0) indicated a neutral response and the lower (−2) and higher (+2) options indicated a negative or positive response, respectively. For example, SAT Item 1 asked the patient “How do you assess your pain relief after treatment in this study?” with the response options of “I feel my pain is much worse” (−2), “somewhat worse” (−1), “no better and no worse” (0), “somewhat better” (1), and “much better” (2); Question 2 “How do you assess your activity level after treatment?” with responses ranging from I feel much less active (−2), I feel somewhat less active (−1), I feel no more and not less active (0), I feel somewhat more active (1) to I feel much more active (−2); Question 3 “How has your quality of life changed after treatment?” I feel my quality of life is much worse (−2), I feel my quality of life is somewhat worse (−1), I feel my quality of life is no better and no worse (0), I feel my quality of life is somewhat better (1), I feel my quality of life is much better (2); Question 4 “Would you undergo this treatment again?” was “administered to subjects with only three response options: “No, absolutely not” (−2), “Unsure” (0), and “Yes, definitely” (2) and Question 5 “How do you compare the treatment in this study to previous medication or therapies for your pain?” The item performance and psychometric properties of the SAT have recently been examined [24].

The Numerical Pain Rating Scale (NPRS)

The NPRS is commonly used in pain medication trials [27] and is one of the many pain items in the modified Brief Pain Inventory (BPI) [28, 29]. The NPRS is an 11-point graded scale ranging from 0–10 with 0 depicting “no pain at all” and 10 denoting “worst pain imaginable.”

Data analysis

Descriptive statistics (mean, standard deviation and frequency) were used to characterize the interview sample in terms of sociodemographic data, health status, the numerical pain rating and clinical characteristics. All interviews were audio recorded with the participant’s permission and transcribed for analysis. The qualitative analysis was conducted by coding the transcripts using ATLAS.ti version 5.0 [30] software to organize the coded concepts using a coding dictionary developed by the coding staff as the coding process continued and concepts were identified. This process was adhered to systematically analyze, code, and compare quotes from participant interviews in order to evaluate the underlying structure of the qualitative data.

The information gained in the interviews was used to explore any potential relevant missing items and to provide recommendations on how to modify the SAT for use in future studies.

Results

Clinical expert input on neuropathic pain

According to the clinical experts, there is a high degree of variability in descriptions of NP experiences among patients with the same type of NP but the descriptions do not differ significantly across types of NP. Experts indicated that patients often report challenges with pain relief and there is a low efficacy rate with the existing NP treatments. Common oral medications prescribed for NP, such as anticonvulsants, opioids, and antidepressants provide continuing efficacy but the dose titration process can be time consuming and many patients experience side effects from oral medications. In contrast, topical medications offer a more agreeable side effect profile but the duration of efficacy is limited in comparison with the oral medications. Interestingly, the experts suggested that the QUTENZA™ patch may offer an extended duration of efficacy compared to other topical treatments for NP and it may be particularly beneficial for patients experiencing burning superficial pain with allodynia such as those with PHN or HIV-AN. Expert opinion also included some negative aspects of QUTENZATM such as painful application, or a lengthy application process requiring assistance from a medical professional.

Patient demography and clinical characteristics

A total of 44 patients participated in the one-on-one qualitative interviews in California, Florida, Georgia, and Virginia over a 3-month period. Twenty patients suffered from PDPN, 16 had HIV-AN and eight had PHN. Demographic and clinical characteristics of the participants are provided in Table  1 and Table  2, respectively.

Table 1 Demographic characteristics and self report Co Morbid conditions
Table 2 Clinical characteristics

Patient experiences with neuropathic pain

Participants reported experiencing many different types of pain and pain symptoms. The most prevalent pain descriptions included: burning, mentioned by 30% (n=13) of the participants, numb (n=12. 27%), sharp (n=10, 23%), pins and needles (n=9, 21%) and throbbing pain n=6, (14%). Less frequent pain descriptors characterized the pain as hot, stabbing, tingling, aching, dull, heavy, and shooting pain, whilst only one or two participants described the pain as cramping, electrical shock, freezing/cold, hypersensitive, biting, clamping, cutting, piercing, pinching, pressure, and tight. There was no major difference between the NP populations in the way they described their pain (Table  3).

Table 3 Pain descriptions

These pain symptoms had an impact on daily activities (Table  4) and aspects of participants’ personal lives. The most common impact of NP on daily activities reported by participants across all pain groups was that pain affected the ability to “do” or engage in daily activities, which was reported by 61% (n=27) of the participants with no difference across NP populations. Participants commonly reported that neuropathic pain interrupted daily activities and that they avoid doing certain activities as a result of their neuropathic pain.

Table 4 Impact of neuropathic pain

Participants were asked to provide examples of the activities affected by neuropathic pain (Table  4). Specific daily activities that were adversely affected by neuropathic pain included: shopping, work, cooking, driving or transportation, cleaning, and wearing clothing. Daily activities identified by 1 or 2 participants included: caring for someone else, going to appointments, home maintenance, running errands, and hygiene. The impact of neuropathic pain on daily activities was similar across pain types. During these discussions, sleep disturbance was commonly identified and had a negative impact among 20 participants (46%) across pain types.

The physical activities affected by neuropathic pain varied by NP population type. Forty five percent of participants with PDPN (n=9) and 56% of participants with HIV-AN (n=9) identified walking and 10% (n=2) and 19% (n=3) respectively identified standing, as physical activities commonly affected by NP, while none of the participants with PHN reported difficulty with these activities (Table  4). Gardening and yard work were reportedly affected by PHN (25% of participants, n=2) and PDPN (10% of participants, n=2) but not at all by HIV-AN participants. Exercise was only discussed as an affected physical activity by HIV-AN participants (n=5, 31%). Playing sports, (PHN n=2, 25%; PDPN n=5, 25%; HIV-AN n=3, 19%) and sitting (PHN n=2, 25%; PDPN n=1, 5.0%; HIV-AN n=3, 19%) were affected for participants in all pain groups, with 23% (n=10) of the participants identifying playing sports as a problem and 14% (n=6) of the participants identifying sitting as a problem. Other physical activities, mentioned by only 1 or 2 participants, included lifting and playing with kids. Participants in all pain groups reported an impact on social activities, but this impact was reported less frequently by participants with HIV-AN than by participants with PHN or PDPN.

In addition to the impact on activities, participants discussed the impacts of NP on their personal lives. About 27% (n=12) of participants across all pain groups noted a negative impact of NP on relationships quoting experiences such as “if you go somewhere with a friend or something and then you have to be-I’ll be like sitting there and then have the sharp pains and then they’re like oh, my gosh, what’s wrong with you? You know, it does interfere with your relationships.” Similarly, about 25% (n=11) of participants mentioned that pain had a negative effect on their emotional well-being. Only one or two participants reported experiencing changes in mental state, outlook on life, sex life, feeling short tempered and difficulty concentrating/focusing as a result of neuropathic pain.

Although descriptions of pain experiences and impacts were highly variable, the experiences reported by patients were not different across the NP populations. This similarity across pain types is consistent with the observations of high intra-pain type variability reported during clinician interviews.

Treatment experiences

Patients were asked to discuss their experience with NP treatments. The most commonly reported type of treatment was anticonvulsant medication followed by antidepressants (Table  5). Participants also reported treatment with opioid and non-opioid analgesics such as NSAIDs and acetaminophen. Experiences with pain treatments other than oral medications included topical treatments (excluding QUTENZA™). Experience with topical treatments and the QUTENZA™ patch were more common among participants with PHN (n=5, 63% and n=2, 25%) whilst in HIV-AN 44% (n=7) used the QUTENZA™ patch in contrast to only 10% (n=2) and 5% (n=1) in PDPN patients. Physical therapy, acupuncture and injections were treatment options only reported by single individual patients.

Table 5 Current and prior neuropathic pain treatments

During the discussion of current and prior treatments, participants were specifically asked to share their experiences with treatment use, availability, cost, and side effects. It is important to note that some participants have tried several different medications within a treatment type and reported different experiences for the different medications.

When asked to describe how easy or difficult it was to use each treatment, most participants (n=75, 82%) described treatments as easy to use. Anticonvulsant medications were generally reported as easy to use by between 73%–88% of participants across all pain groups, as were opioids (65–100%) and non-opioid analgesics (57%–100%). Most participants (78%–100%) with experience using topical treatments indicated that the treatments were easy to use. Half (n=5) of the participants that had tried the QUTENZATM patch said that it was easy to use.

During the discussion of treatment use, participants specified both positive and negative aspects of treatment that influenced their opinions on treatment usability. Pain relief, low pill burden, and ease of taking a pill were highlighted as positive benefits by a majority of the participants. Other participants mentioned duration of relief, improvement in sleep, ability to take the treatment with other medications, onset of relief, cost, and side effects. Twelve out of 16 participants (75%) with HIV-AN reported that pain relief was important in their assessment of treatment usability. There were few problems associated with oral medications although 4 participants (13%) commented on the high pill burden associated with anticonvulsants. More than half of the participants (n=25, 57.7%) reported changing neuropathic pain treatments at least once during the course of their treatment experience. The main reasons for switching were ineffective treatments (n=13, 50%) and side effects (n=11, 42.3%). Other reasons for discontinuing a previous therapy included: physician’s decision, insufficient pain relief, contraindication with another medication, high cost, high pill burden, too much trouble to use, short duration of effectiveness, medication taken off the market, messy application, and loss of effectiveness. The most common reason for starting a new medication was to provide additional pain relief (n=6, 23%). Participants also indicated that new mediations were added to on-going treatments to help with sleeping, break through pain, or severe pain.

In the rating of treatment attributes, pain relief (identified by 47% of the participants, n=45) was identified as the key aspect of treatment. By treatment, pain relief was named as the best aspect of treatment with the highest frequency for opioids (n=4, 64%), QUTENZA™ (n=4, 60%), and anticonvulsants (n=11, 50%). Other characteristics identified as “best aspects of treatment” included ease of use, no side effects, availability, cost, help with sleeping, duration of effectiveness, and quick on-set. “Reduction in pain” was rated as the most important attribute across all pain groups with an average score for all of = 4.7 (range 0–5). Among PHN patients the average was 5.0, PDPN4.6, and HIV-AN=4.8. Participants with PHN and HIV-AN rated ‘Duration of pain relief’ as tied with ‘reduction in pain’ as the two most important attributes in determining treatment success (average scores of 5.0 out of 5 and 4.8, respectively). The second highest rated attribute for participants with PDPN was “improvement in ability to do your usual activities” (average score = 4.5).

The most common treatment characteristic, irrespective of mode of administration, identified by participants as the “worst aspect of treatment” was side effects (28%). Pill burden was identified as the worst aspect for nine oral therapies discussed by participants.

Both clinicians and patients commented on topical as opposed oral medications with topical medication offering a more favorable side effect profile. These finding suggest that side effects play an important role when it comes to treatment satisfaction and its evaluation in clinical trials.

Factors for treatment success

Characteristics of ideal treatments could be separated into 3 categories: results of treatment (n=40), route of administration (n=33), and treatment use (n=19). Ideal treatment attributes described by participants were generally similar across pain groups and focused on complete elimination of pain, permanent pain relief and no side effects. As to most favored routes of administration, taking a pill, use of a patch, and topical administration were reported in that order.

Patient feedback on the SAT

During the debriefing interviews, several issues were reported related to the SAT. In question 1, the question stem and the response options presented challenges since they were not consistent, e.g., the question asks for an assessment of the pain level and the response option states the pain is worse/better after treatment. Question 2 asks respondents to assess the activity level after treatment. Participants found “activity level” to be too broad and unspecific and provided specific examples on activities affected by pain. Question 3 asks about changes in quality of life after treatment which generally was considered to be an unspecific concept. Similar to the question on activity levels, patients reported items they found were important to their quality of life. In question 4 where respondents are asked to state if they would like to undergo treatment again it became obvious that the response options did not fit the questions stem and were not consistent with responses to the questions. Question 5 asks respondents to compare the treatment to other pain treatments with responses describing level of preference for previous or current treatment. Hence the question stem and the response options did not match which caused problems for the respondents.

Additionally, the recall period for all items is retrospective requiring patients to reflect back to when treatment was started which is difficult to remember precisely and therefore fraught with recall bias. The use of positive and negative numbers to depict the response options, especially the negative numbers also caused confusion.

Modifications of the SAT

The patient input suggested that items 2 (activity level) and 3 (quality of life) were too broad and nonspecific. Therefore, these questions were split into 3 sub-questions each using the detailed information derived in the qualitative research. The questions were revised to include examples of specific activities to describe examples of self care activities, daily activities and physical activities, all frequently mentioned in the interviews. With regards to question 3, the same procedure was followed replacing quality of life with specific aspects of your life using emotional well being, sleep and social function as illustrative examples, these again were derived from the interviews.

Questions 4 and 5 they were rephrased to “Based on your experience with the study treatment, would you like to receive this treatment again?” (no, definitely not–yes, definitely) and “Based on your experience with the study treatment, overall how does this treatment compare to other treatments you have received in the past?” (very much worse–very much better). The recommendation is to use questions 1–3 at baseline and predefined follow up visits, and to include questions 4 and 5 at the final visit only.

For questions 1 3, the recall period was changed to “Over the past 7 days.” The response options for questions 1 3 were changed to not at all/slightly better/moderately better/quite a bit better/very much better for all 3 questions to improve consistency.

Baseline and follow up versions of SAT questions 1–3 were also developed to enable assessment of response to treatment over time. Given the nature of questions 4 and 5 no baseline questions were developed for these items.

The changes made to the SAT to address the issues identified during patient interviews are summarized in Table  6.

Table 6 Summary of suggested revisions to the SAT

Discussion

There are a couple of pain satisfaction surveys. The American Pain Society (APS) Satisfaction Survey is one of these and has shown that satisfaction was influenced largely by effectiveness of medication, independent of pain intensity [31]. This suggests that a satisfaction survey related to the effectiveness of a pain medication is an important measurement tool for use in clinical trials of novel pain treatments which is also consistent with the recommendations of the IMMACT group [18].

Even though the APS Satisfaction Survey focused on pain management in general practice, it was not directly related to satisfaction with medication. The same applies to another pain survey, the Pain Treatment Satisfaction Scale (PTSS) [32] which measured satisfaction in patients receiving treatment for acute or chronic pain; it was not designed for use in clinical trials, as it evaluates satisfaction with medical care received as well as pain medication. Although a variety of instruments capturing patient satisfaction exists, none of these measures were identified as appropriate for assessing patient satisfaction with medication used to evaluate the effect of treatment of chronic pain in the context of a clinical trial, which led to the development of the SAT.

In all, forty-four patients across three NP populations were interviewed which can be regarded as a sufficiently large sample size. The consistency of the findings support content validity and concept saturation as defined by Leidy and Vernon [33]and Magasi et al. [34]. Specifically, they define saturation as the point at which no substantially new information/concepts continue to emerge beyond what has been previously mentioned when interviewing the last few patients. Additional support can be found in the FDA guidance document [35], “The number of patients is not as critical as interview quality and patient diversity included in the sample in relation to intended clinical trial population characteristics.” In general, the 3 NP populations were similar in the way they described pain and the impact of pain symptoms. Clinicians reported a high variability in terms of pain reporting across patients but not across different NP types. Although a small number of clinicians were interviewed for this study, they provided similar input on the variability of pain experiences. The pain descriptors used by patients also varied, but were consistent irrespective of NP type and very also similar to the descriptors included in the McGill short form pain questionnaire where pain is referred to as debilitating, burning, sharp, jabbing, deep, and aching, and can persist for months or years [36, 37]. The similarity in pain description across all three NP types indicates that the content of the SAT is applicable for use across the different NP populations.

Similarities supporting the use of the SAT across all three NP populations prove that the concept of satisfaction with treatment assessment is fundamental in the evaluation of pain medication with both the clinical experts and the patients rating the reduction in pain as the most important treatment attribute followed by the ability to perform usual activities (by the PDPN population) and duration of pain relief (by the PHN and HIV-AN populations).

As pain reduction is unanimously identified as the most important aspect of treatment, it is not surprising that changes in pain have been shown to be closely linked to improvement in quality of life [13]. Once again, in the interviews, no difference was seen between the groups in terms of the impact of NP and the disruption of ability to perform daily activities and its impact on quality of life. With similarities in terms of pain definitions and similarities in the way that it affects individuals across all NP types as well as the fact that pain reduction is a critical component of treatment, it appears that the SAT would be appropriate for use in all NP types.

Pain is one area of research where the subjective experience and reporting by the patient is well-established and the concept of self assessment is particularly relevant. The importance of patient report/self assessment can be seen in work conducted by Taylor-Stokes and colleagues [38] where there was significant association between patient- and physician- rated severity but physician and patient ratings were discordant with physicians underestimating severity in 46.7% of patients who reported severe PDPN. Therefore, a patient-reported tool is critical in accessing the correct data. With patients identifying a reduction in pain as the most important treatment attribute, question 1 of the SAT is designed to assess this upfront. The patient interviews provided significant insight into the impact that pain has on patients’ lives and as a result questions 2 and 3 have been modified to reflect the multiple areas on which pain has an impact. Daily activities, physical activities, social activities and relationships were identified by participants with varying types and degrees of NP as facets of life that were affected by pain. These aspects are also captured by Ko and colleagues [39] who report that pain from PDPN interfered with general activity, mood, walking, normal work, relationships, sleep, and enjoyment of life. The addition of sleep and the emotional impact of pain identified by the participants are mirrored in the domain suggestions of the by the IMMPACT group [7, 19, 40]. The suggested modifications of the SAT enables patients to provide more details, as uncovered in the patient interviews, about the way NP affects their lives and the resulting impact of treatment in areas of life that matter to NP patients. Additionally, the consistency in pain and impact reports supports the content validity of the revised SAT, a critical component in any self report instrument [34, 41, 42].

With the introduction of baseline and follow up questionnaires and the inclusion of onset and duration of action of NP treatment, two important treatment attributes mentioned by patients in the interviews can be more efficiently captured. The modifications to the SAT provide an instrument that is more appropriate for use in clinical trials providing a baseline assessment and follow up assessments.

The previous recall bias is also amended and is more in line with FDA recommendations than the previous version as a result of the shorter recall period. The questions on the revised SAT are phrased in a consistent fashion to facilitate the respondents’ answering. Both the questions and the response options follow a similar pattern as well as the inclusion of examples derived from the interviews.

The content validity of the revised SAT has been supported by extensive qualitative research among diverse NP populations and clinicians and NP treatment benefits are now reflected in a more accurate and informed manner in the measure. Further alterations may be necessary once data on the measure performance has been collected but currently the most fundamental concept that of content validity has been assured. Without validity, a measure with good psychometric properties but not based on something real is not valid and has no use.

Funding source

Astellas Pharma Global Development provided funding for this study.

Abbreviations

BPI:

Brief Pain Inventory

EMA:

European Medicines Agency

FDA:

US Food and Drug Administration

HIV-AN:

HIV associated neuropathy

IASP:

International Association for the Study of Pain

IMMPACT:

Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials

NP:

Neuropathic pain

NPRS:

Numerical pain rating score

PDPN:

Painful diabetic peripheral neuropathy

PHN:

Post Herpetic Neuralgia

QoL:

Quality of Life

SAT:

Self Assessment of Treatment

References

  1. Campbell JN, Meyer RA: Mechanisms of neuropathic pain. Neuron 2006, 52: 77–92. 10.1016/j.neuron.2006.09.021

    Article  CAS  PubMed  Google Scholar 

  2. Dworkin RH, Backonja M, Rowbotham MC, Allen RR, Argoff CR, Bennett GJ, Bushnell MC, Farrar JT, Galer BS, Haythornthwaite JA: Advances in neuropathic pain: diagnosis, mechanisms, and treatment recommendations. Arch Neurol 2003, 60: 1524–1534. 10.1001/archneur.60.11.1524

    Article  PubMed  Google Scholar 

  3. Wall PD, Melzack R (Eds): Textbook of pain. 4th edition. Edinburgh; New York: Churchill Livingstone; 1999.

    Google Scholar 

  4. International Association for the Study of Pain (IASP): IASP Taxonomy. Washington, DC: International Association for the Study of Pain (IASP); 2011. http://www.iasp-pain.org/

    Google Scholar 

  5. Treede RD, Jensen TS, Campbell JN, Cruccu G, Dostrovsky JO, Griffin JW, Hansson P, Hughes R, Nurmikko T, Serra J: Neuropathic pain: redefinition and a grading system for clinical and research purposes. Neurology 2008, 70: 1630–1635. 10.1212/01.wnl.0000282763.29778.59

    Article  CAS  PubMed  Google Scholar 

  6. National Institute of Neurological Disorders and Stroke: Peripheral Neuropathy Fact Sheet. NIH Publication No. 04–4853. 2010. http://www.ninds.nih.gov/disorders/peripheralneuropathy/detail_peripheralneuropathy.htm

    Google Scholar 

  7. Dworkin RH, O'Connor AB, Backonja M, Farrar JT, Finnerup NB, Jensen TS, Kalso EA, Loeser JD, Miaskowski C, Nurmikko TJ: Pharmacologic management of neuropathic pain: evidence-based recommendations. Pain 2007, 132: 237–251. 10.1016/j.pain.2007.08.033

    Article  CAS  PubMed  Google Scholar 

  8. Gore M, Dukes E, Rowbotham DJ, Tai KS, Leslie D: Clinical characteristics and pain management among patients with painful peripheral neuropathic disorders in general practice settings. Eur J Pain 2007, 11: 652–664. 10.1016/j.ejpain.2006.10.004

    Article  PubMed  Google Scholar 

  9. Sadosky A, McDermott AM, Brandenburg NA, Strauss M: A review of the epidemiology of painful diabetic peripheral neuropathy, postherpetic neuralgia, and less commonly studied neuropathic pain conditions. Pain Pract 2008, 8: 45–56. 10.1111/j.1533-2500.2007.00164.x

    Article  PubMed  Google Scholar 

  10. Manca A, Kumar K, Taylor RS, Jacques L, Eldabe S, Meglio M, Molet J, Thomson S, O'Callaghan J, Eisenberg E: Quality of life, resource consumption and costs of spinal cord stimulation versus conventional medical management in neuropathic pain patients with failed back surgery syndrome (PROCESS trial). Eur J Pain 2008, 12: 1047–1058. 10.1016/j.ejpain.2008.01.014

    Article  PubMed  Google Scholar 

  11. McCarberg BH, Billington R: Consequences of neuropathic pain: quality-of-life issues and associated costs. Am J Manag Care 2006, 12: S263-S268.

    PubMed  Google Scholar 

  12. McDermott AM, Toelle TR, Rowbotham DJ, Schaefer CP, Dukes EM: The burden of neuropathic pain: results from a cross-sectional survey. Eur J Pain 2006, 10: 127–135. 10.1016/j.ejpain.2005.01.014

    Article  PubMed  Google Scholar 

  13. O'Connor AB: Neuropathic pain: quality-of-life impact, costs and cost effectiveness of therapy. PharmacoEconomics 2009, 27: 95–112. 10.2165/00019053-200927020-00002

    Article  PubMed  Google Scholar 

  14. Tarride J, Collet J, Choinière M, Rousseau C, Gordon A: The economic burden of neuropathic pain in canada. J Med Econ 2006, 9: 55–68. 10.3111/200609055068

    Article  Google Scholar 

  15. Jensen MP, Chodroff MJ, Dworkin RH: The impact of neuropathic pain on health-related quality of life: review and implications. Neurology 2007, 68: 1178–1182. 10.1212/01.wnl.0000259085.61898.9e

    Article  PubMed  Google Scholar 

  16. Meyer-Rosberg K, Kvarnstrom A, Kinnman E, Gordh T, Nordfors LO, Kristofferson A: Peripheral neuropathic pain–a multidimensional burden for patients. Eur J Pain 2001, 5: 379–389. 10.1053/eujp.2001.0259

    Article  CAS  PubMed  Google Scholar 

  17. Hoffman DL, Sadosky A, Alvir J: Cross-national burden of painful diabetic peripheral neuropathy in asia, latin america, and the middle east. Pain Pract 2009, 9: 35–42. 10.1111/j.1533-2500.2008.00249.x

    Article  PubMed  Google Scholar 

  18. Turk DC, Dworkin RH, Allen RR, Bellamy N, Brandenburg N, Carr DB, Cleeland C, Dionne R, Farrar JT, Galer BS: Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain 2003, 106: 337–345. 10.1016/j.pain.2003.08.001

    Article  PubMed  Google Scholar 

  19. Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, Haythornthwaite JA, Jensen MP, Kerns RD, Ader DN: Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain 2008, 9: 105–121. 10.1016/j.jpain.2007.09.005

    Article  PubMed  Google Scholar 

  20. Afilalo M, Cantees K, Ducharme J: Current pain-control practices and research. Ann Emerg Med 1996, 27: 404–407. 10.1016/S0196-0644(96)70215-9

    Article  CAS  PubMed  Google Scholar 

  21. Dieleman JP, Kerklaan J, Huygen FJ, Bouma PA, Sturkenboom MC: Incidence rates and treatment of neuropathic pain conditions in the general population. Pain 2008, 137: 681–688. 10.1016/j.pain.2008.03.002

    Article  PubMed  Google Scholar 

  22. European Medicines Agency: Qutenza-authorisation details. London, UK: European Medicines Agency; 2009.

    Google Scholar 

  23. FDA Center for Drug Evaluation and Research: Summary review for regulatory action. 2009. http://www.accessdata.fda.gov/drugsatfda_docs/nda/2009/022395s000sumr.pdf

    Google Scholar 

  24. Wyrwich KW, Kawata AK, Thompson C, Holmstrom S, Stoker M, Wiklund I: Validation of the Self-Assessment of Treatment questionnaire among patients with postherpetic neuralgia. Pain Res Treat 2012, 2012: 621619.

    PubMed  Google Scholar 

  25. Neurogesx Inc: Qutenza (Capsaicin 80% Patch) for the Management of Neuropathic Pain Associated with Human Immunodeficiency Virus-Associated Peripheral Neuropathy: FDA Briefing document for the anesthesia and analgesia drug products advisory committee meeting-February 9, 2012. Silver Spring, MD: Food and Drug Administration; 2012. http://www.fda.gov/downloads/AdvisoryCommittees/CommitteesMeetingMaterials/Drugs/AnestheticAndLifeSupportDrugsAdvisoryCommittee/UCM290279.pdf

    Google Scholar 

  26. Committee for Medicinal Products for Human Use (CHMP): CHMP Assessment Report for Qutenza. London, UK: European Medicines Agency; 2009. http://www.ema.europa.eu/docs/en_GB/document_library/EPAR_-_Public_assessment_report/human/000909/WC500040450.pdf

    Google Scholar 

  27. Farrar JT, Young JP Jr, LaMoreaux L, Werth JL, Poole RM: Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain 2001, 94: 149–158. 10.1016/S0304-3959(01)00349-9

    Article  CAS  PubMed  Google Scholar 

  28. Cleeland C: The brief pain inventory: user guide. Houston, TX: The University of Texas MD Anderson Cancer Center; 2009.

    Google Scholar 

  29. Cleeland CS: Pain assessment in cancer. In Effect of Cancer on Quality of Life. Edited by: Osoba D. Boca Raton, Fla: CRC Press; 1991:293–305.

    Google Scholar 

  30. Muhr T: User's Manual for ATLAS.ti 5.0. 2004.

    Google Scholar 

  31. Carlson J, Youngblood R, Dalton JA, Blau W, Lindley C: Is patient satisfaction a legitimate outcome of pain management? J Pain Symptom Manage 2003, 25: 264–275. 10.1016/S0885-3924(02)00677-2

    Article  PubMed  Google Scholar 

  32. Evans CJ, Trudeau E, Mertzanis P, Marquis P, Pena BM, Wong J, Mayne T: Development and validation of the pain treatment satisfaction scale (PTSS): a patient satisfaction questionnaire for use in patients with chronic or acute pain. Pain 2004, 112: 254–266. 10.1016/j.pain.2004.09.005

    Article  PubMed  Google Scholar 

  33. Leidy NK, Vernon M: Perspectives on patient-reported outcomes: content validity and qualitative research in a changing clinical trial environment. PharmacoEconomics 2008, 26: 363–370. 10.2165/00019053-200826050-00002

    Article  PubMed  Google Scholar 

  34. Magasi S, Ryan G, Revicki D, Lenderking W, Hays RD, Brod M, Snyder C, Boers M, Cella D: Content validity of patient-reported outcome measures: perspectives from a PROMIS meeting. Qual Life Res 2012, 21: 739–746. 10.1007/s11136-011-9990-8

    Article  PubMed  Google Scholar 

  35. Food and Drug Administration: Guidance for industry on patient-reported outcome measures: use in medical product development to support labeling claims. Fed Regist 2009, 74: 65132–65133.

    Google Scholar 

  36. Mayo Clinic Staff: Postherpetic neuralgia. 2010. http://www.mayoclinic.com/health/postherpetic-neuralgia/DS00277/DSECTION=symptoms

    Google Scholar 

  37. Melzack R: The short-form McGill pain questionnaire. Pain 1987, 30: 191–197. 10.1016/0304-3959(87)91074-8

    Article  CAS  PubMed  Google Scholar 

  38. Taylor-Stokes G, Pike J, Sadosky A, Chandran A, Toelle T: Association of patient-rated severity with other outcomes in patients with painful diabetic peripheral neuropathy. Diabetes Metab Syndr Obes 2011, 4: 401–408.

    PubMed  Google Scholar 

  39. Ko KS, Cha BY, Kim CH, Kwon HS, Lee JH, Park TS, Won JC, Ko SK, Park HJ: Patient-reported outcomes in subjects with painful diabetic peripheral neuropathy: pain description and quality of life. Value in Health 2011, 14: A66.

    Article  Google Scholar 

  40. Turk DC, Dworkin RH, Revicki D, Harding G, Burke LB, Cella D, Cleeland CS, Cowan P, Farrar JT, Hertz S: Identifying important outcome domains for chronic pain clinical trials: an IMMPACT survey of people with pain. Pain 2008, 137: 276–285. 10.1016/j.pain.2007.09.002

    Article  PubMed  Google Scholar 

  41. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, Ring L: Content validity–establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2–assessing respondent understanding. Value Health 2011, 14: 978–988. 10.1016/j.jval.2011.06.013

    Article  PubMed  Google Scholar 

  42. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, Ring L: Content validity–establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1–eliciting concepts for a new PRO instrument. Value Health 2011, 14: 967–977. 10.1016/j.jval.2011.06.014

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ingela Wiklund.

Additional information

Competing interests

Stefan Holmstrom and Malcolm Stoker are full time employees of Astellas Pharma Global Development. The processing fees for this publication will be paid by Astellas Pharma Global Development. No other financial or non-financial interests to declare. Ingela Wiklund, Kathy Wyrwich and Mary Devine: Are employed by the United BioSource Corporation (UBC), which provides consulting and other research services to pharmaceutical, device, government and non-government organizations. In this salaried position, (staff) works with a variety of companies and organizations. He/She receives no payment or honoraria directly from these organizations for services rendered.

Authors’ contributions

IW, KW, KD, SH and MS contributed to conception and design of the study, acquisition of data and interpretation of data; IW, KW and MD contributed to analysis and interpretation of data. All authors contributed to drafting the article or reviewing and revising it critically for important intellectual content; all authors approved the final version to be published. IW attests that the authors had access to all the study data, takes responsibility for the accuracy of the analysis, and had authority over manuscript preparation and the decision to submit the manuscript for publication.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Wiklund, I., Holmstrom, S., Stoker, M. et al. Are treatment benefits in neuropathic pain reflected in the self assessment of treatment questionnaire?. Health Qual Life Outcomes 11, 8 (2013). https://doi.org/10.1186/1477-7525-11-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1477-7525-11-8

Keywords