<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>1477-7525-6-97</ui>
   <ji>1477-7525</ji>
   <fm>
      <dochead>Research</dochead>
      <bibl>
         <title>
            <p>Logistic feasibility of health related quality of life measurement in clinical practice: results of a prospective study in a large population of chronic liver patients</p>
         </title>
         <aug>
            <au id="A1">
               <snm>Gutteling</snm>
               <mi>J</mi>
               <fnm>Jolie</fnm>
               <insr iid="I1"/>
               <insr iid="I2"/>
               <email>j.gutteling@erasmusmc.nl</email>
            </au>
            <au id="A2">
               <snm>Busschbach</snm>
               <mi>JV</mi>
               <fnm>Jan</fnm>
               <insr iid="I2"/>
               <email>j.vanbusschbach@erasmusmc.nl</email>
            </au>
            <au id="A3">
               <snm>de Man</snm>
               <mi>A</mi>
               <fnm>Robert</fnm>
               <insr iid="I1"/>
               <email>r.deman@erasmusmc.nl</email>
            </au>
            <au ca="yes" id="A4">
               <snm>Darlington</snm>
               <mi>E</mi>
               <fnm>Anne-Sophie</fnm>
               <insr iid="I2"/>
               <email>a.darlington@erasmusmc.nl</email>
            </au>
         </aug>
         <insg>
            <ins id="I1">
               <p>Department of Gastroenterology and Hepatology, Erasmus MC, 's Gravendijkwal 230, 3015 CE, Rotterdam, the Netherlands</p>
            </ins>
            <ins id="I2">
               <p>Department of Medical Psychology and Psychotherapy, Erasmus MC, Dr. Molewaterplein 50, 3015 GE Rotterdam, the Netherlands</p>
            </ins>
         </insg>
         <source>Health and Quality of Life Outcomes</source>
         <issn>1477-7525</issn>
         <pubdate>2008</pubdate>
         <volume>6</volume>
         <issue>1</issue>
         <fpage>97</fpage>
         <url>http://www.hqlo.com/content/6/1/97</url>
         <xrefbib>
            <pubidlist>
               <pubid idtype="pmpid">19000316</pubid>
               <pubid idtype="doi">10.1186/1477-7525-6-97</pubid>
            </pubidlist>
         </xrefbib>
      </bibl>
      <history>
         <rec>
            <date>
               <day>28</day>
               <month>8</month>
               <year>2007</year>
            </date>
         </rec>
         <acc>
            <date>
               <day>10</day>
               <month>11</month>
               <year>2008</year>
            </date>
         </acc>
         <pub>
            <date>
               <day>10</day>
               <month>11</month>
               <year>2008</year>
            </date>
         </pub>
      </history>
      <cpyrt>
         <year>2008</year>
         <collab>Gutteling et al; licensee BioMed Central Ltd.</collab>
         <note>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note>
      </cpyrt>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <sec>
               <st>
                  <p>Background</p>
               </st>
               <p>The objective of the present study was to provide a complete and detailed report of technical and logistical feasibility problems with the implementation of routine computerized HRQoL measurement at a busy outpatient department of Hepatology that can serve as a tool for future researchers interested in the procedure.</p>
            </sec>
            <sec>
               <st>
                  <p>Methods</p>
               </st>
               <p>Practical feasibility was assessed by observing problems encountered during the development of the computer program, observing patients' ability to complete the HRQoL questionnaires, monitoring the number of times that patients completed the HRQoL questionnaires and observing logistics at the outpatient department. Patients' reasons for not completing the HRQoL questionnaires were assessed retrospectively by means of a mailed questionnaire. Physicians' attitudes towards the availability of computerized HRQoL information about their patients were assessed by means semi-structured interviews and by means of checklists administered after each consultation with s study participant.</p>
            </sec>
            <sec>
               <st>
                  <p>Results</p>
               </st>
               <p>All physicians (n = 11) and 587 patients agreed to participate in the study. Practical feasibility problems concerned complicated technical aspects of developing a user-friendly computer program and safe data transmission over the Internet, patients' lack of basic computer skills and patients' lack of compliance (completion of questionnaires on only 43% of the occasions). The main reason given for non-compliance was simply forgetting, which seemed to be related to reception employees' passive attitude towards sending patients to the computer. Physicians were generally positive about the instant computerized availability of HRQoL information. They requested the information in 92% of the consultations and found the information useful in 45% of the consultations, especially when it provided them with new information.</p>
            </sec>
            <sec>
               <st>
                  <p>Conclusion</p>
               </st>
               <p>This study was among the first to implement the complete procedure of routine computerized HRQoL measurements in clinical practice and to subsequently describe the feasibility issues encountered. It was shown that the attitudes of physicians were generally positive. Several barriers towards successful implementation of such a procedure were encountered, and subsequently solutions were provided. Most importantly, when implementing routine computerized HRQoL measurements in clinical practice, assistance of an IT professional for the development of a tailor-made computer program, availability of questionnaires in multiple languages and the use of touch-screen computers to optimise patient participation are essential. Also, all staff of the department concerned should approve of the intervention and consider it as part of standard clinical routine if successful implementation is to be obtained.</p>
            </sec>
         </sec>
      </abs>
   </fm>
   <meta>
      <classifications>
         <classification id="endnote" subtype="user_supplied_xml" type="bmc"/>
      </classifications>
   </meta>
   <bdy>
      <sec>
         <st>
            <p>Background</p>
         </st>
         <p>The importance of patients' health related quality of life (HRQoL) in medical practice is nowadays beyond dispute. Two decades ago a committee of the American College of Physicians specifically supported the view that maintenance of a patient's functional well-being is a fundamental goal of medical practice. They also noted that the assessment of the physical, psychological, and social functioning of the patient in terms of the impact of disease is "an essential part of clinical diagnosis, a major determinant of therapeutic choices, a measure of their efficacy, and a guide in planning long-term care..."<abbrgrp><abbr bid="B1">1</abbr></abbrgrp>.</p>
         <p>Since 2001, several impact high impact articles have been published on the effectiveness of HRQoL measurement in clinical practice, which have presented positive results such as more frequent discussion and identification of HRQoL related problems, improved emotional functioning, improved HRQoL, a decrease in depression, a decrease in debilitating symptoms, and expressed interest in continued use of the information by both physicians and patients <abbrgrp><abbr bid="B2">2</abbr><abbr bid="B3">3</abbr><abbr bid="B4">4</abbr><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr><abbr bid="B7">7</abbr></abbrgrp>. Despite these positive results, standard measurement and feedback of HRQoL has as of yet not been widely implemented in clinical practice. This may be explained by the initial lack of convincing data regarding the effectiveness of standardized HRQoL measurement in actually improving HRQoL or psychosocial outcomes <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B8">8</abbr><abbr bid="B9">9</abbr><abbr bid="B10">10</abbr><abbr bid="B11">11</abbr></abbrgrp>, and by practical and attitudinal barriers that have been associated with the implementation of HRQoL measurement in clinical practice. Practical barriers that have been reported include general lack of time, money and human resources, impracticality of instruments, disruption of clinical routine, lack of IT support and health professionals' lack of knowledge in this area. Attitudinal barriers may include health professionals' scepticism of the validity of HRQoL questionnaires, and ability to intervene should the questionnaires reveal any problems <abbrgrp><abbr bid="B11">11</abbr><abbr bid="B12">12</abbr><abbr bid="B13">13</abbr><abbr bid="B14">14</abbr><abbr bid="B15">15</abbr><abbr bid="B16">16</abbr><abbr bid="B17">17</abbr></abbrgrp>.</p>
         <p>To the best of our knowledge, only two studies have actually implemented the procedure of HRQoL measurement in clinical practice and subsequently described the issues encountered in terms of feasibility. In one of the studies, the main finding was that higher compliance occurred when the computerized data collection was integrated into routine care. However, it should be noted that the follow-up time was very short (12 weeks), resulting in a large number of patients attending only once which makes it difficult to draw any firm conclusions on patient compliance in the long run <abbrgrp><abbr bid="B18">18</abbr></abbrgrp>. In the other study, only 18 patients participated and the questionnaires were not computerized <abbrgrp><abbr bid="B19">19</abbr></abbrgrp>. A previous study has shown that pen-and-paper versions of HRQoL questionnaires, which have to be scored by hand, take too much time and are costly in the long term <abbrgrp><abbr bid="B20">20</abbr></abbrgrp>. Providing clinicians with instant information about their patients' HRQoL at busy outpatient clinics can only be obtained if this HRQoL is assessed by means of computers that can generate an output which can instantly be accessed by clinicians.</p>
         <p>The aim of the present study was to gain more insight in the practical and attitudinal feasibility problems encountered during the process of implementing computerized HRQoL measurement at a busy outpatient department of Hepatology (liver disease) (Erasmus MC, Rotterdam, the Netherlands). Chronic liver disease is one of the most prevalent diseases in the world, affecting over 560 million people (<url>http://www.epidemic.org</url>, 4-12-2006). It is a serious disease that is associated with impaired HRQoL <abbrgrp><abbr bid="B21">21</abbr><abbr bid="B22">22</abbr></abbrgrp>. Chronic liver disease is an appropriate example of a typical chronic disease, with patients experiencing substantial comorbidity and possibly mortality as is the case in many other chronic diseases.</p>
         <p>This study was among the first to actually implement the complete procedure of routine computerized HRQoL measurement at an outpatient department, and to subsequently describe all feasibility issues encountered throughout the process. The focus was on technical as well as logistic feasibility issues such as optimization of patient compliance in the long run, rather than effects of the intervention on patient well-being which have been presented elsewhere <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B4">4</abbr><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr><abbr bid="B7">7</abbr></abbrgrp>. Practical suggestions for researchers and health care workers interested in implementing assessment of HRQoL in clinical practice were given.</p>
      </sec>
      <sec>
         <st>
            <p>Methods</p>
         </st>
         <sec>
            <st>
               <p>Patient inclusion</p>
            </st>
            <p>This study was performed at the Department of Gastroenterology and Hepatology of the Erasmus Medical Centre (Rotterdam, the Netherlands), which is one of three specialised centres for liver disease in the Netherlands. With patients visiting the outpatient department on average once every four months, the recruitment phase was set at four months. Between September 2004 and January 2005 all patients of 18 years and older with chronic liver disease (CLD) attending the department of Hepatology, and all physicians working at the department of Hepatology, were invited to participate in the study verbally and in writing. Patients who agreed to participate received an explanation of the purpose and procedure of the study from the researcher, and consequently signed an informed consent form. The protocol was in accordance with the ethical guidelines of the modified 1975 Declaration of Helsinki and approved by the Medical Ethics Committee of the Erasmus MC.</p>
         </sec>
         <sec>
            <st>
               <p>Study design and intervention</p>
            </st>
            <p>The first three months of the study consisted of a pilot-testing phase during which problems with the use of the computer program were detected and solved by asking patients to complete the online questionnaires. Patients' opinions on the computerized questionnaires were assessed by means of a pen-and-paper questionnaire that was administered afterwards. This questionnaire included the following questions: 'did you encounter any difficulties completing the questionnaires? If so, what?, 'what do you think of the time it took to complete the questionnaires?', and 'do you have any suggestions to improve the computer program? ' After these three months, the actual intervention started.</p>
            <p>Physicians were randomly assigned to either the intervention group (who had access to a graphical representation of the HRQoL data of their patients) or the control group (who conducted their consultations as usual). The physicians in the intervention group were asked to use the HRQoL data in all consultations for the duration of one year. Physicians in both the control group and the intervention group were asked to complete a checklist about the content of the consultation after each consultation with a participating patient.</p>
            <p>All participating patients were asked to complete computerized versions of a generic &#8211; (Short Form-12 <abbrgrp><abbr bid="B23">23</abbr></abbrgrp>) and a disease-specific HRQoL questionnaire (Liver Disease Symptom Index 2.0 <abbrgrp><abbr bid="B24">24</abbr></abbrgrp>), and the first part of a pen-and-paper questionnaire on patient satisfaction with the consultation, before each consultation (QUOTE-Liver <abbrgrp><abbr bid="B25">25</abbr></abbrgrp>) for the duration of one year. After the consultation, they completed the second part of the satisfaction questionnaire. For a more elaborate description of the study design and intervention we refer to Gutteling et al. (2008)<abbrgrp><abbr bid="B7">7</abbr></abbrgrp>.</p>
            <p>In order to optimise participation, study participants were given instructions on the study procedure both verbally and in writing at the beginning of the study, and eye-catching posters were put up in the waiting room to remind them of the study. In addition, the reception employees were instructed to refer study participants to the computer. With a study-duration of 1 year, it was estimated that this would yield on average three measurement moments per patient.</p>
         </sec>
         <sec>
            <st>
               <p>Measurement instruments</p>
            </st>
            <sec>
               <st>
                  <p>Practical feasibility</p>
               </st>
               <p>Practical feasibility of computerized HRQoL measurement was assessed throughout the study by a) observing problems encountered during the development of the computer program which had to include several crucial specifications (instant scoring and graphical output of the data, instant availability of data to physicians, guaranteing patient privacy) b) by observing patients' ability to complete the HRQoL questionnaires and discussing any encountered difficulties. c) by monitoring the number of times that patients completed the HRQoL questionnaires. d) by observing logistics at the outpatient department on a daily basis. The observations were done by the main researcher on this project.</p>
               <p>A questionnaire was administered retrospectively to assess participants' reasons for not completing the HRQoL assessments in the clinic. This questionnaire included the following questions: 1) Did you complete the questionnaires with each visit during the past year?, and 2) If not, please indicate why not. This last question had several response categories of which more than one could be checked: a) I forgot to complete the questionnaires, b) I was too late, or there was not enough time before the consultation to complete the questionnaires, c) I did not feel like completing the questionnaires, d) I was too ill to complete the questionnaires and e) other...</p>
            </sec>
            <sec>
               <st>
                  <p>Attitudinal barriers</p>
               </st>
               <p><it>Attitudinal barriers of physicians </it>were explored by semi-structured interviews with all physicians that were conducted midway through the study and at the end of the study. In these interviews physicians were asked, amongst others, whether they would be interested in continued use of the information and whether there were any items that they would like to be included in future versions of the computer program.</p>
               <p>Secondly all physicians in the experimental group were asked to complete a checklist at the end of a consultation of each participating patient, which consisted of four important questions:, a) Did you request the HRQoL information?, b) Did you use the information? c) Did you find the information useful? and d) Why (not)?</p>
               <p><it>Attitudinal barriers on the part of the reception employees </it>were inventorized while observing the process of care at the outpatient department on a daily basis.</p>
            </sec>
         </sec>
         <sec>
            <st>
               <p>Data analysis</p>
            </st>
            <p>The retrospective questionnaire administered to patients on reasons for not completing the assessment at the clinic and the checklist completed by physicians after each consultation were analysed quantitatively in SPSS 11.0, in terms of frequencies and percentages. Descriptive data is presented on the observed practical feasibility. Descriptive data on the interviews with physicians, which were intended to provide global information about physicians' experiences with, and opinions on, the HRQoL information, is also presented.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Results</p>
         </st>
         <sec>
            <st>
               <p>Patients' and physicians' characteristics</p>
            </st>
            <p>All physicians working at the department of Hepatology (n = 11, 10 = male, 1 = female) agreed to participate in the study. Their mean age was 39 years (range 27&#8211;55). The average working experience of the physicians was 8.7 years (range 0 &#8211; 27 years). Five hundred and eighty seven patients gave informed consent to participate (Figure <figr fid="F1">1</figr>) of which 327 completed the measurements once or more. 260 patients who had consented to participate did not complete the measurements once. Demographic characteristics of the 327 participants are presented in Table <tblr tid="T1">1</tblr>, and comparisons were made with the 260 non-responders.</p>
            <tbl id="T1">
               <title>
                  <p>Table 1</p>
               </title>
               <caption>
                  <p>Demographic characteristics of patients in the study</p>
               </caption>
               <tblbdy cols="4">
                  <r>
                     <c>
                        <p/>
                     </c>
                     <c ca="left">
                        <p>Respondents</p>
                        <p>(n = 327)</p>
                     </c>
                     <c ca="left">
                        <p>Non-respondents</p>
                        <p>(n = 260)</p>
                     </c>
                     <c ca="left">
                        <p>P</p>
                     </c>
                  </r>
                  <r>
                     <c cspan="4">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="left">
                        <p>
                           <it>Gender (n, %)</it>
                        </p>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Women</p>
                     </c>
                     <c ca="left">
                        <p>144 (44)</p>
                     </c>
                     <c ca="left">
                        <p>108 (76)</p>
                     </c>
                     <c ca="left">
                        <p>0.46</p>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Men</p>
                     </c>
                     <c ca="left">
                        <p>183 (56)</p>
                     </c>
                     <c ca="left">
                        <p>135 (42)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c cspan="4">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="left">
                        <p>
                           <it>Age (mean, range)</it>
                        </p>
                     </c>
                     <c ca="left">
                        <p>48.1 (20&#8211;81)</p>
                     </c>
                     <c ca="left">
                        <p>47.4 (18&#8211;80)</p>
                     </c>
                     <c ca="left">
                        <p>0.70</p>
                     </c>
                  </r>
                  <r>
                     <c cspan="4">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="left">
                        <p>
                           <it>Diagnosis (n, %)</it>
                        </p>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Hepatitis B</p>
                     </c>
                     <c ca="left">
                        <p>47 (14)</p>
                     </c>
                     <c ca="left">
                        <p>43</p>
                     </c>
                     <c ca="left">
                        <p>0.00</p>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Hepatitis C</p>
                     </c>
                     <c ca="left">
                        <p>47 (14)</p>
                     </c>
                     <c ca="left">
                        <p>54</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Cholestatic liver disease</p>
                     </c>
                     <c ca="left">
                        <p>33 (10)</p>
                     </c>
                     <c ca="left">
                        <p>31</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Pre-transplantation</p>
                     </c>
                     <c ca="left">
                        <p>18 (6)</p>
                     </c>
                     <c ca="left">
                        <p>1</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Post-transplantation</p>
                     </c>
                     <c ca="left">
                        <p>110 (34)</p>
                     </c>
                     <c ca="left">
                        <p>52</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Auto-immune hepatitis</p>
                     </c>
                     <c ca="left">
                        <p>23 (7)</p>
                     </c>
                     <c ca="left">
                        <p>16</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Other</p>
                     </c>
                     <c ca="left">
                        <p>49 (15)</p>
                     </c>
                     <c ca="left">
                        <p>47</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c cspan="4">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="left">
                        <p>
                           <it>Disease Severity (n,%)</it>
                        </p>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>No cirrhosis</p>
                     </c>
                     <c ca="left">
                        <p>206 (63)</p>
                     </c>
                     <c ca="left">
                        <p>153 (63)</p>
                     </c>
                     <c ca="left">
                        <p>0.95</p>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Compensated cirrhosis</p>
                     </c>
                     <c ca="left">
                        <p>87 (27)</p>
                     </c>
                     <c ca="left">
                        <p>63 (26)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Decompensated cirrhosis</p>
                     </c>
                     <c ca="left">
                        <p>34 (10)</p>
                     </c>
                     <c ca="left">
                        <p>28 (11)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c cspan="4">
                        <hr/>
                     </c>
                  </r>
                  <r>
                     <c ca="left">
                        <p>
                           <it>Nationality (n, %)</it>
                        </p>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Dutch</p>
                     </c>
                     <c ca="left">
                        <p>270 (83)</p>
                     </c>
                     <c ca="left">
                        <p>207 (85)</p>
                     </c>
                     <c ca="left">
                        <p>0.54</p>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Moroccan</p>
                     </c>
                     <c ca="left">
                        <p>5 (2)</p>
                     </c>
                     <c ca="left">
                        <p>2 (1)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Turkish</p>
                     </c>
                     <c ca="left">
                        <p>7 (2)</p>
                     </c>
                     <c ca="left">
                        <p>7 (3)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Surinam</p>
                     </c>
                     <c ca="left">
                        <p>10 (3)</p>
                     </c>
                     <c ca="left">
                        <p>4 (2)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Europe other</p>
                     </c>
                     <c ca="left">
                        <p>6 (2)</p>
                     </c>
                     <c ca="left">
                        <p>4 (2)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>World other</p>
                     </c>
                     <c ca="left">
                        <p>25 (7)</p>
                     </c>
                     <c ca="left">
                        <p>20 (7)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
                  <r>
                     <c ca="left" indent="1">
                        <p>Unknown</p>
                     </c>
                     <c ca="left">
                        <p>4 (1)</p>
                     </c>
                     <c ca="left">
                        <p>0 (0)</p>
                     </c>
                     <c>
                        <p/>
                     </c>
                  </r>
               </tblbdy>
               <tblfn>
                  <p>Differences were assessed by means of Chi-square tests (except for age: t-test)</p>
               </tblfn>
            </tbl>
            <fig id="F1">
               <title>
                  <p>Figure 1</p>
               </title>
               <caption>
                  <p>Patients in the study</p>
               </caption>
               <text>
                  <p>
                     <b>Patients in the study.</b>
                  </p>
               </text>
               <graphic file="1477-7525-6-97-1"/>
            </fig>
         </sec>
         <sec>
            <st>
               <p>Practical feasibility</p>
            </st>
            <sec>
               <st>
                  <p>Problems encountered during the development of the computer program</p>
               </st>
               <p>Developing a tailor-made computer program that met our needs with regard to the inclusion of our questionnaires of choice, lay-out, and instant availability of computerized graphical representations of the results to the physicians without violating patients' privacy, proved to be time-consuming and more costly than planned. Initially, we attempted to develop the computer program displaying the questionnaires with basic available computer programs (such as Microsoft Access). This eventually proved to be too complicated considering all the requirements outlined above that had to be met. Expertise of an IT professional was required. Finding an IT professional with the appropriate skills to develop the program cost several months as did the actual development of the final program. In terms of finances there are costs attached to the development of the program, the purchase of a domain name and airing the website where the questionnaires could be completed. During the pilot testing phase, we discovered that administering the Short Form-36, the complete LDSI 2.0 and the complete first part of the QUOTE-Liver interfered with clinical routine. Even though patients did not report negative evaluations regarding the length of the questionnaires, we included shorter versions of the questionnaires in the actual trial in order not to disrupt clinical routine <abbrgrp><abbr bid="B7">7</abbr></abbrgrp>. Completion time was now on average 7.5 minutes, which we found acceptable since it did no longer interfere with clinical routine.</p>
            </sec>
            <sec>
               <st>
                  <p>Patients' ability to complete the HRQoL questionnaires</p>
               </st>
               <p>During the pilot testing phase, problems with patients' basic computer skills such as mouse handling, scrolling and entering digits in a designated field became apparent. Some patients were not able to perform these skills. Although participants with such limited knowledge of computers formed a minority, they required substantial assistance. The computer program used in the trial was amended in order to overcome these problems by, as suggested by the patients participating in the pilot testing phase, making checkboxes larger and the entry field for the patient number more easily identifiable. Also, a mouse pad was used that provided step-by-step instructions for the completion of the questionnaires. These improvements did not visibly improve patient participation. The mouse pad was mostly ignored, and entering the patient number remained difficult, mostly because patients did not know their number (estimation of 1/2). Basic mouse handling also remained problematic for a significant amount of patients (estimation of 1/5), which consequently required substantial assistance.</p>
            </sec>
            <sec>
               <st>
                  <p>HRQoL questionnaire completion rate</p>
               </st>
               <p>At the end of the study, the HRQoL assessment in the clinic had occurred on 43% of the occasions (756 times out of the estimated 1761 times, which is a rough estimation based on the assumption that patients visited the outpatient department on average three times during the study (587 &#215; 3 = 1761)). 260 participants never completed the HRQoL assessment on the computer at all, of which 16 due to substantial language problems. Only 105 patients completed the HRQoL questionnaires three times or more (Table <tblr tid="T2">2</tblr>). A retrospective exploration of the reasons for this low response rate was performed by means of a mailed questionnaire (response rate = 55%, 170 males, 145 females, mean age 50.0 years). The main reason that was given for not completing the retrospective questionnaires was 'simply forgetting'. Other important reasons included 'no time' and 'did not feel like it'. Less often, reasons such as 'the computer was broken', 'there was no-one there to help me complete the HRQoL questionnaires', 'no-one told me to complete the HRQoL questionnaires' and 'the computer was occupied', were given. For an overview of all reasons given we refer to Figure <figr fid="F2">2</figr>.</p>
               <tbl id="T2">
                  <title>
                     <p>Table 2</p>
                  </title>
                  <caption>
                     <p>Number of times that patients completed the questionnaires</p>
                  </caption>
                  <tblbdy cols="11">
                     <r>
                        <c>
                           <p/>
                        </c>
                        <c ca="center" cspan="10">
                           <p>Times that questionnaires were completed</p>
                        </c>
                     </r>
                     <r>
                        <c cspan="11">
                           <hr/>
                        </c>
                     </r>
                     <r>
                        <c>
                           <p/>
                        </c>
                        <c ca="left">
                           <p>1</p>
                        </c>
                        <c ca="left">
                           <p>2</p>
                        </c>
                        <c ca="left">
                           <p>3</p>
                        </c>
                        <c ca="left">
                           <p>4</p>
                        </c>
                        <c ca="left">
                           <p>5</p>
                        </c>
                        <c ca="left">
                           <p>6</p>
                        </c>
                        <c ca="left">
                           <p>7</p>
                        </c>
                        <c ca="left">
                           <p>8</p>
                        </c>
                        <c ca="left">
                           <p>9</p>
                        </c>
                        <c ca="left">
                           <p>>9</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>Patients (n)</p>
                        </c>
                        <c ca="left">
                           <p>327</p>
                        </c>
                        <c ca="left">
                           <p>181</p>
                        </c>
                        <c ca="left">
                           <p>105</p>
                        </c>
                        <c ca="left">
                           <p>58</p>
                        </c>
                        <c ca="left">
                           <p>33</p>
                        </c>
                        <c ca="left">
                           <p>20</p>
                        </c>
                        <c ca="left">
                           <p>13</p>
                        </c>
                        <c ca="left">
                           <p>10</p>
                        </c>
                        <c ca="left">
                           <p>5</p>
                        </c>
                        <c ca="left">
                           <p>4</p>
                        </c>
                     </r>
                  </tblbdy>
               </tbl>
               <fig id="F2">
                  <title>
                     <p>Figure 2</p>
                  </title>
                  <caption>
                     <p>Participants' reasons for not completing the questionnaires</p>
                  </caption>
                  <text>
                     <p>
                        <b>Participants' reasons for not completing the questionnaires.</b>
                     </p>
                  </text>
                  <graphic file="1477-7525-6-97-2"/>
               </fig>
            </sec>
            <sec>
               <st>
                  <p>Logistical issues</p>
               </st>
               <p>Logistical issues that were observed at the outpatient department were forgetfulness of the reception employees to send patients to the computer, and the computer being out of sight of the waiting room area.</p>
            </sec>
         </sec>
         <sec>
            <st>
               <p>Attitudinal barriers</p>
            </st>
            <sec>
               <st>
                  <p>Interviews with physicians</p>
               </st>
               <p>The interview data showed that all physicians would like to use the HRQoL information again in the future, especially for patients awaiting liver transplantation, patients with HCV, and non-native speakers (mostly patients with HBV). They suggested embedding the information in the existing patient information system, and adding a screening tool for depression, especially for patients with HCV and/or patients awaiting liver transplantation, diagnostic questions (e.g. allergies, use of medication), questions about the social situation of younger people (e.g. school, friends, pass-times), and questions about expectations of the consultation.</p>
            </sec>
            <sec>
               <st>
                  <p>Physician checklists</p>
               </st>
               <p>The physicians in the experimental group requested the information in 92% of the consultations, discussing it with their patients in 58% of the consultations. They indicated finding the HRQoL information useful in 45% of the consultations, mostly because it provided new information, but also because it saved time and because it confirmed the verbal information and their own clinical impressions of patients who were doing well physically. These last two statements were also relevant for the one physician who claimed to know his patients well and did therefore not find the HRQoL information particularly useful. All physicians found the information less useful when patients were doing well, when they knew patients well and when patients were very talkative (Figure <figr fid="F3">3</figr>).</p>
               <fig id="F3">
                  <title>
                     <p>Figure 3</p>
                  </title>
                  <caption>
                     <p>Physicians' evaluations of the HRQoL information</p>
                  </caption>
                  <text>
                     <p>
                        <b>Physicians' evaluations of the HRQoL information.</b>
                     </p>
                  </text>
                  <graphic file="1477-7525-6-97-3"/>
               </fig>
            </sec>
            <sec>
               <st>
                  <p>Observations</p>
               </st>
               <p>Attitudinal barriers were encountered on the part of the reception employees. Their busy schedule did not allow for much time to identify study participants and refer them to the computer. The importance to do so was not clear to them, and when no firm instructions were given, they often forgot to send patients to the computer.</p>
            </sec>
            <sec>
               <st>
                  <p>Advice</p>
               </st>
               <p>The most important advice to improve HRQoL measurements in clinical practice that resulted from the current study is summarized in Table <tblr tid="T3">3</tblr>.</p>
               <tbl id="T3">
                  <title>
                     <p>Table 3</p>
                  </title>
                  <caption>
                     <p>Advice to improve HRQoL measurements in clinical practice</p>
                  </caption>
                  <tblbdy cols="1">
                     <r>
                        <c ca="left">
                           <p>
                              <b>Technical issues</b>
                           </p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; For psychometric purposes, computerized questionnaires should resemble pen-and-paper versions as closely as possible</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Hire an IT expert</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Allow for development costs</p>
                        </c>
                     </r>
                     <r>
                        <c cspan="1">
                           <hr/>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>
                              <b>Logistical issues</b>
                           </p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Location in the vicinity of the waiting room area (ideally the computer can be seen from the waiting room area)</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Enough privacy</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Availability of internet/network connection</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Easily accessible to patients</p>
                        </c>
                     </r>
                     <r>
                        <c cspan="1">
                           <hr/>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>
                              <b>Optimal patient participation</b>
                           </p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; use of a touch-screen computer</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; very easy log-on procedure, eg. scanning the patient's punch card</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; questionnaires in multiple languages</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; short questionnaires</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; HRQoL assessment is considered part of clinical routine</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Physicians and front desk employees ask patients to complete the questionnaires</p>
                        </c>
                     </r>
                     <r>
                        <c cspan="1">
                           <hr/>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>
                              <b>Optimal physician participation</b>
                           </p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; HRQoL data embedded in the existing patient information system</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Add screening for depression</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Bring in a local clinical leader as a spokesman for the importance of HRQoL measurement</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Provide clear data output and clear instructions on how to interpret the data</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Make clear that the data should not be used as clear cut-off points for treatment of referral decisions, but rather as a base for more directed discussion of psychosocial topics</p>
                        </c>
                     </r>
                     <r>
                        <c ca="left">
                           <p>&#8226; Provide management options</p>
                        </c>
                     </r>
                  </tblbdy>
               </tbl>
            </sec>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Discussion</p>
         </st>
         <p>The present study is, to the best of our knowledge, the first to describe a variety of feasibility issues encountered during the implementation of computerized HRQoL measurement in clinical practice, in a population of patients with chronic liver disease. Feasibility problems concerning technical aspects of developing a user-friendly computer program with safe data transmission over the Internet, patients' computer skills, and patients' compliance were encountered. Physicians were generally positive about the instant computerized availability of HRQoL information.</p>
         <p>Technical problems that we encountered during the developmental phase of the computer program were substantial, and cost substantial time and effort to correct. Assistance from an IT professional is advised if one intends to develop a computer program that includes the particular questionnaires of interest, is easy for patients to complete, and transmits the information to the physicians' computer in such a way that privacy is assured.</p>
         <p>With regard to patients' lack of basic computer skills, the use of touch-screen computers, which have been shown to be easy to handle by various patient populations <abbrgrp><abbr bid="B20">20</abbr><abbr bid="B26">26</abbr><abbr bid="B27">27</abbr><abbr bid="B28">28</abbr><abbr bid="B29">29</abbr><abbr bid="B30">30</abbr></abbrgrp>, is recommended when implementing HRQoL measurement in clinical practice. This may optimise patient participation, and the quality of the answers, which will be less biased by the presence of family members or friends that help with completing the questionnaires such as found in the study of Velikova et al (2002) <abbrgrp><abbr bid="B31">31</abbr></abbrgrp>.</p>
         <p>A limitation of the present study was the high number of non-participants. Part of the explanation may lie in the fact that patients themselves were responsible for contacting their physician if they were interested in participating in the study. In addition, the number of non-Dutch speaking patients visiting the department of Hepatology of the Erasmus MC is relatively large (Hepatitis B for example, is most common among people from North Africa). These patients were also invited to partcipate, but were not able to participate since the questionnaires in this study were only available in Dutch. Future studies should aim at including non-native speakers, whose data are of particular interest to the physicians in this study.</p>
         <p>The low compliance of patients that did participate in our study, is in accordance with findings of a previous study showing deterioration of compliance with longer follow-up <abbrgrp><abbr bid="B17">17</abbr></abbrgrp>. Bad timing and other priorities were given as possible explanations. In our study, an explanation may lie in the small window of opportunity to complete the questionnaires before each consultation. Indeed, patients mentioned in the retrospective questionnaire that lack of time was one of the main reasons for not completing the questionnaires. Simply forgetting to complete the questionnaires was the most important reason, despite eye-catching posters that were put up in the waiting room. The fact that the retrospective question "have you completed the questionnaires with each visit" was answered with "no" in 57% of the cases supposes an honest attitude of the respondents, who were informed about the anonymity of their responses. Considering these results, it seems that patient participation cannot be left to patients themselves, who may be nervous about the upcoming consultation and/or used to going to the waiting room after announcing themselves at the reception desk. To optimise participation it is, in our opinion, of vital importance that all staff of the department concerned, especially the reception desk personnel but also the nurses and physicians, approves of the intervention, considers it as part of standard clinical routine, and acts accordingly by sending patients to the computer before each consultation.</p>
         <p>The positive attitudes of the physicians in our study towards the availability of instant computerized HRQoL information during the consultation are in accordance with previous studies in oncology <abbrgrp><abbr bid="B18">18</abbr><abbr bid="B30">30</abbr></abbrgrp>, and advocate the continued use of such a procedure in patients with chronic liver disease. However, future studies should aim at including more liver specialists in order to substantiate these findings. Expressed concerns of an increase in workload as a result of the HRQoL data <abbrgrp><abbr bid="B30">30</abbr></abbrgrp> were absent in our study. These positive findings in liver specialists, treating patients with a disease that is generally less acute and life threatening than cancer for instance, give incentive to further exploration of routine computerized HRQoL measurement in other specialisations within internal medicine such as nephrology or gastroenterology. When implementing such a procedure, it should be stressed to physicians that standardized HRQoL information should never replace the clinical dialogue between patient and physician, as important symptoms may then be overlooked, or exaggerated <abbrgrp><abbr bid="B30">30</abbr></abbrgrp>. Rather, the HRQoL information should be seen as an indication of possible problems worth discussing and exploring further during the consultation.</p>
      </sec>
      <sec>
         <st>
            <p>Conclusion</p>
         </st>
         <p>This study addressed practical feasibility issues associated with routine computerized measurement of HRQoL at a busy outpatient department of Hepatology. Feasibility is an important requirement for more widespread implementation of such an intervention. Another requirement is that the intervention is effective in improving patients' well-being and/or medical treatment. The current study has directly contributed to the first requirement by showing that the attitudes of physicians were generally positive, by identifying probable barriers towards successful implementation, and by providing solutions on how to overcome these barriers. These include hiring an IT expert, involving all personnel and using touch-screen computers. While the findings of the current study are encouraging they also emphasise that these implementation processes are complex and should not be underestimated. Further studying of the feasibility and effectiveness of routine computerized HRQoL measurements in clinical practice is needed before widespread implementation can be achieved.</p>
      </sec>
      <sec>
         <st>
            <p>Competing interests</p>
         </st>
         <p>The authors declare that they have no competing interests.</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>JG participated in the design of the study and conducted it. She also drafted the manuscript. RDM participated in the design of the study and helped to conduct it. JB and ASD participated in the design of the study and helped to draft the manuscript. All authors read and approved the final manuscript.</p>
      </sec>
   </bdy>
   <bm>
      <ack>
         <sec>
            <st>
               <p>Acknowledgements</p>
            </st>
            <p>The authors would like to thank all patients and physicians for their active participation in the study.</p>
         </sec>
      </ack>
      <refgrp>
         <bibl id="B1">
            <title>
               <p>Comprehensive functional assessment for elderly patients. Health and Public Policy Committee, American College of Physicians</p>
            </title>
            <aug>
               <au>
                  <cnm>Position Pape</cnm>
               </au>
            </aug>
            <source>Ann Intern Med</source>
            <pubdate>1988</pubdate>
            <volume>109</volume>
            <fpage>70</fpage>
            <lpage>72</lpage>
            <xrefbib>
               <pubid idtype="pmpid">3288035</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B2">
            <title>
               <p>Applications of health status assessment measures in clinical practice. Overview of the third conference on advances in health status assessment</p>
            </title>
            <aug>
               <au>
                  <snm>Lohr</snm>
                  <fnm>KN</fnm>
               </au>
            </aug>
            <source>Med Care</source>
            <pubdate>1992</pubdate>
            <volume>30</volume>
            <issue>5 Suppl</issue>
            <fpage>MS1</fpage>
            <lpage>14</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1097/00005650-199205001-00001</pubid>
                  <pubid idtype="pmpid">1583924</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B3">
            <title>
               <p>Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial</p>
            </title>
            <aug>
               <au>
                  <snm>Detmar</snm>
                  <fnm>SB</fnm>
               </au>
               <au>
                  <snm>Muller</snm>
                  <fnm>MJ</fnm>
               </au>
               <au>
                  <snm>Schornagel</snm>
                  <fnm>JH</fnm>
               </au>
               <au>
                  <snm>Wever</snm>
                  <fnm>LDV</fnm>
               </au>
               <au>
                  <snm>Aaronson</snm>
                  <fnm>NK</fnm>
               </au>
            </aug>
            <source>JAMA</source>
            <pubdate>2002</pubdate>
            <volume>228</volume>
            <issue>23</issue>
            <fpage>3027</fpage>
            <lpage>3034</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1001/jama.288.23.3027</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B4">
            <title>
               <p>Randomized trial of coordinated psychosocial interventions based on patient self-assessments versus standard care to improve the psychosocial functioning of patients with cancer</p>
            </title>
            <aug>
               <au>
                  <snm>McLachlan</snm>
                  <fnm>SA</fnm>
               </au>
               <au>
                  <snm>Allenby</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Matthews</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Wirth</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Kissane</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Bishop</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Beresford</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Zalcberg</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>J Clin Oncol</source>
            <pubdate>2001</pubdate>
            <volume>19</volume>
            <issue>21</issue>
            <fpage>4117</fpage>
            <lpage>25</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">11689579</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B5">
            <title>
               <p>Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial</p>
            </title>
            <aug>
               <au>
                  <snm>Velikova</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Booth</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Smith</snm>
                  <fnm>AB</fnm>
               </au>
               <au>
                  <snm>Brown</snm>
                  <fnm>PM</fnm>
               </au>
               <au>
                  <snm>Lynch</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Brown</snm>
                  <fnm>JM</fnm>
               </au>
               <au>
                  <snm>Selby</snm>
                  <fnm>PJ</fnm>
               </au>
            </aug>
            <source>J Clin Oncol</source>
            <pubdate>2004</pubdate>
            <volume>22</volume>
            <issue>4</issue>
            <fpage>714</fpage>
            <lpage>24</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1200/JCO.2004.06.078</pubid>
                  <pubid idtype="pmpid" link="fulltext">14966096</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B6">
            <title>
               <p>Does routine assessment and real-time feedback improve cancer patients' psychosocial well-being?</p>
            </title>
            <aug>
               <au>
                  <snm>Boyes</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Newell</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Girgis</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>McElduff</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Sanson-Fisher</snm>
                  <fnm>R</fnm>
               </au>
            </aug>
            <source>Eur J Cancer Care [Engl]</source>
            <pubdate>2006</pubdate>
            <volume>15</volume>
            <issue>2</issue>
            <fpage>163</fpage>
            <lpage>71</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1111/j.1365-2354.2005.00633.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">16643264</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B7">
            <title>
               <p>Effectiveness of health-related-quality-of-life measurement in clinical practice: a prospective, randomized controlled trial in patients with chronic liver disease and their physicians</p>
            </title>
            <aug>
               <au>
                  <snm>Gutteling</snm>
                  <fnm>JJ</fnm>
               </au>
               <au>
                  <snm>Darlington</snm>
                  <fnm>ASE</fnm>
               </au>
               <au>
                  <snm>Janssen</snm>
                  <fnm>HLA</fnm>
               </au>
               <au>
                  <snm>Duivenvoorden</snm>
                  <fnm>HJ</fnm>
               </au>
               <au>
                  <snm>Busschbach</snm>
                  <fnm>JJV</fnm>
               </au>
               <au>
                  <snm>de Man</snm>
                  <fnm>RA</fnm>
               </au>
            </aug>
            <source>Qual Life Res</source>
            <pubdate>2008</pubdate>
            <volume>17</volume>
            <issue>2</issue>
            <fpage>195</fpage>
            <lpage>205</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">2238788</pubid>
                  <pubid idtype="pmpid" link="fulltext">18246446</pubid>
                  <pubid idtype="doi">10.1007/s11136-008-9308-7</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B8">
            <title>
               <p>Routine administration of Health Related Quality of Life [HRQoL] and needs assessment instruments to improve psychological outcome &#8211; a systematic review</p>
            </title>
            <aug>
               <au>
                  <snm>Gilbody</snm>
                  <fnm>SM</fnm>
               </au>
               <au>
                  <snm>House</snm>
                  <fnm>AO</fnm>
               </au>
               <au>
                  <snm>Sheldon</snm>
                  <fnm>T</fnm>
               </au>
            </aug>
            <source>Psychol Med</source>
            <pubdate>2002</pubdate>
            <volume>32</volume>
            <issue>8</issue>
            <fpage>1345</fpage>
            <lpage>56</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1017/S0033291702006001</pubid>
                  <pubid idtype="pmpid">12455933</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B9">
            <title>
               <p>The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: a literature review</p>
            </title>
            <aug>
               <au>
                  <snm>Greenhalgh</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Meadows</snm>
                  <fnm>K</fnm>
               </au>
            </aug>
            <source>J Eval Clin Pract</source>
            <pubdate>1999</pubdate>
            <volume>5</volume>
            <issue>4</issue>
            <fpage>401</fpage>
            <lpage>16</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1046/j.1365-2753.1999.00209.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">10579704</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B10">
            <title>
               <p>Provision of feedback on perceived health status to health care professionals: a systematic review of its impact</p>
            </title>
            <aug>
               <au>
                  <snm>Espallargues</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Valderas</snm>
                  <fnm>JM</fnm>
               </au>
               <au>
                  <snm>Jordi</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>Med Care</source>
            <pubdate>2000</pubdate>
            <volume>38</volume>
            <issue>2</issue>
            <fpage>175</fpage>
            <lpage>186</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1097/00005650-200002000-00007</pubid>
                  <pubid idtype="pmpid">10659691</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B11">
            <title>
               <p>Health status reports in the care of patients with rheumatoid arthritis</p>
            </title>
            <aug>
               <au>
                  <snm>Kazis</snm>
                  <fnm>LE</fnm>
               </au>
               <au>
                  <snm>Callahan</snm>
                  <fnm>LF</fnm>
               </au>
               <au>
                  <snm>Meenan</snm>
                  <fnm>RF</fnm>
               </au>
               <au>
                  <snm>Pincus</snm>
                  <fnm>T</fnm>
               </au>
            </aug>
            <source>J Clin Epidemiol</source>
            <pubdate>1990</pubdate>
            <volume>43</volume>
            <issue>11</issue>
            <fpage>1243</fpage>
            <lpage>53</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/0895-4356(90)90025-K</pubid>
                  <pubid idtype="pmpid" link="fulltext">2243259</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B12">
            <title>
               <p>A qualitative study of patients' and physicians' views about practice-based functional health assessment</p>
            </title>
            <aug>
               <au>
                  <snm>McHorney</snm>
                  <fnm>CA</fnm>
               </au>
               <au>
                  <snm>Earl Bricker</snm>
                  <fnm>D</fnm>
                  <suf>Jr</suf>
               </au>
            </aug>
            <source>Med Care</source>
            <pubdate>2002</pubdate>
            <volume>40</volume>
            <issue>11</issue>
            <fpage>1113</fpage>
            <lpage>25</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1097/00005650-200211000-00012</pubid>
                  <pubid idtype="pmpid">12409856</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B13">
            <title>
               <p>The use of quality of life data in clinical practice</p>
            </title>
            <aug>
               <au>
                  <snm>Morris</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Perez</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>McNoe</snm>
                  <fnm>B</fnm>
               </au>
            </aug>
            <source>Qual Life Res</source>
            <pubdate>1998</pubdate>
            <volume>7</volume>
            <issue>1</issue>
            <fpage>85</fpage>
            <lpage>91</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1023/A:1008893007068</pubid>
                  <pubid idtype="pmpid" link="fulltext">9481154</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B14">
            <title>
               <p>Patient-based health status measurement in clinical practice: a study of its impact on epilepsy patients' care</p>
            </title>
            <aug>
               <au>
                  <snm>Wagner</snm>
                  <fnm>AK</fnm>
               </au>
               <au>
                  <snm>Ehrenberg</snm>
                  <fnm>BL</fnm>
               </au>
               <au>
                  <snm>Tran</snm>
                  <fnm>TA</fnm>
               </au>
               <au>
                  <snm>Bungay</snm>
                  <fnm>KM</fnm>
               </au>
               <au>
                  <snm>Cynn</snm>
                  <fnm>DJ</fnm>
               </au>
               <au>
                  <snm>Rogers</snm>
                  <fnm>WH</fnm>
               </au>
            </aug>
            <source>Qual Life Res</source>
            <pubdate>1997</pubdate>
            <volume>6</volume>
            <issue>4</issue>
            <fpage>329</fpage>
            <lpage>41</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1023/A:1018479209369</pubid>
                  <pubid idtype="pmpid" link="fulltext">9248315</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B15">
            <title>
               <p>Health status measurement. Implementation strategies</p>
            </title>
            <aug>
               <au>
                  <snm>Golden</snm>
                  <fnm>WE</fnm>
               </au>
            </aug>
            <source>Med Care</source>
            <pubdate>1992</pubdate>
            <volume>30</volume>
            <issue>5 Suppl</issue>
            <fpage>MS187</fpage>
            <lpage>95</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1097/00005650-199205001-00016</pubid>
                  <pubid idtype="pmpid">1583933</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B16">
            <title>
               <p>Barriers to the use of health status measures in clinical investigation, patient care, and policy research</p>
            </title>
            <aug>
               <au>
                  <snm>Deyo</snm>
                  <fnm>RA</fnm>
               </au>
               <au>
                  <snm>Patrick</snm>
                  <fnm>DL</fnm>
               </au>
            </aug>
            <source>Med Care</source>
            <pubdate>1989</pubdate>
            <volume>27</volume>
            <issue>3 Suppl</issue>
            <fpage>S254</fpage>
            <lpage>68</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1097/00005650-198903001-00020</pubid>
                  <pubid idtype="pmpid">2646491</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B17">
            <title>
               <p>Health-related quality of life measurement in pediatric clinical practice: an appraisal and precept for future research and application</p>
            </title>
            <aug>
               <au>
                  <snm>Varni</snm>
                  <fnm>JW</fnm>
               </au>
               <au>
                  <snm>Burwinkle</snm>
                  <fnm>TM</fnm>
               </au>
               <au>
                  <snm>Lane</snm>
                  <fnm>MM</fnm>
               </au>
            </aug>
            <source>Health Qual Life Outcomes</source>
            <pubdate>2005</pubdate>
            <volume>3</volume>
            <fpage>34</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1156928</pubid>
                  <pubid idtype="pmpid" link="fulltext">15904527</pubid>
                  <pubid idtype="doi">10.1186/1477-7525-3-34</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B18">
            <title>
               <p>Feasibility and compliance of automated measurement of quality of life in oncology practice</p>
            </title>
            <aug>
               <au>
                  <snm>Wright</snm>
                  <fnm>EP</fnm>
               </au>
               <au>
                  <snm>Selby</snm>
                  <fnm>PJ</fnm>
               </au>
               <au>
                  <snm>Crawford</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Gillibrand</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Johnston</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Perren</snm>
                  <fnm>TJ</fnm>
               </au>
               <au>
                  <snm>Rush</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Smith</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Velikova</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Watson</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Gould</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Cull</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>J Clin Oncol</source>
            <pubdate>2003</pubdate>
            <volume>21</volume>
            <issue>2</issue>
            <fpage>374</fpage>
            <lpage>82</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1200/JCO.2003.11.044</pubid>
                  <pubid idtype="pmpid" link="fulltext">12525532</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B19">
            <title>
               <p>Quality of life assessment in daily clinical oncology practice: a feasibility study</p>
            </title>
            <aug>
               <au>
                  <snm>Detmar</snm>
                  <fnm>SB</fnm>
               </au>
               <au>
                  <snm>Aaronson</snm>
                  <fnm>NKL</fnm>
               </au>
            </aug>
            <source>Eur J Cancer</source>
            <pubdate>1998</pubdate>
            <volume>34</volume>
            <issue>8</issue>
            <fpage>1181</fpage>
            <lpage>6</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0959-8049(98)00018-5</pubid>
                  <pubid idtype="pmpid" link="fulltext">9849476</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B20">
            <title>
               <p>Evaluating health-related quality of life: cost comparison of computerized touch-screen technology and traditional paper systems</p>
            </title>
            <aug>
               <au>
                  <snm>Lofland</snm>
                  <fnm>JH</fnm>
               </au>
               <au>
                  <snm>Schaffer</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Goldfarb</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Pharmacotherapy</source>
            <pubdate>2000</pubdate>
            <volume>20</volume>
            <issue>11</issue>
            <fpage>1390</fpage>
            <lpage>5</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1592/phco.20.17.1390.34887</pubid>
                  <pubid idtype="pmpid">11079288</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B21">
            <title>
               <p>Health Related Quality of Chronic Liver Patients: A Dutch Population-Based Study</p>
            </title>
            <aug>
               <au>
                  <snm>Plas</snm>
                  <mnm>van der</mnm>
                  <fnm>SM</fnm>
               </au>
            </aug>
            <publisher>Rotterdam, the Netherlands: Erasmus Medical Center</publisher>
            <pubdate>2004</pubdate>
         </bibl>
         <bibl id="B22">
            <title>
               <p>Health-related quality of life in chronic liver disease: the impact of type and severity of disease</p>
            </title>
            <aug>
               <au>
                  <snm>Younossi</snm>
                  <fnm>ZM</fnm>
               </au>
               <au>
                  <snm>Boparai</snm>
                  <fnm>N</fnm>
               </au>
               <au>
                  <snm>Price</snm>
                  <fnm>LL</fnm>
               </au>
               <au>
                  <snm>Kiwi</snm>
                  <fnm>ML</fnm>
               </au>
               <au>
                  <snm>McCormick</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Guyatt</snm>
                  <fnm>G</fnm>
               </au>
            </aug>
            <source>Am J Gastroenterol</source>
            <pubdate>2001</pubdate>
            <volume>96</volume>
            <issue>7</issue>
            <fpage>2199</fpage>
            <lpage>205</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1111/j.1572-0241.2001.03956.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">11467653</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B23">
            <title>
               <p>A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity</p>
            </title>
            <aug>
               <au>
                  <snm>Ware</snm>
                  <fnm>J</fnm>
                  <suf>Jr</suf>
               </au>
               <au>
                  <snm>Kosinski</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Keller</snm>
                  <fnm>SD</fnm>
               </au>
            </aug>
            <source>Med Care</source>
            <pubdate>1996</pubdate>
            <volume>34</volume>
            <issue>3</issue>
            <fpage>220</fpage>
            <lpage>33</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1097/00005650-199603000-00003</pubid>
                  <pubid idtype="pmpid">8628042</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B24">
            <title>
               <p>The Liver Disease Symptom Index 2.0; validation of a disease-specific questionnaire</p>
            </title>
            <aug>
               <au>
                  <snm>Plas</snm>
                  <mnm>van der</mnm>
                  <fnm>SM</fnm>
               </au>
               <au>
                  <snm>Hansen</snm>
                  <fnm>BE</fnm>
               </au>
               <au>
                  <snm>de Boer</snm>
                  <fnm>JB</fnm>
               </au>
               <au>
                  <snm>Stijnen</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Passchier</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>de Man</snm>
                  <fnm>RA</fnm>
               </au>
               <au>
                  <snm>Schalm</snm>
                  <fnm>SW</fnm>
               </au>
            </aug>
            <source>Qual Life Res</source>
            <pubdate>2004</pubdate>
            <volume>13</volume>
            <issue>8</issue>
            <fpage>1469</fpage>
            <lpage>81</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1023/B:QURE.0000040797.17449.c0</pubid>
                  <pubid idtype="pmpid" link="fulltext">15503842</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B25">
            <title>
               <p>Quality of care from the patients' perspective: from theoretical concept to a new measuring instrument</p>
            </title>
            <aug>
               <au>
                  <snm>Sixma</snm>
                  <fnm>HJ</fnm>
               </au>
               <au>
                  <snm>Kerssens</snm>
                  <fnm>JJ</fnm>
               </au>
               <au>
                  <snm>Campen</snm>
                  <fnm>CV</fnm>
               </au>
               <au>
                  <snm>Peters</snm>
                  <fnm>L</fnm>
               </au>
            </aug>
            <source>Health Expect</source>
            <pubdate>1998</pubdate>
            <volume>1</volume>
            <issue>2</issue>
            <fpage>82</fpage>
            <lpage>95</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1046/j.1369-6513.1998.00004.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">11281863</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B26">
            <title>
               <p>Development of a Smiling Touchscreen multimedia program for HRQoL assessment in subjects with varying levels of literacy</p>
            </title>
            <aug>
               <au>
                  <snm>Thumboo</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Wee</snm>
                  <fnm>HL</fnm>
               </au>
               <au>
                  <snm>Cheung</snm>
                  <fnm>YB</fnm>
               </au>
               <au>
                  <snm>Machin</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Luo</snm>
                  <fnm>N</fnm>
               </au>
               <au>
                  <snm>Fong</snm>
                  <fnm>KY</fnm>
               </au>
            </aug>
            <source>Value Health</source>
            <pubdate>2006</pubdate>
            <volume>9</volume>
            <issue>5</issue>
            <fpage>312</fpage>
            <lpage>9</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1111/j.1524-4733.2006.00120.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">16961549</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B27">
            <title>
               <p>Patients' views on quality of care: a comparison of men and women</p>
            </title>
            <aug>
               <au>
                  <snm>Larsson</snm>
                  <fnm>BW</fnm>
               </au>
               <au>
                  <snm>Larsson</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Starrin</snm>
                  <fnm>B</fnm>
               </au>
            </aug>
            <source>J Nurs Manag</source>
            <pubdate>1999</pubdate>
            <volume>7</volume>
            <issue>3</issue>
            <fpage>133</fpage>
            <lpage>9</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1046/j.1365-2834.1999.00121.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">10578808</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B28">
            <title>
               <p>Touch-screen computer systems in the rheumatology clinic offer a reliable and user-friendly means of collecting quality-of-life and outcome data from patients with rheumatoid arthritis</p>
            </title>
            <aug>
               <au>
                  <snm>Greenwood</snm>
                  <fnm>MC</fnm>
               </au>
               <au>
                  <snm>Hakim</snm>
                  <fnm>AJ</fnm>
               </au>
               <au>
                  <snm>Carson</snm>
                  <fnm>E</fnm>
               </au>
               <au>
                  <snm>Doyle</snm>
                  <fnm>DV</fnm>
               </au>
            </aug>
            <source>Rheumatology [Oxford]</source>
            <pubdate>2006</pubdate>
            <volume>45</volume>
            <issue>1</issue>
            <fpage>66</fpage>
            <lpage>71</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1093/rheumatology/kei100</pubid>
                  <pubid idtype="pmpid" link="fulltext">16263782</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B29">
            <title>
               <p>Patients' experiences using a computerized program with a touch-sensitive video monitor for the assessment of health-related quality of life</p>
            </title>
            <aug>
               <au>
                  <snm>Buxton</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>White</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Osoba</snm>
                  <fnm>D</fnm>
               </au>
            </aug>
            <source>Qual Life Res</source>
            <pubdate>1998</pubdate>
            <volume>7</volume>
            <issue>6</issue>
            <fpage>513</fpage>
            <lpage>9</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1023/A:1008826408328</pubid>
                  <pubid idtype="pmpid" link="fulltext">9737141</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B30">
            <title>
               <p>Automated collection of quality-of-life data: a comparison of paper and computer touch-screen questionnaires</p>
            </title>
            <aug>
               <au>
                  <snm>Velikova</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Wright</snm>
                  <fnm>EP</fnm>
               </au>
               <au>
                  <snm>Smith</snm>
                  <fnm>AB</fnm>
               </au>
               <au>
                  <snm>Cull</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Gould</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Forman</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Perren</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Stead</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Brown</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Selby</snm>
                  <fnm>PJ</fnm>
               </au>
            </aug>
            <source>J Clin Oncol</source>
            <pubdate>1999</pubdate>
            <volume>17</volume>
            <issue>3</issue>
            <fpage>998</fpage>
            <lpage>1007</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">10071295</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B31">
            <title>
               <p>Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology</p>
            </title>
            <aug>
               <au>
                  <snm>Velikova</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Brown</snm>
                  <fnm>JM</fnm>
               </au>
               <au>
                  <snm>Smith</snm>
                  <fnm>AB</fnm>
               </au>
               <au>
                  <snm>Selby</snm>
                  <fnm>PJ</fnm>
               </au>
            </aug>
            <source>Br J Cancer</source>
            <pubdate>2002</pubdate>
            <volume>86</volume>
            <issue>1</issue>
            <fpage>51</fpage>
            <lpage>9</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/sj.bjc.6600001</pubid>
                  <pubid idtype="pmpid">11857011</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
      </refgrp>
   </bm>
</art>
