This study aimed at evaluating face and content validity, feasibility and reliability of process quality indicators developed previously in the United States or other countries. The indicators can be used to evaluate care and services for vulnerable older adults affected by cognitive impairment or dementia within an integrated service system in Quebec, Canada.
A total of 33 clinical experts from three major urban centres in Quebec formed a panel representing two medical specialties (family medicine, geriatrics) and seven health or social services specialties (nursing, occupational therapy, psychology, neuropsychology, pharmacy, nutrition, social work), from primary or secondary levels of care, including long-term care. A modified version of the RAND(R)/University of California at Los Angeles (UCLA) appropriateness method, a two-round Delphi panel, was used to assess face and content validity of process quality indicators. The appropriateness of indicators was evaluated according to a) agreement of the panel with three criteria, defined as a median rating of 7-9 on a nine-point rating scale, and b) agreement among panellists, judged by the statistical measure of the interpercentile range adjusted for symmetry. Feasibility of quality assessment and reliability of appropriate indicators were then evaluated within a pilot study on 29 patients affected by cognitive impairment or dementia. For measurable indicators the inter-observer reliability was calculated with the Kappa statistic.
Initially, 82 indicators for care of vulnerable older adults with cognitive impairment or dementia were submitted to the panellists. Of those, 72 (88%) were accepted after two rounds. Among 29 patients for whom medical files of the preceding two years were evaluated, 63 (88%) of these indicators were considered applicable at least once, for at least one patient. Only 22 indicators were considered applicable at least once for ten or more out of 29 patients. Four indicators could be measured with the help of a validated questionnaire on patient satisfaction. Inter-observer reliability was moderate (Kappa = 0.57).
A multidisciplinary panel of experts judged a large majority of the initial indicators valid for use in integrated care systems for vulnerable older adults in Quebec, Canada. Most of these indicators can be measured using patient files or patient or caregiver interviews and reliability of assessment from patient-files is moderate.
Notes
Cites: Int J Geriatr Psychiatry. 2003 Mar;18(3):222-3512642892
Cites: J Am Geriatr Soc. 2000 Apr;48(4):363-910798460
Cites: J Am Geriatr Soc. 2003 Jul;51(7 Suppl):S346-5012823666
Cites: N Engl J Med. 2003 Jun 26;348(26):2635-4512826639
Cites: Can Fam Physician. 2003 Aug;49:992-712943358
Cites: Ann Intern Med. 2003 Nov 4;139(9):740-714597458
Cites: BMJ. 2003 Nov 22;327(7425):1219-2114630762
Cites: Int J Qual Health Care. 2003 Dec;15 Suppl 1:i5-1114660518
Cites: Int J Qual Health Care. 2003 Dec;15(6):523-3014660535
Cites: Can J Psychiatry. 2004 Feb;49(2):83-9115065741
Cites: Qual Saf Health Care. 2004 Aug;13(4):260-415289628
Cites: N Engl J Med. 1996 Sep 26;335(13):966-708782507
Cites: N Engl J Med. 1999 Jan 7;340(1):52-39878647
Cites: Can J Aging. 2004 Fall;23(3):231-4615660297
Cites: Int J Qual Health Care. 2005 Apr;17(2):141-615665066
Cites: Ann Intern Med. 2005 Aug 16;143(4):274-8116103471