To examine the agreement between self-reported and routinely collected administrative health-care utilization data, and the factors associated with agreement between these two data sources.
A representative sample of seniors living in an Ontario county within Canada was identified using the Ontario Ministry of Health's Registered Persons Data Base in 1992. Health professional billing information and hospitalization data were obtained from the Ontario Ministry of Health and Long-Term Care (OMH) and the Ontario Health Insurance Plan (OHIP).
A cross-sectional survey was carried out to assess any contact and frequency of contacts with health professionals and hospital admissions. Similar information was obtained from routinely collected administrative data. The level of agreement was assessed using the proportion of absolute agreement, Cohen's kappa statistic (kappa), and the intraclass correlation coefficient (ICC). Logistic and linear regressions were used to identify factors that were associated with the magnitude and direction of disagreement respectively.
Telephone interviews were conducted on 1,054 seniors, and complete data were available for 1,038 seniors. Each respondent's personal health number was used to electronically link survey data with health professional billing and hospitalization databases.
Substantial to almost perfect agreement was found for the contact utilization measures, while agreement on volume utilization measures varied from poor to almost perfect. In surveys, seniors overreported contact with general practitioners and physiotherapists or chiropractors, and underreported contact with other medical specialists. Seniors also underreported the number of contacts with general practitioners and other medical specialists. The odds of agreement decreased if respondents were male, aged 75 years and older, had incomes of less than $25,000, had poor/fair/good self-assessed health status, or had two or more chronic conditions.
The findings of this study indicate that there are substantial discrepancies between self-reported and administrative data among older adults. Researchers seeking to examine health-care use among older adults need to consider these discrepancies in the interpretation of their results. Failure to recognize these discrepancies between survey and administrative data among older adults may lead to the establishment of inappropriate health-care policies.
Notes
Cites: Biometrics. 1977 Mar;33(1):159-74843571
Cites: Med Care. 1978 Dec;16(12):995-1005362083
Cites: Med Care. 1981 Mar;19(3):310-57218896
Cites: J Community Health. 1981 Winter;7(2):80-927328199
Cites: Med Care. 1983 Oct;21(10):1001-116418985
Cites: Health Serv Res. 1986 Jun;21(2 Pt 1):129-443525467
Cites: Med Care. 1987 Jan;25(1):20-43807447
Cites: J Am Geriatr Soc. 1988 Jul;36(7):613-63385114
Cites: Am J Public Health. 1989 Nov;79(11):1554-62817172
Cites: J Clin Epidemiol. 1990;43(6):543-92348207
Cites: Am J Public Health. 1991 Jan;81(1):63-81898500