Observer ratings in psychotherapy are a common way of collecting information in psychotherapy research. However, human observers are imperfect instruments, and their ratings may be subject to variability from several sources. One source of variability can be raters' assessing more than 1 instrument at a time. The purpose of this research is to investigate whether it is possible to have raters assess 2 different psychotherapy process measures simultaneously and still produce dependable scores. Two studies were designed. The first compared scores assessed by raters who rated either 1 instrument or 2 instruments simultaneously. The second compared scores of raters who assessed 2 instruments simultaneously and scores of expert raters who assessed 1 instrument. The results show that variability in scores is largely due to differences across the object of measurement (e.g., patients). Small variability was reported for raters, raters' interaction with patients, and whether the rater assessed 1 instrument or 2 instruments simultaneously. The results are promising for the quality of observer ratings of psychotherapy process and for the feasibility of future psychotherapy process research. (PsycINFO Database Record (c) 2012 APA, all rights reserved).
Monitoring of ongoing psychotherapy is of crucial importance in improving the quality of mental health care by detecting therapies being off track, which requires that the instrument used is psychometrically sound. This study investigates the psychometric properties of the Norwegian version of the Outcome Questionnaire 45.2 (OQ-45) and situates the results in an international context.
Data from one non-clinical sample (N = 338) and one clinical sample (N = 560) were compared to international samples investigating reliability, cut-offs, and factor structure.
The results show adequate reliability and concurrent validity.
The means, clinical cut-offs, and the reliable change index vary across countries. However, the means of the OQ-45 for nonclinical samples correlate highly with external values of national well-being, indicating that the OQ-45 is a valid instrument internationally. The factor analyses in the present study do not confirm the hypothesized factor structure of the OQ-45, but are similar to the results internationally.
As established in several studies, therapists differ in effectiveness. A vital research task now is to understand what characterizes more or less effective therapists, and investigate whether this differential effectiveness systematically depends on client factors, such as the type of mental health problem. The purpose of the current study was to examine whether therapists are universally effective across patient outcome domains reflecting different areas of mental health functioning. Data were obtained from 2 sites: the Research Consortium of Counseling and Psychological Services in Higher Education (N = 5,828) in the United States and from primary and secondary care units (N = 616) in Sweden. Outcome domains were assessed via the Outcome Questionnaire-45 (Lambert et al., 2004) and the CORE-OM (Evans et al., 2002). Multilevel models with observations nested within patients were used to derive a reliable estimate for each patient's change (which we call a multilevel growth d) based on all reported assessment points. Next, 2 multilevel confirmatory factor analytic models were fit in which these effect sizes (multilevel ds) for the 3 subscales of the OQ-45 (Study 1) and 6 subscales of CORE-OM (Study 2) were indicators of 1 common latent factor at the therapist level. In both data sets, such a model, reflecting a global therapist effectiveness factor, yielded large factor loadings and excellent model fit. Results suggest that therapists effective (or ineffective) within one outcome domain are also effective within another outcome domain. Tentatively, therapist effectiveness can thus be conceived of as a global construct. (PsycINFO Database Record
It has been claimed that the monitoring of ongoing psychotherapy is of crucial importance for improving the quality of mental health care. This study investigated the effect of using the Norwegian version of the patient feedback system OQ-Analyst using the Outcome Questionnaire-45.2. Patients from six psychiatric clinics in Southern Norway (N = 259) were randomized to feedback (FB) or no feedback (NFB). The main effect of feedback was statistical significant (p = .027), corroborating the hypothesis that feedback would improve the quality of services, although the size of the effect was small to moderate (d = 0.32). The benefits of feedback have to be considered against the costs of implementation.