|
|
||||||||
Regular Article |
Received April 16, 1999; accepted June 3, 1999. From the Department of Psychiatry, University of Oslo, Norway. Address correspondence to Dr. Bøgwald, Department of Psychiatry, University of Oslo, P.O. Box 85 Vinderen, 0319 Oslo, Norway; e-mail: k.p.bogwald{at}psykiatri.uio.no
| Abstract |
|---|
|
|
|---|
Key Words: Transference Brief Dynamic Psychotherapy Process Scale Therapist Interventions
| Introduction |
|---|
|
|
|---|
Global concepts like "transference interpretations" or "working with the patient/therapist relationship" or "focus on the here and now" are too vague and general to be used as items for measuring different technical aspects of the analysis of the patient/therapist relationship. Interpretations of transference in a strict sense (e.g., genetic interpretations) are used sparsely in mainstream short-term dynamic psychotherapy.9,10 Questions about how the patient might feel and fantasize about the therapist are often used to prime the patient's own understanding of transference phenomena or neurotic repetitional patterns. In our study, we needed to include a wider range of different interventions that might be used to explore possible transference reactions than is covered in most existing adherence scales. We therefore developed a new rating scale, Specific Therapeutic Technique (STT; Høglend, 1995, unpublished manuscript), for measuring therapist interventions that address the patient/therapist interaction and transference phenomena. The new scale was based on elements from existing adherence scales, especially from the Vanderbilt Therapeutic Strategies Scale.11
| CONSIDERATIONS IN CONSTRUCTING THE SCALE |
|---|
|
|
|---|
| DESCRIPTION OF THE SCALE |
|---|
|
|
|---|
We decided to include five different elements that we consider important when measuring how much the therapist has focused on the patient/therapist relationship and interpreted possible transference phenomena in a given psychotherapy session. It is important to emphasize that our purpose is to capture the therapist's active utilization of possible transference phenomena that goes beyond mere use of transference interpretations in a strict sense. For instance, the therapist addressing the therapeutic relationship by asking the patient how he or she feels about the therapy is no interpretation. But addressing the patient's feelings or thoughts about the therapeutic relationship is often a precursor to transference interpretations. A short description of the five different elements that constitute the transference subscale appears in Table 1.
|
The items in the STT-extratransference subscale are very similar, but they describe interventions where the therapist focuses on interpersonal relations other than the patient/therapist relationship.
| RATING INSTRUCTIONS |
|---|
|
|
|---|
The raters using STT were instructed to consider both the relative frequency (relative to all interventions) of the transference-related interventions and how explicitly and with what degree of emphasis the interventions were delivered. On the basis of a synthesis of these considerations, the expert clinician rates each item on a Likert five-step scale ranging from 0 ("not at all") to 4 ("very much").
Concepts like the correspondence between the transference interpretations and psychodynamic formulations,15 focal adherence,16 the degree of accuracy,17,18 or plan compatibility19 of transference interpretations might all be important factors in process ratings, but they should not be part of the transference subscale measuring to what extent such interventions have been used. We aim at the purest possible estimate of transference-related interventions given by the therapistunaffected by the timing, accuracy, degree of friendliness/hostility, or "correctness" of these interventions. The timing, quality, and meaningfulness of the interventions, as well as the patient's immediate responses to the transference focusing, should be measured independently of the transference subscale. If the patient's response were to be given weight in rating the STT-transference, then relationships between these interventions and outcome would be confounded by patient characteristics.
| METHODS |
|---|
|
|
|---|
Therapies, Therapists, and Raters
In an ongoing large-scale randomized study (Oslo Transference Study) with dismantling strategy, two forms of brief dynamic psychotherapy are compared: both groups are treated with dynamic psychotherapy, but in one group, therapist interventions addressing patient/therapist interaction (transference) are meant to be used minimally or avoided. In the other group, analysis of the therapist/patient relationship and transference interpretations are to be employed in the way that is usual in mainstream dynamic therapy. Simple randomization allocated 17 patients to the treatment group where transference-related interventions should be used actively (program group) and 13 patients to the group where such interventions should be avoided (comparison group). The therapies in both groups consist of weekly sessions for up to 1 year or a maximum 40 sessions. We intended to have two treatment groups that both were given therapy by a skillful following of basic psychodynamic principles but that could be differentiated on one component, namely, the degree of transference focusing.
It has been shown that high emphasis on transference analysis in brief dynamic psychotherapy may be causally related to less favorable outcome22,23 or deterioration of therapeutic alliance.24 Overzealous use of transference analysis should therefore be avoided, and the therapists were trained to use moderate amounts of transference interpretations even to the patients in the program group.
The therapists in the study, six psychiatrists and one clinical psychologist, are all experienced therapists (mean clinical experience 20 years), and all are well educated in both short-term and long-term dynamic therapy, several with psychoanalytic education. They underwent 3 years of pilot training in order to be able to implement the techniques of both treatments with ease and competence.
The three raters were psychiatrists. All were highly experienced with psychodynamic treatment (mean clinical experience 20 years).
Measures
Together with the new 15-item process rating (STT) scale presented above, a more general process rating scale, the Interpretive and Supportive Technique Scale (ISTS),13 with 14 items, and an eight-item General Interpersonal Skill instrument (Høglend, 1995, unpublished manuscript) were used. The last instrument is a competence rating scale that measures the therapist's general skill in a given session on a five-level scale from 0 ("not at all") to 4 ("very much"). The items intend to measure quality factors that adherents of most modalities of psychotherapy would agree on, such as "Therapist responds to the patient in an accepting and understanding manner" and "Therapist interventions seem meaningful and well timed."
The ISTS is a relatively new instrument for measuring different supportive and expressive interventions in psychotherapy. This scale has shown good psychometric properties in two large-scale studies.13 The ISTS and the STT have similar rating instructions and scale formats (e.g., full-session sample segments, Likert scales of 0 to 4). Both instruments have relatively few items. The ISTS consists of an interpretive subscale of seven items and a supportive subscale of seven items. We grouped the seven interpretive items into two new subscales: the 4 items not containing transference interpretations but containing other explorative interventions (named ISTS-explorative), and the three items with transference-related interpretations (ISTS-transference).
Prior to randomization, the patients were evaluated with a comprehensive battery of self-report and clinician-rated instruments. In this article, pretreatment variables reporting the patient's own symptom description, the Symptom Checklist-90revised,21 and the independent evaluator-rated Global Assessment of Functioning Scale from DSM-IV20 will be analyzed.
Procedure
The raters used the three process rating scales independently after listening to the audiotaped 45-minute therapy sessions. The raters were generally blind to the patient's treatment group (except as noted below), but they were given a written pretreatment psychodynamic formulation in order to assess how well the therapist's interventions adhered to this pretreatment formulation. All sessions in the 30 treatments were audiotaped, and from the pool of sessions, one from the early stage (session 7) and one from the middle phase (session 16) were selected for process ratings. On the basis of the interrater reliability estimates achieved by the three raters at session 7, we decided to use only two of the three raters when rating session 16. For practical reasons, and in order to test if knowledge of the actual treatment group would bias the ratings, we decided to include all cases where the therapists rated their own patients. Thus, 18% of the total number of ratings were done by raters not blind to the treatment group.
Data Analysis
The interrater reliability estimates were calculated as intraclass correlations25 (ICC[2,k]), where rater is considered a random factor and k is the number of raters.
Differences in use of transference (STT-transference), extratransference (STT-extratransference), and supportive versus interpretive interventions and of general skill in the two treatment groups were tested with independent-sample t-tests. The classification of the individual cases was done by discriminant analysis (SPSS version 8.026), using treatment group as grouping variable and STT-transference score as independent variable. To test the possibility of biased ratings by the raters who were also therapist to the patient rated, we compared the therapist-rater with the two other raters in two separate ways. First we compared the STT-transference scores to see if knowledge of actual treatment group yields more extreme ratings: for example, did raters who knew that the therapist should focus on transference give higher ratings on STT-transference than raters blind to treatment group? Second, we used the Moses test of extreme reactions26 to test the hypothesis that therapist-raters had more extreme ratings when rating their own patients. As part of the investigation of convergent and divergent validity, we correlated STT-transference ratings with scores from other process scales, using Pearson's correlation coefficients. Furthermore, exploratory analysis to see if we could find any associations between pretreatment patient variables and the therapists' interventions was done by using multivariate analysis of variance.
| RESULTS |
|---|
|
|
|---|
|
The individual item ratings showed that, as expected, the transference-related interventions most used in the group assigned for transference focusing were those that contain simple statements about the patient/therapist relationship (mean score 3.0, "considerable") and questions about the patient's feelings toward therapy or the therapist (mean 2.8, "considerable"). These interventions are often preparations to interpretations of dynamic elements involving the patient/therapist relationship (mean 2.3, "moderately") and linking of repetitional patterns (mean 2.4, "moderately"). Direct questions about the patient's thoughts about what the therapist might feel toward the patient may be potent interventions to illuminate and make transference phenomena conscious, but they may be anxiety-provoking when used early in therapy. This intervention was used relatively seldom (mean 1.4, "very little") in sessions 7 and 16.
In the treatment group where transference focusing should be avoided or minimally used, this abstention was accomplished in almost all the cases, with mean ratings on all of the five items in the range 0.03 to 0.40, corresponding to a use of these interventions between "not at all" and "very little."
An acceptable coefficient of internal consistency (Cronbach's alpha) was found for STT-transference: 0.97. The alpha for the five-item STT-extratransference subscale was 0.87. The alpha was only 0.50 if we combined all 10 items from both subscales, indicating that our subscales measure different constructs.
When therapists rated their own patients from the high transference group, the mean STT-transference score was 2.6 (SD=0.8) compared with 2.7 (SD=0.8) for the two raters blind to treatment group. Patients in the low transference group were on average rated 0.08 (SD=0.2) on STT-transference by their therapists, compared with an average of 0.02 (SD=0.04) for the two other raters. These results indicate that knowledge of treatment group did not bias the ratings. Blind raters tended to discriminate just as well or better between the groups. Even if the average scores are very similar, one might expect more extreme ratings on individual patients when rated by their own therapist. However, the Moses test of extreme reactions was nonsignificant for all possible comparisons.
To test if STT can be used to distinguish the two treatment groups, we compared the groups by using independent-sample t-tests. As shown in Table 3, the STT-transference subscore was significantly different in the two groups. The STT-extratransference score was significantly higher in the treatment group where focus on the patient/therapist relationship was avoided, indicating that analysis of other interpersonal relationships was given more space and emphasis. Transference-related interventions measured with ISTS were also different in the two groups. Other explorative interventions and supportive interventions were not significantly different in the two groups. Our measure of competence (general skill) was very similar in the two groups. We found satisfactory treatment integrity in the project regarding general competence, use of explorative and supportive techniques, adherence to specific techniques, and differentiation between treatment groups on the component that should be different.
|
|
|
|
|
The different therapists had given the same amounts of transference interpretations. Only one of the seven therapists differed significantly in skill level and use of support. Treatment group influenced variance in the use of transference interpretations, as intended, but it did not significantly influence the therapist's use of support or general skill in the studied sessions. No significant therapist-by-group interactions regarding use of transference, support, or skill were found, indicating that the relatively long pilot training of the therapists had made them able to implement the techniques of both groups with high competence and adherence.
| DISCUSSION |
|---|
|
|
|---|
Even within each modality (the two different treatment groups), the reliabilities were acceptable and were better than those reported in some other studies.1,3 We decided to include ratings (18% of the total number of ratings) where the therapist rated his or her own cases and therefore was aware of the actual treatment group. This did not bias the ratings: knowledge of treatment group did not give more extreme ratings in any direction. Using therapists as raters of their own patients is often avoided because of the presumed biases. Our findings indicate that therapists can do process ratings such as STT reliably.
The STT-transference subscale was able to differentiate the two experimental groups both on a group level (t-tests) and on a case level (discriminant analysis).
We found a high correlation coefficient between our transference subscale and a three-item subscale describing transference-related interventions from the ISTS.13 On the other hand, the correlation between STT-transference and the remaining four interpretive items or the seven-item support subscale from ISTS was low. These results indicate elements of convergent and discriminant validity for the STT.
Further validation of the construct measured is warranted. As part of this effort, we are in the process of testing the association between the STT-transference scores from audiotaped sessions and the posttreatment assessment of the therapeutic ingredients both from the patient's and the therapist's perspective.
One important aspect of the present study was to test if experimental manipulation of one component of the therapy, namely focus on the patient/therapist relationship, would influence other techniques used by the therapists or their general therapeutic skill. When the therapist did not use the patient/therapist relationship actively as a vehicle to increase the patient's insight, more time was available for focusing and interpretation of other (here labeled as "extratransference") interpersonal relationships. In the treatment group where transference focusing was avoided, we measured significantly higher scores on the five-item extratransference subscale of STT.
When we used the Interpretive and Supportive Technique Scale (ISTS),13 our estimated interrater reliability for the interpretive subscale was comparable with the findings of the developers of ISTS (ICC[2,1]=0.82). However, our estimate on the supportive subscale was much lower (ICC[2,1]=0.48). The low reliability coefficient for the supportive items seems to have one main explanation: the average use of supportive interventions was low and had little variance. When interrater reliability is measured with the ICC, low variance necessarily makes it difficult to achieve high coefficients. The two treatment groups did not differ regarding use of supportive interventions.
Pretreatment patient distress and global functioning as measured with SCL-90-R and GAF, did not influence the use of specific techniques, degree of support, or general skill of the therapists. For most of the cases, our raters did not know the patients' pretreatment symptom levels and could not compensate for pretreatment "client difficulty" when doing competence ratings, as some authors27 have advocated. The fact that pretreatment dysfunction did not influence use of supportive versus explorative interventions might be explained by a relatively homogeneous patient sample, well selected by experienced clinicians for dynamic psychotherapy and generally in little need of supportive interventions. Alternatively, the controlled experimental design might have been carried through by the therapists in an "overcontrolled" manner, with rigid adherence to the instructions regardless of the patients' conditions and needs. The general high ratings on the competence scale do not support the latter hypothesis. Although the use of transference interventions was convincingly different in the two groups, the use of transference interpretations was moderate even in the cases randomized to focus on possible transference phenomena. That the patients' pretreatment symptoms and dysfunctions did not predict the therapists' competence or how much they would use specific techniques is consistent with findings reported by Barber et al.28 in a study of depressed patients treated with Supportive-Expressive Dynamic Psychotherapy.
The current study has some limitations that should be considered. The high interrater reliability estimates may have resulted partly from the raters being highly familiar with the scales. Compared with many other studies using different process rating scales,29 the raters in this study were far more experienced as clinicians. As stated, the rating of STT requires a certain degree of inference, and it is questionable whether undergraduates, for instance, would achieve the same high interrater reliabilities. Interrater reliability should be further tested using other groups of raters and also different patient populations.
Only 2 sessions, out of a mean number of 35 sessions, have been rated from each of the 30 treatments so far. Is the mean of these 2 sessions representative for all the sessions? Based on the relatively high correlation between STT-transference ratings on the two occasions (r=0.74, P<0.001), and intersession reliability as high as 0.85 (using ICC[2,k] model according to Shrout and Fleiss,25 where k=[number of different sessions]=2), we have found high stability in the use of transference interpretations across the two sessions.
It can be argued that the substantial difference in use of transference-related interventions between the two groups (effect size=4.0) may be due in part to rater biases. For example, an early interpretation of the patient/therapist relationship might have influenced the raters by creating an anchoring heuristic14: after forming an early estimate and a guess of treatment group based on a single intervention, the raters might fail to adjust their estimates accurately on the basis of subsequent data. Our acceptable interrater agreement, even within treatment modality, is inconsistent with a strong influence of such biases.
| CONCLUSIONS |
|---|
|
|
|---|
| Acknowledgments |
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
P. Hoglend, K.-P. Bogwald, S. Amlo, A. Marble, R. Ulberg, M. C. Sjaastad, O. Sorbye, O. Heyerdahl, and P. Johansson Transference Interpretations in Dynamic Psychotherapy: Do They Really Yield Sustained Effects? Am J Psychiatry, June 1, 2008; 165(6): 763 - 771. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Hoglend, S. Amlo, A. Marble, K.-P. Bogwald, O. Sorbye, M. C. Sjaastad, and O. Heyerdahl Analysis of the Patient-Therapist Relationship in Dynamic Psychotherapy: An Experimental Study of Transference Interpretations Am J Psychiatry, October 1, 2006; 163(10): 1739 - 1746. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Høglend, K.-P. Bøgwald, S. Amlo, O. Heyerdahl, O. Sørbye, A. Marble, M. C. Sjaastad, and H. Bentsen Assessment of Change in Dynamic Psychotherapy J Psychother Pract Res., October 1, 2000; 9(4): 190 - 199. [Abstract] [Full Text] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ALL ISSUES | SEARCH | TABLE OF CONTENTS |