A 5 year comprehensive study using Therapeutic Storytelling Intervention (TSI) in a community mental health setting
This naturalistic outcome study suggests that TSI is successful method of communicating with multi-problem children and adolescents who are hard to reach using many traditional methods. Those attending TSI groups were selected for this study because they formed a coherent and trackable cohort of patients who had received a manualised treatment. While cognisant of the hierarchy of research design with regard to power, sample size and control for confounds, this study make an important contribution to exploring methods of engaging and retaining distressed young people in treatment and provides a foundation on which to build successful clinical interventions. The data in this study form the basis of a randomised controlled trial which is currently being established.
The most outstanding result of this study is that children and adolescents with severe mental health disorders and high rates of co-morbidity were engaged in an outpatient group treatment programme and that the overall retention rate of 60% is significantly higher than found in many similar programmes. TSI is equally successful in retaining boys and girls in treatment. The high rate of retention is of particular interest to clinicians who are attempting to generate creative ways of treating children and adolescents in community mental health settings. Many patients and their families do not share mental health professional views that ongoing follow-up is beneficial to them reflected in compliance rates as low as 20 -30 % with outpatient treatment (Coatsworth, Santisteban, McBride, & Szapocznik, 2001; King, Hovey, Brand, & Wilson, 1997; Rotheram-Borus et al., 1999; Spirito, Plummer, Gispert, Levy, & et al., 1992). Dropout occurs rapidly with a median survival rate of only three sessions (Trautman, Stewart, & Morishima, 1993) compared with average retention of 16 sessions demonstrated in this study.
Pre and post group data suggest that both parents and patients perceive an improvement in their general mental health and behaviour. Parents rated their children as having fewer behavioural problems and less symptoms of depression, anxiety and attention difficulties. Similarly participants rated themselves as more effective with greater enjoyment of life and lower rates of overall depression, suicidality and more positive perceptions of the way in which their family functioned.
Groups are intrinsically attractive from both developmental and service delivery perspectives. However oppositional adolescents and those who have ‘failed’ previous treatment programs strongly resist efforts to utilise their ‘issues’ as material upon which the group session is dependant. Frequently such adolescents will act out in order to disrupt the group and/or terminate their inclusion. TSI precludes the destruction of the group by this route by providing ‘safe’, externalised material for group discussion. TSI rapidly engages resistant, hopeless and depressed adolescents, enabling family and other therapy to proceed with the amelioration of risk factors.
Setting and Participants
Catchment area: This study is based 347 children and adolescents who attended TSI group therapy at a public outpatient child and adolescent mental health service in South Auckland, New Zealand. The catchment area for this service is populated by more than 400,000 of which more than one third are under 20 years. At the last census European/Pakeha made up 52% of the community, Pacific peoples 27%, Maori 17% and Asians 15% of the community. The rates of unemployment (10.1% in this area vs. 7.5% nationally), single parent families (23% vs. 19%), number of people living in each house (3.3 vs. 2.7) and proportion of adults with no educational qualifications (29% vs. 27.6%) are higher in this community compared with other parts of New Zealand (Statistics New Zealand, 2002). It is acknowledged that the local context will influence the wider applicability of this information.
The Clinic: A multidisciplinary team including child psychiatrists, clinical psychologists, psychiatric nurses, social workers and family therapists work with children, adolescents and their families who represent the 3-5% of the population in greatest need of psychiatric services. Children and adolescents up to the age of 20 years (if still in school) are treated using a combination of crisis interventions, family therapy, group therapy, medication and individual therapy. Attempts are made to involve the wider systems of care for the young person including the family, school, social work agency, police and health care providers with which they have contact. Inpatient admissions are possible at a regional child and adolescent psychiatric unit.
Selection of participants: Patients were assessed by two mental health clinicians as part of usual clinic practices and a treatment plan generated which may include any combination of family therapy, group therapy, medication, or individual therapy. All patients who attended the clinic between 1997 and 2001 and who were referred to group therapy were included in this study.
Procedure and Measures
The primary investigator collated demographic data from clinical records and individual attendance data at each group session, which was collected by administrative staff for all patients. A clinical profile of patients attending TSI was generated in 1999 as part of quality improvement using a using a pre and post measure design. The primary investigator distributed questionnaires to group members and their parents attending the initial group session and again at the completion of the group process. Parents of all patients completed the Childhood Behaviour Checklist (CBCL). Children completed the Childhood Depression Inventory (CDI) and adolescents completed these measures and the McMaster Family Assessment Device (FAD) and Beck Scale for Suicide Ideation (BSSI). These measures were found to have acceptable reliablity with this population with Cronbach alpha ranging from .83 (FAD) to .95 (BSSI).
Psychiatric diagnoses were not routinely generated by clinicians during the period of this study and are therefore not reported. However a study conducted by the primary investigator suggests that nearly 50% of patients present with a mood disorder, 17% present with disruptive behaviours, including conduct disorder and oppositional defiant disorder, 7% have PTSD and 27% experienced difficulties such as childhood sexual abuse, parent/child relationship issues or neglect. More than half of patients have comorbid psychiatric disorders (Fortune, 2002). This population is also known to experience high rates of known risk factors for psychosocial distress such as suicide behaviour, substance abuse, parental psychopathology, physical abuse and childhood sexual abuse (Fortune, 2002).
Data were entered into the Statistical Package for the Social Sciences (SPSS), Version 11.5 for Windows, on an IBM compatible PC. Data were checked for errors and the necessary corrections made. Preliminary descriptive statistics were conducted to check assumptions underlying the use of parametric and nonparametric methods. An alpha of 0.05 was used for all statistical tests.
he early TSI groups were particularly targeted at boys but over the period of the study TSI has been increasingly utilised with both girls and boys. One quarter (n = 78) of group participants are Maori and two thirds European/Pakeha (n = 238). Two thirds of patients attending the group were adolescents and one third were under the age of 12 years.
Demographic profile of group participants
|European / Pakeha||52||71||42||76||86||68||17||57||41||65||238||69|
Between three and six groups were completed each calendar year with variance reflecting fluctuating staffing numbers, particularly in 2000. The groups were conducted over an average of 16 sessions but can be condensed to 9 sessions if required or extended for up to 20 sessions dependant on the requirements of the group members and clinicians.
Duration and number of participants in each group 1997 – 2001
|Total number of groups conducted||12||6||13||3||6|
|Average number of sessions||17||15||16||15||16|
|Range||10 – 19||11 – 20||11 – 19||14 – 16||9 – 18|
|Average number of patients per group||6||9||10||10||11|
|Range||3 – 11||6 – 13||3 – 15||8 – 12||8 – 16|
Three out of every five patients attended more than 60% of sessions and were described as ‘graduates’ with no significant difference in rates of graduation between males and females. Half of non-graduates had legitimate reasons for dropping out of the group such as moving out of the area or the family having significant problems with transport. Average attendance among patients who commenced TSI was 65% from 1997 – 2001. Among graduates average attendance rates were between 86% – 89% which allows for one session missed due to illness and another to attend a school camp or similar.
Maori were more likely than other ethnic groups to begin the TSI group but fail to complete it while Pacific Island children and adolescents were more likely to be referred to the group by their key worker and but fail to commence the group (x2 (6, N = 347) = 34.32, p = .000).
Crisis re-presentations appear to be significantly lower in comparison with outcome studies of similar populations (Beautrais, 2000) with 3% of graduates representing with deliberate self-harm between 1997 and 2001.
Attendance and retention rates for group participants 1997 – 2001
Attendance and retention rates for group participants 1997 – 2001
|Year of TSI completion|
|Total Number of Participants||73||55||126||30||63|
|Referred but Did Not Start||8%||18%||15%||0%||8%|
|Number of crisis representations||1||3||0||0||1|
|Percent of Graduates||2%||11%||0%||0%||3%|
From figure it can be seen that average attendance at group sessions declines with an increasing number of sessions, but not among those who graduate from the programme. It appears that successful engagement with the therapeutic process can be defined by a return after session three.
Average attendance rates per session for graduates, non-graduates and total sample
Pre and post test data were available for a sub-set of 46 children and adolescents. Using the CBCL measure, parents rated significant reductions in withdrawn (t(25) = 3.05, p = .005), somatic (t(25) = 2.50, p = .02) and anxious/depressed behaviours (t(25) = 2.55, p = .02) among their offspring. Parents also rated their children has having fewer attentional difficulties (t(25) = 2.88, p = .008). Parents reported an overall improvement in their child’s behaviour at the completion of the group compared with at the beginning of the group process (t(25) = 3.15, p = .001).
CBCL scores pre and post group intervention
|Total T score||67.15||8.38||61.65||11.30||3.14**|
|Internal T score||64.85||8.41||57.27||12.70||3.61***|
|External T score||66.23||9.30||63.19||11.66||1.79|
|* p < .05 ** p < .01 *** p < .001|
Children and adolescents who completed the CDI before and after the TSI group rated themselves as significantly less depressed at follow-up (t(33) = 2.41, p = .02) with the strongest effect seen in the domain of perceived ineffectiveness where the mean score fell from 2.97 (SD = 2.29) to 1.76 (SD = 1.78) (t(36) = 3.10, p = .004).
Childhood Depression Inventory scores pre and post group
|Negative self esteem||1.76||1.96||1.10||1.52||1.81|
|Total CDI score||13.5||8.79||9.65||8.36||2.41*|
|* p < .05 ** p < .01 *** p < .001|
Adolescents perceived an improvement in the way in which their family functioned at follow-up using the McMaster Family Assessment Device (t(21) = 2.21, p = .04). The strongest improvements were seen in the extent to which adolescents felt the roles of family members were clear and congruent (t(21) = 2.77, p = .01) and the degree to which family members were affectively connected and involved with each other (t(21) = 2.69, p = .01).
Family functioning as perceived by the adolescents
|* p < .05 ** p < .01 *** p < .001|
Adolescents reported a significant reduction in their overall suicidality following the group compared with prior to attending the group (t(17) = 2.73, p = .01).
Abraham, P. P., Lepisto, B. L., & Schultz, L. (1995). Adolescents perceptions of process and speciality group therapy. Psychotherapy, 32(1), 70 – 76.
Beautrais, A. (2000). The Canterbury suicide project: aims, overview and progress. Community Mental Health in New Zealand, 8(2), 32 – 39.
Coatsworth, J. D., Santisteban, D. A., McBride, C. K., & Szapocznik, J. (2001). Brief strategic family therapy versus community control: engagement, retention and an exploration of the moderating role of adolescent symptom severity. Family Process, 40(3), 313 – 332.
Fortune, S. A. (2002). Suicidal behavaviour among a clinical sample of children and adolescents in New Zealand.
King, C. A., Hovey, J. D., Brand, E., & Wilson, R. (1997). Suicidal adolescents after hospitalization: Parent and family impacts on treatment follow-through. Journal of the American Academy of Child & Adolescent Psychiatry, 36(1), 85-93.
Mishna, F., Kaiman, J., Little, S., & Tarshis, E. (1994). Group therapy with adolescents who havd learning disabilities and social/emotional problems. Journal of Child and Adolescent Group Therapy, 4(2), 117 – 131.
Phillips, R. (1989). Gem of the First Water a Fable for Our Times (Third ed.). Auckland: Therapeutic Story Telling International.
Rotheram-Borus, M. J., Piacentini, J., Van Rossem, R., Graae, F., Cantwell, C., Castro-Blanco, D., et al. (1999). Treatment adherence among Latina female adolescent suicide attempters. Suicide & Life-Threatening Behavior, 29(4), 293 – 311.
Spirito, A., Plummer, B., Gispert, M., Levy, S., & et al. (1992). Adolescent suicide attempts: Outcomes at follow-up. American Journal of Orthopsychiatry, 62(3), 464-468.
Statistics New Zealand. (2002). Manukau City Census 2001 area data. Wellington: Government Print.
Trautman, P. D., Stewart, N., & Morishima, A. (1993). Are adolescent suicide attempters noncompliant with outpatient care? Journal of the American Academy of Child & Adolescent Psychiatry, 32(1), 89 – 94.