The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

This article reports results of a pilot study of three participants receiving regulation-focused psychotherapy for children (RFP-C), a manualized, short-term, psychodynamic treatment for children with oppositional defiant disorder and other externalizing problems. RFP-C targets implicit emotion regulation while using an intensive, psychodynamic, play therapy approach to decrease the child’s need for disruptive behaviors.

Methods:

Three children with oppositional defiant disorder participated in a trial of RFP-C. Externalizing symptoms were assessed with the Oppositional Defiant Disorder Rating Scale, and emotion regulation was assessed with the Emotion Regulation Checklist.

Results:

All three children improved in accordance with expectations. Participants exhibited clinically significant and reliable change, as assessed by the primary symptom measure, and demonstrated improved capacity for emotional regulation.

Conclusions:

Results suggest that RFP-C has the potential to produce significant improvements in emotion regulation capacity and in symptoms of oppositional defiant disorder. This pilot study provides initial support for RFP-C as an efficacious and cost-effective intervention, with high treatment compliance rates, and lays the groundwork for a randomized controlled trial of the intervention.

HIGHLIGHTS

  • Oppositional defiant disorder is the leading reason for referral to youth mental health services.

  • Cost-effective treatments that foster treatment completion and address the implicit emotion regulation deficits of the disorder are needed.

  • Regulation-focused psychotherapy for children (RFP-C) is a manualized, psychodynamic treatment for children that reduces symptoms of oppositional defiant disorder and activates more adaptive forms of implicit emotion regulation.

  • This pilot study provides preliminary support for the efficacy of RFP-C and lays the groundwork for a larger-scale randomized controlled trial of the intervention.

Externalizing behaviors are common in a wide range of child mental health problems. Oppositional defiant disorder is the leading reason for referral to youth mental health services, with a lifetime prevalence of 10.2% (1). The DSM-5 (2) describes the disorder as a recurrent pattern of developmentally inappropriate levels of negativistic, defiant, disobedient, and hostile behavior toward authority figures. Children with disruptive behavior disorders, such as oppositional defiant disorder, are more likely to have impaired academic progress, early substance use problems, and higher rates of adult incarceration (3, 4). A significant proportion of children with acute externalizing behaviors have poor longitudinal outcomes in terms of psychopathology and functional ability (1). The disorder also is a strong predictor of generalized anxiety disorder, panic, and depression in adulthood (5). Although a diagnosis of oppositional defiant disorder increases a child’s risk for poorer outcomes across the lifespan, the disorder is highly variable in its presentation and developmental trajectory.

Current Treatment Approaches

Psychosocial treatments are the preferred first-line treatment for disruptive behavior problems (6). Current evidence-based approaches for elementary school–age children with oppositional defiant disorder include behavioral parent training (79), family skills training approaches (10, 11), and the collaborative and proactive solutions intervention (12). There are two components to all behavioral parent training approaches: working to improve the parent-child relationship and providing parents with more effective behavior management strategies, such as positive attending, contingent attention, reinforcement, and the use of time-out procedures (13). These interventions help parents define and monitor their child’s behavior, improve their parenting practices, and apply consistent and effective discipline to encourage prosocial behaviors. Family skills training builds on traditional behavioral interventions by offering children and parents their own skills groups and providing structured opportunities for the family to practice together (11). Collaborative and proactive solutions is a cognitive-behavioral model that emphasizes helping adults and children to develop skills to collaboratively resolve issues of disagreement (14).

The aforementioned treatment approaches have demonstrated efficacy with modest effect sizes across multiple studies. However, child psychotherapy interventions are limited by the elevated attrition rates among vulnerable populations, because of factors such as low socioeconomic status, ethnic minority status, parental functioning, maternal stress, low parental motivation, and child symptom severity (1518). Poor treatment compliance and outcome also are attributable to the fact that parent-focused models of treatment contradict parents’ beliefs that the cause of the problem resides within the child (1921). Effectiveness of these programs is dependent on parental engagement in the treatment (22), and because of the considerable time commitment required by such programs, participation may not be feasible for parents facing high levels of stress (16). Nearly one-third of treated children do not benefit from traditional behavioral interventions (17, 18), and positive effects have been shown to decline posttreatment among disadvantaged families (23). Finally, parent training modalities are relatively expensive psychotherapy interventions that, as a result, are not always widely available in community care settings (24).

It has also been argued that none of the cognitive and behavioral interventions described above adequately address implicit emotion regulation (2527). Previous research has demonstrated the importance of addressing the affective and emotion regulation components of oppositional defiant disorder (2831). In contrast to the DSM-5 criteria for the disorder, which focus on a set of behaviors, it appears that oppositional defiant disorder is best conceptualized as a disorder of emotion regulation rather than simply a disorder of behavioral dysregulation (26, 29, 30, 32). Negative emotionality, coupled with deficits in self-regulation, have been identified as primary precursors to behavioral difficulties such as those evident in oppositional defiant disorder (33). Given these findings, there is a need for treatments that are cost-effective, encourage treatment compliance, and address the core implicit emotion regulation deficits that are evident in the disorder.

Regulation-Focused Psychotherapy for Children (RFP-C)

Regulation-focused psychotherapy for children (RFP-C) (34) is a manualized, time-limited, psychodynamic treatment for children with externalizing behaviors that aims to activate more adaptive forms of implicit emotion regulation. The RFP-C treatment approach, along with many clinical examples, are described in the manual and several associated publications (25, 26, 3437). The intervention consists of 16 individual play therapy sessions with the child and four parent meetings, delivered over the course of 10 weeks. RFP-C conceptualizes disruptive symptoms as maladaptive attempts to regulate emotions. When certain emotions are too difficult for children to consciously experience or verbalize, they involuntarily rely on aggressive, disruptive behaviors to hide from these painful emotions and remove them from their awareness (26, 35). In essence, for these children, it is easier to get mad (e.g., act out) than it is to feel sadness, guilt, loss, or shame. Disruptive behaviors divert both the child’s and the caregivers’ attention away from the underlying and painful affect. These psychological processes are similar to impaired implicit emotion regulation capacities (26, 38). The term emotion regulation suggests internal adjustments and compromises that are made in the service of emotional homeostasis; this concept contrasts with behavioral approaches that emphasize emotional restraint (27).

Although there is a long history of psychodynamic psychotherapy being used in the treatment of disruptive behavior problems (34, 35, 3942), RFP-C is the first attempt to systematize the process of addressing children’s defense mechanisms against unpleasant emotions. Throughout the course of the play therapy sessions, the clinician notices and gently identifies the child’s defensive behaviors and verbalizations when they occur. This iterative and gradual exposure to avoided, and largely unconscious, feelings improves the child’s implicit emotion regulation abilities (25, 35, 43), thereby enabling the child to function better in his or her environment. RFP-C also includes parent meetings that encourage caregivers to develop an understanding of the meaning of the child’s behavior.

The purpose of this study was to evaluate changes in oppositional and defiant symptoms and emotion regulation among children participating in RFP-C. Three cases were selected for inclusion to obtain initial data in preparation for a larger randomized controlled trial, now underway. We hypothesized that participants’ symptoms of oppositional defiant disorder would decrease, and emotion regulation would increase, after treatment and at the three- and six-month follow-ups.

Methods

Participants

Three children and their caregivers participated in this pilot study. Nine parents took part in the initial phone screening, and six were invited for an in-person intake interview along with their children. Participants who were excluded at each stage of screening received referrals for treatment elsewhere. All participants were assessed for parental and child trauma history as part of the intake process. While there were no reports of acute traumatic events (e.g., natural disasters or abuse) and none of the participants met diagnostic criteria for posttraumatic stress disorder, all families reported one or more stressful life events (e.g., divorce, death of grandparents, financial stressors). In accordance with the RFP-C model, which emphasizes attending to painful affect, stressors reported for each child and family were taken into account by the treating clinician. A summary of demographic and other characteristics of participants can be seen in Table 1.

Table 1. Participant characteristics, pilot study of regulation-focused psychotherapy for children (RFP-C) with oppositional defiant disorder (ODD)

Participant characteristicChild 1Child 2Child 3
Age (years)958
Race-ethnicityBlack/non-white HispanicBlackWhite
MedicationNoNoNo
DiagnosisaODD, dysthymiaODDODD, enuresis
Estimated FSIQb839591
Prior therapyYesNoYes
School typePublicPublicPublic
Family income0–19,99920,000–39,999120,000–139,999
Caregiver 1 educationCollegeSome collegeGraduate degree
Caregiver 2 educationN/AGEDGED

aDiagnosis of ODD, as assessed via the Kiddie-Schedule for Affective Disorders and Schizophrenia-Present/Lifetime and the Child Behavior Checklist.

bFSIQ=Full-scale intelligence quotient (IQ); average IQ score in the population is 100, with a standard deviation of 15.

Table 1. Participant characteristics, pilot study of regulation-focused psychotherapy for children (RFP-C) with oppositional defiant disorder (ODD)

Enlarge table

Procedures

The study protocol was reviewed and approved by the Albert Einstein College of Medicine Institutional Review Board. Parents and/or caregivers responded to postings in the community and online by calling the intake coordinator. Those who met the phone screening criteria (N=6) attended an in-person intake where caregivers provided informed consent and children provided assent for participation. Three families, who completed the full intake process and met inclusion criteria, were enrolled.

Inclusion criteria for the children were ages 5–12 years, met DSM-5 criteria for oppositional defiant disorder, fluent in English, and able to attend treatment twice a week for 10 weeks. Children with comorbid disorders were included. Exclusion criteria were the presence of psychosis or suicidal or homicidal risk, current enrollment in another therapy program, anticipation of major medication changes during the trial, and intellectual disability. The RFP-C treatment manual (34) was used by the study therapists (3rd- and 4th-year students in a psychology doctoral program) to deliver the intervention. All therapy sessions were video recorded, and the recordings were reviewed in weekly supervision meetings.

Measures

At intake, parents completed the Kiddie-Schedule for Affective Disorders and Schizophrenia–Present/Lifetime (K-SADS-PL) (44), a psychiatric diagnostic interview for school-age children. Clinical presentation was confirmed with subscales of the Child Behavior Checklist (CBCL) (45), which was completed by parents before and after treatment. Children’s intellectual functioning was assessed at intake with the Wechsler Abbreviated Scale of Intelligence (two-subtest form), and parents’ English fluency was assessed with the Word Reading subtest of the Wechsler Individual Achievement Test–III.

Symptoms were assessed with the Oppositional Defiant Disorder Rating Scale (ODD-RS) (46). Respondents rate the eight symptoms of the disorder using a 4-point response scale ranging from 0 (not at all) to 3 (very much). The ODD-RS has good internal consistency (α=0.92) and moderate interrater reliability between caregivers (r=0.70). Parents completed the ODD-RS at intake, weekly throughout the treatment, at the conclusion of treatment, and at follow-ups.

Emotion regulation capacities were assessed with the Emotion Regulation Checklist (ERC) (47), a 24-item parent report questionnaire that assesses children’s emotion regulation capacities. Reliability coefficients are high for the overall scale (0.89) and for the two subscales (lability/negativity=0.96, regulation=0.83).

A research assistant, who was not one of the staff providing the intervention, interviewed parents after the treatment concluded. Interview prompts were adapted from those described in an earlier study of children’s expectations and experiences of psychodynamic psychotherapy (48).

Data Analysis

Power analysis.

A power analysis was conducted targeting change in scores on the ODD-RS as the focal outcome measure. For this study, the average effect size for symptom change from a recent meta-analysis of externalizing disorders was used (d=0.879) (49). An estimated mean for children with a diagnosis of oppositional defiant disorder on the ODD-RS was 14.94 (SD=5.30), compared with children without a diagnosis, whose mean was 7.83 (SD=4.97) (46). Using an effect size of d=0.879, we expected a mean reduction of 4.5 points on the ODD-RS after treatment.

Cutoff scores for inclusion.

A cutoff score of 8 on the ODD-RS was chosen, corresponding to standard norms (44) and endorsement of four or more of the symptoms on the scale being characteristic of the child’s current behavior. This criterion is consistent with DSM-5 criteria for a diagnosis of oppositional defiant disorder.

Reliable change index (RCI).

Clinically significant and reliable change was assessed by creating classifications of “recovered, “improved,” “unchanged,” or “deteriorated” based on the cutoff score and an index of measurement error, the reliable change index (RCI) (50).The RCI determines, for each case, whether posttreatment change was significant, over and above measurement error. The RCI is the difference between the posttreatment and pretreatment scores divided by the standard error of their difference. RCI scores of 1.96 or greater indicate that there is a statistically and clinically significant reliable change from pre- to posttreatment. Given the small sample size of this study, we used the weighted average of the standard deviations reported for groups with and without a diagnosis to calculate the standard error (44).

Results

Treatment Compliance

All three families in this study completed treatment and maintained attendance throughout the treatment protocol. Specifically, of 60 possible sessions (16 child sessions plus four parent meetings across three cases), only one child session was missed.

Outcomes

After 10 weeks of treatment with RFP-C, all three children showed improvements in accordance with expectations and the a priori power analysis. An overview of the RFP-C protocol is available in the online supplement. Detailed data for change in ODD-RS scores and emotion regulation (ERC) can be seen in Tables 2 and 3, respectively. Figure 1 presents changes in ODD-RS scores for each participant throughout RFP-C treatment and at the three- and six-month follow-ups. One participant was lost to follow-up at the six-month time point. Improvements in oppositional and defiant symptoms appear to have been maintained at follow-up for the sample overall (see Table 4).

Table 2. Change in ODD-RS scores for three children receiving 10 weeks of RFP-Ca

ChildIntakeCompletedDifferenceE ΔbCohen’s dcRCIcClassification
184–4–.5.79–1.97Recovered
21914–5.5.98–2.46Improved
3139–4–.5.79–1.97Improved
Mean13.339–4.33–.17.85

aODD-RS, Oppositional Defiant Disorder Rating Scale. Scores range from 0 to 24, with higher scores indicating greater symptom severity. RFP-C, regulation-focused psychotherapy for children.

bValues indicate how far the difference score for each case is (positive or negative) from the expected difference of 4.5 points.

cComputed with the same weighted SD as was used for the computation of the reliable change index (RCI) described above. This value of d was consistent with the expected effect size of d=.879 (4.5 expected difference) used for the power analysis.

Table 2. Change in ODD-RS scores for three children receiving 10 weeks of RFP-Ca

Enlarge table

Table 3. Change in emotion regulation of three children receiving 10 weeks of RFP-Ca

ChildScaleIntakeCompletedDifferenceCohen’s dRCI
1Emotion Regulation19212.422.00
1Lability and Negativity31310.000
2Emotion Regulation21243.643.00
2Lability and Negativity3330–3.64–7.32
3Emotion Regulation263151.065.00
3Lability and Negativity3426–81.70–19.51

aAs measured with the Emotion Regulation Checklist. Subscale scores range from 8 to 32, with higher scores indicating greater emotion regulation. Lability and Negativity subscale scores range from 15 to 60, with higher scores indicating greater dysregulation. RFP-C, regulation-focused psychotherapy for children; RCI, reliable change index.

Table 3. Change in emotion regulation of three children receiving 10 weeks of RFP-Ca

Enlarge table
FIGURE 1.

FIGURE 1. Oppositional Defiant Disorder Rating Scale (ODD-RS) scores over the course of treatment for the three childrena

aEach point represents an ODD-RS score. The center line for each child shows the trend over the course of the treatment. Possible scores range from 0 to 24, with higher scores indicating greater symptom severity.

Table 4. ODD-RS scores at intake and follow-up for three children in a 10-week pilot study of RFP-Ca

Time pointNMeanSDRange
Intake313.335.518–19
End of treatment39.005.004–14
3-month follow-up35.335.131–11
6-month follow-up26.002.834–8

aODD-RS, Oppositional Defiant Disorder Rating Scale. Scores range from 0 to 24, with higher scores indicating greater symptom severity. RFP-C, regulation-focused psychotherapy for children.

Table 4. ODD-RS scores at intake and follow-up for three children in a 10-week pilot study of RFP-Ca

Enlarge table

Parents’ Experiences of RFP-C

The responses parents gave in end-of-treatment interviews were uniformly positive about the experience of participating in RFP-C. To protect their identities, we have used all male pronouns to refer to the child participants. Parents described a sense of relief at receiving help for their children and being empowered to understand their children’s oppositional behavior. One parent stated, “I think therapy was very helpful. I wish therapy could have been a little longer . . . It helped him so much. He looked at things differently. The time from February until now, he is a different kid.” Another parent explained changes after RFP-C this way, “I can tell you the tantrums are not long and drawn out like they were. They are less frequent. He stopped wetting the bed. That is huge. I didn’t expect to see change so quickly. I’m seeing the changes already. And I’m sorry I didn’t start it sooner. I wish I would have.” The only negative feedback was a repeated comment that parents wished the therapy had lasted longer than 20 sessions.

Discussion

This study is the first empirical examination of RFP-C treatment response among children with oppositional defiant disorder. Our hypothesis that children would experience a decrease in symptoms after treatment was supported. One child began with relatively fewer symptoms and experienced enough improvement to be classified as recovered. The two other children, with higher levels of oppositional and defiant behavior at the start of treatment, experienced greater improvement and were classified as improved at the end of treatment. Two of the three participants were in the recovered range at the three-month follow up.

There was also support for the hypothesis that RFP-C would be associated with improvements in the children’s abilities to manage difficult emotions. All three children demonstrated clinically significant improvements in emotion regulation. Two demonstrated significant decreases in lability and/or negativity, and one demonstrated no change in lability or negativity. Finally, parents reported a positive experience in the exit interviews, suggesting the possible utility of RFP-C among families who have traditionally had difficulty in traditional behavioral treatment. This pilot study provides preliminary support for further investigation of RFP-C. A larger-scale randomized controlled trial is now under way.

Dropout rates from psychotherapy interventions appear to have improved during the last 20 years as more tailored approaches have emerged; however, premature termination from child psychotherapy persists, with about 1 of every 3.5 clients dropping out of cognitive-behavioral treatments (51) and even higher attrition rates among those with disruptive behavior problems (52). It is notable that all the families in this study completed treatment and maintained attendance throughout the treatment protocol. Additionally, the intervention was cost-effective to administer ($3,333 per clinician) compared with behavioral parent training interventions ($73,000 per trained clinician) (24). We anticipate that the average cost to deliver RFP-C can be reduced to approximately $2,500 per clinician for future studies.

This was an initial pilot study to evaluate the effectiveness of a manualized, psychodynamic intervention for children with oppositional defiant disorder. Our sample size was small, and there was no control group. A randomized controlled trial of RFP-C with a substantially larger sample size is currently under way and will add to our understanding of this treatment approach. Additionally, this study relied on parental reports of the child's symptoms; however, parents appear to be valid reporters of children’s externalizing behaviors and social functioning (53). Future research should incorporate teacher and clinician reports of behavior. As with any pilot data, the sample size constrained our ability to evaluate for treatment moderator effects. Variables such as income and education, degree of callous-unemotional traits, and the role of adverse childhood experiences will be evaluated in future studies with sufficient sample sizes.

Conclusions

The high prevalence of oppositional defiant disorder and other disruptive behavior problems and the difficulties these disorders cause for children and their families suggest the importance of treatment protocols that can provide relief in a cost-effective manner. Given that oppositional defiant disorder presents an inordinate burden on health care expenditures (on par with asthma, epilepsy, or diabetes) (54) and the high rates of attrition in currently available psychotherapy approaches, there is a great need for innovative methods that can be delivered by professionals with a range of clinical experience and across a variety of settings. This pilot study provides initial support for RFP-C as a clinical intervention for children with oppositional defiant disorder. Findings suggest that RFP-C is associated with significant lessening of symptoms and improvements in emotion regulation capacities. Additionally, RFP-C can be delivered as a cost-effective, brief, psychotherapy intervention that appears to help families to maintain attendance and complete the treatment.

In classrooms and families, children are often identified because of oppositional behavior that creates problems for those around them. The profound difficulties these children have managing the unpleasant emotions that they experience as intolerable are less readily apparent. Although the presenting problem is the disruption or aggression the child displays, contemporary, neuroscience-informed models suggest that these symptoms are signals of underlying impairments in emotion regulation. RFP-C works to remove roadblocks to managing difficult and unpleasant emotions, especially in children who have profound deficits in this area.

Explicit emotion regulation strategies, such as effortful distraction and cognitive reappraisal, are the primary targets of cognitive-behavioral interventions. In contrast, implicit regulatory strategies (much like defense mechanisms) are automatic, and thus outside of the child’s awareness. Yet, these strategies negatively affect children’s ability to cope with negative feelings and life stressors. In fact, a child’s capacity for implicit emotion regulation may be more important for a child’s emotional functioning than explicit skills to manage disruptive behavior (26, 35, 55). The procedures in RFP-C are designed specifically to engage children and families who have not done well in treatments emphasizing explicit skills. The clinician’s focus on the child’s in-session behaviors (e.g., remaining experience-near) and gradually increasing awareness of the meaning and the implicit purpose of disruptive behavior (e.g., protecting the child from painful affect), allows children to build implicit emotion regulation abilities in a safe, therapeutic environment. Parent meetings in RFP-C also empower parents to adjust their expectations and understanding of the child so that the home environment can better support these children as they begin to modify the quality, intensity, and duration of their emotional response. Close attention to children’s difficulties with shame, guilt, sadness, and loss—as is the norm in RFP-C—may help facilitate greater and more lasting recovery from oppositional defiant disorder and other externalizing disorders.

Ferkauf Graduate School of Psychology, Yeshiva University, Bronx, New York (Prout, Aizin, Ramchandani, Racine, Gorokhovsky); Mount Sinai St. Luke’s, New York (Rice); Pacella Research Center–New York Psychoanalytic Society and Institute, New York (Murphy, Hoffman); The Rebecca School, New York (Gaines); New Alternatives for Children, New York (Sessler).
Send correspondence to Dr. Prout ().

The authors report no financial relationships with commercial interests.

This research was funded by the Pacella Research Center of the New York Psychoanalytic Society and Institute.

References

1 Nock MK, Kazdin AE, Hiripi E, et al.: Lifetime prevalence, correlates, and persistence of oppositional defiant disorder: results from the National Comorbidity Survey Replication. J Child Psychol Psychiatry 2007; 48:703–713Crossref, MedlineGoogle Scholar

2 Diagnostic and Statistical Manual of Mental Disorders, 5th ed. Arlington, VA, American Psychiatric Publishing, 2013Google Scholar

3 Foster EM, Jones DE: The high costs of aggression: public expenditures resulting from conduct disorder. Am J Public Health 2005; 95:1767–1772Crossref, MedlineGoogle Scholar

4 Robins LN, Price RK: Adult disorders predicted by childhood conduct problems: results from the NIMH Epidemiologic Catchment Area project. Psychiatry 1991; 54:116–132Crossref, MedlineGoogle Scholar

5 Copeland WE, Shanahan L, Costello EJ, et al.: Childhood and adolescent psychiatric disorders as predictors of young adult disorders. Arch Gen Psychiatry 2009; 66:764–772Crossref, MedlineGoogle Scholar

6 Comer JS, Chow C, Chan PT, et al.: Psychosocial treatment efficacy for disruptive behavior problems in very young children: a meta-analytic examination. J Am Acad Child Adolesc Psychiatry 2013; 52:26–36Crossref, MedlineGoogle Scholar

7 Forgatch MS, Patterson GR. Parent Management Training—Oregon Model: an intervention for antisocial behavior in children and adolescents; in Evidence-Based Psychotherapies for Children and Adolescents. Edited by Weisz JR, Kazdin AE. New York, Guilford Press, 2010Google Scholar

8 Kaminski JW, Claussen AH: Evidence base update for psychosocial treatments for disruptive behaviors in children. J Clin Child Adolesc Psychol 2017; 46:477–499Crossref, MedlineGoogle Scholar

9 Kazdin AE: Parent Management Training: Treatment for Oppositional, Aggressive, and Antisocial Behavior in Children and Adolescents. New York, Oxford University Press, 2008CrossrefGoogle Scholar

10 Kumpfer KL, Alvarado R: Family-strengthening approaches for the prevention of youth problem behaviors. Am Psychol 2003; 58:457–465Crossref, MedlineGoogle Scholar

11 Nixon RDV, Sweeney L, Erickson DB, et al.: Parent-child interaction therapy: a comparison of standard and abbreviated treatments for oppositional defiant preschoolers. J Consult Clin Psychol 2003; 71:251–260Crossref, MedlineGoogle Scholar

12 Ollendick TH, Greene RW, Austin KE, et al.: Parent management training and collaborative and proactive solutions: a randomized control trial for oppositional youth. J Clin Child Adolesc Psychol 2016; 45:591–604Crossref, MedlineGoogle Scholar

13 McMahon RJ, Wells K: Conduct problems, in Treatment of Child Disorders, 2nd ed. Edited by Mash E, Barkley R. New York, Guilford Press, 2006Google Scholar

14 Greene RW, Ablon JS, Goring JC, et al.: Effectiveness of collaborative problem solving in affectively dysregulated children with oppositional-defiant disorder: initial findings. J Consult Clin Psychol 2004; 72:1157–1164Crossref, MedlineGoogle Scholar

15 Kazdin AE: Premature termination from treatment among children referred for antisocial behavior. J Child Psychol Psychiatry 1990; 31:415–425Crossref, MedlineGoogle Scholar

16 Kazdin AE, Mazurick JL: Dropping out of child psychotherapy: distinguishing early and late dropouts over the course of treatment. J Consult Clin Psychol 1994; 62:1069–1074Crossref, MedlineGoogle Scholar

17 Masi G, Manfredi A, Milone A, et al.: Predictors of nonresponse to psychosocial treatment in children and adolescents with disruptive behavior disorders. J Child Adolesc Psychopharmacol 2011; 21:51–55Crossref, MedlineGoogle Scholar

18 Masi G, Muratori P, Manfredi A, et al.: Response to treatments in youth with disruptive behavior disorders. Compr Psychiatry 2013; 54:1009–1015Crossref, MedlineGoogle Scholar

19 Baden AD, Howe GW: Mothers’ attributions and expectancies regarding their conduct-disordered children. J Abnorm Child Psychol 1992; 20:467–485Crossref, MedlineGoogle Scholar

20 Bickett LR, Milich R, Brown RT: Attributional styles of aggressive boys and their mothers. J Abnorm Child Psychol 1996; 24:457–472Crossref, MedlineGoogle Scholar

21 Peters S, Calam R, Harrington R: Maternal attributions and expressed emotion as predictors of attendance at parent management training. J Child Psychol Psychiatry 2005; 46:436–448Crossref, MedlineGoogle Scholar

22 Reid MJ, Webster-Stratton C, Baydar N: Halting the development of conduct problems in Head Start children: the effects of parent training. J Clin Child Adolesc Psychol 2004; 33:279–291Crossref, MedlineGoogle Scholar

23 Leijten P, Raaijmakers MAJ, de Castro BO, et al.: Does socioeconomic status matter? A meta-analysis on parent training effectiveness for disruptive child behavior. J Clin Child Adolesc Psychol 2013; 42:384–392Crossref, MedlineGoogle Scholar

24 Blueprints for Healthy Youth Development. https://www.blueprintsprograms.org/program-costs/generationpmto. Accessed July 31, 2018.Google Scholar

25 Prout TA, Gaines E, Gerber LE, et al.: The development of an evidence-based treatment: Regulation-Focused Psychotherapy for Children with externalising behaviours (RFP-C). J Child Psychother 2015; 41:255–271CrossrefGoogle Scholar

26 Rice TR, Hoffman L: Defense mechanisms and implicit emotion regulation: a comparison of a psychodynamic construct with one from contemporary neuroscience. J Am Psychoanal Assoc 2014; 62:693–708Crossref, MedlineGoogle Scholar

27 Southam-Gerow MA, Kendall PC: Emotion regulation and understanding: implications for child psychopathology and therapy. Clin Psychol Rev 2002; 22:189–222Crossref, MedlineGoogle Scholar

28 Burke JD, Hipwell AE, Loeber R: Dimensions of oppositional defiant disorder as predictors of depression and conduct disorder in preadolescent girls. J Am Acad Child Adolesc Psychiatry 2010; 49:484–492Crossref, MedlineGoogle Scholar

29 Cavanagh M, Quinn D, Duncan D, et al.: Oppositional defiant disorder is better conceptualized as a disorder of emotional regulation. J Atten Disord 2017; 21:381–389Crossref, MedlineGoogle Scholar

30 Drabick DAG, Gadow KD: Deconstructing oppositional defiant disorder: clinic-based evidence for an anger/irritability phenotype. J Am Acad Child Adolesc Psychiatry 2012; 51:384–393Crossref, MedlineGoogle Scholar

31 Eisenberg N, Cumberland A, Spinrad TL, et al.: The relations of regulation and emotionality to children’s externalizing and internalizing problem behavior. Child Dev 2001; 72:1112–1134Crossref, MedlineGoogle Scholar

32 Gadow KD, Drabick DAG: Anger and irritability symptoms among youth with ODD: cross-informant versus source-exclusive syndromes. J Abnorm Child Psychol 2012; 40:1073–1085Crossref, MedlineGoogle Scholar

33 DeLisi M, Vaughn MG: Foundation for a temperament-based theory of antisocial behavior and criminal justice system involvement. J Crim Justice 2014; 42:10–25CrossrefGoogle Scholar

34 Hoffman L, Rice TR, Prout TA: Manual of Regulation-Focused Psychotherapy for Children (RFP-C) With Externalizing Behaviors: A Psychodynamic Approach. New York, Routledge, 2016Google Scholar

35 Hoffman L: Mentalization, emotion regulation, countertransference. J Infant Child Adolesc Psychother 2015; 14:258–271CrossrefGoogle Scholar

36 Hoffman L: Berta Bornstein’s “Frankie”: the contemporary relevance of a classic to the treatment of children with disruptive symptoms. Psychoanal Study Child 2014; 68:152–176Crossref, MedlineGoogle Scholar

37 Prout TA, Chacko A, Spigelman A, et al.: Bridging the divide between psychodynamic and behavioral approaches for children with oppositional defiant disorder. J Infant Child Adolesc Psychother 2018; 17:364–377CrossrefGoogle Scholar

38 Rice TR: Commentary: executive functioning—a key construct for understanding developmental psychopathology or a ‘catch-all’ term in need of some rethinking? Front Neurosci 2017; 11:130Crossref, MedlineGoogle Scholar

39 Eresund P: Psychodynamic psychotherapy for children with disruptive disorders. J Child Psychother 2007; 33:161–180CrossrefGoogle Scholar

40 Target M, Fonagy P: Efficacy of psychoanalysis for children with emotional disorders. J Am Acad Child Adolesc Psychiatry 1994; 33:361–371Crossref, MedlineGoogle Scholar

41 Kernberg PF, Chazan SE: Children With Conduct Disorders: A Psychotherapy Manual. New York, NY, Basic Books, 1991Google Scholar

42 Laezer KL: Effectiveness of psychoanalytic psychotherapy and behavioral therapy treatment in children with attention deficit hyperactivity disorder and oppositional defiant disorder. J Infant Child Adolesc Psychother 2015; 14:111–128CrossrefGoogle Scholar

43 Hoffman L. Do children get better when we interpret their defenses against painful feelings? Psychoanal Study Child 2007;62:291–313MedlineGoogle Scholar

44 Kaufman J, Birmaher B, Brent D, et al.: Kiddie-SADS—Present and Lifetime Version (K-SADS-PL). Pittsburgh, University of Pittsburgh School of Medicine, 1996Google Scholar

45 Achenbach TM, Rescorla L. Manual for the ASEBA School-Age Forms and Profiles. Burlington, VT, University of Vermont, Research Center for Children, Youth, & Families, 2001.Google Scholar

46 O’Laughlin EM, Hackenberg JL, Riccardi MM: Clinical usefulness of the oppositional defiant disorder rating scale (ODDRS). J Emot Behav Disord 2010; 18:247–255CrossrefGoogle Scholar

47 Shields A, Cicchetti D: Emotion regulation among school-age children: the development and validation of a new criterion Q-sort scale. Dev Psychol 1997; 33:906–916Crossref, MedlineGoogle Scholar

48 Carlberg G, Thorén A, Billström S, et al.: Children’s expectations and experiences of psychodynamic child psychotherapy. J Child Psychother 2009; 35:175–193CrossrefGoogle Scholar

49 Battagliese G, Caccetta M, Luppino OI, et al.: Cognitive-behavioral therapy for externalizing disorders: a meta-analysis of treatment effectiveness. Behav Res Ther 2015; 75:60–71Crossref, MedlineGoogle Scholar

50 Jacobson NS, Truax P: Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991; 59:12–19Crossref, MedlineGoogle Scholar

51 Fernandez E, Salem D, Swift JK, et al.: Meta-analysis of dropout from cognitive behavioral therapy: magnitude, timing, and moderators. J Consult Clin Psychol 2015; 83:1108–1122Crossref, MedlineGoogle Scholar

52 Luk ESL, Staiger PK, Mathai J, et al.: Children with persistent conduct problems who dropout of treatment. Eur Child Adolesc Psychiatry 2001; 10:28–36Crossref, MedlineGoogle Scholar

53 Konold TR, Walthall JC, Pianta RC: The behavior of child behavior ratings: measurement structure of the Child Behavior Checklist across time, informants, and child gender. Behav Disord 2004; 29:372–383CrossrefGoogle Scholar

54 Guevara JP, Mandell DS, Rostain AL, et al.: National estimates of health services expenditures for children with behavioral disorders: an analysis of the Medical Expenditure Panel Survey. Pediatrics 2003; 112:e440–e446Crossref, MedlineGoogle Scholar

55 Rice T, Prout T, Hoffman L. Implicit emotion regulation: linking childhood oppositional defiant disorder with adult depression and bipolar disorder? Int J Adolesc Med Health 2017; 29:1–2. doi: 10.1515/ijamh-2015-0075MedlineGoogle Scholar