The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Original ArticlesFull Access

The Relationship between Depression Severity and Cognitive Errors

Abstract

Cognitive errors (CEs) are evidenced to be related to depressive thinking in major depressive disorder (Beck Et Al., 1979; Dozois & Beck, 2008). Studies using self-report questionnaires demonstrate that CEs are more prevalent in individuals with depression than in non-depressed individuals (Gupta & Kar, 2008) and that CEs are related to depression severity (Miranda & Mennin, 2007). The study discussed in this paper aimed to describe CEs in depressed patients and examined the relationship between CEs and severity of depression. Participants (N = 45) undergoing cognitive therapy were assessed for CEs and for depression at session three using the Cognitive Errors Rating System (CERS; Drapeau et al., 2008) and the Beck Depression Inventory (BDI; Beck et al., 1979). Participants had more negative CEs than positive, and the most prevalent cluster of CEs was selective abstraction. Participants deemed as being “high distorters” on the CERS had significantly more negative CEs, but not positive CEs, than “low distorters” despite not differing on BDI scores. Psychotherapy research and practice implications are discussed.

Introduction: The Relationship Between Depression Severity and Cognitive Errors

Cognitive errors (CEs) are a key construct in cognitive therapy (CT), especially when assessing, researching, or treating patients suffering from depression. Early on, Beck (1976) outlined specific cognitive errors, including arbitrary inference, selective abstraction, overgeneralization, magnification (catastrophizing) and minimization, personalizing, and absolutistic dichotomous thinking. Burns (1999) defined and outlined the importance of other cognitive errors such as mind-reading, fortune telling, mental filter, all-or-nothing thinking, should statements, discounting the positive, emotional reasoning, and labeling and mislabeling. More recently, Yurica and DiTomasso (2005) conducted a review and identified 17 cognitive distortions common in the literature, including arbitrary inference/jumping to conclusions, catastrophizing, comparison, dichotomous/black-and-white thinking, disqualifying the positive, emotional reasoning, externalizing self-worth, fortune-telling, labeling, magnification, mind reading, minimization, overgeneralization, perfectionism, personalization, selective abstraction, and “should” statements. Despite the availability of definitions for these individual CEs, and suggestions that individual CEs are important to understand depression, studies examining cognitive errors in depression reported findings in terms of a general level of distortion, rather than for specific CEs (e.g., Briere, 2000; Hamblin, Beutler, Scogin, & Corbishley, 1993; Monroe, Slavich, Torres, & Gotlib, 2007; Tang, DeRubeis, Beberman, & Pham, 2005).

Exceptions to this include a study by Wenzlaff and Grozier (1988). They examined the use of overgeneralizations in dysphoric and nondysphoric participants who received false negative feedback after a social perceptiveness test. While both groups lowered their self-evaluations of social perceptiveness after receiving the feedback, only the participants with dysphoria lowered their ratings in proficiency judgments. More recently Van den Heuvel, Derksen, Eling, and van der Staak (2012) explored how overgeneralization relates to different mood disorders. The researchers examined tendencies of patients to make overgeneralizations targeted at the self and across situations. Participants diagnosed with major depression and those diagnosed with bipolar disorder were found to exhibit high levels of overgeneralization towards the self. However, only patients with bipolar disorder demonstrated elevated levels of overgeneralizations across situations. This study is of particular importance because it demonstrates subtle differences among patients regarding a specific CE, and it highlights the need to explore specific types of cognitive errors.

Wenzlaff’s and Grozier’s (1988) study was particularly important in that it examined the CE, magnification/minimization, which is the tendency to evaluate oneself, others, or a situation in a way that magnifies or minimizes the negative or positive aspects (Drapeau et al., 2008). Consistent with Beck’s theory of depression, dysphoric participants rated social perceptiveness to be more important when they were given failure feedback on the task. Participants who were not dysphoric rated the task as more important when they received successful feedback on the task. This finding is consistent with Ellis’ theory (1980) that individuals who are depressed tend to “awfulize” or magnify the unpleasantness of situations. However, Wenzlaff’s and Grozier’s finding does not necessarily illustrate that participants with dysphoria committed an “error” that was disproportionate to the demands of the situation; it demonstrated that they responded differently to the feedback than did nondepressed controls. Additionally, the participants with dysphoria in Wenzlaff and Grozier’s study did not minimize the importance of their success on social perceptiveness (relative to controls) as Beck’s theory postulates they would. The results, however, do suggest that dysphoric individuals (relative to controls) may be differentially influenced by negatively and positively valenced events. Exploring CE types and valence may have important implications.

Another CE empirically investigated is fortune telling, which involves “making the assumption that the worst or best possible outcome will occur in a situation” (Drapeau et al., 2008, p. 18). Fortune telling has been found to relate to identifiable psychotherapy processes and to specific psychological disorders, including depression and anxiety (Miranda, Fontes, & Marroquin, 2008). Miranda and Mennin (2007) assessed fortune telling in a group of participants with depression by presenting participants with a future events task. This task assessed the certainty in which participants believed that positive and negative events would occur. There was a positive correlation between greater severity of depression and the likelihood of negative events occurring. In addition, the more severe the depression, the more certain were the participants that positive future events would not occur. Few studies assessed several individual CEs, and often, within studies on individual cognitive errors, the focus was directed to distortion as a whole (Curry et al., 2006; Tang, DeRubeis, Beberman, & Pham, 2005; Burns, Shaw, & Croker, 1987,) or was specific to very few CEs within the typology of the scale used (Flett, Goldstein, Hewitt, and Wekerle, 2012; Jager-Hyman et al., 2014; Leung & Poon, 2001).

There arguably remains a paucity of research about the nature of specific cognitive errors in depression, despite the claimed importance of cognitive errors in theory and practice. This may be understandable, in part, because measuring cognitive errors has always been a challenge. For example, Hammen and Krantz (1976) designed a self-report questionnaire to measure specific CEs using case vignettes. When developing the scale items, independent raters could not agree on the type of CE represented; therefore, items were categorized as being distorted or not distorted. Lefebvre (1981) also attempted to assess CEs using a self-report measure of seven different CEs, but because of difficulties with reliability, these seven were condensed down to the four errors of catastrophizing, overgeneralizing, personalization, and selective abstraction. It was no surprise that most researchers have relied on experimental design in a laboratory setting, or have used self-report questionnaires. The former is certainly important and can offer invaluable information, but remain costly to implement and the ecological validity of the findings provided may be questionable. Despite utility of the self-report questionnaire, the latter is not without limitation. For example, a person’s mood can influence how he/she responds to items on a questionnaire (Moussavi, et al., 2007), especially in the case of depression where a negative reporting bias is likely (Owsley, & McGwin, 2004; Shean, & Baldwin, 2010). Further, participants may think in ways not captured in the format in which the questionnaire was written, and participants may not be able to report accurately on the frequency of their thoughts. Difficulty concentrating, which is a symptom of major depression, may inhibit the act of completeing a questionnaire (e.g., Gotlib, & Joorman, 2010).

Another limitation is that questionnaires require content for the items. For example, questions may include items relating to particular academic or social events (e.g., the Negative and Positive Cognitive Error Questionnaire by McKenna, 1987), and participants may neglect to endorse an item because they cannot relate to the content. Thus, their actual level of distortion is under represented (Floyd & Scogin, 1998). Additionally, unique thoughts and beliefs may not be captured by paper and pencil measures (Segal, 1984), and self-report measures rely on the assumption that maladaptive attitudes and beliefs reflect how people think during stressful situations (Gunthert, Cohen, Butler, & Beck, 2005). Gunthert and colleagues argued dispositional self-report measures may be too far removed from what happens in stressful situations, and that “a more direct strategy would be to assess participants’ actual thoughts in response to naturally occurring stress rather than to request their more general reports of underlying dysfunctional attitudes” (p. 78). One implication of these measurement limitations was articulated by Jacobson and colleagues (1996) who underlined the possible “inadequacy of currently available measuring instruments” (p. 303) in CT. Concurrent with this, reseachers recommended (Dozois & Dobson, 2004; Oei & Free, 1995) assessing key constructs by using a variety of assessment modalities (e.g., self-report and observer-rated).

This study is a first step in addressing these challenges. It aims to examine cognitive errors in depression, as assessed by trained observers. It thus provides a perspective complementary to what has been obtained through experimental studies and the use of questionnaires. This study also aims to increase our understanding of the association between many possible CEs and depression. Indeed, most CEs have not been researched, possibly because of a lack of methods to assess them. For example, cognitive errors are not explicitly identified on the Cognitive Bias Questionnaire (Krantz & Hammen, 1979), or the Cognitive Distortions Scale (CDS, Briere, 2000), and only four are represented on Lefebvre’s (1981) Cognitive Error Questionnaire. Henriques and Leitenberg (2002) have stated that “negative cognitive errors such as personalization, overgeneralization, selective abstraction, and catastrophization may play a role in the etiology and maintenance of dysphoric mood and are therefore deserving of more research separate from dysfunctional attitudes and automatic thoughts” (p. 258). It would be useful to examine more closely cognitive errors independent of the content domains used on existing scales, since these may not address the experiences of those using these questionnaires.

Therefore, the first aim of this study was to describe the type and frequency of specific cognitive errors in depressed participants at therapy intake. It also aimed to determine if depressed participants displayed more negative than positive CEs and whether or not positive and negative CEs were related to one another. A second aim was to examine the relationships between cognitive errors and severity of depression. Indeed, while research supports the idea that CEs are different in individuals with and without depression, little is known about the relationship that may exist between CEs and levels or severity of depression.

Given the dearth of research on the link between depression severity and cognitive errors, we tested whether depression severity is positively correlated with negative CEs and negatively correlated with positive CEs. We also examined if individuals with high and low distortions differ from one another on levels of depression. We questioned if subdividing the sample of depressed patients based on levels of distortion might maximize variance in the variable of interest, namely cognitive errors, and allow for a more precise observation of processes in subgroups of patients (see Peris et al., 2010).

Method

Participants

Forty-five participants (N = 45) were drawn from the cognitive therapy (CT) treatment arm of an earlier component study of CT (see Jacobson et al., 1996, 2000). These participants were selected based on the availability of data. Participation requirements included a diagnosis of major depression as defined according to the Diagnostic and Statistical Manual of Mental Disorders (3rd edition, revised; DSM—III—R;American Psychiatric Association, 1987; also consistent with the DSM-IV), a score greater than 13 on the 17-item Hamilton Rating Scale for Depression (HRSD; Hamilton, 1967), and greater than 19 on the Beck Depression Inventory (BDI; Beck et al., 1979). Based on these criteria five participants were excluded from the current study. Exclusion criteria for the Jacobson study included having other concurrent mental disorder, such as bipolar or psychotic subtypes of depression, panic disorder, substance abuse disorder, schizophrenia, schizophreniform disorder, and organic brain syndrome. Participants were also excluded if they were receiving additional treatment including psychotherapy, pharmacotherapy, or who required hospitalization for psychosis or risk of suicide. Thirty-five (78%) of the participants were female; the mean age of the sample was 39.24 years (range = 21 – 61 years). Two of the participants (4.4%) were African American, 34 (75.6%) were Caucasian, three (6.7%) were Native American, and two (4.4%) were Asian; the remaining participants did not report their ethnicity.

All participants were offered 20 sessions of cognitive therapy for depression. For the current study, session three was selected (session three was used for 44 participants and session two for one participant, based on availability). This session was selected because the first few sessions typically involve activities such as explaining the treatment rationale, setting the therapeutic parameters, and obtaining a patient history (Beck et al., 1979), tasks which may not be conducive to the spontaneous production of distortions in the client’s narrative. Further, Horvath and Luborsky (1993) reported that the therapeutic alliance forms during the first five sessions, and peaks during session three. A positive bond likely facilitates greater disclosure on the part of the patient (Rector, Zuroff, & Segal, 1999). Additionally, formal cognitive restructuring exercises such as challenging automatic thoughts and devising more realistic alternatives are not typically introduced until session four (Ilardi & Craighead, 1994), suggesting that a patient’s quantity of cognitive distortions would not have been purposefully targeted by the therapist.

Measures

Beck Depression Inventory. Measures included the Beck Depression Inventory (BDI;Beck et al., 1979), a widely used 21-item self-report instrument of depressive symptoms that has excellent psychometric properties, which was completed at session 3 (Beck, Steer, & Garbin, 1988).

Cognitive Errors Rating Scale (CERS). This observer-rated measure (Drapeau, Perry, & Dunkley, 2008) was used to assess cognitive errors. A detailed manual describes 15 cognitive errors, which are based on work by Beck (1976), J. Beck (1995), Burns (1999), and DeRubeis, Tang, and Beck (2001): (1) Fortune telling, (2) labeling, (3) overgeneralizing, (4) all-or-nothing thinking, (5) discounting the positive or negative, (6) emotional reasoning, (7) magnification and/or minimization of the negative or positive, (8) mental filter, (9) should and must statements, (10) tunnel vision, (11) jumping to conclusions, (12) mind-reading, (13) personalization, (14) inappropriate blaming/crediting of self, while ignoring the roles of others, and (15) inappropriate blaming/crediting of other, while ignoring the role of self. The 15 cognitive errors from the CERS may be subdivided into negative or positive valences, depending on the impact of the error (negative or positive) on the individual, resulting in 30 different CEs. The CEs may also be grouped into four higher order clusters according to Lefebvre (1981): fortune telling (Cluster A: CE 1), overgeneralization (Cluster B: CEs 2 and 3), selective abstraction (Cluster C: CEs 4 to 11), and personalizing (Cluster D: CEs 12 to 15). These four clusters may be subdivided into positive and negative valences, resulting in eight clusters.

The CERS enables trained raters to assess the type and quantity of cognitive errors as they spontaneously occur in a person’s speech. While it has been suggested that mood priming may be necessary to capture latent cognitive vulnerabilities, such as schemas and dysfunctional attitudes (Segal & Ingram, 1994), cognitive errors have been found at multiple levels of cognition, including the more accessible automatic thoughts (Beck, 1995). This suggests they may be captured without the use of a prime. Research has shown the validity and reliability of the CERS (D’Iuso, Blake, Fitzpatrick, & Drapeau, 2009; Kramer, Bodenmann, & Drapeau, 2009; Kramer, de Roten, & Drapeau, 2011; Kramer & Drapeau, 2011; Kramer, Vaudroz, Rugeri, & Drapeau, in press; Lewandowski, D’Iuso, Blake, & Drapeau, in press).

In the current study, three Ph.D. students and one M.A. student were trained in using the CERS. As all therapy sessions had been audio-taped, the third therapy session was selected and transcribed verbatim for raters.

Raters were blind as to session number. In order to determine inter-rater reliability, 18% of the cases were rated independently by at least two raters. Inter-rater reliability was good to excellent: for the 30 individual CEs, the Intra-class Coefficient (ICC 2, 1) was .81, for the 15 CEs it was .78, for the 8 clusters it was .88, for the 4 clusters it was .84, for positive versus negative CEs it was .92, and for the total CEs it was .86.

Results

Mean BDI scores were 30.10 (SD = 6.51). As the sample contained fewer than 50 participants, the Shapiro-Wilk test was used to determine the normality of the variables. Results indicated that all CE variables were non-normally distributed; therefore non-parametric tests were used for all analyses.

Profile of Cognitive Errors

On average, participants spoke 3365.31 words (SD = 1488.08) during a 50-minute session of early therapy. These sessions contained an average of 3.50 cognitive errors (CEs) per 1000 words (SD = 2.23), totaling 10.91 CEs per session (SD = 6.46). Of these CEs, 10.27 (94%) were negative in valence, with only .64 (6%) being positive in valence. The frequency of each cognitive error per 50-minute session, and expressed as a proportion of total CEs can be found in Table 1 (see Drapeau, Perry & Dunkley, 2008 for specific information on data conversion procedures).

Table 1 Number of Cognitive Errors In an Average 50-Minute Session of Early Therapy (N = 45)

CE ClustersIndividual CEs
MSD%SDMSD%SD
Fortune telling
Positive.11.321.08.04Fortune Telling (p).11.321.10.04
Negative1.131.419.66.11Fortune Telling (n)1.131.419.88.11
Overgeneralization
Positive.18.392.59.08Labelling (p).07.25.50.02
Negative2.622.7724.29.20Labelling (n)1.622.0114.79.15
Overgen. (p).11.322.15.08
Overgen. (n)1.001.2810.05.12
Selective Abstraction
Positive.24.572.18.05All-or-nothing (p).00.00.00.00
Negative4.783.1041.98.19All-or-nothing (n).33.563.22.06
Discounting (p).07.33.43.02
Discounting (n).13.34.94.03
Emot. Reason. (p).02.15.32.02
Emot. Reason. (n).911.367.54.10
Mag./min. (p).11.321.12.03
Mag./min. (n).49.874.09.07
Mental Filter (p).00.00.00.00
Mental Filter (n).22.422.48.06
Should & must (p).00.00.00.00
Should & must (n)1.221.1313.18.14
Tunnel vision (p).00.00.00.00
Tunnel vision (n).09.29.78.02
Jump to conclu. (p).04.21.37.02
Jump to conclu. (n)1.381.4210.71.11
Personalizing
Positive.11.321.58.06Mind-reading (p).07.251.23.05
Negative1.711.6714.13.11Mind-reading (n)1.091.1610.22.10
Personalization (p).02.15.21.01
Personalization (n).18.441.61.04
Blame/cred. slf (p).02.15.17.01
Blame/cred. slf (n).40.992.33.05
Blame/cred. o (p).00.00.00.00
Blame/cred. o (n).04.21.30.01

Table 1 Number of Cognitive Errors In an Average 50-Minute Session of Early Therapy (N = 45)

Enlarge table

Prevalence of Negative vs. Positive CEs

A two-tailed Wilcoxon signed-rank test indicated that participants had more negative than positive CEs for total scores, and for each of the four CE clusters: fortune telling, overgeneralization, selective abstraction, and personalizing (see Table 2).

Table 2 Positive and Negative Cognitive Errors at Early Therapy (N = 45)

Positive CEsNegative CEs
CEs/1000 wordsCEs Mdn (range)Mdn (range)ZSig. (2-tailed)
Total CEs.00 (.00-1.15)2.58 (.00-10.26)—5.71<.001
CE Clusters
Fortune Telling.00 (.00–.30).28 (.00-1.57)—4.24<.001
Overgeneralization.00 (.00–.59).61 (.00–4.06)—5.17<.001
Selective Abstract..00 (.00–.85)1.29 (.00-6.15)—5.65<.001
Personalizing.00 (.00–.86).34 (.00-2.11)—4.94<.001
Note: Wilcoxon signed-rank test.

Table 2 Positive and Negative Cognitive Errors at Early Therapy (N = 45)

Enlarge table

Correlations Between Negative and Positive CEs

Spearman two-tailed correlations were computed to determine if positive and negative cognitive errors are related to one another. No significant correlation was found for positive and negative CEs (r =—.20, p = .19). The four CE clusters of fortune telling, overgeneralization, selective abstraction, and personalizing were correlated with each other. Fortune telling negative and selective abstraction negative were significantly correlated (r = .31, p = .04), and overgeneralization negative and selective abstraction negative were significantly correlated (r = .31, p = .04). We found no other combination; no positive CE cluster was related to a negative CE cluster.

The above correlations were recomputed for high and low distorters. The split of the sample into two such groups offers another way to examine the data, one that considers the possibility that processes may be different for subgroups of depressed individuals. Participants were categorized as high or low distorters based on their median split scores for early therapy total cognitive errors (e.g., Dozois, Covin, & Brinker, 2003). A two-tailed Mann-Whitney test confirmed that the group that had been classified as high distorters endorsed significantly more total cognitive errors (Mdn = 4.74, range = 2.75–10.26), than did the low distorters (Mdn = 1.94, range = .00–2.57; U = .00; p < .001). These differences were largely due to negative cognitive errors, which significantly differed between the groups (high distorters: Mdn = 4.33, range = 2.59–10.26; low distorters: Mdn = 1.70, range = .00–2.40; U = .00; p <.001), while positive CEs did not (high distorters: Mdn = .00, range = .00–1.15; low distorters: Mdn = .17, range = .00–.86; U = 233.00; p = .62).

Two-tailed Spearman correlations indicated that total positive CEs and total negative CEs were not correlated for high distorters (r = –.35, p = .11). However, there were significant correlations observed for the following CE clusters: fortune telling positive and selective abstraction positive (r = .70, p <.001); fortune telling negative and selective abstraction positive (r = –.43,p = .04); selective abstraction negative and personalizing positive (r = –.51, p = .01). Among the low distorters, again total positive CEs and total negative CEs were not significantly correlated (r = –21, p = .34); however, the following CE clusters were significantly correlated: Selective abstraction negative and selective abstraction positive (r = .43, p = .04), personalizing positive and overgeneralization negative (r = –.43, p = .04).

CEs and Level of Depressive Symptoms

For the complete sample, no significant correlations were found among total, total positive, or total negative CEs and level of depression on the Beck Depression Inventory (BDI) at early therapy based on the use of Spearman one-tailed correlations. Similarly, no positive or negative CE Cluster was significantly correlated with depressive symptoms at early therapy on the BDI. In terms of the 30 specific CEs, no positive CEs were significantly correlated with level of depression on the BDI. Significant correlations for negative CEs were found for magnification (r = .30, p = .02) and for should and must statements (r = – .27, p = .04). As more correlations were hypothesized, high versus low distorters were examined separately.

For depression scores, a two-tailed Mann-Whitney test indicated that high and low distorters did not differ from one another on their BDI scores (U = 248.00, p = .91). Among the low distorters (n = 22), the only significant correlation between CEs and depressive symptoms was an inverse relationship between positive fortune telling and depression scores on the BDI (r = –.44, p = .02). For high distorters (n = 23), significant correlations were found for depression and total CEs (r = .47, p = .01), negative CEs (r = .38, p = .04), and negative selective abstraction (r = .35, p = .05). Depressive symptoms were also inversely related to positive CEs (r = – .14, p = .03), and positive overgeneralization (r = –.41, p = .03).

As individuals with high distortions had associations between positive and negative CEs and depression, while those with low distortions had an association only between positive fortune telling and depression, correlations were conducted to determine if those with high distortions had a general tendency to distort. Tentative support for this hypothesis was found using one-tailed Spearman correlations which indicated that positive and negative CEs approached a significant correlation for high distorters (r = –.35, p = .05), but not for low distorters (r = –.21, p = .17).

Discussion

All cognitive errors found were in the spontaneous speech of depressed participants. The selective abstraction cluster was most prevalent, followed by overgeneralization, personalizing, and fortune telling. When individual CEs were separated from the clusters, the top six CEs were labeling negative, followed by should and must negative, jumping to conclusions negative, mind-reading negative, overgeneralizing negative, and fortune telling negative. These findings were consistent with theoretical tenets, such as Beck and colleagues’ concept of the negative cognitive triad, including negative thoughts about the self (labeling), future (fortune telling) and world (overgeneralizing) (e.g., Beck et al., 1979). It was also reflective of Ellis’ emphasis on depressed clients’ tendencies to “awfulize” (use magnification) and use should statements (Ellis, 1980).

The findings supported the hypothesis that participants would have more negative than positive CEs. This result was consistent with theory and previous research indicating that thinking is distorted negatively in patients with depression (Beck et al., 1979; Hamilton & Abramson, 1983; Hawley, Zuroff, Brozina, & Dobson, 2014; Pothier, Dobson, & Drapeau, 2012; Schwartzman, et al., 2012;). These results were also consistent with those of Kramer, Bodenmann, and Drapeau (2009), who found that patients with bipolar disorder had a higher ratio of negative to cognitive positive errors when in a depressed mood state. When in a manic state, they demonstrated more positive CEs.

The current study also found that there was no relationship between positive and negative CEs for the entire sample. However, there were several instances of positive and negative CEs being significantly correlated among high and low distorters. Previous research was inconsistent in this regard, as negative and positive distortions had been found to be positively correlated (e.g., Henriques & Leitenberg, 2002), negatively correlated (e.g., Lauren & Black, 2011), and uncorrelated (e.g., Mazur, Wolchik, & Sandler, 1992).

Previous research suggested depressive symptoms were significantly correlated with cognitive variables, such as automatic thoughts (e.g., Dobson & Breiter, 1983; Dozois, et al., 2009; Hjemdal, Stiles, & Wells, 2013; Oei, Bullbeck, & Campbell, 2006), dysfunctional attitudes (e.g., Oei, et al., Segal, et al., 2006; Sherrer & Dobson, 2009), and cognitive errors (e.g., Henriques & Leitenberg, 2002; Pothier, Dobson, & Drapeau, 2012; Sato, 2004; Schwartzman, et al., 2012). The current study found that in most instances, level of depressive symptoms was not related to cognitive errors. The exceptions were significant positive correlation between magnification negative and depressive symptoms and the inverse relationship between should and must statements negative and depressive symptoms.

To further investigate these counterintuitive findings, we examined high and low distortions separately. There were no differences among individuals with high and low distortions on their levels of depression; there were some significant correlations between depression and cognitive errors within the two groups. Among those with low distortions, a greater amount of positive fortune telling was associated with lower levels of depression on the BDI. Among those with high distortions, greater levels of depression were associated with having greater total CEs, negative CEs, and negative selective abstraction CEs. Individuals with high distortions were also found to have lower depression scores associated with higher levels of positive CEs and positive overgeneralization. Distorting in the positive direction may function as a successful short-term mood-boosting strategy for those with high distortions, given it was associated with lower levels of depression, the strategy of distorting information may work against these individuals when negatively valenced information is present, given that negative CEs were associated with greater levels of depression.

Limitations

There are some limitations involved with using an older dataset. For instance, the Diagnostic and Statistical Manual of Mental Disorders has been updated. Applying older diagnostic criteria has the potential to diagnose inaccurately psychological disorders. However, the Diagnostic and Statistical Manual of Mental Disorders, 5th edition; DSM-5; American Psychiatric Association, 2013) includes similar criteria for major depression compared to earlier editions (Paris, 2013). In addition, the Beck Depression Inventory (BDI-IA; Beck et al., 1979) was applied during the initial study and the most current edition of this scale is the Beck Depression Inventory II (BDI-II; Beck, Steer, Brown, 1996). These two versions of the depression inventory have, however, been found to diagnose similar levels of depression (Beck, Steer, Ball, & Ranieri, 1996) and are highly correlated in terms of measuring depression (r = .93, p < .001).

Although the present study relied on data drawn from an older study, the latter is considered to be a highly important random controlled trial, which is evidenced by the republishing of the original work (Jacobson et al., 1996, 2000). In addition, other studies have recently used this same dataset for research purposes. For example, Tang and Derubeis (2005) applied measures of total cognitive change to the dataset through the use of a self-report measure (Patient Cognitive Change Scale; [PCCS]; Tang and DeRubeis, 1999). However, the scale they used was a self-report measure, which may not be the most accurate reporting of cognitive errors for patients with depression. For instance, depressed patients are more likely to be affected by a negative reporting bias (Owsley, & McGwin, 2004; Shean, & Baldwin, 2010). Using the observer-rated CERS on this dataset allowed for a more objective examination of CEs using a specific cognitive distortion typology.

Conclusion

Several general trends and conclusions may be drawn from this study. The theoretical tenets of cognitive therapy (e.g., Beck et al., 1979; Ellis, 1980) were supported in that all types of cognitive errors were found in the spontaneous speech of participants with depression. The distortions of labeling negative, should and must statements negative, jumping to conclusions negative, mind-reading negative, overgeneralizing negative, and fortune telling negative, were most prevalent. It remains to be seen to what extent this may differ in non-depressed individuals.

The hypothesis that participants have more negative than positive CEs was also supported. No relationship between positive and negative CEs was found at early therapy for the entire sample. However, there were a few significant correlations among individuals with high and low distortions, suggesting that for the most part, depressed participants did not have a general tendency to distort information, but that distortion was more likely to occur in the negative, rather than in the positive direction. There were also no significant correlations between cognitive errors and levels of depression for the entire sample. However, when individuals with low and high distortions were separated, several correlations were found. In particular, among the high distorters, higher levels of negative CEs and lower levels of positive CEs were related to higher levels of depressive symptoms.

This study presents a number of limitations. First, a relatively small sample size may have limited the power to detect additional findings. Also, while the CERS allows for an assessment of the quantity of CEs, the qualitative properties, such as the meaning of CEs to the participant, could not be assessed. Furthermore, while it may be reasonable to assume that priming is not necessary to elicit cognitive errors, as these can be found at multiple levels of cognition (e.g., Beck, 1995), the low prevalence of CEs in this sample of depressed patients raises questions about the number of errors displayed in a therapy session that is not particularly stressful. Finally, the methodology did not allow for latent CEs to be assessed.

The strengths of this research is the use of detailed session coding as a methodology to examine the relationship between types and levels of distortions and severity of depression. This window into individual sessions may allow therapists to better understand how CEs function within sessions, and the CERS could be a beneficial tool for researchers and clinicians. Indeed, the majority of the research has used self-report assessment of automatic thoughts and dysfunctional attitudes. Further, much of the research in cognitive therapy for depression has focused on the role of negative distortions. The current study is one of only a few to examine positive cognitive errors. An observer-rated method contributes information that should be considered together with data derived from studies that have used laboratory settings and self-report instruments. This methodology also allowed cognitive errors to be assessed as they naturally occurred in the participants’ speech, rather than having participants recall the frequency of past thoughts, or estimate how they might be likely to distort in a hypothetical situation. Finally, the current study provided a detailed profile of the frequency of cognitive errors in a sample of depressed participants.

The current study contributes to existing knowledge by offering a more detailed account of the role of both positive and negative cognitive errors in depression, and from a novel perspective, using an observer-rated method. Further, individual differences were highlighted so that group means would not obscure unique findings between groups that may be of clinical utility to practitioners. One clinical implication of this study is that positive and negative CEs may signal different psychological processes for different people. Furthermore, some people may have a tendency to distort, while others may selectively distort in the negative direction. Practitioners may wish to pay greater attention to how positive and negative CEs impact the moods of their depressed patients, as theoretical writings have largely emphasized the role that negative CEs have on mood.

*Department of Counselling Psychology, McGill University, Montreal, Canada
#Department of Psychology, University of Calgary, Calgary, Canada
Department of Psychiatry, McGill University, Montreal, Canada.
Mailing address: Prof. Martin Drapeau, McGill Psychotherapy Process Research Group, McGill University, 3700 McTavish Street, Suite 614, Montréal, Quebec H3A 1Y2, Canada. e-mail:

Acknowledgement:

This research was supported by the Fonds de la Recherche en Santé du Québec and the Social Science and Humanities Research Council of Canada.

References

American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.Google Scholar

Andersen, S.M. (1990). The inevitability of future suffering: The role of depressive predictive certainty in depression. Social Cognition, 8, 203–228. doi: 10.1521/soco.1990.8.2.203CrossrefGoogle Scholar

Andersen, S.M., & Limpert, C. (2001). Future-event schemas: Automaticity and rumination in Major Depression. Cognitive Therapy and Research, 25, 311–333. doi:10.1023/A:1026447600924CrossrefGoogle Scholar

Andersen, S.M., Spielman, L.A., & Bargh, J.A. (1992). Future-event schemas and certainty about the future: Automaticity in depressives’ future-event predictions. Journal of Personality and Social Psychology, 63, 711–723. doi:10.1037/0022-3514.63.5.711Crossref, MedlineGoogle Scholar

Beach, S.R.H., Nelson, G.M., & O’Leary, K.D. (1988). Cognitive and marital factors in depression. Journal of Psychopathology and Behavioral Assessment, 10(2), 93–105. doi: 10.1007/BF00962635CrossrefGoogle Scholar

Beck, A.T. (1976). Cognitive therapy and the emotional disorders. New York: International Universities Press.Google Scholar

Beck, A.T., Rush, A.J., Shaw, B.F., & Emery, G. (1979). Cognitive therapy of depression, New York, NY: The Guilford Press.Google Scholar

Beck, A.T., Steer, R.A., Ball, R., & Ranieri, W.F. (1996). Comparison of Beck Depression Inventories-IA and-II in psychiatric outpatients. Journal of personality assessment, 67(3), 588–597.Crossref, MedlineGoogle Scholar

Beck, A.T., Steer, R.A., & Brown, G.K. (1996). Manual for Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation.Google Scholar

Beck, A.T., Steer, R.A., & Garbin. M.G. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77–100. doi:10.1016/0272-7358(88)90050-5CrossrefGoogle Scholar

Beck, J.S. (1995). Cognitive therapy: Basics and Beyond. New York, NY: Guilford Press.Google Scholar

Briere, J. (2000). Cognitive Distortions Scale (CDS). Odessa, FL: Psychological Assessment Resources.Google Scholar

Burns, D.D. (1999). The feeling good handbook. New York: Penguin Group.Google Scholar

Burns, D.D., Shaw, B.F., & Croker, W. (1987). Thinking styles and coping strategies of depressed women: An empirical investigation. Behavior Research and Therapy, 25, 223–225. doi: 10.1016/0005-7967(87)90049-0Crossref, MedlineGoogle Scholar

Coyne, J.C., & Gotlib, I.H. (1983). The role of cognition in depression: a critical appraisal. Psychological Bulletin, 94(3), 472–505. doi: 10.1037/0033-2909.94.3.472Crossref, MedlineGoogle Scholar

Curry, J., Rohde, P., Simons, A., Silva, S., Vitiello, B., Kratochvil, C., … & March, J. (2006). Predictors and moderators of acute outcome in the Treatment for Adolescents with Depression Study (TADS). Journal of the American Academy of Child & Adolescent Psychiatry, 45(12), 1427–1439.Crossref, MedlineGoogle Scholar

DeRubeis, R.J., Tang, T.Z., & Beck, A.T. (2001). Cognitive therapy. In K. S. Dobson (Ed.), Handbook of cognitive-behavioral therapies (2nd Ed.), pp. 349–392. New York: Guilford.Google Scholar

D’Iuso, D., Blake, E., Fitzpatrick, M., & Drapeau, M. (2009). Cognitive errors, coping patterns, and the therapeutic alliance: a study of in-session process. Counseling and Psychotherapy Research, 9(2), 108–114. doi: 10.1080/14733140902804276CrossrefGoogle Scholar

Dobson, K.S., & Breiter, H.J. (1983). Cognitive assessment of depression: reliability and validity of three measures. Journal of Abnormal Psychology, 92(2), 107–109. doi:10.1037/0021-843X.92.1.107Crossref, MedlineGoogle Scholar

Dobson, K.S., & Shaw, B.F. (1986). Specificity and stability of self-referent encoding in clinical depression. Journal of Abnormal Psychology, 10, 34–40. doi:10.1037/0021-843X.96.1.34Google Scholar

Dozois, D.J., & Beck, A.T. (2008). Cognitive schemas, beliefs and assumptions. Risk factors in depression, 1, 121–143.Google Scholar

Dozois, D.J., Bieling, P.J., Patelis-Siotis, I., Hoar, L., Chudzik, S., McCabe, K., & Westra, H.A. (2009). Changes in self-schema structure in cognitive therapy for major depressive disorder: a randomized clinical trial. Journal of consulting and clinical psychology, 77(6), 1078.Crossref, MedlineGoogle Scholar

Dozois, D.J.A., Covin, R., & Brinker, J.K. (2003). Normative data on cognitive measures of depression. Journal of Consulting and Clinical Psychology, 71, 71–80. doi:10.1037/0022-006X.71.1.71Crossref, MedlineGoogle Scholar

Dozois, D.J., & Dobson, K.S. (2004). The prevention of anxiety and depression: Theory, research, and practice. Washington DC: American Psychological Association.CrossrefGoogle Scholar

Drapeau, M., Perry, J.C., & Dunkley, D. (2008). The cognitive error rating system manual (3rd ed.). Montreal, QC: McGill University. Unpublished manual.Google Scholar

Ellis, A. (1980). Rational-Emotive Therapy and Cognitive Behavior Therapy: Similarities and Differences. Cognitive Therapy and Research, 4(4), 325–340. doi: 10.1007/BF01178210CrossrefGoogle Scholar

Flett, G.L., Goldstein, A.L., Hewitt, P.L., & Wekerle, C. (2012). Predictors of deliberate self-harm behavior among emerging adolescents: An initial test of a self-punitiveness model. Current psychology, 31(1), 49–64.CrossrefGoogle Scholar

Floyd, M., & Scogin, F. (1998). Cognitive-behavior therapy for older adults: How does it work? Psychotherapy, 35, 4, 459–463. doi:10.1037/h0087770CrossrefGoogle Scholar

Gotlib, I.H., & Joormann, J. (2010). Cognition and depression: current status and future directions. Annual review of clinical psychology, 6, 285.Crossref, MedlineGoogle Scholar

Gunthert, K.C., Cohen, L.H., Butler, A.C., & Beck, J.S. (2005). Predictive role of daily coping and affective reactivity in cognitive therapy outcome: Application of a daily process design to psychotherapy research. Behavior Therapy, 36, 77–88. doi: 10.1016/S0005-7894(05)80056-5CrossrefGoogle Scholar

Gupta, R., & Kar, B.R. (2008). Interpretative bias: Indicators of cognitive vulnerability to depression. German Journal of Psychiatry, 11, 98–102.Google Scholar

Hamblin, D.L., Beutler, L.E., Scogin, F., & Corbishley, A. (1993). Patient responsiveness to therapist values and outcome in group cognitive therapy. Psychotherapy Research 3(1), 36–46. doi:10.1080/10503309312331333649CrossrefGoogle Scholar

Hamilton, E.W., & Abramson, L.Y. (1983). Cognitive patterns and major depressive disorder: a longitudinal study in a hospital setting. Journal of Abnormal Psychology, 92, 173–184. doi:10.1037/0021-843X.92.2.173Crossref, MedlineGoogle Scholar

Hammen, C.L. (1978). Depression, distortion, and life stress in college students. Cognitive Therapy and Research, 2, 189–192. doi: 10.1007/BF01172733CrossrefGoogle Scholar

Hammen, C.L., & Krantz, S. (1976). Effect of success and failure on depressive cognitions. Journal of Abnormal Psychology, 85, 577–586. doi: 10.1037/0021-843X.85.6.577Crossref, MedlineGoogle Scholar

Harrell, T., & Ryon, N. (1983). Cognitive-behavioral assessment of depression: Clinical validation of the automatic thoughts questionnaire. Journal of Consulting & Clinical Psychology, 51, 721–725. doi: 10.1037/0022-006X.51.5.721Crossref, MedlineGoogle Scholar

Hawley, L.L., Zuroff, D.C., Brozina, K., Ho, M.H.R., & Dobson, K.S. (2014). Self-Critical Perfectionism and Stress Reactivity Following Cognitive Behavioral Therapy for Depression. International Journal of Cognitive Therapy, 7(3), 287–303.CrossrefGoogle Scholar

Henriques, G., & Leitenberg, H. (2002). An experimental analysis of the role of cognitive errors in the development of depressed mood following negative social feedback. Cognitive Therapy and Research, 26(2), 245–260. doi: 10.1023/A:1014577904837CrossrefGoogle Scholar

Hjemdal, O., Stiles, T., & Wells, A. (2013). Automatic thoughts and meta - cognition as predictors of depressive or anxious symptoms: A prospective study of two trajectories. Scandinavian journal of psychology, 54(2), 59–65.Crossref, MedlineGoogle Scholar

Hollon, S.D., DeRubeis, R.J., & Evans, M.D. (1987). Causal mediation of change in treatment for depression: Discriminating between non-specificity and non-causality. Psychological Bulletin, 102, 139–149. doi:10.1037/0033-2909.102.1.139Crossref, MedlineGoogle Scholar

Hollon, S.D. & Kendall, P.C. (1980). Cognitive self-statements in depression: Development of an automatic thoughts questionnaire. Cognitive Therapy and Research, 4, 383–395. doi:10.1007/BF01178214CrossrefGoogle Scholar

Horvath, A.O., & Luborsky, L. (1993). The role of the therapeutic alliance in psychotherapy. Journal of Consulting and Clinical Psychology, 61, 561–573. doi:10.1037/0022-006X.61.4.561Crossref, MedlineGoogle Scholar

Ilardi, S.S., & Craighead, W.E. (1994). The role of nonspecific factors in cognitive-behavior therapy for depression, Clinical Psychology: Science and Practice, 1, 138–156. doi:10.1111/j.1468-2850.1994.tb00016.xGoogle Scholar

Jacobson, N.S., Dobson, K.S., Truax, P.A., Addis, M.E., Koerner, K., Gollan, J.K., Gortner, E., & Prince, S.E. (1996). A component analysis of cognitive-behavioral treatment for depression. Journal of Consulting and Clinical Psychology, 64, 295–304. doi:10.1037/0022-006X.64.2.295Crossref, MedlineGoogle Scholar

Jacobson, N.S., Dobson, K.S., Truax, P.A., Addis, M.E., Koerner, K., Gollan, J.K., Gortner, E., Prince, Stacey E. (2000). A component analysis of cognitive–behavioral treatment for depression. Prevention & Treatment, 3(1), no Pagination Specified, Article 23a. doi: 10.1037/1522-3736.3.1.323aCrossrefGoogle Scholar

Jager-Hyman, S., Cunningham, A., Wenzel, A., Mattei, S., Brown, G. K., & Beck, A. T. (2014). Cognitive distortions and suicide attempts. Cognitive therapy and research, 38(4), 369–374.Crossref, MedlineGoogle Scholar

Klar, Y., Gabai, T. & Baron, Y. (1997). Depression and generalizations about the future: Who overgeneralizes what? Personality and Individual Difference, 22(4), 575–584. doi:10.1016/S0191-8869(96)00186-9CrossrefGoogle Scholar

Kramer, U., Bodenmann, G., & Drapeau, M. (2009). Cognitive errors assessed by observer ratings in bipolar affective disorder: relationship with symptoms and therapeutic alliance. The Cognitive Behaviour Therapist, 2, 92–105. doi: 10.1017/S1754470X09990043CrossrefGoogle Scholar

Kramer, U., de Roten, Y., & Drapeau, M. (2011). Effects of Training in the Cognitive Errors and Coping Action Patterns Rating Scales. Swiss Journal of Psychology, 70(1), 41–46. doi:10.1024/1421-0185/a000037CrossrefGoogle Scholar

Kramer, U., & Drapeau, M. (2011). Étude de validation de la version franc̨aise des échelles de codage du coping et des erreurs cognitives (CE-CAP) sur une population non-clinique. Annales Médico-Psychologiques. 169(8), 523–527. doi: 10.1016/j.amp.2009.07.017CrossrefGoogle Scholar

Kramer, U., Vaudroz, C., Ruggeri, O., & Drapeau, M. (In press). Biased Thinking assessed by External Observers in Borderline Personality Disorder. Psychology and Psychotherapy: Theory, Research and Practice.Google Scholar

Krantz, S., & Hammen, C.L. (1979) Assessment of cognitive bias in depression. Journal of Abnormal Psychology, 88, 611–619. doi: 10.1037/0021-843X.88.6.611Crossref, MedlineGoogle Scholar

Krantz, S.E., & Lui, C. (1987). The effect of mood and information valence on depressive cognitions. Cognitive Therapy and Research, 11, 185–196. doi: 10.1007/BF01183264CrossrefGoogle Scholar

Lauren, B., & Black, S.K. (2011). The breakdown of self-enhancing and self-protecting cognitive biases in depression. Handbook of self-enhancement and self-protection, 358.Google Scholar

Lefebvre, M.G. (1981). Cognitive distortion and cognitive errors in depressed psychiatric and low back pain patients. Journal of Consulting and Clinical Psychology, 49, 517–525. doi:10.1037/0022-006X.49.4.517Crossref, MedlineGoogle Scholar

Leung, P.W., & Poon, M.W. (2001). Dysfunctional schemas and cognitive distortions in psychopathology: A test of the specificity hypothesis. Journal of Child Psychology and Psychiatry, 42(06), 755–765.Crossref, MedlineGoogle Scholar

Lewandowski, M., D’Iuso, D., Blake, E., & Drapeau, M. (In press). Cognitive errors and coping strategies and their relation to client involvement and experiencing. Counseling & Psychotherapy Research.Google Scholar

MacLeod, A.K., Byrne, A., & Valentine, J.D. (1996). Affect, emotional disorder, and future-directed thinking. Cognition and Emotion, 10, 69–86. doi: 10.1080/026999396380394CrossrefGoogle Scholar

MacLeod, A.K., Williams, J.M.G., & Bekerian, D.A. (1991). Worry is reasonable: The role of explanations in pessimism about future personal events. Journal of Abnormal Psychology, 100, 478–486. doi:10.1037/0021-843X.100.4.478Crossref, MedlineGoogle Scholar

Mazur, E., Wolchik, S.A., & Sandler, I.N. (1992). Negative cognitive errors and positive illusions for negative divorce events: Predictors of children’s psychological adjustment. Journal of Abnormal Child Psychology, 20(6), 523–542. doi: 10.1007/BF00911238Crossref, MedlineGoogle Scholar

Michael, C.C., & Funabiki, D. (1985). Depression, distortion, and life stress: Extended findings. Cognitive Therapy and Research, 9(6), 659–666. doi: 10.1007/BF01173024CrossrefGoogle Scholar

Norman, Miller, I.W., & Dow, M.G. (1988). Characteristics of depressed patients with elevated levels of dysfunctional cognitions. Cognitive Therapy and Research, 12(1), 39–51. doi:10.1007/BF01172779CrossrefGoogle Scholar

Miranda, R., & Andersen, S.M. (2006). Induced processing efficiency in making pessimistic versus optimistic future-event predictions: Implications for depressive schemas, Submitted.Google Scholar

Miranda, R., Fontes, M., & Marroquín, B. (2008). Cognitive content-specificity in future expectancies: Role of hopelessness and intolerance of uncertainty in depression and GAD symptoms. Behaviour Research and Therapy, 46(10), 1151–1159.Crossref, MedlineGoogle Scholar

Miranda, R., & Mennin, D.S. (2007). Depression, generalized anxiety disorder, and certainty in pessimistic predictions about the future. Cognitive Therapy and Research, 31(1), 71–82.CrossrefGoogle Scholar

Monroe, S.M., Slavich, G.M., Torres, L.D., & Gotlib, I.H. (2007). Severe life events predict specific patterns of change in cognitive biases in major depression. Psychological medicine, 37(06), 863–871.Crossref, MedlineGoogle Scholar

Moussavi, S., Chatterji, S., Verdes, E., Tandon, A., Patel, V., & Ustun, B. (2007). Depression, chronic diseases, and decrements in health: results from the World Health Surveys. The Lancet, 370(9590), 851–858.Crossref, MedlineGoogle Scholar

Miranda, R., & Mennin, D.S. (2007). Depression, Generalized Anxiety Disorder, and Certainty in Pessimistic Predictions about the Future. Cognitive Therapy and Research, 31(1), 72–81. doi:10.1007/s10608-006-9063-4CrossrefGoogle Scholar

Miranda, J., Persons, J.B., & Byers, C.N. (1990). Endorsement of dysfunctional beliefs depends on current mood state. Journal of Abnormal Psychology, 99(3), 237–241. doi:10.1037/0021-843X.99.3.237Crossref, MedlineGoogle Scholar

Moreno, R., Cunningham, A.C., Gatchel, R.J., & Mayer, T.G. (1991). Functional restoration for low back pain: Changes in depression, cognitive distortion, and disability. Journal of Occupational Rehabilitation, 1, 207–217. doi: 10.1007/BF01073457Crossref, MedlineGoogle Scholar

Newman, M.G., Zuellig, A.R., Kachin, K.E., Constantino, M.J., Przeworski, A., Erickson, T., & Cashman-McGrath, L. (2002). Preliminary reliability and validity of the Generalized Anxiety Disorder Questionnaire-IV: A revised self-report diagnostic measure of Generalized Anxiety Disorder. Behavior Therapy, 33, 215–233. doi: 10.1016/S0005-7894(02)80026-0CrossrefGoogle Scholar

Norman, W.H., Miller, I.W., Klee, S.H. (1983). Assessment of cognitive distortion in a clinically depressed population. Cognitive Therapy and Research, 7(2), 133–140. doi:10.1007/BF01190066CrossrefGoogle Scholar

Oei, T.P., Bullbeck, K., & Campbell, J.M. (2006). Cognitive change process during group cognitive behaviour therapy for depression. Journal of affective disorders, 92(2), 231–241.Crossref, MedlineGoogle Scholar

Oei, T.P.S., & Free, M.L. (1995). Do cognitive behavior therapies validate cognitive models of mood disorders? A review of the empirical evidence. International Journal of Psychology, 30(2), 145–179. doi: 10.1080/00207599508246564CrossrefGoogle Scholar

Owsley, C., & McGwin, G. Jr. (2004). Depression and the 25-item National Eye Institute Visual Function Questionnaire in older adults. Ophthalmology, 111, 2259–64.Crossref, MedlineGoogle Scholar

Paris, J. (2013). The intelligent clinician’s guide to DSM-5. New York: Oxford University Press.CrossrefGoogle Scholar

Peris, T.S., Bergman, R.L., Asarnow, J.R., Langley, A., McCracken, J.T., & Piacentini, J. (2010). Clinical and cognitive correlates of depressive symptoms among youth with obsessive compulsive disorder. Journal of Clinical Child and Adolescent Psychology, 39(5), 616–626. doi:10.1080/15374416.2010.501285Crossref, MedlineGoogle Scholar

Pothier, B., Dobson, K.S., & Drapeau, M. (2012). Investigating the relationship between depression severity and cognitive rigidity through the use of cognitive errors. Archives of Psychiatry and Psychotherapy, 2, 35–40.Google Scholar

Rector, N.A., Zuroff, D.C., & Segal, Z.V. (1999). Cognitive change and the therapeutic alliance: The role of technical and nontechnical factors in cognitive therapy. Psychotherapy, 36, 320–328. doi:10.1037/h0087739CrossrefGoogle Scholar

Scherrer, M.C., & Dobson, K.S. (2009). Predicting responsiveness to a depressive mood induction procedure. Journal of Clinical Psychology, 65(1), 20–35.Crossref, MedlineGoogle Scholar

Schwartzman, D., Stamoulos, C., D’Iuso, D., Thompson, K., Dobson, K.S., Kramer, U., & Drapeau, M. (2012). The relationship between cognitive errors and interpersonal patterns in depressed women. Psychotherapy, 49(4), 528.Crossref, MedlineGoogle Scholar

Segal, Z.V. (1984). Shifting cognitive assessment strategies from a state to trait focus: the case of self-schemata measures. Paper presented at the meeting of the Association for Advancement of Behavior Therapy, Philadelphia.Google Scholar

Segal, Z.V., Kennedy, S., Gemar, M., Hood, K., Pedersen, R., & Buis, T. (2006). Cognitive reactivity to sad mood provocation and the prediction of depressive relapse. Archives of General Psychiatry, 63, 749–755.Crossref, MedlineGoogle Scholar

Segal, Z.V., & Ingram, R.E. (1994). Mood priming and construct activation in tests of cognitive vulnerability to unipolar depression. Clinical Psychology Review, 14, 663–695. doi:10.1016/0272-7358(94)90003-5CrossrefGoogle Scholar

Shean, G., & Baldwin, G. (2008). Sensitivity and specificity of depression questionnaires in a college-age sample. The Journal of Genetic Psychology, 169(3), 281–292.Crossref, MedlineGoogle Scholar

Smith, T.W., O’Keeffe, J.L., & Christensen, A.J. (1994). Cognitive distortion and depression in chronic pain: Association with diagnosed disorders. Journal of Consulting and Clinical Psychology, 62(1), 195–198. doi:10.1037/0022-006X.62.1.195Crossref, MedlineGoogle Scholar

Smith, T.W., Peck, J.R., Milano, R.A., & Ward, J.R. (1988). Cognitive distortion in rheumatoid arthritis: relation to depression and disability. Journal of Consulting and Clinical Psychology, 56(3), 412–416. doi:10.1037/0022-006X.56.3.412Crossref, MedlineGoogle Scholar

Summerfeld, L.J. & Endler, N.S. (1996). Coping with emotion and psychopathology. In M. ZeidnerN. S. Endler (Eds.). Handbook of coping, theory, research, applications (pp. 602–639). New York: John Wiley & Sons.Google Scholar

Tang, T.Z., & DeRubeis, R.J. (1999). Sudden gains and critical sessions in cognitive-behavioural therapy for depression. Journal of Consulting and Clinical Psychology, 67(6), 894–904.Crossref, MedlineGoogle Scholar

Tang, T.Z., DeRubeis, R.J., Beberman, R., & Pham, T. (2005). Cognitive changes, critical sessions, and sudden gains in cognitive-behavioural therapy for depression. Journal of Consulting and Clinical Psychology, 73(1), 168–172.Crossref, MedlineGoogle Scholar

Wenzlaff, R.M., & Grozier, S.A. (1988). Depression and the magnification of failure. Journal of Abnormal Psychology, 97(1), 90–93. doi:10.1037/0021-843X.97.1.90Crossref, MedlineGoogle Scholar

Yurica, C.L., & DiTomasso, R.A. (2005). Cognitive distortions. In Encyclopedia of cognitive behavior therapy (pp. 117–122). Springer US.CrossrefGoogle Scholar