http://dx.doi.org/10.24016/2022.v8.292

ORIGINAL ARTICLE

 

 

Psychometric analysis of a simplified version of the Emotion Regulation Questionnaire in Mexican adults: The ERQ-CA-9

 

Análisis psicométrico de una versión simplificada del Emotion Regulation Questionnaire en adultos mexicanos: el ERQ-CA-9

 

 

Pablo D. Valencia ^1*, Anabel De la Rosa-Gómez ¹

¹ Facultad de Estudios Superiores Iztacala, Universidad Nacional Autónoma de México, State of Mexico, Mexico.

 

* Correspondence: Pablo D. Valencia. E-mail: pablo.valencia@ired.unam.mx.

 

Received: September 23, 2021. | Revised: November 10, 2022. | Accepted: December 31, 2022. | Published Online: December 31, 2022.

 

CITE IT AS:

Valencia, P., & De la Rosa-Gómez, A. (2022). Psychometric analysis of a simplified version of the Emotion Regulation Questionnaire in Mexican adults: The ERQ-CA-9. Interacciones, 8, e292. http://dx.doi.org/10.24016/2022.v8.292

 

ABSTRACT

Background: The Emotion Regulation Questionnaire (ERQ) is the most widely used measure of cognitive reappraisal and expressive suppression, two core emotion regulation strategies. However, the original ERQ has complex wording, which may make it difficult for readers of lower educational levels. Objective: We aimed to examine the psychometric properties of a simplified version of the ERQ, initially designed for children and adolescents: the ERQ-CA. Method: A sample of 397 Mexican adults was studied (77.3% women, 22.7% men; mean age = 22.84). A confirmatory factor analysis, as well as a graded response model, were used to study the internal functioning of the instrument. In addition, its associations with three psychopathological variables (anxiety, depression, and suicidal ideation) were examined. Results: A 9-item version of the ERQ-CA showed adequate fit (CFI = .95, RMSEA = .06), as well as good reliability (ω_reappraisal = .76; ω_suppression = .75). Both subscales performed better at levels closer to the mean of their respective constructs. Finally, significant correlations were found between both subscales and the psychopathological variables. Conclusion: The 9-item ERQ-CA constitutes a promising alternative to measure cognitive reappraisal and expressive suppression in the Mexican adult population.

Keywords: emotion regulation; factor analysis, statistical; psychometrics; validation study; Mexico.

 

RESUMEN

Antecedentes: El Cuestionario de Regulación Emocional (ERQ) es la medida más utilizada para la reevaluación cognitiva y la supresión expresiva, dos estrategias centrales de regulación emocional. Sin embargo, el ERQ original tiene una redacción compleja, lo que puede dificultar su lectura a los lectores de menor nivel educativo. Objetivo: Se buscó examinar las propiedades psicométricas de una versión simplificada del ERQ, inicialmente diseñada para niños y adolescentes: el ERQ-CA. Método: Una muestra de 397 adultos mexicanos fue estudiada (77.3% mujeres, 22.7% hombres; edad promedio = 22.84). Se utilizó un análisis factorial confirmatorio, así como un modelo de respuesta graduada, para estudiar el funcionamiento interno del instrumento. Además, se examinaron sus asociaciones con tres variables psicopatológicas (ansiedad, depresión e ideación suicida). Resultados: Una versión de 9 ítems del ERQ-CA mostró un ajuste adecuado (CFI = .95, RMSEA = .06), así como una buena fiabilidad (ω_{reevaluación} = .76; ω_supresión = .75). Ambas subescalas se comportaron mejor en los niveles más cercanos a la media de sus respectivos constructos. Finalmente, se encontraron correlaciones significativas entre ambas subescalas y las variables psicopatológicas. Conclusión: El ERQ-CA de 9 ítems constituye una alternativa prometedora para medir la reevaluación cognitiva y la supresión expresiva en la población adulta mexicana.

Palabras clave: regulación emocional; análisis factorial; psicometría; estudio de validación; México.

 

BACKGROUND

Emotional regulation (ER) is defined as any action taken to increase or decrease an emotional response (Gross, 2015). As such, the study of ER and its difficulties constitutes a central aspect of mental health research (Berking & Wupperman, 2012; Cludius et al., 2020; T. Hu et al., 2014). One of the most influential theoretical models for the study of ER is the so-called process model, which pragmatically integrates previous lines of research related to coping (Gross, 2015; McRae & Gross, 2020). This model distinguishes between two families of ER strategies: those focused on antecedents (before the emotional response occurs) and those focused on the emotional response itself (Gross, 1998). In the case of antecedent-focused strategies, the most studied has been cognitive reappraisal, which consists of the cognitive change made by the individual in order to modify their emotional response (Joormann et al., 2010). On the other hand, the strategy focused on the emotional response that has been most studied is expressive suppression, which consists of an attempt to hide the emotional response when it has already occurred (Salters-Pedneault et al., 2010).

Both ER strategies have been studied in relation to different mental health outcomes. In a meta-analysis by T. Hu et al. (2014), a composite variable of “negative mental health indicators” (depression, anxiety, and negative affect) was found to have correlations of -.20 and .25 with reappraisal and suppression, respectively. Examining specific disorders, another meta-analysis found that reappraisal had a negative correlation with depression (r = -.17) and anxiety (r = -.13), although the latter was not significant (Aldao et al., 2010). In the same meta-analysis, suppression was found to have positive and generally higher correlations with depression and anxiety (r = .36 and r = .29, respectively). In a more recent study, cognitive reappraisal was found to correlate negatively with depression (r = -.32) and anxiety (r = -.14), whereas expressive suppression correlated positively (r = .18 and r = .10, respectively) (Preece et al., 2021). Likewise, there is also evidence that both ER variables are associated with suicidal ideation (Forkmann et al., 2014; Ghorbani et al., 2017). For example, Forkmann et al. (2014) found that suicidal ideation was significantly associated with both reappraisal (β = -.10) and suppression (β = .33).

Given the importance of these two strategies for the study of ER, Gross et al. (2003) constructed a specific instrument to measure them: the Emotion Regulation Questionnaire (ERQ). This has been massively used in ER research, to the point that it constitutes the most widely used measure of cognitive reappraisal and expressive suppression (T. Hu et al., 2014). Consequently, it has multiple validation studies (i.e., Cabello et al., 2013; delValle et al., 2022; Moreta-Herrera et al., 2022). In Spanish, the version developed by Rodríguez-Carvajal et al. (2006) has been validated in the Mexican population (Olalde-Mathieu et al., 2022). In Mexico, the fit of the ERQ’s factor structure was marginally acceptable but suboptimal (CFI = .90, RMSEA = .09), so there seems to be room for improvement.

In the literature on the cross-cultural adaptation of instruments, the importance of a systematic translation has been emphasized (Sousa & Rojjanasrirat, 2011), as failing to meet this need may cause the adapted test not to be equivalent to the original (Bader et al., 2021). However, a related but not always addressed problem is that the reading ability of the new population may be different from that of the initial population (Bauer et al., 2022). Moreover, even the instrument in its original form may not be entirely appropriate for the general population. For example, in the US healthcare context, it is recommended that patient materials be written at an academic level at least two grades below the national average (Weiss, 2007). However, reviews of existing instruments have shown that this is not always the case (McHugh & Behar, 2009).

As for the ERQ, the wording of its items may be too complex for people with a low level of education. To quantify this, readability indices can be used, such as the Fernández-Huerta index, for which values of at least 70 are recommended (Ríos-Hernández, 2017). When this index is applied to the Spanish version of the ERQ (Olalde-Mathieu et al., 2022; Rodríguez-Carvajal et al., 2006), a value of 64.59 is obtained, which is considered “normal” but is below what is desired. In this situation, a possible alternative is the ERQ in its version for children and adolescents (ERQ-CA; Gullone & Taffe, 2012). Although this instrument was not designed for the adult population, the content of its items does not preclude its use in this age group. In the review of the scientific literature for the present study, two Spanish versions of the ERQ-CA were found (Martín-Albo et al., 2020; Pastor et al., 2019). When the Fernández-Huerta index is applied to these versions, a value of 87.94 (easy) is found for that of Martín-Albo et al. (2020) and one of 75.65 (somewhat easy) for that of Pastor et al. (2019). This indicates that the ERQ-CA constitutes a promising alternative for the measurement of ER in adults. However, to the authors’ knowledge, the psychometric performance of the ERQ-CA in adults has not yet been examined.

Therefore, the present study aimed to examine the psychometric properties of a simplified version of the ERQ (the ERQ-CA; Gullone & Taffe, 2012) in the Spanish version of Martín-Albo et al. (2020), since it is the one with the highest readability index. Specifically, we examined (a) its internal structure, (b) its internal consistency reliability, (c) the psychometric quality of its items, and (d) its validity evidence based on relations to other variables (specifically, anxiety, depression, and suicidal ideation). Our results should provide a simple and easy-to-understand alternative to measure ER strategies in the Mexican adult population. This is important since instruments designed for the general population should be very simple to read (McHugh & Behar, 2009); likewise, their items should be as short as possible (Hamby & Ickes, 2015). This allows the tests to be suitable for a larger number of people, which in turn is a way of democratizing their use (Weiss, 2007).

 

METHOD

Design

The present study has an instrumental design, as it focuses on examining the psychometric properties of a measure (Ato et al., 2013).

 

Participants

The sample consisted of 397 people (77.3% women, 22.7% men), who were recruited by convenience. The only inclusion criteria were to be of legal age and to have lived in Mexico for the last five years. Ages ranged from 18 to 49 (M = 22.84, SD = 4.27). The majority of participants (67.5%) identified themselves as female, 23.9% as male, 6.0% as non-binary (including gender-fluid), and 0.5% as “other”; eight people preferred not to indicate their gender. Also, 40.3% of the sample considered themselves part of the LGTBIQ+ community. The states with the highest representation were the State of Mexico (12.6%), Mexico City (8.3%), and Aguascalientes (8.1%). More than half of the participants had a university education. Also, most of them had had suicidal thoughts during the last year, as well as anxious and depressive symptomatology during the last two weeks. Detailed information about the sample is presented in Table 1.

 

 

Table 1. Characteristics of the study sample.

Variable	n	%
Age (M = 22.84, SD = 4.27)
18–24	305	76.8
25–29	67	16.9
30–49	25	6.3
Sex
Women	307	77.3
Men	90	22.7
Gender identity
Female	268	67.5
Male	95	23.9
Non-binary (including gender-fluid)	24	6.0
Other	2	0.5
Prefer not to say	8	2.0
Is LGBTQ+
No	237	59.7
Yes	160	40.3
Educational level
Middle school	9	2.3
High school	166	41.8
Undergraduate school	209	52.6
Master’s degree	13	3.3
Suicidal ideation in the previous 12 months
Never	98	24.7
Rarely	99	24.9
Sometimes	129	32.5
Frequently	53	13.4
Always or almost always	18	4.5
Significant anxiety (GAD-2 ≥ 3)
No	184	46.3
Yes	213	53.7
Significant depression (PHQ-2 ≥ 3)
No	170	42.8
Yes	227	57.2

 

 

Instruments

Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CA; Gullone & Taffe, 2012). This instrument was created to measure two emotional regulation strategies (cognitive reappraisal and expressive suppression) in children and adolescents. In the present study, however, it was applied to an adult population. The reappraisal subscale consists of 6 items, whereas the suppression subscale consists of 4 items. In all cases, a Likert scale of 5 response options was presented (1 = Strongly disagree, 5 = Strongly agree). For this research, the Spanish version of Martín-Albo et al. (2020) was used. After an informal pilot application, it was decided to slightly modify the wording of item 3, as it was observed that it seemed to repeat the phrasing of item 1. Originally, the item read “Cuando no quiero sentirme tan mal (p. ej., triste, enfadado), pienso en otra cosa” [When I don’t want to feel so bad (e.g., sad, angry), I think about something else] and was changed to “Cuando no quiero sentirme tan mal (p. ej., triste, enfadado), pienso en algo diferente” [When I don't want to feel so bad (e.g., sad, angry), I think about something different]. After this modification, the Fernández-Huerta readability index was 86.74, i.e., it remained “easy” to read (Ríos-Hernández, 2017). The detailed psychometric properties of this measure will be presented in the Results section of this article.

Generalized Anxiety Disorder Scale (GAD-2; Kroenke et al., 2007). This is an ultra-brief measure of symptomatology related to generalized anxiety disorder. It consists of 2 items: “Feeling nervous, anxious or on edge” and “Not being able to stop or control worrying”. Taking the last two weeks as a time frame, people should answer according to the following Likert scale: 0 = Not at all, 1 = Several days, 2 = More than half of the days and 3 = Nearly every day. The GAD-2 has been validated in the Mexican population with good psychometric properties (Gaitán-Rossi et al., 2021). A cut-off point of ≥ 3 was considered adequate to estimate the presence of generalized anxiety disorder, both in the original study (Kroenke et al., 2007) and in the Mexican population. In the present data, the reliability of the scale was good (α = .83; ω_categorical = .82).

Patient Health Questionnaire (PHQ-2; Kroenke, 2003). This ultra-brief instrument measures depressive symptomatology. It uses the following 2 items: “Little interest or pleasure in doing things” and “Feeling down, depressed or hopeless”. Individuals are asked to indicate the extent to which they have experienced both situations during the past two weeks, using the following response scale: 0 = Not at all, 1 = Several days, 2 = More than half of the days, and 3 = Nearly every day. The PHQ-2 has been examined before in a rural Mexican population (Arrieta et al., 2017) and, in line with the original study by Kroenke et al. (2003), a cut-off point of ≥ 3 was found to be adequate to identify depressive symptomatology. In the present study, the reliability of the PHQ-2 was adequate (α = .74; ω_categorical = .74).

Single-item of suicidal ideation. An ad hoc item was constructed to measure suicidal ideation in the last year. This consisted of the following question: “During the last 12 months, how often have you thought about ending your life?”. The response options were as follows: 1 = Never, 2 = Rarely, 3 = Sometimes, 4 = Frequently, and 5 = Always or almost always.

 

Procedure

A survey was developed on the Google Forms platform, which was distributed through social media (mainly Facebook). The instruments were presented in the following order: a single-item of suicidal ideation (included in the sociodemographic file), ERQ-CA, GAD-2, and PHQ-2. Data collection was conducted in September 2022.

 

Statistical analysis

First, the descriptive statistics of the ERQ-CA’s items were examined: mean, standard deviation, skewness, kurtosis, percentage of responses, and item-total correlation. A confirmatory factor analysis was then performed using a robust estimator of the maximum likelihood family (MLR). This is feasible when the items analyzed have at least five response options as in the present case (Rhemtulla et al., 2012). This allows a simpler factor model to be applied, rather than a more complex one such as those using polychoric correlations and least squares estimators (e.g., WLSMV). The fit was assessed with the following approximate indices: comparative fit index (CFI), Tucker-Lewis index (TLI), root-mean-square error of approximation (RMSEA), and standardized root-mean residual (SRMR). As a guide, the following goodness-of-fit criteria were consulted: CFI > .95, TLI > .95, RMSEA < .06, SRMR < .08 (L. Hu & Bentler, 1999). In case of not obtaining a good fit, possible re-specifications from the modification indices were evaluated. Next, internal consistency reliability was examined through the alpha (α) and omega (ω) coefficients.

Then, a graded response model (Samejima, 2016), which is part of the item response theory, was applied to each subscale. Discrimination (a) and difficulty (b) parameters were estimated, as well as information curves, which graphically represent the psychometric quality of the items at different levels of the construct (Furr, 2018). Finally, validity evidence based on relations to other variables (in this case, anxiety, depression, and suicidal ideation) was examined, for which Pearson correlation coefficients were estimated. All analyses were performed in the R 4.0.3 program, in which the packages lavaan 0.6-11, semTools 0.5-3, and mirt 1.33.2 were implemented.

 

Ethical considerations

Participants had to provide informed consent to take part in the study. The questionnaire administration was online and completely anonymous. There were no financial benefits for participants, but a list of free psychological services was shared with them at the end of the form. The project was approved by the Ethics Committee of the Masters and Doctoral Program in Psychology of the Universidad Nacional Autónoma de México.

 

RESULTS

Item-level descriptive statistics

Table 2 presents the descriptive statistics at the item level. As can be seen, all of them (with the exception of item 4) had means slightly above 3 (i.e., the central option of the scale). Also, it can be seen that all skewness and kurtosis values were approximately within the -1 to +1 range. The responses were distributed among the five options, with no floor or ceiling effects observed in any of the cases. As for the item-total correlations, most were above .30; the only exception was item 1, in which case this value was marginally lower.

 

 

Table 2. Item-level descriptive statistics of the ERQ-CA.

Item	M	SD	g₁	g₂	% per response option					rᵢₜ
					1	2	3	4	5
Reappraisal
1. When I want to feel happier‚ I think about something different	3.58	0.98	-0.60	-0.23	2	14	21	49	14	.29
3. When I want to feel less bad (e.g.‚ sad‚ angry or worried). I think about some other thing.	3.47	1.08	-0.46	-0.73	3	21	16	45	15	.43
5. When I’m worried about something‚ I make myself think about it in a way that helps me feel better.	3.12	1.16	-0.21	-1.00	9	25	20	36	10	.48
7. When I want to feel happier about something‚ I change the way I’m thinking about it.	3.23	1.04	-0.38	-0.62	6	20	27	40	8	.54
8. I control my feelings about things by changing the way I think about them.	3.22	0.99	-0.32	-0.72	4	23	27	41	6	.55
10. When I want to feel less bad (e.g. sad‚ angry‚ or worried) about something‚ I change the way I’m thinking about it.	3.28	1.01	-0.43	-0.61	5	20	25	43	7	.64
Suppression
2. I keep my feelings to myself.	3.26	1.22	-0.21	-1.03	8	23	20	31	17	.61
4. When I am feeling happy‚ I am careful not to show it.	2.35	1.07	0.53	-0.54	23	40	20	15	3	.37
6. I control my feelings by not showing them.	3.30	1.14	-0.23	-0.93	6	23	22	35	15	.67
9. When I’m feeling bad (e.g. sad‚ angry‚ or worried). I’m careful not to show it.	3.86	1.11	-0.87	-0.09	4	12	13	39	33	.43

Note. g₁ = skewness, g₂ = kurtosis; rᵢₜ = corrected item-total correlation.

 

 

Confirmatory factor analysis

In testing the original 10-item model, a below-desirable fit was found (CFI = .91, RMSEA = .07). The modification indices were examined and it was decided to allow for a correlation between the errors of items 1 and 3. In doing so, the fit improved markedly (CFI = .96, RMSEA = .05). However, it was noted that the factor loading of item 1 (λ₁ = .26) was relatively low compared to the other items. Therefore, it was decided to test a third model excluding this item. This last model also presented a good fit (CFI = .95, RMSEA = .06), so, for parsimony, it was selected as the final model. The detailed fit indices of each model are presented in Table 3.

 

 

Table 3. Fit indices of the confirmatory factor analyses of the ERQ-CA

Model	χ²	df	p	CFI	TLI	RMSEA	SRMR	ωreappraisal	ωsuppression
Model 1 (10 items)	99.97	34	<.001	.91	.89	.07	.06	.76	.75
Model 2 (10 items, with correlated errors of items 1 and 3)	65.63	33	.001	.96	.94	.05	.05	.73	.75
Model 3 (9 items, excluding item 1)	57.88	26	<.001	.95	.94	.06	.05	.77	.75

Note: X² = Chi-squared. df = Degrees of freedom. CFI = Comparative fit index. TLI = Tucker-Lewis inndex. RMSEA = Root mean square error of approximation. SRMR = Standardized root mean square residual. ω = omega coefficient.

 

 

Internal consistency reliability was estimated from the factor loadings of this final model (Figure 1). Adequate values were found for both the cognitive reappraisal subscale (α = .76; ω = .77) and the expressive suppression subscale (α = .73; ω = .75).

 

 

 

Figure 1. Factor structure of the final ERQ-CA model.

Note. For simplicity, error terms were not plotted.

 

 

Graded response model

A graded response model was applied to each subscale separately. In the case of the reappraisal subscale, it was found that the most discriminative item was item 10, while the least discriminative was item 3. Also, the difficulty parameters were similar for all items, with the exception of item 3, which required very low levels of the construct (approximately 4 standard deviations below the mean) to have a 50% probability of selecting the lowest response option (Table 4). For the suppression subscale, the most and least discriminative items were 6 and 4, respectively. Regarding the difficulty parameters, it was observed that item 4 required notably high levels of the construct to select the maximum response option; on the other hand, item 9 required lower levels of the construct to select the lowest response option.

 

 

Table 4. Estimated parameters of a graded response model applied to the ERQ-CA

Item	a	b₁	b₂	b₃	b₄
Reappraisal
3. When I want to feel less bad (e.g.‚ sad‚ angry or worried). I think about something different.	1.00	-3.81	-1.34	-0.45	2.06
5. When I’m worried about something‚ I make myself think about it in a way that helps me feel better.	1.56	-1.97	-0.57	0.15	1.92
7. When I want to feel happier about something‚ I change the way I’m thinking about it.	1.89	-2.12	-0.88	0.08	1.96
8. I control my feelings about things by changing the way I think about them.	1.94	-2.36	-0.83	0.11	2.11
10. When I want to feel less bad (e.g. sad‚ angry‚ or worried) about something‚ I change the way I’m thinking about it.	2.67	-2.00	-0.82	-0.01	1.77
Suppression
2. I keep my feelings to myself.	2.18	-1.81	-0.64	0.05	1.21
4. When I am feeling happy‚ I am careful not to show it.	0.92	-1.54	0.64	1.92	4.27
6. I control my feelings by not showing them.	3.31	-1.79	-0.64	0.01	1.19
9. When I’m feeling bad (e.g. sad‚ angry‚ or worried). I’m careful not to show it.	1.33	-3.03	-1.64	-0.94	0.70

Note. The discrimination (a) and difficulty (b) parameters are presented.

 

 

Integrating the discrimination and difficulty parameters, information curves were constructed, which are presented in Figure 2. As can be seen, in both subscales the greatest informative capacity was found at levels closer to the mean. In the case of the reappraisal subscale, it tended to decline at levels above or below 2 SD with respect to the mean. As for the suppression subscale, the decrease in informative capacity occurred approximately outside the range between -2 and +1.5 SD. As can be seen in Figure 2a, the most informative item of reappraisal was item 10, while the least informative was item 3. In the suppression subscale, the most informative item was item 6 and the least informative one was item 4 (Figure 2b).

 

 

 

Figure 2. Item information curves of the ERQ-CA’s subscales.

 

 

Associative evidence of validity

Regarding the cognitive reappraisal subscale, significant correlations were found with anxiety (r₍₃₉₅₎ = -.16, 95% CI [-.25, -.06], p = .002), depression (r₍₃₉₅₎ = -.18, 95% CI [-.27, -.08], p < .001), and suicidal ideation (r₍₃₉₅₎ = -.22, 95% CI [-.31, -.12], p < .001). Similarly, the expressive suppression subscale also showed significant correlations with anxiety (r₍₃₉₅₎ = .21, 95% CI [.11, .30], p < .001), depression (r₍₃₉₅₎ = .29, 95% CI [.20, .38], p < .001), and suicidal ideation (r₍₃₉₅₎ = .23, 95% CI [.14, .33], p < .001).

 

DISCUSSION

The present study examined the psychometric performance of a simplified version of the ERQ (the ERQ-CA) in an adult population. Our results show that, after eliminating one item, the proposed factor model presented a good fit and adequate reliability. Also, both subscales had a higher informative capacity at medium levels of the construct, which supports the usefulness of the ERQ-CA for assessing ER in the general adult population. Moreover, significant correlations were observed in the expected direction with three psychopathological variables: anxiety, depression, and suicidal ideation.

To the authors’ knowledge, this is the first time the ERQ-CA has been used in adults. The results of our study and those reported with the original ERQ show remarkable similarities (Olalde-Mathieu et al., 2022; Preece et al., 2021). However, the present version has the advantage of being simpler and easier to understand. Moreover, having a single simplified version would facilitate comparisons between different age groups (e.g., if the same instrument is applied to children, adolescents, and adults). At this point, it is important to highlight the usefulness of tools designed to quantify the readability of a test, such as the Fernández-Huerta index used in the present study (Ríos-Hernández, 2017). Although this approach has been widely applied in the healthcare field (e.g., Checa-Moreno et al., 2021; Coco et al., 2017), a greater use in psychometric studies is lacking.

Derived from the findings of our study, one item (item 1) had to be dropped to achieve an adequate fit, as the error of this item presented a significant covariation with the error of item 3. It is worth mentioning that such an incidence had already been observed in the original study of the ERQ-CA (Gullone & Taffe, 2012). In order to avoid this situation, we modified item 3 before data collection; however, correlated errors emerged in the data even so. Although it would have been possible to keep the correlated errors in the model, they are undesirable because they make it difficult to interpret the construct measured and may be a sign of an inadequate psychometric model (Dominguez-Lara, 2019). Therefore, it was decided to eliminate one of the two items (item 1), similar to what had already been proposed in previous research (which, however, eliminated item 3 instead of item 1; Rice et al., 2018; Spaapen et al., 2014). Other studies even suggested removing both items (items 1 and 3) to achieve a good fit (Balzarotti, 2021; Gong et al., 2021). However, we considered that this could substantially affect the content validity of the instrument.

Adding to the previous results, the graded response model showed that the items had different psychometric qualities. However, as a whole, they showed better performance at levels close to the mean for both constructs (reappraisal and suppression). This coincides with what was found in a study that applied the graded response model to the original version of the ERQ (Brandão et al., 2017). In that study, both subscales were also found to be more informative at near-average levels. Taken together, this information suggests that the ERQ-CA is most useful when applied to people with average levels of reappraisal or suppression; its quality may be lower in people who have very low or very high levels of these constructs.

Finally, the significant associations between both subscales and a set of psychopathological variables support the use of the ERQ-CA for the study of mental health in the adult population (Aldao et al., 2010; T. Hu et al., 2014). Specifically, significant correlations were hypothesized with anxiety and depression (Aldao et al., 2010; Preece et al., 2021), as well as with suicidal ideation (Forkmann et al., 2014; Ghorbani et al., 2017). These were found as expected.

 

Limitations and future directions

The present study has some limitations that deserve mention. First, the use of a convenience sample limits the generalizability of the results. Specifically, the study sample was predominantly female, young adult, and college-educated. This is also reflected in the high prevalence of anxious and depressive symptomatology, suggesting a self-selection bias of the participants. Secondly, and related to the above, the small number of male participants prevented us from performing an invariance analysis with regard to sex. This is important, as the literature suggests that there may be differences in the way men and women regulate their emotions (Nolen-Hoeksema, 2012), but an invariance test is needed before meaningful comparisons can be made between these groups (Dimitrov, 2010). Future studies should examine samples with more diverse sociodemographic characteristics, which will allow for the factor equivalence analyses necessary for valid comparisons between groups (Dimitrov, 2010). Third, our study did not include the ERQ for adults among its instruments, which would have been important for comparing the original and simplified versions of the ERQ. Finally, it should be noted that the ERQ (either the original or the simplified one) is not a diagnostic tool, but a dimensional measure that aims to provide a quantitative score of a psychological attribute. Therefore, by definition, there can be no cut-off points. Although this could be seen as a limitation (e.g., because of the absence of sensitivity and specificity values), it is rather a reflection of the theoretical concepts underlying the instrument.

 

Implications for public health

The ERQ-CA-9 test has the potential to influence public health by offering a more user-friendly and accessible method of measuring cognitive reappraisal and expressive suppression, which are believed to be linked to mental health. The test’s increased readability and simplicity could lead to more participation in research studies, especially among individuals who have been previously underrepresented due to factors such as low literacy or language barriers. The ERQ-CA-9 test could be used in studies that aim to discover how external events impact behavior through psychological means. This test could also provide valuable information for public health policies and programs focused on preventing and treating mental health disorders.

 

Conclusion

The ERQ-CA, with 9 items, is a promising alternative for measuring ER strategies in the adult population. Unlike the original version of the ERQ, it is easier to read and has similar psychometric performance. Further research should examine additional properties, such as measurement invariance, sensitivity to change, and ability to predict outcomes different from those examined in the present study.

 

ORCID

Pablo D. Valencia https://orcid.org/0000-0002-6809-1805

Anabel De la Rosa-Gómez https://orcid.org/0000-0002-3527-1500

 

CONTRIBUTION OF THE AUTHORS

Pablo D. Valencia: Conceptualization, Methodology, Formal analysis, Data Curation, Writing - Original Draft.

Anabel De la Rosa-Gómez: Conceptualization, Writing - Review & Editing, Supervision, Project administration, Resources.

 

FUNDING

This research was supported by a PhD fellowship awarded to the first author (CVU no. 1139858) by the Consejo Nacional de Ciencia y Tecnología (Conacyt).

 

CONFLICTS OF INTEREST

The authors of this study report no conflict of interest.

 

ACKNOWLEDGMENTS

The authors also wish to thank the Master's and Doctoral Program in Psychology of the Universidad Nacional Autónoma de México.

 

REVIEW PROCESS

This study has been reviewed by external peers in a double-blind mode. The editor in charge David Villarreal-Zegarra. The review process can be found as supplementary material 1.

 

DATA AVAILABILITY STATEMENT

The data that support the findings of this study are openly available in the Open Science Framework (OSF) at https://doi.org/10.17605/OSF.IO/3ADCJ.

 

DISCLAIMER

The authors are responsible for all statements made in this article.

 

REFERENCES

Aldao, A., Nolen-Hoeksema, S., & Schweizer, S. (2010). Emotion-regulation strategies across psychopathology: A meta-analytic review. Clinical Psychology Review, 30(2), 217–237. https://doi.org/10.1016/J.CPR.2009.11.004

Arrieta, J., Aguerrebere, M., Raviola, G., Flores, H., Elliott, P., Espinosa, A., Reyes, A., Ortiz‐Panozo, E., Rodriguez‐Gutierrez, E. G., Mukherjee, J., Palazuelos, D., & Franke, M. F. (2017). Validity and utility of the Patient Health Questionnaire (PHQ)‐2 and PHQ‐9 for screening and diagnosis of depression in rural Chiapas, Mexico: A cross‐sectional study. Journal of Clinical Psychology, 73(9), 1076–1090. https://doi.org/10.1002/jclp.22390

Ato, M., López-García, J. J., & Benavente, A. (2013). A classification system for research designs in psychology. Anales de Psicología / Annals of Psychology, 29(3), 1038–1059. https://doi.org/10.6018/analesps.29.3.178511

Bader, M., Jobst, L. J., Zettler, I., Hilbig, B. E., & Moshagen, M. (2021). Disentangling the effects of culture and language on measurement noninvariance in cross-cultural research: The culture, comprehension, and translation bias (CCT) procedure. Psychological Assessment, 33, 375–384. https://doi.org/10.1037/pas0000989

Balzarotti, S. (2021). The Emotion Regulation Questionnaire: Factor structure and measurement invariance in an Italian sample of community dwelling adults. Current Psychology, 40(10), 4918–4929. https://doi.org/10.1007/s12144-019-00426-3

Bauer, K., Morin, K. L., Renz, T. E., & Zungu, S. (2022). Autism assessment in low- and middle-income countries: Feasibility and usability of Western tools. Focus on Autism and Other Developmental Disabilities, 37(3), 179–188. https://doi.org/10.1177/10883576211073691

Berking, M., & Wupperman, P. (2012). Emotion regulation and mental health: Recent findings, current challenges, and future directions. Current Opinion in Psychiatry, 25(2), 128–134. https://doi.org/10.1097/YCO.0b013e3283503669

Brandão, T., Schulz, M. S., Gross, J. J., & Matos, P. M. (2017). The Emotion Regulation Questionnaire in women with cancer: A psychometric evaluation and an item response theory analysis. Psycho-Oncology, 26(10), 1647–1653. https://doi.org/10.1002/pon.4356

Cabello, R., Salguero, J. M., Fernández-Berrocal, P., & Gross, J. J. (2013). A Spanish adaptation of the Emotion Regulation Questionnaire. European Journal of Psychological Assessment, 29, 234–240. https://doi.org/10.1027/1015-5759/a000150

Checa-Moreno, V., Díaz-Mohedo, E., & Suárez-Serrano, C. (2021). Analysis of the readability of questionnaires on symptoms of pelvic floor dysfunctions adapted to Spanish. International Journal of Environmental Research and Public Health, 18(19), 10320. https://doi.org/10.3390/ijerph181910320

Cludius, B., Mennin, D., & Ehring, T. (2020). Emotion regulation as a transdiagnostic process. Emotion, 20(1), 37–42. https://doi.org/10.1037/emo0000646

Coco, L., Colina, Sonia, Atcherson, Samuel R, & Marrone, Nicole. (2017). Readability level of Spanish-language patient-reported outcome measures in audiology and otolaryngology. American Journal of Audiology, 26(3), 309–317. https://doi.org/10.1044/2017_AJA-17-0018

delValle, M. V., Andrés, M. L., Urquijo, S., Zamora, E. V., Mehta, A., & Gross, J. J. (2022). Argentinean adaptation and psychometric properties of the Emotion Regulation Questionnaire (ERQ). Psychological Reports, 125(5), 2733–2759. https://doi.org/10.1177/00332941211021343

Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2), 121–149. https://doi.org/10.1177/0748175610373459

Dominguez-Lara, S. (2019). Correlation between residuals in confirmatory factor analysis: A brief guide to their use and interpretation. Interacciones, 5(3), e207. https://doi.org/10.24016/2019.v5n3.207

Forkmann, T., Scherer, A., Böcker, M., Pawelzik, M., Gauggel, S., & Glaesmer, H. (2014). The relation of cognitive reappraisal and expressive suppression to suicidal ideation and suicidal desire. Suicide and Life-Threatening Behavior, 44(5), 524–536. https://doi.org/10.1111/sltb.12076

Furr, R. M. (2018). Psychometrics. An introduction (3rd ed.). SAGE.

Gaitán-Rossi, P., Pérez-Hernández, V., Vilar-Compte, M., & Teruel-Belismelis, G. (2021). Prevalencia mensual de trastorno de ansiedad generalizada durante la pandemia por Covid-19 en México [Monthly prevalence of generalized anxiety disorder during the Covid-19 pandemic in Mexico]. Salud Pública de México, 63(4), 478–485. https://doi.org/10.21149/12257

Ghorbani, F., Khosravani, V., Sharifi Bastan, F., & Jamaati Ardakani, R. (2017). The alexithymia, emotion regulation, emotion regulation difficulties, positive and negative affects, and suicidal risk in alcohol-dependent outpatients. Psychiatry Research, 252, 223–230. https://doi.org/10.1016/j.psychres.2017.03.005

Gong, J., Wang, M.-C., Zhang, X., Zeng, H., & Yang, W. (2021). The Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CA): Factor structure and measurement invariance in a Chinese student samples. Journal of Personality Assessment. https://doi.org/10.1080/00223891.2021.2014506

Gross, J. J. (1998). Antecedent- and response-focused emotion regulation: Divergent consequences for experience, expression, and physiology. Journal of Personality and Social Psychology, 74(1), 224–237. https://doi.org/10.1037/0022-3514.74.1.224

Gross, J. J. (2015). Emotion regulation: Current status and future prospects. Psychological Inquiry, 26(1), 1–26. https://doi.org/10.1080/1047840X.2014.940781

Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85(2), 348–362. https://doi.org/10.1037/0022-3514.85.2.348

Gullone, E., & Taffe, J. (2012). The Emotion Regulation Questionnaire for Children and Adolescents (ERQ–CA): A psychometric evaluation. Psychological Assessment, 24, 409–417. https://doi.org/10.1037/a0025777

Hamby, T., & Ickes, W. (2015). Do the readability and average item length of personality scales affect their reliability? Some meta-analytic answers. Journal of Individual Differences, 36, 54–63. https://doi.org/10.1027/1614-0001/a000154

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Hu, T., Zhang, D., Wang, J., Mistry, R., Ran, G., & Wang, X. (2014). Relation between emotion regulation and mental health: A meta-analysis review. Psychological Reports, 114(2), 341–362. https://doi.org/10.2466/03.20.PR0.114k22w4

Joormann, J., Yoon, K. L., & Siemer, M. (2010). Cognition and emotion regulation. In A. M. Kring & D. M. Sloan (Eds.), Emotion regulation and psychopathology: A transdiagnostic approach to etiology and treatment. (pp. 174–203). The Guilford Press.

Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2003). The Patient Health Questionnaire-2: Validity of a two-item depression screener. Medical Care, 41(11). https://doi.org/10.1097/01.MLR.0000093487.78664.3C

Kroenke, K., Spitzer, R. L., Williams, J. B. W., Monahan, P. O., & Löwe, B. (2007). Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Annals of Internal Medicine, 146(5), 317–325. https://doi.org/10.7326/0003-4819-146-5-200703060-00004

Martín-Albo, J., Valdivia-Salas, S., Lombas, A. S., & Jiménez, T. I. (2020). Spanish Validation of the Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CA): Introducing the ERQ-SpA. Journal of Research on Adolescence, 30(S1), 55–60. https://doi.org/10.1111/jora.12465

McHugh, R. K., & Behar, E. (2009). Readability of self-report measures of depression and anxiety. Journal of Consulting and Clinical Psychology, 77, 1100–1112. https://doi.org/10.1037/a0017124

McRae, K., & Gross, J. J. (2020). Emotion regulation. Emotion, 20(1), 1–9. https://doi.org/10.1037/emo0000703

Moreta-Herrera, R., Perdomo-Pérez, M., Vaca-Quintana, D., Sánchez-Vélez, H., Camacho-Bonilla, P., Vásquez de la Bandera, F., Dominguez-Lara, S., & Caycho-Rodríguez, T. (2022). New psychometric evidence of a bifactor structure of the Emotional Regulation Questionnaire (ERQ) in Ecuadorian college students. Psychology in Russia: State of the Art, 15(1), 120–134. https://doi.org/10.11621/pir.2022.0108

Nolen-Hoeksema, S. (2012). Emotion regulation and psychopathology: The role of gender. Annual Review of Clinical Psychology, 8, 61–87. https://doi.org/10.1146/annurev-clinpsy-032511-143109

Olalde-Mathieu, V. E., Licea-Haquet, G., Reyes-Aguilar, A., & Barrios, F. A. (2022). Psychometric properties of the Emotion Regulation Questionnaire in a Mexican sample and their correlation with empathy and alexithymia. Cogent Psychology, 9(1), 2053385. https://doi.org/10.1080/23311908.2022.2053385

Pastor, M. C., López-Penadés, R., Cifre, E., & Moliner-Urdiales, D. (2019). The Spanish version of the Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CA): A psychometric evaluation in early adolescence. The Spanish Journal of Psychology, 22, E30. Cambridge Core. https://doi.org/10.1017/sjp.2019.30

Preece, D. A., Becerra, R., Hasking, P., McEvoy, P. M., Boyes, M., Sauer-Zavala, S., Chen, W., & Gross, J. J. (2021). The Emotion Regulation Questionnaire: Psychometric properties and relations with affective symptoms in a United States general community sample. Journal of Affective Disorders, 284, 27–30. https://doi.org/10.1016/j.jad.2021.01.071

Rhemtulla, M., Brosseau-Liard, P. E., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. https://doi.org/10.1037/a0029315

Rice, S. M., Treebe, M. S., Gersh, E., Ogrodniczuk, J. S., & Kealy, D. (2018). The Emotion Regulation Questionnaire: ERQ-9 factor structure and measurement invariance in Australian and Canadian community samples. TPM - Testing, Psychometrics, Methodology in Applied Psychology, 25(3), 369–377. https://doi.org/10.4473/TPM25.3.3

Ríos-Hernández, I. N. (2017). Un acercamiento a la legibilidad de textos relacionados con el campo de la salud [An approach to the readability of healthcare-related texts]. Chasqui. Revista Latinoamericana de Comunicación, 135, 253–273. https://doi.org/10.16921/chasqui.v0i135.2892

Rodríguez-Carvajal, R., Moreno-Jiménez, B., & Garrosa, E. (2006). Cuestionario de Regulación Emocional. Versión española. Autorizado por los autores de la versión original en inglés [Emotion Regulation Questionnaire. Spanish version. Authorized by the authors of the original English version]. Universidad Autónoma de Madrid.

Salters-Pedneault, K., Steenkamp, M., & Litz, B. T. (2010). Suppression. In A. M. Kring & D. M. Sloan (Eds.), Emotion regulation and psychopathology: A transdiagnostic approach to etiology and treatment. (pp. 137–156). The Guilford Press.

Samejima, F. (2016). Graded response models. In W. J. van der Linden (Ed.), Handbook of item response theory (pp. 123–136). Chapman and Hall/CRC. https://doi.org/10.1201/9781315374512-16

Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268–274. https://doi.org/10.1111/j.1365-2753.2010.01434.x

Spaapen, D. L., Waters, F., Brummer, L., Stopa, L., & Bucks, R. S. (2014). The Emotion Regulation Questionnaire: Validation of the ERQ-9 in two community samples. Psychological Assessment, 26, 46–54. https://doi.org/10.1037/a0034474

Weiss, B. D. (2007). Health literacy and patient safety: Help patients understand. Manual for clinicians (2nd ed.). American Medical Association Foundation.