نوع مقاله : مقاله پژوهشی

نویسندگان

1 استادیار گروه روان‌شناسی و آموزش کودکان استثنایی، دانشگاه علامه طباطبائی، تهران، ایران.

2 استادیار گروه روان‌شناسی، دانشگاه شهید مدنی آذربایجان، تبریز، ایران.

3 دانشجوی دکتری سنجش و اندازه‌گیری، دانشگاه علامه طباطبائی، تهران، ایران.

10.22054/jpe.2023.73990.2579

چکیده

پژوهش حاضر باهدف بررسی ویژگی­های روان‌سنجی مقیاس درجه‌بندی رفتاری کارکردهای اجرایی - ویراست دوم در دانش‌آموزان با مشکلات رفتاری برون‌نمود انجام شد. روش پژوهش حاضر توصیفی از نوع مطالعات همبستگی- هنجاریابی بود. جامعه آماری پژوهش حاضر را تمامی دانش­آموزان پسر با مشکلات رفتاری برون‌نمود 7 تا 12 ساله استان تهران و استان آذربایجان شرقی تشکیل می‌دادند که در سال تحصیلی 1401-1400 مشغول به تحصیل بودند. برای انتخاب نمونه ابتدا دانش‌آموزان با مشکلات رفتاری برون‌نمود شناسایی شدند. سپس والدین آن‌ها فرم والد مقیاس درجه‌بندی رفتاری کارکردهای اجرایی - ویراست دوم و پرسشنامه عصب- روان‌شناختی کولیج (2002) را تکمیل کردند که درنهایت تحلیل با 599 نفر انجام شد. برای تجزیه‌وتحلیل داده‌ها ضریب آلفای کرونباخ، تحلیل عاملی تأییدی و روایی ملاکی به کارگرفته شد. نتایج نشان داد که مقیاس درجه‌بندی رفتاری کارکردهای اجرایی - ویراست دوم از پایایی و روایی مناسبی برخوردار است؛ بنابراین، می‌توان از این مقیاس جهت ارزیابی کارکردهای اجرایی در دانش‌آموزان با مشکلات رفتاری برون‌نمود استفاده کرد.

کلیدواژه‌ها

عنوان مقاله [English]

Psychometric Properties of the Behavior Rating Inventory of Executive Function, Second Edition in Students with Externalizing Behavior Problems

نویسندگان [English]

  • Asgar Alimohamadi 1
  • karim abdolmohamadi 2
  • Abolfazl Gadami 3

1 Assistant Professor, Department of Psychology and Education of Exceptional Children, Allameh Tabataba’i University, Tehran, Iran.

2 Assistant Professor, Department of Psychology, Azarbaijan Shahid Madani University, Tabriz, Iran.

3 PhD student in Assessment and Measurement, Allameh Tabataba’I University, Tehran, Iran.

چکیده [English]

Abstract
The present study was conducted investigating the psychometric properties of the Behavioral Rating Inventory of Executive Functions - Second Edition (BRIEF-2) in students with externalizing behavior problems. The method was based on correlation research. The statistical population consisted of all male students with behavioral problems between the ages 7 and 12 in East Azarbayejan province who were studying in the academic year 2021-2022. To select the sample, first, students with externalizing behavior problems were identified. Then their parents completed the parent form of Behavioral Rating Inventory of Executive Functions - Second Edition (BRIEF-2) and Coolidge's Neuropsychological Questionnaire (2002). The data was analyzed with 599 people. Cronbach's alpha coefficient, confirmatory factor analysis, and criterion validity were used to analyze the data. The results showed that the behavioral rating inventory of executive functions - second edition (BRIEF-2) has good reliability and validity. Therefore, this scale can be used to evaluate executive functions in students with externalizing behavior problems.
Keywords: psychometric properties, behavior rating inventory of executive function, externalizing behavioral problems.
 
 
Extended Abstract

Introduction

Externalizing problems such as disruptive behavior, aggression, and breaking rules can be a significant public health issue. These symptoms can have serious consequences for individuals, including dealing with disruptive behavior, feeling insecure or victimized, and incurring economic costs for prevention, treatment, and trials (Constanty et al., 2021). When evaluating children with externalizing behavior problems, it's important to assess their executive functions. Executive functions refer to the cognitive processes that are involved in regulating behavior, such as attention, working memory, and self-control. There is a relationship between executive functions and externalizing behavior problems, which means that how well a child can regulate their behavior is linked to their cognitive abilities. By assessing executive functions, we can better understand the cognitive and behavioral factors that contribute to externalizing behavior problems in children. The Behavior Rating Inventory of Executive Function, Second Edition (BRIEF-2) is currently the most widely used tool for measuring executive functions in children (Pino Muñoz et al., 2021; Parhoon et al., 2022). While BRIEF-2 is a comprehensive tool for assessing executive functions in children, its psychometric features have not been fully examined in children with externalizing behavior problems. The current research aims to answer the question of whether the psychometric characteristics of the BRIEF-2 parent form are appropriate for use in assessing executive functions in students with externalizing behavior problems.
Research Question
Are the psychometric characteristics of the BRIEF-2 parent form suitable for assessing executive functions in students with externalizing behavior problems?

Literature Review

Anastasiadis (2023) conducted a study to examine the clinical usefulness of the BRIEF-2 and its associated scales in differentiating between pediatric ADHD presentations and comorbidity. The study used archival data from 211 children between the ages of 5 and 12 who were seen at a university-based ADHD Evaluation Clinic. Ratings from parents and teachers were analyzed separately. The results of the study were consistent with predictions, showing that the Emotional Regulation Index (ERI) was highest in the combined presentation of ADHD. Parhoon et al., (2021) conducted a study to examine the psychometric properties of the Persian version of BRIEF-2 parent-form in children between the ages of six and 12 years. The study used confirmatory factor analysis to analyze the internal structure of the BRIEF-2. The results showed that the model with three indexes (Behavioral, Emotional, and Cognitive) and nine scales (Inhibit, Shift, Self-Monitor, Emotional Control, Initiate, Working Memory, Plan/Organize, Organization of Materials, and Task-Monitor) had a good fit. Jiménez & Lucas-Molina (2019) conducted a study to examine two aspects of BRIEF-2 in a sample of primary school-aged children. The results of the study showed that the confirmatory factor analysis of BRIEF-2 revealed a good fit for the sample. The model with three indexes (Behavioral, Emotional, and Cognitive) and nine scales (Inhibit, Shift, Self-Monitor, Emotional Control, Initiate, Working Memory, Plan/Organize, Organization of Materials, and Task-Monitor) was found to be an appropriate fit for the data.

Methodology

The current research used a descriptive correlational-normative study method. The statistical population for this study included all male students between the ages of 7 and 12 years old who had behavioral problems and were studying in East Azarbaijan province during the academic year of 2021-2022. The final analysis of the current research included data from 599 questionnaires. The researchers used three different tools to collect data: The Child Behavior Checklist (CBCL), the Behavioral Rating Scale of Executive Functions - Second Edition (BRIEF-2), and the Coolidge Neuropsychological Questionnaire. The researchers used two different software programs, SPSS and Lisrel, to examine the psychometric properties of the BRIEF-2.

Results

The results of the confirmatory factor analysis of BRIEF-2 in Table 1 and Figure 2 showed that all fit indices, including the square root of the mean error of approximation (RMSEA), were within the desired range. This indicates that the model used in the questionnaire data is an appropriate fit for the data.
Table 1. All fit indices of BRIEF-2 confirmatory factor analysis.




Fitness indices


Values




RMSEA


0.098




NFI


0.96




NNFI


0.95




CFI


0.97




GFI


0.94




AGFI


0.89




 
            Fig. 1. Estimation of standardized coefficients
 

Discussion

 The results of the study showed that the BRIEF-2 has good reliability, as indicated by the examination of Cronbach's alpha coefficients and internal consistency. Additionally, the confirmatory factor analysis confirmed the three-factor model of the scale and its nine components. This suggests that the three-factor structure of the BRIEF-2 is desirable and acceptable in the studied population of school-aged children with externalizing behavioral problems. This finding is in line with the research results of Parhoon et al. (2022), Parhoon et al. (2021), Anastasiadis (2023) and Jiménez & Lucas-Molina (2019).
One limitation of this study is that the statistical population was limited to primary school-aged male students with externalizing behavioral problems. Therefore, caution should be taken when generalizing the results to other groups of children. Additionally, the data used in this study was limited to participants from East Azarbaijan province. This means that the results may not be representative of other regions or populations. Besides all limitations, it is suggested that the BRIEF-2 be used as an evaluation and diagnostic tool for assessing executive functions in primary school-aged students with externalizing behavior problems.

Conclusion

The results of this study suggest that children with high levels of behavioral problems may experience more difficulties with executive functions, which can negatively impact their emotional and motivational abilities. Based on the desirable psychometric properties of the BRIEF-2 and its appropriate criterion validity, it can be used as a tool to evaluate the executive functions of primary school-aged students with externalizing behavior problems.
Acknowledgments
The researchers express their sincere gratitude and appreciation to all the participants who contributed to the implementation of this research. Without their participation, this study would not have been possible.

کلیدواژه‌ها [English]

  • psychometric properties
  • behavior rating inventory of executive function
  • externalizing behavioral problems.  

Alizadeh, H., & Zahedipour, M. (2004). Executive functions in children with and without developmental coordination disorder. Advances in Cognitive Science, 6(3), 49-56.

Minaee, A. (2006). Adaptation and standardization of child behavior checklist, youth self-report, and teacher’s report forms. Journal of exceptional children, 6(1), 529-558.

Minaei, A. (2005). Handbook of Achenbach Child Behavior Checklist (CBCL), Tehran: Exceptional Children Research Institute Publications.

parhoon, K., parhoon, H., Moradi, A., & Hassanabadi, H. (2021). Psychometric Properties of the Behavior Rating Inventory of Executive Function, Second Edition (BRIEF2) in Students aged 13 to 18 years. Quarterly of Educational Measurement, 12(45), 165-186.

 

منابع
مینایی، اصغر. (1385). انطباق و هنجاریابی سیاهه‌ رفتاری کودک آخنباخ، پرسشنامه خودسنجی و فرم گزارش معلم. فصلنامه کودکان استثنایی؛ ۶ (۱): ۵۵۸-۵۲۹.
مینایی، اصغر. (1384). کتابچه راهنمای فرم‌های سن مدرسه نظام سنجش مبتنی بر تجربه آخنباخ (CBCL)، تهران: انتشارات پژوهشکده کودکان استثنایی.
علیزاده، حمید و زاهدی پور، مهدی. (1383). کارکردهای اجرایی در کودکان با و بدون اختلال هماهنگی رشدی. تازه‌های علوم شناختی؛ ۶ (۳ و ۴)، ۵۶-۴۹.
پرهون، کمال.، پرهون، هادی.، مرادی، علیرضا؛ و حسن‌آبادی، حمیدرضا. (1400). ویژگی‌های روان‌سنجی مقیاس درجه‌بندی رفتاری کارکردهای اجرایی–ویراست دوم در دانش‌آموزان 13 تا 18 سال. مجله اندازه‌گیری تربیتی، 12 (45).
References
Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-18 and 1991 profile. University of Vermont, Department of Psychiatry.
Achenbach, T. M. (2001). Manual for ASEBA school-age forms & profiles. University of Vermont, Research Center for Children, Youth & Families.
Anastasiadis, W. A. (2023). The Clinical Utility of the Brief-2 Emotional Regulation Index (ERI) in Predicting Psychiatric Disorders Comorbid with Pediatric Adhd (Doctoral dissertation, Indiana State University).
Best, J. R., & Miller, P. H. (2010). A developmental perspective on executive function. Child development81(6), 1641-1660.
Bradley, R., Doolittle, J., & Bartolotta, R. (2008). Building on the data and adding to the discussion: The experiences and outcomes of students with emotional disturbance. Journal of Behavioral Education, 17(1), 4-23.‏
Constanty, L., Lepage, C., Rosselet Amoussou, J., Wouters, E., Decoro, V., De-Paz, L., ... & Urben, S. (2021). Non-pharmaceutical interventions for self-regulatory failures in adolescents suffering from externalizing symptoms: a scoping review. Biomedicines, 9(9), 1081.
Forms, M., Abad, J., & Kirchner, T. (2011). Internalizing and externalizing problems. In R. J. R. Levesque (Ed.), Encyclopedia of adolescence (pp. 1464–1489). New York, NY: Springer.
Gage, N. A. (2013). Characteristics of students with emotional disturbance manifesting internalizing behaviors: A latent class analysis. Education and Treatment of Children, 36(4), 127–145.
Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000). Test review behavior rating inventory of executive function. Child Neuropsychology6(3), 235-238.
Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2015). BRIEF-2, Behavior Rating Inventory of Executive Function (2nd Ed.). Psychological Assessment Resources, Inc.
Hendrickson, N. K., & McCrimmon, A. W. (2019). Test review: Behavior rating inventory of executive function, (BRIEF- 2), Canadian Journal of School Psychology; 34(1) 73–78.
Husky, M. M., Boyd, A., Bitfoi, A., Carta, M. G., Chan-Chee, C., Goelitz, D., ... & Kovess-Masfety, V. (2018). Self-reported mental health in children ages 6–12 years across eight European countries. European child & adolescent psychiatry27(6), 785-795.
Isquith, P. K., Roth, R. M., & Gioia, G. (2013). Contribution of rating scales to the assessment of executive functions. Applied Neuropsychology: Child2(2), 125-132.
Jiménez, A., & Lucas-Molina, B. (2019). Dimensional structure and measurement invariance of the BRIEF-2 across gender in a socially vulnerable sample of primary school-aged children. Child Neuropsychology25(5), 636-647.
Kulkarni, T., Sullivan, A. L., & Kim, J. (2021). Externalizing behavior problems and low academic achievement: Does a causal relation exist? Educational Psychology Review, 33, 915-936.
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive psychology, 41(1), 49-100.
Nigg, J. T. (2017). On the relations among self-regulation, self-control, executive functioning, effortful control, cognitive control, impulsivity, risk-taking, and inhibition for developmental psychopathology. Journal of Child Psychology and Psychiatry58(4), 361-383.
Parhoon, K., Moradi, A., Alizadeh, H., Parhoon, H., Sadaphal, D. P., & Coolidge, F. L. (2022). Psychometric properties of the behavior rating inventory of executive function, (BRIEF2) in a sample of children with ADHD in Iran. Child Neuropsychology28(4), 427-436.
Pino Muñoz, M., & Arán Filippetti, V. (2021). Confirmatory factor analysis of the BRIEF-2 parent and teacher form: Relationship to performance-based measures of executive functions and academic achievement. Applied Neuropsychology: Child10(3), 219-233.
Pinsonneault, M., Parent, S., Castellanos-Ryan, N., & Séguin, J. R. (2016). Low intelligence and poor executive function as vulnerabilities to externalizing behavior. In En Beauchaine, T. P., S. P. Hinshaw (Ed.), Oxford library of psychology. The oxford handbook of externalizing spectrum disorders USA: Oxford University Press.
Roth, R. M., Isquith, P. K., & Gioia, G. A. (2014). Assessment of executive functioning using the Behavior Rating Inventory of Executive Function (BRIEF). In Handbook of executive functioning (pp. 301-331). Springer, New York, NY. ‏
Schoemaker, K., Mulder, H., Deković, M., & Matthys, W. (2013). Executive functions in preschool children with externalizing behavior problems: A meta-analysis. Journal of abnormal child psychology, 41(3), 457-471. ‏
Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: Do performance‐based measures and ratings of executive function assess the same construct? Journal of child psychology and psychiatry, 54(2), 131-143. ‏
Williamson, A. A., Zendarski, N., Lange, K., Quach, J., Molloy, C., Clifford, S. A., & Mulraney, M. (2021). Sleep problems, internalizing and externalizing symptoms, and domains of health-related quality of life: bidirectional associations from early childhood to early adolescence. Sleep, 44(1), zsaa139.
Willner, C. J., Gatzke-Kopp, L. M., & Bray, B. C. (2016). The dynamics of internalizing and externalizing comorbidity across the early school years. Development and psychopathology28(4pt1), 1033-1052.
Woltering, S., Lishak, V., Hodgson, N., Granic, I., & Zelazo, P. D. (2016). Executive function in children with externalizing and comorbid internalizing behavior problems. Journal of Child Psychology and Psychiatry57(1), 30-38.
Yeh, K. H., & Yang, Y. J. (2006). Construct validation of individuating and relating autonomy orientations in culturally Chinese adolescents. Asian Journal of Social Psychology, 9(2), 148-160. ‏
Zelazo, P. D., Blair, C. B., & Willoughby, M. T. (2016). Executive Function: Implications for Education. NCER 2017-2000. National Center for Education Research.