Evaluation of careless or insufficient effort responses given to scales


Uzunoglu A., ERCAN İ.

Communications in Statistics: Simulation and Computation, 2025 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2025
  • Doi Numarası: 10.1080/03610918.2025.2524544
  • Dergi Adı: Communications in Statistics: Simulation and Computation
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Business Source Elite, Business Source Premier, CAB Abstracts, Compendex, Computer & Applied Sciences, Veterinary Science Database, zbMATH, Civil Engineering Abstracts
  • Anahtar Kelimeler: Careless responding, Cattell’s sabotage index, FIC score, Insufficient effort responding, MFIC score
  • Bursa Uludağ Üniversitesi Adresli: Evet

Özet

Scales are commonly administered to participants in various studies, including those in psychology, sociology, and medicine; however, obtaining accurate results from these applied scales is often challenging due to participants typically providing careless or insufficient effort responses. In this study, Cattell’s sabotage index and the modified fixed individualized chance (MFIC) score will be used to assess the effectiveness of these indices in identifying careless or insufficient effort responses, using data obtained through simulation. The purpose of the simulation study is to compare the performance of these indices based on metrics such as root mean square error (RMSE) and bias (BIAS). These comparisons will be conducted under varying conditions, taking into account factors such as scale type, the number of items, the number of reversed items, and sample size. The study aims to determine how these factors influence the occurrence of careless or insufficient effort responding across different scenarios. Cattell’s sabotage index outperforms the modified fixed individualized chance (MFIC) score in identifying careless or insufficient effort responses. For Cattell’s sabotage index, high performance is observed in large samples at a careless and insufficient effort response rate of 0.30.