ساخت و رواسازی آزمون تفکر انتقادی: کاربرد نظریه سؤال-پاسخ

نوع مقاله : مقاله پژوهشی

نویسندگان

1 دانشجوی دکتری سنجش آموزش دانشگاه تهران

2 عضو هیئت علمی جامعه المصطفی العالمیه

3 استادیار دانشگاه تهران

چکیده

مطالعه حاضر با هدف ساخت و رواسازی آزمون تفکر انتقادی با استفاده از نظریه سؤال ـ پاسخ انجام گرفت. بدین‌منظور از بین دانشجویان دانشگاه‌های قم و شیخ مفید، یک نمونه به اندازه (478=n) انتخاب، و پرسشنامه موردنظر با همکاری آن­ها اجرا شد. از بین مدل‌های مختلف در نظریه سوال ـ پاسخ، مدل سه پارامتری مناسب تشخیص داده ‌شد. داده‌ها با کاربرد مدل لوجستیک سه ‌پارامتری تحلیل ‌شد. به‌منظور بررسی مفروضه‌های این نظریه (تک‌بعدی بودن و استقلال موضعی) از تحلیل عاملی اکتشافی استفاده شد. نتایج تحلیل عاملی وجود یک عامل غالب و استقلال موضعی سؤالات را تائید کرد. به‌منظور بررسی مناسب بودن سؤالات از تابع آگاهی سؤالات استفاده شد. بررسی توابع آگاهی سؤالات نشان داد برخی از سؤالات دارای آگاهی بسیار کمی بوده و یا تابع آگاهی در طول بازه توانایی گسترده نشده است. پس از حذف سؤالات نامناسب، پارامترهای سؤالات باقی‌مانده دوباره برآورد شد. برآوردهای جدید نشان داد دامنه ضریب تشخیص بین 113/0 تا 899/1 و ضریب دشواری بین 990/0- تا 780/2 است. همچنین ضریب حدس نیز در دامنه بین 000/0 تا 790/0 قرار دارد. به­طور کلی، می‌توان گفت پرسشنامه تفکر انتقادی با 7 مؤلفه و 29 سوال، دارای ویژگی‌های مطلوب برای سنجش سازه مذکور می‌باشد.

کلیدواژه‌ها


عنوان مقاله [English]

The Construction and Validation of a Test for Measuring Critical Thinking of Students: Using Item-Response Theory (IRT)

نویسندگان [English]

  • Hasan Taghian 1 2
  • Ali Moghadamzadeh 3
  • Keyvan Salehi 3
چکیده [English]

This study aimed to build and validate the Critical Thinking Scale using item-response theory. For this purpose, a sample size (n=7478) was selected from Qom and Sheikh Mofid university students and the questionnaire was implemented with their cooperation. Three-parameter model was detected more suitable among various IRT models. Data was analyzed through three-parameter logistic model. Exploratory factor analysis was applied to evaluate the theory’s assumptions (one-dimensional and local independence). Factor analysis’s results confirmed the existence of a dominant factor and local independence. Item Information Function was used to evaluate the propriety of questions. Item Information Function examination showed that some of questions had very little information or the information function was not distributed over ability range. The rest of the item parameters were estimated again after removing inappropriate items. New estimations showed that the range of Discriminant Coefficient was .133 to 1.899 and difficulty coefficient -.990 to 2.780. In addition, coefficient conjecture was .0 to .0790. Eventually, the results showed that the Critical Thinking Scale with 7 components and 29 items has desirable properties to measure the structure.

کلیدواژه‌ها [English]

  • critical thinking
  • test
  • item-response theory (IRT)
  • three-parameter logistic model
Ali pour, V., Seifnaraghi, M., Naderi, E., & Shariatmadari, A. (2013). Reflection on the barriers to critical thinking in the curriculum of secondary education. Curriculum Planning, 9 (2), 1-15. {Persian}.Bailin, S. (2002). Critical thinking and science education. Science & Education, 11(4), 361–375.
Bailin, S., Case, R., Coombs, J. R., & Daniels, L. B. (1999). Conceptualizing critical thinking. Journal of Curriculum Studies, 31(3), 285–302.
 Case, R. (2005). Moving critical thinking to the main stage. Education Canada, 45(2), 45–49.
Cattell. R. B. (1966). Handbook of Multivariate Experimental Psychology. Chicago: Rand McNally.
Cottrell, S. (2005). Critical Thinking Skills: Developing Effective Analysis and Argument. Basingstoke. Palgrave Macmillan.
DeMars, C. (2010). Item Response Theory. New York: Oxford University Press.
 Ennis, R. H. (1985). A logical basis for measuring critical thinking skills. Educational Leadership, 43(2), 44–48.
 Facione, P. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. Millbrae, CA: The California Academic Press.
Facione, P. (2000). The disposition toward critical thinking: Its character, measurement, and relation to critical thinking skill. Informal Logic, 20(1), 61–84.
Falsafinejad, M.R. (2010). Fundation of Item-Response Theory. Tehran: Allameh tabatabaei press. {Persian
Hale, E.S. (2008). Project demonstrating excellence. A Critical Analysis of Richard Paul's Substantive Trans-disciplinary Conception of Critical Thinking. Submitted in partial fulfillment of the Requirements for the Degree of Doctor of Philosophy in Interdisciplinary Studies. Union Institute & University, Cincinnati, OHIO.
Halpern, D. F. (1998). Teaching critical thinking for transfer across domains: Dispositions, skills, structure training, and metacognitive monitoring. American Psychologist, 53(4), 449–455.
Hooman, HA (1992). Psychological and educational measurement (test preparation technique). Tehran: Entesharateh-Dorsa. {Persian.
Khalili, H., & Soleimani, M. (2003). Determining the trust, credibility and norm scores of the California Critical Thinking Skills Test-Form B (TSTCC-B). Journal of Babol University of Medical Sciences, 2, 84-90, {Persian}.
Lewis, A., & Smith, D. (1993). Defining higher order thinking. Theory into Practice, 32(3), 131–137.
Linden, W. J., & Hambleton, R. K. (1997). Handbook of modern item response theory. Springer, New York.
Lipman, M. (1988). Critical thinking-What can it be? Educational Leadership, 46(1), 38–43.
Loehlin, J. C. (1987). Latent variable models: An introduction to factor, path, and structural analysis. Hillsdale, NJ: Erlbaum.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison Wesley, Reading, MA.
McPeck, J. E. (1990). Critical thinking and subject specificity: A reply to Ennis. Educational Researcher, 19(4), 10–12.
Moatari, M., Abedi, HA., Amini., & Fathi-Azar, A. (2001). the impact of Rethinking on critical thinking skills of nursing students in Tabriz city. Iranian Journal of Medical Education, 4, 55-60. {Persian.
Paul, R. W. (1992). Critical thinking: What, why, and how? New Directions for Community Colleges, 1992(77), 3–24.
Rasch, G.(1960). Probabilistic models for some intelligence and attainment tests. Danish Institute for Educational Research, Copenhagen, Denmark.
Samejima, F. (1977). A use of the information function in taitored testing. Applied Psychological Measurement, 1, 233-347.
 Shariatmadari, A. (2006). The principles of education, Isfahan: Entezarateh Mashaal. {Persian}.
Sternberg, R. J. (1986). Critical thinking: Its nature, measurement, and improvement National Institute of Education.
 Thayer-Bacon, B. J. (2000). Transforming critical thinking: Thinking constructively. New York, NY: Teachers College Press.
 Tindal, G., & Nolet, V. (1995). Curriculum-based measurement in middle and high schools: Critical thinking skills in content areas. Focus on Exceptional Children, 27(7), 1–22.
Vander Linden, W. J. (2016). Handbook of Item Response Theory, Volume Two: Statistical Tools. Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences: CRC Press.
 Willingham, D. T. (2007). Critical thinking: Why is it so hard to teach? American Educator, 8–19.
Worrell JA., & Profetto-McGrath, J. (2007). Critical thinking as an outcome of context-based learning among post RN students: A literature review. Nurse Education Today; 27:420–426.
Zori, S., Nosek, J. L., & Musil, C. M. (2010). Critical Thinking of Nurse Managers Related to Staff RNs’ Perceptions of the Practice Environment. Journal of Nursing Scholarship, 42(3), 305–313.