The Construction and Validation of a Test for Measuring Critical Thinking of Students: Using Item-Response Theory (IRT)

Document Type : Research Paper

Authors

Abstract

This study aimed to build and validate the Critical Thinking Scale using item-response theory. For this purpose, a sample size (n=7478) was selected from Qom and Sheikh Mofid university students and the questionnaire was implemented with their cooperation. Three-parameter model was detected more suitable among various IRT models. Data was analyzed through three-parameter logistic model. Exploratory factor analysis was applied to evaluate the theory’s assumptions (one-dimensional and local independence). Factor analysis’s results confirmed the existence of a dominant factor and local independence. Item Information Function was used to evaluate the propriety of questions. Item Information Function examination showed that some of questions had very little information or the information function was not distributed over ability range. The rest of the item parameters were estimated again after removing inappropriate items. New estimations showed that the range of Discriminant Coefficient was .133 to 1.899 and difficulty coefficient -.990 to 2.780. In addition, coefficient conjecture was .0 to .0790. Eventually, the results showed that the Critical Thinking Scale with 7 components and 29 items has desirable properties to measure the structure.

Keywords

References

Ali pour, V., Seifnaraghi, M., Naderi, E., & Shariatmadari, A. (2013). Reflection on the barriers to critical thinking in the curriculum of secondary education. Curriculum Planning, 9 (2), 1-15. {Persian}.Bailin, S. (2002). Critical thinking and science education. Science & Education, 11(4), 361–375.
Bailin, S., Case, R., Coombs, J. R., & Daniels, L. B. (1999). Conceptualizing critical thinking. Journal of Curriculum Studies, 31(3), 285–302.
 Case, R. (2005). Moving critical thinking to the main stage. Education Canada, 45(2), 45–49.
Cattell. R. B. (1966). Handbook of Multivariate Experimental Psychology. Chicago: Rand McNally.
Cottrell, S. (2005). Critical Thinking Skills: Developing Effective Analysis and Argument. Basingstoke. Palgrave Macmillan.
DeMars, C. (2010). Item Response Theory. New York: Oxford University Press.
 Ennis, R. H. (1985). A logical basis for measuring critical thinking skills. Educational Leadership, 43(2), 44–48.
 Facione, P. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. Millbrae, CA: The California Academic Press.
Facione, P. (2000). The disposition toward critical thinking: Its character, measurement, and relation to critical thinking skill. Informal Logic, 20(1), 61–84.
Falsafinejad, M.R. (2010). Fundation of Item-Response Theory. Tehran: Allameh tabatabaei press. {Persian
Hale, E.S. (2008). Project demonstrating excellence. A Critical Analysis of Richard Paul's Substantive Trans-disciplinary Conception of Critical Thinking. Submitted in partial fulfillment of the Requirements for the Degree of Doctor of Philosophy in Interdisciplinary Studies. Union Institute & University, Cincinnati, OHIO.
Halpern, D. F. (1998). Teaching critical thinking for transfer across domains: Dispositions, skills, structure training, and metacognitive monitoring. American Psychologist, 53(4), 449–455.
Hooman, HA (1992). Psychological and educational measurement (test preparation technique). Tehran: Entesharateh-Dorsa. {Persian.
Khalili, H., & Soleimani, M. (2003). Determining the trust, credibility and norm scores of the California Critical Thinking Skills Test-Form B (TSTCC-B). Journal of Babol University of Medical Sciences, 2, 84-90, {Persian}.
Lewis, A., & Smith, D. (1993). Defining higher order thinking. Theory into Practice, 32(3), 131–137.
Linden, W. J., & Hambleton, R. K. (1997). Handbook of modern item response theory. Springer, New York.
Lipman, M. (1988). Critical thinking-What can it be? Educational Leadership, 46(1), 38–43.
Loehlin, J. C. (1987). Latent variable models: An introduction to factor, path, and structural analysis. Hillsdale, NJ: Erlbaum.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison Wesley, Reading, MA.
McPeck, J. E. (1990). Critical thinking and subject specificity: A reply to Ennis. Educational Researcher, 19(4), 10–12.
Moatari, M., Abedi, HA., Amini., & Fathi-Azar, A. (2001). the impact of Rethinking on critical thinking skills of nursing students in Tabriz city. Iranian Journal of Medical Education, 4, 55-60. {Persian.
Paul, R. W. (1992). Critical thinking: What, why, and how? New Directions for Community Colleges, 1992(77), 3–24.
Rasch, G.(1960). Probabilistic models for some intelligence and attainment tests. Danish Institute for Educational Research, Copenhagen, Denmark.
Samejima, F. (1977). A use of the information function in taitored testing. Applied Psychological Measurement, 1, 233-347.
 Shariatmadari, A. (2006). The principles of education, Isfahan: Entezarateh Mashaal. {Persian}.
Sternberg, R. J. (1986). Critical thinking: Its nature, measurement, and improvement National Institute of Education.
 Thayer-Bacon, B. J. (2000). Transforming critical thinking: Thinking constructively. New York, NY: Teachers College Press.
 Tindal, G., & Nolet, V. (1995). Curriculum-based measurement in middle and high schools: Critical thinking skills in content areas. Focus on Exceptional Children, 27(7), 1–22.
Vander Linden, W. J. (2016). Handbook of Item Response Theory, Volume Two: Statistical Tools. Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences: CRC Press.
 Willingham, D. T. (2007). Critical thinking: Why is it so hard to teach? American Educator, 8–19.
Worrell JA., & Profetto-McGrath, J. (2007). Critical thinking as an outcome of context-based learning among post RN students: A literature review. Nurse Education Today; 27:420–426.
Zori, S., Nosek, J. L., & Musil, C. M. (2010). Critical Thinking of Nurse Managers Related to Staff RNs’ Perceptions of the Practice Environment. Journal of Nursing Scholarship, 42(3), 305–313.
Journal of Applied Psychological Research
Volume 7, Issue 4
March 2017
Pages 219-231

Files

Share

How to cite

Statistics