Validity and validation in educational and psychological testing: Theory and recommendations Validez y Validación para Pruebas Educativas y Psicológicas: Teoría y Recomendaciones

Abstract

Background: Validity is one of most fundamental concepts in the context of educational and psychological testing and refers to the degree to which interpretations of test scores that are used for a particular purpose are supported by both theory and empirical evidence. In this paper, we discuss validity as it pertains to educational and psychological testing. We also trace the history of validity theory, focusing on its evolution and discuss how to validate the use of a test for a particular purpose. Method: We draw heavily from the Standards for Educational and Psychological Testing, which are developed by the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education, to provide a framework for test validation. We also provide a brief description of argument-based validation and its components and outline the challenges associated with the operationalization of the validation process from an argumentation perspective. Results: Five sources of validity evidence are proposed for the validation of test scores: test content, response processes, internal structure, relations to other variables, and consequences of testing. Conclusion: Following the Standards, validity evidence can be gathered to support the interpretation and uses of test scores for a specific purpose, thus promoting sound testing practices that can help reduce the negative consequences of high-stakes test use.