David J Weiss

Photo of David J Weiss

Contact Me

djweiss@umn.edu
612-625-0342

Psychology
N660 Elt H

75 E River Rd

Affiliations

My primary area of interest is computerized adaptive testing (CAT). CAT is the redesign of tests of ability, achievement, interests, personality, attitudes, preferences – or any kind of psychological variable – for delivery by computers. In a CAT, test questions (or items) are selected dynamically by psychometric algorithms programmed into the computer that identify the most efficient and effective set of items to measure each individual. The result of applying CAT is the capability of measuring each individual to a predetermined level of precision, or classifying individuals with predetermined error rates, with a minimum number of items. Most contemporary CAT procedures are based on advanced psychometric models based in item response theory (IRT). Therefore, my interests extend into methodological issues in IRT as they relate to CAT. One of my current areas of research is the measurement of individual change. Although there has been considerable research focused on measuring change at the group level, or measuring change for an individual relative to a group, there has been virtually no research allowing the measurement of change for a single individual measured at two or more occasions on two or more variables. My research focuses on the development and evaluation of statistical tests applicable to both CATs and conventional tests for detecting psychometrically significant intraindividual change. My second current area of research is on the effects of measurement error on the Type I error rates and power of a variety of statistical tests. Virtually all statistical tests assume error-free measurements. My research operationalizes error from an IRT perspective, allowing study of the effects of different patterns of error. Results demonstrate how measurement error deteriorates the performance of statistical tests, leading to erroneous conclusions from standard hypothesis testing and interval estimation procedures. We also are examining the differential effects of conventional tests and CATs as they result in different degrees and patterns of measurement error. For further information about CAT visit (http://www.iacat.org)

Educational Background & Specialties

Educational Background

  • Ph.D.: University of Minnesota, Minneapolis, Minnesota, 1963.

Specialties

  • computerized adaptive testing
  • Item response theory
  • psychometric methods
Courses Taught
  • Psy 5865 - Advanced Psychological and Educational Measurement
  • Psy 8960 Seminar: Computerized adaptive testing
  • Pay 8960 Seminar: Item response theory
  • PSy 8881 Seminar: Psychometric methods
Research & Professional Activities

Professional Activities

  • President Emeritus: International Association for Computerized Adaptive Testing , 2010
  • Editor: Journal of Computerized Adaptive Testing , 2012
  • Fellow, American Psychological Association Division 5 - Evauluation and Measurement:
  • Member, Psychometric Society:
  • Member, National Council on Measurement in Education:
  • Fellow, American Educational Research Association:
  • Editor, Applied Psychological Measurement: 1976 - 2001
Publications
  • Weiss, David J (2011). Better Data From Better Measurements Using Computerized Adaptive Testing. Journal of Methods and Measurement in the Social Sciences, 2 (1), 1-27.
  • Finkelman, M., Weiss, D.J., & Kim-Kang, G. (2010). Item selection and hypothesis testing for the adaptive measurement of change. Applied Psychological Measurement, 34(4), 238-254.
  • Weiss, David J (in press). Item Banking, Test Development, and Test Delivery. In K. F. Geisinger (Ed.), The APA Handbook on Testing and Assessment. American Psychological Association,
Awards
  • American Psychological Association fellow