Department
Barowsky School of Business
Document Type
Poster Presentation
Presentation Date
2026
Sponsorship/Conference/Institution
Society for Industrial and Organizational Psychology Annual Conference
Location
New Orleans, LA
Abstract/Presentation Excerpt
Open-ended assessments are essential for workplace training but limited by scoring resources. This paper provides a psychometric evaluation of generative AI ratings of open-ended responses in training contexts, offering evidence for the reliability, validity, and utility of GenAI scores. The study demonstrates best practices for using GenAI as a rater through effective task design, quality rubrics, and optimized prompts. Results support GenAI as a practical solution for scaling open-ended assessments while maintaining psychometric rigor in workplace learning and development.
Rights
The Authors. All rights reserved.
COinS