From user needs to AI solutions: a human-centered design approach for AI-powered virtual teamwork competency training

Abstract

This study develops a human-centered design (HCD) approach to create a GenAI trainer that addresses critical gaps in virtual teamwork training for engineering students. While virtual teamwork competency is increasingly essential, current programs often prioritize task completion over competency development. Leveraging generative AI's capabilities for personalized interaction, scenario simulation, and tailored feedback, we employ a three-phase HCD approach: (1) identifying unmet user needs through stakeholder interviews, revealing key challenges in instructional support, training formats, feedback mechanisms, and teamwork awareness; (2) co-designing solutions with instructors and students to create an AI trainer that combines Socratic questioning and scenario-based learning; and (3) testing the system and obtaining feedback from engineering students. Results demonstrate significant improvements across multiple dimensions: transforming passive learning into active experiences, delivering real-time actionable feedback, enhancing conceptual understanding and awareness of virtual teamwork, and developing practical virtual teamwork skills through authentic scenarios. Participant feedback also identified future improvements for enhanced personalization and immersion. This study contributes both theoretically and practically by illustrating how HCD can effectively integrate AI capabilities with pedagogical needs, while providing a replicable model for developing competency-based training tools that balance technological innovation with educational effectiveness.