Content area
AI Assess, a ChatGPT-based assessment system utilizing the ChatGPT platform by OpenAI, composed of four components, is proposed herein. The components are tested on the GPT model to determine to what extent they can grade various exam questions based on learning outcomes, generate relevant practice problems to improve content retention, identify student knowledge gaps, and provide instantaneous feedback to students. The assessment system has been explored using software engineering and computer science courses and is successful through testing and evaluation. AI Assess has demonstrated the ability to generate practice problems based on syllabus information and learning outcomes. The components have been shown to identify weak areas for students. Finally, it has been shown to provide different levels of feedback. The combined set of components, if incorporated into a complete software system and implemented in classrooms with proposed transparency mechanisms, has vast potential to reduce instructor workload, improve student understanding, and enhance the learning experience. The potential for GPT-powered chatbots in educational assessments is vast and must be embraced by the education sector.
Details
Teaching Methods;
Prompting;
Learning Processes;
Educational Technology;
Grading;
English (Second Language);
Second Languages;
Student Improvement;
Knowledge Representation;
Brain;
Short Term Memory;
Feedback (Response);
Natural Language Processing;
Educational Objectives;
Artificial Intelligence;
Educational Assessment;
Symbolic Learning;
Outcomes of Education;
Language Processing;
Engineering Education;
Networks;
Educational Facilities Improvement
Language;
Software;
Students;
Feedback;
Educational evaluation;
Educational technology;
English as a second language;
Education;
Computer science;
Chatbots;
Innovations;
Machine learning;
Human-computer interaction;
Artificial intelligence;
Educational objectives;
Learning outcomes;
Neural networks;
Engineering;
Natural language processing;
Large language models;
Transparency;
Learning;
Components;
Evaluation;
Classrooms
; Russell Morris Frost 1
; Fedoruk, Benjamin David 2
; Diyab, Ahmad 3 1 Faculty of Engineering, Lakehead University, Thunder Bay, ON P7B 5E1, Canada;
2 Mitch and Leslie Frazer Faculty of Education, Ontario Tech University, Oshawa, ON L1G 0C5, Canada
3 Shad Alumni, Western University, London, ON N6A 3K7, Canada;