About

Solutions

Impact

Get Involved

Try Our Demo

Does Multiple Choice Have a Future in the Age of AI?

Check out our latest paper, accepted to the International Conference on Learning Analytics and Knowledge (LAK) 2025.

PLUS joins learning engineering virtual institute

Learn More

Try Our Demo

Does Multiple Choice Have a Future in the Age of AI?

Check out our latest paper, accepted to the International Conference on Learning Analytics and Knowledge (LAK) 2025.

Research

Publications

2024

Do Tutors Learn from Equity Training and Can Generative AI Assess It?

International Conference on Learning Analytics and Knowledge (LAK), 2025

Danielle R. Thomas, Conrad Borchers, Sanjit Kakarla, Jionghao Lin, Shambhavi Bhushan, Boyuan Guo, Erin Gatz, Kenneth R. Koedinger

Paper

Dec 13, 2024

Does Multiple Choice Have a Future in the Age of Generative AI? A Posttest-only RCT

International Conference on Learning Analytics and Knowledge (LAK), 2025

Danielle R. Thomas, Conrad Borchers, Sanjit Kakarla, Jionghao Lin, Shambhavi Bhushan, Boyuan Guo, Erin Gatz, Kenneth R. Koedinger

Paper

Dec 13, 2024

Examining the Use of an AI-Powered Teacher Orchestration Tool at Scale

L@S '24: Proceedings of the Eleventh ACM Conference on Learning @ Scale

Emma Brunskill, Kole A. Norberg, Stephen Fancsali, Steve Ritter

Paper

Jul 15, 2024

How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

International Journal of Artificial Intelligence in Education

Jionghao Lin, Zifei Han , Danielle R. Thomas, Ashish Gurung, Shivang Gupta, Vincent Aleven, Kenneth R. Koedinger

Paper

May 3, 2024

How Can I Improve? Using GPT to Highlight the Desired and Undesired Parts of Open-ended Responses

International Conference on Educational Data Mining (EDM), 2024

Jionghao Lin, Eason Chen, Zifei (Feifei) Han, Ashish Gurung, Danielle R. Thomas, Wei Tan, Ngoc Dang Nguyen, Kenneth R. Koedinger

Paper

May 2, 2024

Learning and AI Evaluation of Tutors Responding to Students Engaging in Negative Self-Talk

In Proceedings of the Eleventh ACM Conference of Learning @ Scale (L@S ‘24), July 18-20, 2024, Atlanta, Georgia.

Danielle R. Thomas, Jionghao Lin, Shambhavi Bhushan, Ralph Abboud, Erin Gatz, Shiv Gupta, Kenneth R. Koedinger

Paper

May 20, 2024

The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities

International Conference on Artificial Intelligence in Education (AIED), 2024

Danielle R. Thomas, Erin Gatz, Shivang Gupta, Vincent Aleven, Kenneth R. Koedinger

Paper

May 1, 2024

Using Generative AI to Provide Feedback to Adult Tutors in Training and Assess Real-life Performance

The Learning Ideas Conference

Danielle R Thomas, Erin Gatz, Shivang Gupta, Jionghao Lin, Cindy Tipper, Kenneth R. Koedinger

Paper

Apr 10, 2024

Improving Student Learning with Hybrid Human-AI Tutoring: A Three-Study Quasi-Experimental Investigation

International Conference on Learning Analytics and Knowledge (LAK), 2024

Danielle R Thomas, Jionghao Lin, Erin Gatz, Ashish Gurung, Shivang Gupta, Kole Norberg, Stephen E Fancsali, Vincent Aleven, Lee Branstetter, Emma Brunskill, Kenneth R Koedinger

Paper

Website

Mar 18, 2024

Improving Assessment of Tutoring Practices using Retrieval-Augmented Generation

AAAI2024 Workshop on AI for Education - Bridging Innovation and Responsibility

Zifei (Feifei) Han, Jionghao Lin, Ashish Gurung, Danielle R Thomas, Eason Chen, Conrad Borchers, Shivang Gupta, Kenneth R Koedinger

Paper

Feb 16, 2024

Using Large Language Models to Assess Tutors' Performance in Reacting to Students Making Math Errors

AAAI2024 Workshop on AI for Education - Bridging Innovation and Responsibility

Sanjit Kakarla, Danielle Thomas, Jionghao Lin, Shivang Gupta, Kenneth R Koedinger

Paper

Feb 16, 2024

2024

Do Tutors Learn from Equity Training and Can Generative AI Assess It?

International Conference on Learning Analytics and Knowledge (LAK), 2025

Danielle R. Thomas, Conrad Borchers, Sanjit Kakarla, Jionghao Lin, Shambhavi Bhushan, Boyuan Guo, Erin Gatz, Kenneth R. Koedinger

Paper

Does Multiple Choice Have a Future in the Age of Generative AI? A Posttest-only RCT

International Conference on Learning Analytics and Knowledge (LAK), 2025

Danielle R. Thomas, Conrad Borchers, Sanjit Kakarla, Jionghao Lin, Shambhavi Bhushan, Boyuan Guo, Erin Gatz, Kenneth R. Koedinger

Paper

Examining the Use of an AI-Powered Teacher Orchestration Tool at Scale

L@S '24: Proceedings of the Eleventh ACM Conference on Learning @ Scale

Emma Brunskill, Kole A. Norberg, Stephen Fancsali, Steve Ritter

Paper

How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

International Journal of Artificial Intelligence in Education

Jionghao Lin, Zifei Han , Danielle R. Thomas, Ashish Gurung, Shivang Gupta, Vincent Aleven, Kenneth R. Koedinger

Paper

How Can I Improve? Using GPT to Highlight the Desired and Undesired Parts of Open-ended Responses

International Conference on Educational Data Mining (EDM), 2024

Jionghao Lin, Eason Chen, Zifei (Feifei) Han, Ashish Gurung, Danielle R. Thomas, Wei Tan, Ngoc Dang Nguyen, Kenneth R. Koedinger

Paper

Learning and AI Evaluation of Tutors Responding to Students Engaging in Negative Self-Talk

In Proceedings of the Eleventh ACM Conference of Learning @ Scale (L@S ‘24), July 18-20, 2024, Atlanta, Georgia.

Danielle R. Thomas, Jionghao Lin, Shambhavi Bhushan, Ralph Abboud, Erin Gatz, Shiv Gupta, Kenneth R. Koedinger

Paper

The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities

International Conference on Artificial Intelligence in Education (AIED), 2024

Danielle R. Thomas, Erin Gatz, Shivang Gupta, Vincent Aleven, Kenneth R. Koedinger

Paper

Using Generative AI to Provide Feedback to Adult Tutors in Training and Assess Real-life Performance

The Learning Ideas Conference

Danielle R Thomas, Erin Gatz, Shivang Gupta, Jionghao Lin, Cindy Tipper, Kenneth R. Koedinger

Paper

Improving Student Learning with Hybrid Human-AI Tutoring: A Three-Study Quasi-Experimental Investigation

International Conference on Learning Analytics and Knowledge (LAK), 2024

Danielle R Thomas, Jionghao Lin, Erin Gatz, Ashish Gurung, Shivang Gupta, Kole Norberg, Stephen E Fancsali, Vincent Aleven, Lee Branstetter, Emma Brunskill, Kenneth R Koedinger

Paper

Website

Improving Assessment of Tutoring Practices using Retrieval-Augmented Generation

AAAI2024 Workshop on AI for Education - Bridging Innovation and Responsibility

Zifei (Feifei) Han, Jionghao Lin, Ashish Gurung, Danielle R Thomas, Eason Chen, Conrad Borchers, Shivang Gupta, Kenneth R Koedinger

Paper

Using Large Language Models to Assess Tutors' Performance in Reacting to Students Making Math Errors

AAAI2024 Workshop on AI for Education - Bridging Innovation and Responsibility

Sanjit Kakarla, Danielle Thomas, Jionghao Lin, Shivang Gupta, Kenneth R Koedinger

Paper

2023

2022

Before 2022

Other Work by Our Team

An astonishing regularity in student learning rate

Proceedings of the National Academy of Sciences

Kenneth R. Koedingera, Paulo F. Carvalhoa, Ran Liub, and Elizabeth A. McLaughlin

Paper

Mar 20, 2023

Designing Hybrid Human-AI Orchestration Tools for Individual and Collaborative activities: A Technology Probe Study

IEEE Transactions on Learning Technologies pp191-205

Vanessa Echeverria, Kexin Yang, LuEttaMae Lawrence, Nikol Rummel, Vincent Aleven

Paper

Feb 23, 2023

Robust Educational Dialogue Act Classifiers with Low-Resource and Imbalanced Datasets

AIED 2023: Artificial Intelligence in Education pp 114–125

Jionghao Lin, Wei Tan, Ngoc Dang Nguyen, David Lang, Lan Du, Wray Buntine, Richard Beare, Guanliang Chen & Dragan Gašević

Paper

Jun 23, 2023

Does Informativeness Matter? Active Learning for Educational Dialogue Act Classification

AIED 2023: Artificial Intelligence in Education pp 176–188

Wei Tan, Jionghao Lin, David Lang, Guanliang Chen, Dragan Gašević, Lan Du & Wray Buntine

Paper

Jun 23, 2023

Pair-Up: Prototyping Human-AI Co-orchestration of Dynamic Transitions between Individual and Collaborative Learning in the Classroom

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems pp1-17

Kexin Bella Yang, Vanessa Echeverria, Zijing Lu, Hongyu Mao, Kenneth Holstein, Nikol Rummel, Vincent Aleven

Paper

Feb 23, 2023