Webinar: Steps Toward the Use of AI and VALUE Assessment of Student Work

April 28, 2020 @ 1:00 pm – 2:00 pm
LEAP Texas

LEAP Texas was disappointed with the difficult, but necessary, decision to cancel the in-person 7th Annual LEAP Texas Conference in response to the ongoing Coronavirus crisis. However, we are happy to announce the launch of the 7th Annual LEAP Texas Conference Webinar Series! This series will feature a number of the Concurrent Session presentations that were scheduled for the Conference. The first part of this series will run from April 21 through May 8, 2020, with additional presentations coming over the summer.

April 28, 2020 – 1:00 pm (CST)

Steps Toward the Use of AI and VALUE Assessment of Student Work

Webinar Track: Assessment of General Education Outcomes and/or the Texas Core Learning Objectives

Karen White-Goyzueta – Texas Southmost College
John Burke – Vantage Learning and McCann Associates

Objective and valid assessment of student performance on the six core objectives mandated by THECB is sometimes difficult and very time-consuming. Although conducting calibration sessions for comparative analysis at the course- and institutional-level assessment is beneficial, rater bias exists and it takes multiple inter-rater sessions to ensure findings are truly an authentic assessment of student performance on Critical Thinking and Communication. In this session, we will review how Texas Southmost College (TSC) addresses this challenge by incorporating artificial intelligence (AI) scored writing for diagnostic and formative assessment of adapted AAC&U rubrics. In a pilot project, First-Year English students complete a Signature Assignment in response to course requirements. The AI system provides an overall score plus a score on criterion for Critical Thinking (issues/problems, evidence collection, context, synthesis, and conclusions) and Communication (context, content development, language and syntax, organization and presentation). TSC conducts a comparative analysis on the AI scores to course- and institutional-level assessment scores. We will share our experience in this pilot, and discuss plans to use AI to assess the other core objectives.

To register for this webinar please go to: https://docs.google.com/forms/d/e/1FAIpQLSdfBcza4qngV6sO5CFioFchHWyPSjS53EB5ig_ELqOuN0LaUw/viewform