Listen now: Indicate Impact podcast series on AI in Evaluation

The MERL Tech Initiative (MTI) team joins Dugan Fraser for a podcast series about AI in evaluation.

In September, Indicate Impact published a series focusing on AI in Evaluation in their “Indicator Podcast”. MTI Core Collaborators, Linda Raftree, Kevin Cyrus Hong, Kelly Church, Isabelle Amazon-Brown, Dr. Savita Bailur, Cathy Richards, and Varaidzo Faith Magodo-Matimba are featured in a number of episodes, all available below. 

AI in evaluation: a long view

The first episode, with Linda Raftree and Kevin Hong, raised the need for greater “critical literacy” amongst evaluator users, meaning that if we use AI, we need to be able to explain what it did and how we used it. They also explored the theme of radical disclosure of AI use in evaluation work.

How evaluators can develop an AI policy

The second episode focuses on how evaluators can develop an AI policy. In this conversation, Linda Raftree, Kelly Church, and Kevin Hong share key insights that can inform AI policy design.

Evaluating AI

The third episode is especially relevant for people involved in evaluations of programs that make heavy use of AI, like those that use bots to give health advice. It’s a conversation with The MERL Tech Initiative‘s Dr. Savita Bailur and Isabelle Amazon-Brown about things like vibe-coding, digital twins, harm and bias, UX design, and more!