The NLP Community of Practice was set up in 2022 in response to genuinely revolutionary developments in the field of AI, most notably OpenAI’s release of ChatGPT. 2 years on, we’re coming together for our last event of 2024 to reflect on what we’ve learned, and celebrate what we’ve achieved together.

This interactive workshop hosted by the EES and facilitated by Linda Raftree and Zach Tilton builds on the EES’s Sparking Discussion on AI in Evaluation Practice that took place on November 4.

We will begin with an engaging discussion on AI in our personal lives and our work followed by a more in-depth overview of Gen AI in Evaluation landscape, including examples of different use cases. Following that, participants will work in teams to develop shared principles for using GenAI in evaluation processes. Then we’ll take a closer look at a few easily accessible GenAI tools and how they could be applied to evaluation tasks. We’ll practice prompt engineering and we’ll build a custom GPT. Throughout the workshop, we’ll create space for discussion and experience sharing among participants to both ask questions and share how they are using different kinds of AI tools and approaches in their own work.

Participants will leave the session with a better understanding of AI and GenAI overall, hands-on experience with some GenAI tools for research and evaluation, and an overarching set of questions and orientation for assessing if and when to use GenAI in their own work.

Fees: €180 Members and €230 Non-Members

NLP-CoP members who joined before November 15, 2024 can get a discounted price for this workshop. More information is available on the registration page

Big Tech is playing a growing role in the new US administration, with the wealthiest tech owners seen courting favor even before the elections and Elon Musk charged with downsizing the federal government. Join the New York City Technology Salon and special guest lead discussants for a lively, participatory round table conversation on what 2025 and beyond might look like for the US and the Globe as Big Tech comes even closer to political power. (In-person only!)

MERL Tech conferences ran from 2014 through 2019, and we’ll be hosting more MERL Tech events in the coming years. Meanwhile, you can access past agenda and other information about MERL Tech in DC, London and Johannesburg by clicking on a tab below for the city you’re interested in.