Thursday, 10.45-12.15

So many methods, so little time! Kecia Bertermann, Girl Effect; Melissa Chiappetta, Abt Associates
This session is for anyone who is looking to study changes in perception or behavior online or through a digital platform but isn’t sure where to begin. Drawing on case studies from an Abt Associates evaluation of activities under the USAID Family Care First Cambodia project, and Girl Effect research and evaluation for the global Girl Effect Mobile platform, participants will learn about the digital measurement and evaluation approaches that were developed for a targeted intervention and a broad platform.

Session Level:  

Beginner, Intermediate

Session Details:

Intrigued by the power of digital and social media analytics? Simultaneously concerned with capturing impact? Overwhelmed by the options available for capturing data digitally? This session is for anyone who is looking to study changes in perception or behavior online or through a digital platform but who isn’t sure where to begin. Drawing on case studies from an Abt Associates evaluation of activities under the USAID Family Care First Cambodia project and Girl Effect research and evaluation for the global Girl Effect Mobile platform, participants will learn about the digital measurement and evaluation approaches that were developed for a targeted intervention and a broad platform. Abt is conducting a rapid cycle evaluation comparing different channels of delivering an online social behavior change communications (SBCC) campaign message focused on making potential Cambodian orphanage donors and volunteers aware of the harms of these orphanages. Girl Effect Mobile is a global digital platform with health, education, economic empowerment, and safety content aimed at 14-16 year old vulnerable girls, available in 60+ countries. These two channels and platforms are very different, and the solutions that we arrived at for our measurement needs are bespoke to the requirements of each platform. But, the purpose of the studies–to measure social behavior change and perceptions online–and the questions that we asked ourselves as we developed our frameworks are quite similar. This session will articulate and explore this process, and, using a separate case study, participants will have the opportunity to practice the process of analysing requirements for demonstrating impact and thinking through possible methodological approaches to measure social behavior change online.

Session Leads:

Kecia Bertermann, Senior Manager, Evidence at Girl Effect. Kecia serves as Senior Evidence Manager of the Evidence team at Girl Effect, a London-based NGO that uses media, brands and technology to empower girls. Kecia is a mixed-methods researcher with a focus on adolescent girls and the intersection of digital technologies and behaviour change. She oversees the monitoring, evaluation and learning of a portfolio of mobile innovation projects, including the Girl Effect Mobile platform, which reaches 2.4 million users monthly in 65 countries. She has worked in monitoring and evaluation in Africa and Asia since 2006, with a focus on participatory methodologies, GIS and digital measurement and created innovative tech projects such as the Girl Impact Map. She began her international development career in public health, with a focus on emergency response, community health and post-conflict interventions. More about Kecia here or at Girl Effect.

Melissa Chiappetta, Director of the Center for International Evaluation, Abt Associates. Melissa is a performance-management and evaluation expert with eleven years of experience designing monitoring, evaluation, and learning (MEL) systems and conducting evaluations, including capabilities in advanced research design and statistical analysis, and sixteen years of experience managing projects. She is also a technical expert in the fields of education, agriculture, and food security. Ms. Chiappetta leads Abt Associates’ Center for International Evaluation (CIE), where she builds and maintains the strategic vision for CIE, building Abt Associates’ portfolio of international evaluations, developing tools and frameworks for evaluation, and ensuring the quality of all CIE portfolio work. She also serves as Framework Director for Abt’s Global Evaluation Framework Agreement (GEFA) with DFID and is the Program Director for USAID’s Rapid Feedback (RF) Monitoring, Evaluation, Research, and Learning (MERL) project. Ms. Chiappetta has a Master’s of Science in Foreign Service degree from Georgetown University and has experience in approximately 20 countries. Learn more about Melissa here, here or at Abt Associates.