Thursday, 15.15-16.45 (Balcony D)

Data quality in the age of lean dataJulie Peachey, Progress out of Poverty Index (PPI); Sam Schueth, Intermedia; Christina Villella, MEASURE Evaluation.
This session will prompt a lively discussion about several different aspects of data quality including new issues arising from the use of mobile survey technology; challenges in the quality, security, privacy and confidentiality of mHealth data; and whether collecting data via alternative methods such as SMS, IVR or call centers has an impact on data quality. Please come and add your experiences and questions to the discussion!

Session Details:

The use of tablet- and mobile-based surveys has become common place in most
M&E and research fieldwork, often replacing paper-based data collection
tools. The benefits in terms of time, cost and accuracy of survey implementation using computer assisted personal interviewing (CAPI) are enormous, but CAPI-based data collection is not without its own challenges. Additionally, as interest in ‘lean data’ continues and data collection goes more ‘alternative’, how do interview methods such as SMS and IVR affect the accuracy of results?

This session will explore new issues in data quality and quality control arising from the use of mobile survey technology and other methods of data collection. The session, conducted as an informal roundtable discussion led by experts from InterMedia, MEASURE Evaluation, and Innovations for Poverty Action, will touch on a number of topics such as:

  1. new data quality frameworks compared to the best practices of traditional
    paper surveys
  2. challenges in the quality, security, privacy and confidentiality of mHealth data, including root causes of these challenges and how they affect data quality
  3. accuracy of data collected via SMS or IVR or call centers rather than interviewing at a person’s home (this is particularly relevant to poverty measurement with the PPI).

The goal is to have a highly interactive discussion and learn from each other. Please bring your experiences and questions and come ready for a hearty discussion.

Session Level:

Intermediate, Advanced

Session Resources:

Session Leads:

Christina Villella is a Health Informatics Associate at MEASURE Evaluation. Christina has over six years of experience in program planning, evaluation, management, health informatics, and research. Currently, she is supporting MEASURE Evaluation in the Health Informatics portfolio. In this role, Christina contributes thought leadership to the field of health informatics through the development of tools and guidelines for low- and middle-income countries (LMICs) to use in adopting digital health solutions for their health information systems and through providing technical assistance to countries in adopting digital health information systems such as electronic medical records. Christina also coordinates the data exchange of foreign aid data between two US government systems including overseeing data element mapping, testing, and quality control processes. Prior to joining ICF, Christina assessed mHealth activities with an aim of making recommendations to fill gaps to meet the needs health workers in LMICs. She graduated from UNC with a Master’s degree in Public Health in Health Behavior.

Samuel Schueth is the Director of Research at InterMedia. Dr. Samuel Schueth is a research scientist who joined the InterMedia Research Department in July 2016. In his role as InterMedia’s Director of Research, Sam provides research direction on methodology, implementation and engages with the research team on analysis planning. Sam also has responsibility for the InterMedia QC process and implementation as well as overseeing and managing the advanced analytics team. Among other projects, he has completed impact evaluations of governance and stabilization programs, quantitative surveys measuring financial inclusion, gender relations, economic growth, and the delivery of education, health, and agricultural services, indices of business confidence and competitiveness, and evaluated the effectiveness of counter-narcotics and countering violent extremism (CVE) communications campaigns. Sam holds a Ph.D. in Geography from the University of Minnesota. He speaks German, Georgian, Russian and French.

Julie Peachey, is the Director of Innovations for Poverty Action. Julie serves as a Director at Innovations for Poverty Action where she oversees the Progress out of Poverty Index® (PPI®), a household-level poverty measurement tool. Julie has more than 20 years’ business and non-profit experience, including 15 years in international development with a focus on financial inclusion, social enterprise, and impact measurement. Her accomplishments include establishing and serving on the board of a social business in India, transforming a credit-focused rural bank into a savings-led institution in the Philippines, and playing a key role in raising $25 million in private equity for a technology company. Julie started her career as a public accountant at KPMG and holds an MBA from the Kellogg Graduate School of Management at Northwestern University. More at or Twitter: @povertyindex.

Woubedle Alemayehu, is a Consultant at Oxford Policy Management. Learn more about Woubedle here or at Oxford Policy Management.