Measuring and Modeling Impact in Evaluations from Coursera

We want to provide you some information about our course “Measuring and Modeling Impact in evaluations”. The purpose of this course is to give you a better understanding of different measures of impact that could be used in the evaluation of a program in the areas of maternal and child health and nutrition. For each of the measures presented, we will discuss current sources of data you might draw on as well as describe the methods that can be used to measure these. When we describe the methods, we also try to identify the strengths and weakness of the methods as well as their suitably for use in an evaluation. The course also discusses how modeling can be used in evaluations as either a replacement for measuring impact or to supplement measured impact. The last two lessons in this course focus on giving you an introduction and training on how the Lives Saved Tool (LiST) works and how to use it. This model can be used to estimate most – if not all – of the impact measures we describe in the course and can be an important part of both planning and estimating impact in an evaluation of a large-scale program. While this course is self-contained, it is also linked to other courses on evaluation. We developed this course for public health program managers and evaluators and assume the students in the course will have a background in public health with a focus on maternal and child health in low- and middle-income countries.

The development of this course was supported by a grant from Government Affairs Canada (GAC) for the Real Accountability, Data Analysis for Results (RADAR) project.

What's inside

Syllabus

Introduction to Measuring and Modeling Impact

This module welcomes students to the Measuring and Modeling Impact course presented by faculty from the Johns Hopkins Bloomberg School of Public Health. The module also introduces faculty and provides an overview of impact measures.

Measuring Mortality and Maternal Mortality

This module will first cover a broad set of issues that cut across all types of mortality, including under-five, maternal and neonatal. It then has lessons and readings that focus on understanding maternal mortality, data sources for maternal mortality and approaches to measurement.

Measuring and Modelling Mortality in Children

This module will introduce you to the major indicators related to deaths among children that could be used as a measure of impact. For each of these indicators we describe common sources of these indicators as well as methods used to measure or model these indicators .

Nutrition

In this model we provide and overview of common impact measures related to nutrition. For each of these indicators we describe common sources and the methods that can be used to collect these indicators in an evaluation.

Other Impact Measures

In this module we review other categories of possible impact measures, including morbidity, long-term consequences of programs and birth outcomes. For each category of additional impact measures we review the major indicators, possible sources of these indicators as well a a quick overview of methods that could be used to collect them.

Modeling Impact

In this module, we introduce the Lives Saved Tool (LiST) which is a mathematical modeling tool that can be used to model the impact of maternal, newborn, child health and nutrition. We review basic concepts, data sources, and review how the software itself works as well.

Topics In LiST

In this module, we discuss specific topics in LiST including how nutrition is modelled in LiST, how maternal and child mortality are modelled in LiST, and how subnational modelling is handled in LiST. We conclude by reviewing some additional tools that are relevant to LiST.

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Provides invaluable insights into measuring and modeling impact in evaluations

Develops a deep understanding of different measures of impact used in maternal and child health and nutrition evaluations

Leverages real-world data sources and methodologies to enhance practical application

Introduces the Lives Saved Tool (LiST) for comprehensive impact estimation and planning

Guides learners through the intricacies of impact measurement and modeling in the context of public health

Taught by renowned faculty from Johns Hopkins Bloomberg School of Public Health

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Measuring and Modeling Impact in Evaluations with these activities:

Review Epidemiology Basics

Show steps

Refresh foundational knowledge in epidemiology, particularly measures of disease frequency and association, to enhance understanding of impact measurement techniques.

Browse courses on Epidemiology

Show steps

Review concepts such as incidence, prevalence, and risk ratios.
Practice calculating and interpreting epidemiological measures using sample datasets.

Review Course Syllabus

Show steps

Focus on understanding data sources, methods of measurement, and strengths/weaknesses

Browse courses on Maternal and Child Health

Show steps

Download and read the course syllabus
Identify key topics and learning objectives

Review Maternal and Child Health Statistics

Show steps

Refreshing your knowledge on maternal and child health statistics will provide a strong foundation for understanding impact measurement in this domain.

Browse courses on Maternal Health

Show steps

Review data from reputable sources such as the World Health Organization or UNICEF.
Focus on key indicators related to maternal and child mortality, morbidity, and nutrition.

Ten other activities

Expand to see all activities and additional details

Show all 13 activities

Assist at a Child Nutrition Clinic

Show steps

Gain practical experience in a child nutrition setting, observing and supporting the implementation of nutrition interventions.

Show steps

Contact a local child nutrition clinic or organization.
Offer your assistance with tasks such as food distribution, data collection, or educational outreach.
Document your experiences and reflect on the challenges and successes of the clinic's interventions.

Complete Online Tutorials on Data Analysis

Show steps

Completing online tutorials on data analysis will enhance your ability to analyze data and draw meaningful conclusions from impact measurement.

Browse courses on Data Analysis

Show steps

Identify online tutorials that align with the course content.
Follow the tutorials step-by-step.
Apply the concepts to real-life scenarios.

Practice Measuring Infant Mortality

Show steps

Practice calculating infant mortality rates to strengthen understanding of mortality measurement techniques.

Show steps

Find data on live births and infant deaths for a specific geographic area and time period.
Calculate the infant mortality rate using the formula: (Number of infant deaths / Number of live births) x 1,000.
Interpret the results and identify factors that may contribute to infant mortality in the area.

Discuss Impact Measurement with Peers

Show steps

Discussing impact measurement with peers will help you learn from others' experiences and perspectives, and gain a deeper understanding.

Browse courses on Impact Measurement

Show steps

Find a peer who is also taking the course.
Schedule a time to meet to discuss impact measurement.
Come prepared to share your thoughts and experiences.

Evaluate Nutrition Impact Assessment

Show steps

Collaborate with peers to review an impact assessment of a nutrition intervention, fostering critical analysis and peer-learning.

Browse courses on Nutrition

Show steps

Select an impact assessment report on a nutrition intervention.
Form a peer group and assign roles for reviewing specific sections of the report.
Provide constructive feedback on the assessment's methodology, data analysis, and recommendations.
Summarize the group's evaluation and discuss areas for improvement.

Maternal Mortality Modeling with LiST

Show steps

Follow a guided tutorial on using the Lives Saved Tool (LiST) to estimate maternal mortality impact, enhancing understanding of modeling techniques.

Browse courses on Maternal Mortality

Show steps

Install and familiarize yourself with LiST software.
Follow the tutorial's steps to input relevant data and parameters.
Analyze the model's output, including estimated maternal mortality rates and potential interventions.

Practice Using the Lives Saved Tool

Show steps

Practicing using the Lives Saved Tool will help you improve your skills in measuring and modeling impact in maternal and child health and nutrition programs.

Show steps

Access the Lives Saved Tool website.
Read the documentation and tutorials.
Enter data from a program you are familiar with.
Estimate the impact of the program.

Develop an Infographic on Maternal and Newborn Health

Show steps

Create a visually engaging infographic that summarizes key findings and recommendations on maternal and newborn health, enhancing communication and knowledge sharing.

Browse courses on Maternal Health

Show steps

Gather data and evidence on maternal and newborn health indicators.
Design the infographic using visual elements, charts, and concise text.
Review and refine the infographic to ensure clarity and impact.

Create a Fact Sheet on Impact Measurement

Show steps

Creating a fact sheet on impact measurement will help you synthesize and solidify your understanding.

Browse courses on Impact Measurement

Show steps

Choose a specific area of impact measurement to focus on.
Research and gather information on the topic.
Create a draft of the fact sheet.
Share the fact sheet with others for feedback.

Design a Maternal Mortality Reduction Strategy

Show steps

Develop a comprehensive plan for reducing maternal mortality in a specific context, applying knowledge of impact measurement and modeling techniques.

Browse courses on Maternal Mortality

Show steps

Identify the target population and assess the current maternal mortality situation.
Research and evaluate existing interventions and best practices.
Design a tailored intervention strategy, including specific objectives, activities, and monitoring indicators.
Develop a budget and implementation plan.

Career center

Learners who complete Measuring and Modeling Impact in Evaluations will develop knowledge and skills that may be useful to these careers:

Biostatistician

Biostatisticians use statistical methods to solve problems in public health. The Measuring and Modeling Impact in Evaluations course can help Biostatisticians develop the skills needed to design and conduct studies that measure the effectiveness of public health interventions. Additionally, the course can help Biostatisticians develop the skills needed to analyze data and interpret results.

See salaries and explore the career path for Biostatistician

Public Health Analyst

Public Health Analysts collect and analyze data to identify and address public health problems. The Measuring and Modeling Impact in Evaluations course can help Public Health Analysts develop the skills needed to design and conduct studies that measure the effectiveness of public health interventions. Additionally, the course can help Public Health Analysts develop the skills needed to analyze data and interpret results.

See salaries and explore the career path for Public Health Analyst

Epidemiologist

Epidemiologists investigate the causes of disease and injury. The Measuring and Modeling Impact in Evaluations course can help Epidemiologists develop the skills needed to measure the effectiveness of public health interventions, which can inform their research and help them to identify the most effective ways to prevent and treat disease.

See salaries and explore the career path for Epidemiologist

Health Policy Analyst

Health Policy Analysts develop and evaluate public health policies. The Measuring and Modeling Impact in Evaluations course can help Health Policy Analysts develop the skills needed to measure the effectiveness of public health policies, which can inform their decision-making and help them to develop more effective policies. Additionally, the course can help Health Policy Analysts develop the skills needed to analyze data and interpret results.

See salaries and explore the career path for Health Policy Analyst

Research Scientist

Research Scientists conduct research to improve public health outcomes. The Measuring and Modeling Impact in Evaluations course can help Research Scientists develop the skills needed to design and conduct studies that measure the effectiveness of public health interventions. Additionally, the course can help Research Scientists develop the skills needed to analyze data and interpret results.

See salaries and explore the career path for Research Scientist

Health Economist

Health Economists use economic principles to evaluate the cost-effectiveness of health care interventions. The Measuring and Modeling Impact in Evaluations course can help Health Economists develop the skills needed to measure the cost-effectiveness of public health programs, which can inform their decision-making and help them to identify the most cost-effective ways to improve health outcomes.

See salaries and explore the career path for Health Economist

Health Program Manager

Health Program Managers plan, implement, and evaluate public health programs. The Measuring and Modeling Impact in Evaluations course can help Health Program Managers develop the skills needed to measure the effectiveness of their programs, which can inform their decision-making and improve the efficiency of their programs. Additionally, the course can help Health Program Managers develop the skills needed to manage and evaluate complex health projects.

See salaries and explore the career path for Health Program Manager

Data Analyst

Data Analysts collect, analyze, and interpret data to solve problems. The Measuring and Modeling Impact in Evaluations course can help Data Analysts develop the skills needed to design and conduct studies that measure the effectiveness of public health interventions. Additionally, the course can help Data Analysts develop the skills needed to analyze data and interpret results.

See salaries and explore the career path for Data Analyst

Survey Researcher

Survey Researchers design and conduct surveys to collect data on public health issues. The Measuring and Modeling Impact in Evaluations course can help Survey Researchers develop the skills needed to design and conduct surveys that measure the effectiveness of public health interventions. Additionally, the course can help Survey Researchers develop the skills needed to analyze data and interpret results.

See salaries and explore the career path for Survey Researcher

International Health Specialist

International Health Specialists work to improve health outcomes in developing countries. The Measuring and Modeling Impact in Evaluations course can help International Health Specialists develop the skills needed to measure the effectiveness of their programs, which can inform their decision-making and improve the efficiency of their programs. Additionally, the course can help International Health Specialists develop the skills needed to manage and evaluate complex health projects in developing countries.

See salaries and explore the career path for International Health Specialist

Health Scientist Administrator

Health Scientist Administrators oversee the financial and operational management of public health programs. The Measuring and Modeling Impact in Evaluations course can help Health Scientist Administrators understand how to measure the effectiveness of health programs, which can inform their decision-making and improve the efficiency of their programs. Additionally, the course can help Health Scientist Administrators develop the skills needed to manage and evaluate complex health projects.

See salaries and explore the career path for Health Scientist Administrator

Nonprofit Program Manager

Nonprofit Program Managers plan, implement, and evaluate programs for nonprofit organizations. The Measuring and Modeling Impact in Evaluations course can help Nonprofit Program Managers develop the skills needed to measure the effectiveness of their programs, which can inform their decision-making and improve the efficiency of their programs. Additionally, the course can help Nonprofit Program Managers develop the skills needed to manage and evaluate complex projects.

See salaries and explore the career path for Nonprofit Program Manager

Health Communication Specialist

Health Communication Specialists develop and implement communication campaigns to promote health and prevent disease. The Measuring and Modeling Impact in Evaluations course can help Health Communication Specialists develop the skills needed to measure the effectiveness of their campaigns, which can inform their decision-making and improve the efficiency of their programs.

See salaries and explore the career path for Health Communication Specialist

Public Health Advocate

Public Health Advocates work to improve public health policies and programs. The Measuring and Modeling Impact in Evaluations course can help Public Health Advocates develop the skills needed to measure the effectiveness of public health policies and programs, which can inform their advocacy work and help them to develop more effective policies and programs.

See salaries and explore the career path for Public Health Advocate

Health Educator

Health Educators develop and implement educational programs to promote health and prevent disease. The Measuring and Modeling Impact in Evaluations course can help Health Educators develop the skills needed to measure the effectiveness of their programs, which can inform their decision-making and improve the efficiency of their programs.

See salaries and explore the career path for Health Educator