Indicators in K4Health's Guide for Making Content Meaningful

GHKC's Guide to Monitoring and Evaluating Knowledge Management in Global Health Programs was developed to describe key components of KM activities and help measure outcomes in learning and action. This resource is part of a series of case examples developed by GHKC members highlighting ways the Guide has been used and suggestions for future editions of the Guide.

Contact: Saori Ohkubo, Senior Program Officer, Johns Hopkins Center for Communication Programs (saori.ohkubo@jhu.edu)
 

Making Content Meaningful

Overview

The abundance of free quality content—from eLearning courses and multimedia resources to guidance documents and research papers—presents a remarkable opportunity for knowledge sharing. Making content freely available, however, does not always ensure its widespread use. Measuring whether a content adaptation activity is successful means assessing whether learning objectives have been met and also evaluating production, dissemination, and other related processes. The Knowledge for Health (K4Health) Project relied on the Guide to monitoring and evaluating knowledge management in global health programs (KM M&E Guide) when writing the chapter on evaluating activities and outcomes for Making content meaningful: A guide to adapting existing global health content for different audiences. The content adaptation guide simplified some of the logic model elements. K4Health selected 22 illustrative indicators from the 42 indicators in the KM M&E Guide for each of the three measures—reach, usefulness, and use—and included them in the content adaptation guide as  Appendix D, and made a reference to the KM M&E Guide for further information.

The KM M&E Guide was an invaluable resource in the development of the Content Adaptation Guide, particularly in the Evaluation Stage write-up. The illustrative indicators offer a multi-dimensional view of the effectiveness of adapted content or other learning interventions.

Background

The abundance of free quality content—from eLearning courses and multimedia resources to guidance documents and research papers—presents a remarkable opportunity for knowledge sharing. Making content freely available, however, does not always ensure its widespread use. It is equally important to provide free content in an appropriate format and in languages that people will use. The K4Health Project at the Johns Hopkins Center for Communication Programs (CCP) developed Making content meaningful: A guide to adapting existing global health content for different audiences, a content adaptation guide to help program managers and health-care providers expand the reach, usefulness, and use of free and openly-licensed global health family planning content. The guide outlines a framework with key steps and questions for consideration, activity sheets, illustrative examples, and real-life case studies that will help readers make informed decisions in the content adaptation process.

Evaluating KM Activities

Measuring the success of a content adaptation activity means assessing whether learning objectives have been met and also monitoring and evaluating production, dissemination and other related processes. K4Health relied on the KM M&E Guide when writing the content adaptation guide chapter on evaluating activities and outcomes.

Use of the Monitoring and Evaluation Guide

The logic model in the KM M&E Guide provides the content adaptation guide with a useful framework for specifying three measurement components directly related to content adaptation:

  • Reach – Distribution of the adapted content
  • Usefulness – User satisfaction and perception of quality of the adapted content
  • Use – Knowledge gained or applied as a result of the adapted content

The content adaptation guide simplified some of the logic model elements. For example, while the KM M&E Guide presents Learning and Action as two distinct stages of the initial outcome, these two stages are grouped as Use in the content adaptation guide for simplicity.

Specific Indicators Included in the Content Adaptation Guide

K4Health selected 22 illustrative indicators from the 42 indicators in the KM M&E Guide for each of the three measures and included them in the content adaptation guide as an Appendix D. They also made a reference to the KM M&E Guide for further information.

Indicators for Adaptation

The content adaptation guide also provides an example of the indicators that K4Health and the Grameen Foundation used in their adaptation activity to repackage eLearning health content to a mobile app (Box 7 on p.42).

Indicators in Action

Future Suggestions for the Guide

Content that is adapted for a specific cultural context, translated into a local language, or repackaged into an appropriate delivery format can greatly enhance the reach, usefulness, and use of new or validated knowledge. The KM M&E Guide is a helpful resource for introducing standard practices for monitoring and evaluating whether KM projects, activities, and tools are effective at supporting global health and development efforts.

The KM M&E Guide might be improved in the following ways:

  • Include more case study examples or “indicators in action” to show how outcome indicators can inform the decision-making process.
  • Organize indicators into categories in a table format rather than paragraph/page format, which can get unwieldy to follow.  
  • Consider splitting strengths and weaknesses into two separate columns, as the content adaptation guide does.  
  • Introduce example scenarios to give readers an opportunity to put theory to practice.

Acknowledgement

Making content meaningful: A guide to adapting existing global health content for dIfferent audiences was authored by Amy Lee, Lisa Mwaikambo, and Nandini Jayarajan of the K4Health Project at CCP.