Internal triangulation This refers to strengthening validity within the M&E process itself, principally by the use of multiple methods and techniques for exploring the same topic. To meet the needs for representativeness, use these three simple solutions: Combine quantitative and qualitative methods Either a) integrate two methods: i.e. semi-structured interviews with both open and closed-ended questions or b) use each kind of data collection sequentially i.e. open-ended questions first assess the range and nature of responses before collecting information from closed-ended questionnaires Rating and ranking techniques Semi-quantitative and participatory ranking can help individuals express values, opinions and preferences about different elements (discovered through interviewing and/or observation) in a democratic, visible way. Open analysis and discussion of findings during data collection Analytical discussion of findings can be held with groups that are representative of specific stakeholders, information users, and/or the community at large. These discussions can focus on the prevalence, interpretation and validity of the findings. The meetings can also explore the significance of emerging issues and elicit recommendations for identified problems or constraints on the project. ANALYSIS METHODS Purpose: To ensure that data that is collected is converted into useful information General Steps: Organize Raw Data. Assembling all the data, use a checklist of all your data sources if it’s helpful. Thoroughly check the data to be sure all the data have the adequate identifiers. Check the data for completeness Prepare descriptions. Write out lists of issues (themes, indicators) including the key ideas in each sub-category. Note any emerging issues, i.e., ideas that are repeating and substantive, but not included in the original plan of study. Where appropriate, do tabulations, i.e., counting answers or observed events. Generate Interpretations (most complex) . Once validated, the data is considered factual. These facts need to be put into context and assessed in relation to each other as well as in relation to the project objectives. The process of extracting and putting meaning to the isolated facts is referred to as interpretation. Check carefully on representativeness and reliability of data. Look for researcher effects on respondents and note any researcher bias. Discuss the findings and emerging analysis. Consider any limitations to believability. Make specific recommendations.
Tips on use: While this method also involves ranking, it differs from matrix scoring in that it only looks at one indicator at a time and gives it a rank by comparing past and present conditions relating to that single indicator. Figure 2. The ladder exercise undertaken by women to assess the impact of a training program RANKING AND POCKET CHARTS Purpose: To assess changes or patterns in people’s general opinions about a list of options, through a single overall ranking process. From an M&E perspective, this method is valuable to assess people’s opinions on a list of comparable options, for example, related to decision making in a local organization or personal practices in relation to any topic, such as land management or personal hygiene (see Box 2). How to: 1. Make a complete list of all the options for the being monitored (maize varieties, sources of credit, erosion control measures, etc.). 2. When conducted with a you have a couple options for the ranking: