Tools & Approaches
Concerning surveys and data issues
Outcome/ Impact Studies:
-
Outcome or Impact Studies give a comprehensive overview over the main outputs, outcomes, impacts, sustainability etc. of an activity or working area.
-
They combine all information from several sources, usually Mixed Method Surveys, Stakeholder Interviews and project monitoring information.
-
The findings are visualized graphically and summarized in a brief report.
Mixed Methods Surveys:
-
Mixed Method Surveys combine the strengths of quantitative and qualitative methods, by using a mid-sized sampling.
-
They include numbers, ratings and narratives (e.g. opinions, descriptions of processes etc.)
-
Usually for one study several surveys are combined and various types of stakeholder are interviewed by using customized questionnaires.
Functional MS Excel data-collection & processing tools:
-
In most cases Mixed Method Surveys, as described above, do not require the use of complicated statistical programs, but can be implemented completely by using MS Excel.
-
Also, other tools such as Training Evaluation Questionnaires can be completely carried out in MS Excel and include the following features:
-
Guidelines on how to use the Tool
-
Printout sheet (note: needs to fit on a single page)
-
Data-entry sheets
-
Database
-
Analysis sheets (quantitative & qualitative)
-
Report format, including charts.
-
Efficient Stakeholder Interview processes and formats:
-
The developed methodology allows the customization of guide-questions for each interviewee in an efficient and systematic manner.
-
Interviews are recorded in a detailed manner.
-
Very large amounts of recorded information can be summarized and analysed in an efficient and systematic way.
Concerning monitoring systems
Results Models:
-
Results Models form the basis of a Result-Oriented Monitoring System by defining the main activities including their outputs, outcomes and inter-linkages.
-
The Results Model shows the structure of the project/program and the system boundaries/ attribution gap.
-
Thereby it also enables the localization and confirmation of the indicators within the logical structure of the intervention.
-
All information needs of the monitoring system are identified through the Results Model.
Indicator & Monitoring Matrix:
-
All indicators and further key information needs of the monitoring system are listed in the Indicator & Monitoring Matrix.
-
All required Data Collection Tools, including responsibilities, timing, sampling and further technical details are specified.
-
Data Collection Tools are designed on this basis.
Planning and Reporting Format:
-
Developed planning formats enable meaningful planning by not only naming activities, but also specifying their outputs and outcomes in a brief but clear manner.
-
The way responsibilities are recorded enables filtering and therefore easy use by all project staff.
-
The formatting of the planning timeline enables follow-up in an easy and visualized manner.
-
Later reporting can easily be built into the planning format and facilitate efficient project management.
Training/Event Evaluation Tool:
-
A brief (1 page) and a more detailed (4 page) Training/Event Evaluation questionnaire are available.
-
The Tool does not only consist of the questionnaire but can include all the further features described in the section headed “Functional MS Excel data-collection & processing tools”.