Evaluation/ Impact Assessments

Here is the 4-step process for integrated evaluations and impact assessments.

Step 1. Identify Evaluation/Impact Assessment Approach

Step 2. Develop Framework

Step 3. Develop Stakeholder Matrix

Step 4. Identify how you will measure for different stakeholders

STEP 1. Evaluation Approach (Identify the aims and objectives of the evaluation)

Eg. Evaluation of the impact on residents for an IoT digital intervention installed in homes.

We understand the specific aims of the evaluation are to:

understand the challenges and benefits of installing this product for residents.
evaluate the changes (intended and unintended impacts) experienced by residents upon install and through use.
capture learnings from this evaluation to improve the design and development of product.

STEP 2. Develop Framework

This is an evaluation framework you can fill in yourselves.

The aim is to provide the conceptual boundaries for the evaluation; these aims have been segmented into series of “areas of the evaluation” and can be grouped under the following headings:

Input/Outputs	Outcomes	Impacts	Learning
These should be taken from your TOC	These should be taken from your TOC
These should be taken from your TOC	e.g. capacities and capabilities for learning on this project/programme

Area of evaluation	Themes	Things to look for (markers)*
Inputs/Outputs	Input	• The resources committed and activities undertaken
	Output	• What is delivered and/or produced
Outcomes	Expectations	• Expectations generated for participants, residents.
	Short/medium term results	• Has this been appropriately identified?
• What else could we add here?
• Think about social, environmental, governance.
• Think about benchmarking metrics eg. WHO, ESG criteria, SDGs.
Impacts	Long term results	• Has this been appropriately identified?
• What else could we add here?
• Think about social, environmental, governance.
• Think about benchmarking metrics eg. WHO, ESG criteria, SDGs.
Learning	Capacities and capabilities	• Identify opportunities and challenges from this evaluation.
• Integrate retrospective.