We field-test solutions/interventions based on pre-designed experiment. The major purpose of an experiment is to validate the causality – i.e. to ensure that what is being achieved is a result of the intervention and not anything else. In addition, Solution Testing ends with hands on guidance on what can and should be modified to attain maximum impact.
A randomized controlled trial (RCT) is an experimental form of impact evaluation in which the group receiving the intervention is chosen at random from the eligible population, and a control group is also chosen at random from the same eligible population. It tests the extent to which planned impacts are being achieved. RCT is the “gold standard” technique because of its effectiveness in establishing causality. Although our preferred Solution Testing method is RCT, we recognize that due to financial, logistical or other factors, administration of RCT is not always feasible.
Where RCT is not feasible, we employ quasi-experiment techniques to determine the impact and causality of interventions. These alternative methods include:
Difference-in-Differences – where the impact of the intervention is assessed by comparing pre and post treatment differences in the outcome in the treatment and control groups.
Matching – where the impact of the intervention is measured by pairing treatment and control group participants based on all relevant attributes.