Realising Ambition glossary of terms

Evaluation

The task of working out whether a course of action is effective. In the context of the Realising Ambition programme, it refers to the use of research to investigate systematically the effectiveness of particular projects, programmes or ‘interventions’ in terms of improving children and young people’s outcomes.

Experimental evaluation

An evaluation of an intervention that compares the outcomes of children and young people who receive the intervention to those of a control group of similar children and young people who do not. The control group may be identified by randomly allocating children and young people who meet the target group criteria (in this case, 8-14 year olds)‘ - a randomised controlled trial -, or by identifying a comparable group of children and young people in receipt of similar service - a quasi-experimental design.

Non-experimental design

Evaluations that measure the outcomes of children and young people receiving an intervention before and after the intervention, but do not compare these outcomes to a control group. Results drawn from evaluations that use this approach are at best suggestive.

Early intervention

An intervention that seeks to intervene early in the development of problems. Such interventions may work with those showing early signs of problems, or those at the highest risk of developing problems. Early intervention does not necessarily mean intervening at a young age.

Evaluation quality

Whether the evidence of the efficacy and effectiveness of the intervention is reliable (one of the four standards of evidence).

Fidelity

The faithfulness to the original design of a programme or intervention. When implementing evidence-based programs in new sites or with new audiences, practitioners often adapt interventions. This has been shown to degrade their impact. Much of the skill in the effective implementation and replication of interventions lies in distinguishing between making adaptations to respond sensibly to the new context, and adaptations which might undermine the effectiveness of the intervention.

Intervention

The programme, project or activity delivered by an organisation designed to improve outcomes for children and young people. In the context of the Realising Ambition programme, organisations are applying to replicate interventions. This may be an intervention designed and implemented within the UK, or it may be an evidence-based intervention to be imported from overseas. The intervention may be distinct from the organisation that delivers it (that is, the intervention may have been designed and delivered by a different organisation to the one seeking to replicate it).

Intervention activity

The processes, tools, events, technology and/or actions that are an intentional (deliberate) part of the way the intervention works. Put another way, what are ‘active ingredients’ of the intervention that lead to improved outcomes for children and young people.

Intervention impact

How much change in target outcomes can be directly attributed to the intervention (one of the four standards of evidence).

Intervention specificity

Whether the intervention is focused, practical and logical (one of the four standards of evidence).

Objectivity

Facts that are not based on or influenced by the personal feelings, tastes and opinions of individuals or people, but rather transparent and unbiased criteria.

Outcome

In the context of services for children and young people, outcomes are the impact of an intervention on children and young people. The Realising Ambition programme seeks to support interventions that ultimately prevent children and young people from entering the criminal justice system. This may be achieved by improving a range of health and development outcomes associated with a decreased risk of entering the criminal justice system, for example, children’s behaviour, mental health or engagement to school. Outcomes are distinct from outputs, which may be defined as the effect of an intervention on an indicator, for example the number of arrests/convictions and whether or not a child/young person received special educational support.

Organisation

The organisation, or lead organisation within a partnership, responsible for delivering and replicating the intervention. They need not necessarily be the developer of the intervention. 

Organisational readiness

The skill and will of key staff and stakeholders. In the Realising Ambition programme, this relates to the skill and will of staff and stakeholders in lead organisations and any partners to replicate the intervention, and to work alongside Catch 22 and partners to build an evidence base and share learning.

Prevention

An intervention that seeks to prevent poor outcomes from occurring in the first place. In the context of Realising Ambition, prevention relates to avoiding children and young people from entering the criminal justice system. This may be achieved by preventing a range of negative behaviours associated with this, for example, engagement in substance misuse or antisocial behaviour.

Protective factor

An innate characteristic, event or context that may mitigate a specific risk. For example, in the context of a family history of crime or antisocial behaviour, a responsible adult that a child or young person can rely on may reduce the likelihood that the child or young person would engage in behaviour that might lead to involvement in the criminal justice system. Interventions may seek to promote specific protective factors in order to improve child outcomes.

Replication

Spreading a proven intervention into new geographical areas or to new/different audiences of children and young people. It is distinct from scaling-up, that is, simply increasing the number of young people currently served.

Risk factor

An innate characteristic, event or context that increases the likelihood of a negative outcome. For example, a family history of crime or antisocial behaviour has been shown to increase the chance that children and young people may engage in similar activities, and is thus a risk factor. Interventions may seek to reduce specific risk factors as a route towards improving associated outcomes.

Quality assurance

The systematic monitoring and evaluation of various aspects of a project, service or facility to make sure that minimum standards of quality are met.

Standards of Evidence

A set of objective and unbiased criteria developed by the Social Research Unit and international partners and designed to assess: (a) the degree to which interventions are focused, practical and logical; (b) the quality of any impact evaluation; (c) the change in outcomes that may be attributable to the intervention; and (d) the degree to which the intervention is ready to be implemented and replicated. See the Standards of Evidence.

Subjective

Views based upon feelings and opinions of individuals opposed to objective facts.

Sustainable organisation

An organisation able to demonstrate that it can meet present and future delivery commitments. In the context of the Realising Ambition programme, this means organisations need to be sustainable for the period of the grant and beyond, and will be able to fulfil associated commitments.

System readiness

The degree to which the intervention is accompanied by the necessary support and information to enable its quality implementation in communities and public systems (one of the four standards of evidence).

Target population

The specific group of people whose outcomes the intervention has been demonstrated to improve, or explicitly seeks to improve. Realising Ambition will support interventions that seek to prevent children and young people aged 8 to 14 from entering the criminal justice system. The target population will thus be children and young people aged 8 to 14.