Using self-reporting to help demonstrate impact

on
November 17, 2023

Stakeholders, trustees, management teams, funders, and commissioners no longer just want to know just what we do—our outputs—they want to know the full impact that our work is having.

LifeLine Projects is well-known for its award-winning VIP Mentoring approach. We’re currently supporting over 600 at-risk young people. And, since 2000, we’ve helped over 300,000 people across our various programmes using a range of tools to demonstrate impact;

Twenty years ago, when programmes or initiatives were assessed, meaningful impact measurements were not in common use. But now, there are an abundance of impact measurement toolkits available—one that our SW!TCH team are currently using is the Self-Report Delinquency Scale (SRDS) from the Edinburgh Study of Youth Transitions and Crime (ESYTC).

This tool helps to measure the severity and frequency of ‘hidden and socially unacceptable’ behaviours and actions carried out by young people. A further aim is to explore why some young people become serious, frequent, and persistent offenders and why some young people do not.

The SRDS is used alongside other measurements carried out by our Youth Development Workers, such as the Warwick and Edinburgh Wellbeing Scale (WEMWBS) which assesses the mentees wellbeing. Through these measurements, we can see the direct impact being made by our work and how far a young person has came during their time with us.

The SRDS questionnaires are used when a young person we work with has been identified as “at risk of criminal exploitation”. The first time a young person fills out the questionnaire is when their mentoring with a Youth Development Worker begins. It is then repeated at both the halfway point and completion of the mentoring period (usually totalling 26 weeks). The questionnaire (self-administrated and completed by the young person themselves) explores the young person’s involvement with nineteen different negative behaviours.

What are the negative behaviours?
  1. Fare-dodging
  2. Noisy/cheeky behaviour in public
  3. Shoplifting
  4. Ride in stolen vehicle
  5. Theft from school
  6. Carried a knife/weapon
  7. Graffiti
  8. Robbery
  9. Criminal Damage
  10. Housebreaking
  11. Theft from home
  12. Broken into vehicle to steal
  13. Fire-setting
  14. Harming or injuring animals
  15. Assault
  16. Bullying
  17. Racial assault or harassment
  18. Selling illegal drugs
  19. Skipped or skived school

The questionnaire produces two scores:

  • Variety of delinquency score: the number of different offending behaviours the respondent reports having been involved in.
  • Volume of delinquency score: the estimated minimum total number of offending behaviours committed.

Progression of SW!TCH mentees using SRDS, 2022-23

Average volume score

Start
0
Middle
0
End
0

Average variety score

Start
0
Middle
0
End
0

What we’ve learned from the results of these self-reporting questionnaires is the young people we mentor show a noticeable decrease during their time with us in self-reporting any of these hidden or socially unacceptable behaviours. This serves as a useful indicator of the success of the mentoring process in moving a young person away from these negative behaviours. It should be noted that, as the survey is self-reporting, there is always the possibility of false claims in these questionnaires—however, in our experiences, the relationships we develop through mentoring lead to greater trust and a willingness to open up and be honest.

We’ve been using SRDS with SW!TCH Futures for about a year now, and it’s been a useful measure for tracking the progress a young person has made with us. It can also help our Youth Development Workers to identify problematic behaviours that contribute to risk of Serious Youth Violence for a young person and to highlight which behaviours have been reduced and which still require additional work.

—Alex Nelson, SW!TCH Lives Manager

Share on

These articles may contain testimonials by LifeLine staff members and service users of our programmes and/or services. These testimonials reflect the real-life experiences and opinions of such staff members/service users. However, the experiences are personal to those staff members/service users and may not necessarily be representative of all staff members/service users of our programmes and/or services. We do not claim, and you should not assume, that all staff members/service users will have the same experiences. Individual results may vary.

Testimonials are submitted in various forms such as text, audio and/or video, and are reviewed by us before being posted. They appear in the newsletter in words as given by the staff members and service users, except for the correction of grammar or typing errors. Some testimonials may have been shortened for the sake of brevity where the full testimonial contained extraneous information not relevant to the general audience.

The views and opinions contained in the testimonials belong solely to the individual user and do not reflect our views and opinions. Staff members/service users are not paid or otherwise compensated for their testimonials.

 

We're hiring!

Visit our Vacancies page to see the latest opportunities to become part of the LifeLine team.