Create your free CareStream account to:

  • Give every member of staff CPD certified training, free
  • Track who has finished in your training matrix
  • Run any of our 100+ free audit templates with your team
  • Check your first 5 policies against CQC regulations
  • Add as many staff logins as you need
  • Certificates for every course, with access that never expires

CPD training, audits and policy checks in one place

Free for ever · No card needed · Upgrade any time and keep everything

CPD Certified
Scenario

You can show who attended. Can you show training effectiveness?

Training effectiveness is the question behind every training budget: did it change anything? A completion rate cannot answer that. With training built from your own policies, the answers staff give, the gaps they close and your audit scores can sit side by side, so you can show a trend and say honestly what it does and does not prove.

Book a demo

14 day free trial · Set up in a day · UK data residency

The scenario

The training budget is spent. The director asks what it changed.

A scenario we see in many care settings.

It is the end of the year and a director sits down with the registered manager. Every course has been delivered and the completion figure looks healthy. Then comes the fair question: what did all that training change? The manager knows the team feels more confident, and the last two infection control audits looked better, but none of it is written down together. There is a spreadsheet of dates and a folder of certificates. There is no line that connects what was taught to what is now done differently on the floor.

A care home director and a manager look together at a laptop showing a simple rising line chart, with a training folder and a mug on the table in a bright office
January to June

Infection control and moving and handling are delivered to every team.

July

Completion sits at 96 per cent. The spreadsheet is up to date.

Autumn

The monthly infection audits start to look better.

Year end review

The director asks: what did the training change?

What the manager has

Completion dates and certificates. Nothing on what staff understood.

The audit scores

They improved, but nobody linked them to the training that preceded them.

The honest worry

Is it the training working, or just a good few months?

?
Next inspection

“How do you know your training is effective?” A folder of dates is not an answer.

Completion tells you who finished. It does not tell you whether anyone understood, or whether practice changed. Here is how CareStream lets you build that picture, and where it stops.

An example scenario, not a named service.

Why it matters

Completion is easy to count and easy to mistake for effect

Evaluating training effectiveness means asking what people understood and what changed, not only who finished.

Finished is not the same as understood

A carer can click through a module and still be unsure what to do. Only a check on understanding, and what happens after a wrong answer, shows the difference.

Feelings and facts need separate evidence

Staff may say a session was useful and still miss key points. Training evaluation works best when how people felt, what they know and what they do are looked at separately.

A good trend can be a coincidence

Audit scores rise for many reasons: a new team lead, a quieter month, a stricter auditor. Without the training data beside them, you cannot even ask the question properly.

How it works

From a completed module to a measured trend.

Measuring effect starts with the Training built from your own policies feature, and builds up in three layers. The first two are covered in adhoc training. The last two layers below are on the Enterprise plan.

Start with a check on understanding, not a tick for attendance

  • Pick a topic module in the Training screen. It is built from your own policies where they cover the topic, with general good practice as the fallback
  • Edit and preview the lessons and questions, then allocate them to staff, with an optional due date
  • Staff complete it in the Staff Hub, and every answer is kept, so there is a record of what was understood
Training
Standard trainingAdhoc Training Modules & Questions
Live policy training
Infection Prevention and ControlQuestions editable
✦ Generate lesson & questions✦ Questions onlyPreview
Question 1When must you wash your hands before and after contact with a resident?
Question 2What should you do with a soiled uniform at the end of a shift?
Question 3Who do you tell if you suspect an outbreak?
Assign this module:Assign to specific staff…Assign to all staff (31)

Illustration based on the Training screen. Example questions.

A wrong answer is followed up, and the follow up is counted

  • A wrong answer goes into the carer's Follow-up tab in the Staff Hub, and they get an email, at most once a day, in English
  • They choose Learn & retry, a short lesson then a fresh question, or Just retry the same question, as often as they need
  • CareStream counts each gap put right and whether the carer used the lesson, which feeds the effectiveness figures. A short, optional rating of confidence and usefulness can follow
Staff Hub: Follow-up
Follow-up

A few things to revisit. Learn the point, then answer, or just retry. Either way it clears from here.

Infection Prevention and ControlWhen must you wash your hands before and after contact with a resident?
Learn & retryJust retry
Why this matters

Hands carry germs between residents, so they are cleaned at the key moments, not only when they look dirty.

Remember
  • Clean hands before contact
  • Clean hands after contact
  • Gloves do not replace hand hygiene
Picture this

You finish helping one resident and a call bell rings in the next room.

Continue to the question

Illustration based on the Staff Hub Follow-up tab. Example content.

Effectiveness of Training: learning, reaction and closed gaps in one view

  • In Analytics, the Effectiveness of Training tab shows questions put right, the share of gaps resolved, and how many were closed with a lesson rather than a simple retry
  • It also shows assessment accuracy, training completed, confidence to apply and how useful staff rated the training, plus gaps closed week by week over eight weeks
  • This tab is on the Enterprise plan. It reflects knowledge checks and ratings, not resident outcomes
Audits
Effectiveness of Training (example figures)Example
Questions put right46
Gaps resolved81%
Engaged with learning68%
Put right, 30 days19
How gaps get closed (example)
Learn & retry31
Just retry15
Knowledge and reaction (example)
Assessment accuracy88%
Training completed96%
Confidence to apply84%

Example screen with made up figures, for illustration only.

Training Impact: audit scores set beside training completion

  • Link an audit to the training modules it relates to, using Linked training on the audit
  • The impact view then shows, month by month, the audit score next to the share of allocated staff who had completed the linked training
  • It is a trend, not proof of cause, and it needs several monthly audit runs to mean anything. It is on the Enterprise plan
Audits
Training Impact: Infection control audit (example figures)Example
First audit72%
Latest audit89%
Change+17
Month by month (example)
March: audit 72%Trained 20%
May: audit 78%Trained 64%
July: audit 84%Trained 96%
September: audit 89%Trained 96%

Example screen with made up figures, for illustration only.

Talk it through

The questions managers ask, and how CareStream answers them

Read this as a conversation. The questions are the ones we hear most.

Manager

What do you mean by training effectiveness?

CareStream

Whether the training changed anything. That means more than who finished it. It covers how staff felt about it, what they understood, and whether the practice you audit has moved. CareStream gives you evidence for the middle two and a trend for the last one.

Manager

What does Effectiveness of Training actually show me?

CareStream

In Analytics it shows how many wrong answers were put right, the share of gaps resolved, how many were closed with a lesson, assessment accuracy and training completed. It also shows confidence and usefulness ratings, and gaps closed week by week.

Manager

Where does the confidence and usefulness rating come from?

CareStream

After a piece of training, staff are offered a short optional rating in the Staff Hub, a score of one to five for how confident they feel and how useful it was. Treat it as a guide.

Manager

What does the audit comparison show?

CareStream

You link an audit to the training modules it relates to. It then shows the audit score each month next to the share of allocated staff who had completed that training. If both rise, that is encouraging evidence. It is not proof of cause.

Manager

So can you prove the training caused the improvement?

CareStream

No, and we would not say so. Audit scores can move for other reasons. What you get is a clear trend with the training beside it, which is a far stronger position than an unsupported claim.

Manager

Does it show whether residents are better off?

CareStream

No. The measures are knowledge checks, ratings and audit scores. Linking training to outcomes such as falls is not something CareStream does. Those outcomes would need recording and analysing separately.

Manager

Which plan is it on, and how do I try it?

CareStream

Both are on the Enterprise plan, as the pricing page shows. You can start a 14 day free trial by creating an account, and the pricing page shows what each plan includes.

Manager

What could I show an inspector?

CareStream

The questions staff were asked, what they got wrong, the lessons they used, and the audit trend beside the training. It sits with the rest of your CQC evidence. It shows you check your training works. It is not a rating, a pass or a regulator record.

What it does not do

Measuring an effect is not the same as proving it

It shows a trend, not a cause

It sets audit scores beside completion. If they rise together, that is useful evidence. It cannot rule out a new team lead, a quiet month or a change in who does the audit.

It does not measure resident outcomes

What you see is knowledge checks, optional ratings and audit scores. It does not track falls, infections or any other outcome for residents.

Both reports are Enterprise features and need data

Both are on the Enterprise plan. The impact view also needs a linked audit and several monthly runs before the trend means much.

Questions

Training effectiveness in care, answered

Measuring the effect

How do you measure training effectiveness in a care service?

Look at four things: how staff reacted, what they learned, whether they act differently, and whether results improve. Knowledge checks and follow ups cover learning, observation covers behaviour, and audits show practice over time. CareStream handles the knowledge checks, the follow up and the audit comparison.

What is the difference between training evaluation and a completion report?

A completion report records who finished. Training evaluation asks what they understood and what changed. A short check after the module, and a follow up on wrong answers, are the first steps from one to the other.

What is the best way of evaluating training effectiveness with a small team?

Keep it simple. Check understanding after each module, look at the weakest topics each month, and compare one or two audits with the related training.

What does training impact mean in practice?

It is the change in what your audits find after staff are trained. In CareStream, audits linked to training let you see the audit score month by month beside training completion.

Can I measure the effect of face to face training too?

Yes, once you allocate a short module on the same topic afterwards. See face to face training for how that works. A session does not trigger anything by itself, so you allocate the follow up.

Which plan includes these reports?

Both reports are Enterprise plan features. The pricing page lists every plan, and you can try CareStream free for 14 days.

About inspections

Does CQC expect me to show my training works?

Regulation 18 on staffing says staff must receive the support, training, professional development, supervision and appraisal necessary to carry out their duties. CQC guidance on Regulation 18 says providers should monitor training completion and act where requirements are not being met. It does not name a particular way of measuring effect.

Is a high completion rate enough?

CQC guidance on Regulation 18 also talks about staff being supervised until they can show they are competent, and ongoing supervision to make sure competence is maintained. Completion alone does not show that, so it helps to have evidence of understanding as well.

Guide

A practical way to evaluate your training

You do not need a research project to evaluate training. You need a few honest measures, looked at regularly and read with caution.

Four questions to ask of any training

A widely used way to evaluate training separates four things: did people find it useful, did they learn it, do they do things differently, and did results improve. Each needs a different kind of evidence, and the further down the list, the harder it is to prove.

Be clear about which question each of your figures answers. A completion rate answers none of them. A knowledge check answers the second. An audit score answers the third and, loosely, the fourth.

A simple routine for the registered manager

  • After each module: look at the questions most often missed, and at who still has an open gap.
  • Each month: check how many gaps were put right, and how many with a lesson rather than a retry.
  • Each quarter: choose one audit that relates to a topic you trained on, link it, and read the trend.
  • Before you present it: write down one other thing that changed in the same period, so you do not overclaim.

How to word it for a director or an inspector

Say what you measured and what you did not. For example: staff answered knowledge checks, gaps were followed up, and our infection control audit score rose as completion rose. Then add what it does not show. That balance is what makes the evidence believable.

For the inspector. Keep the questions, the follow ups and the audit trend together, and be open about what they do not prove.

Accreditations and compliance

  • Good Business Charter accredited
  • CPD Certified training, The CPD Certification Service
  • Registered with the Information Commissioner's Office
  • Disability Confident Committed
  • GDPR compliant

CPD Provider No. 50224 · ICO registration ZC221613