20140131 Presentation Lille def

Outcome monitoring
Empowerment of clients and their local and
national representatives
Chris Nas
Senior policy advisor
[email protected]
WHO Collaborating Centre
for Research and Training
Lille, January 31th 2014
About GGZ Nederland
Dutch Association of Mental Health and Addiction Care
• Chris Nas
– Between 2009 – 2011 leading the nationwide programme for
ROM in Mental Health (joint programme of client organisations,
professional associations and service providers)
• works for GGZ Nederland
–
–
–
–
–
Sector organisation in the Netherlands for mental healthcare.
With more than 100 member organisations
Providing 95% of specialist mental healthcare in the Netherlands
To 815,800 unique clients (children and adults)
Services are prevention, addiction care, outpatient care, acute
clinical care, sheltered housing/assisted living, forensic care.
– For which they employ 89,500 staff
– Turnover € 5.4 billion (10.6 % of Dutch healthcare expenditure)
GGZ Nederland (2013), GGZ in de Zorgverzekeringswet
2
When you leave this room, I hope you will
take this home with you
Outcome monitoring empowers clients and their
representatives, because it facilitates:
• shared decision making in treatment on the level of
clients and professionals;
• professional reflection on the level of teams,
departments and/or providers;
• transparency on relevance and effectiveness of
treatments and guidelines;
• transparency on effectiveness of mental health care
organisations.
3
Outcome measurement is primarily an aid
for clients and mental health workers
Clients fill in questionnaires at
the beginning, during and end
of treatment or support.
Measuring:
• reduction of symptoms
• functioning in daily life
• quality of life
4
Quality of Life questionnaire (QoL+)
Could you please tell how satisfied you are with …..
1)
2)
3)
4)
5)
6)
7)
8)
…. your housing situation?
…. your relations with people?
…. your physical health?
…. your mental health?
…. your financial situation?
…. your work?
…. your life in general?
…. the support you receive?
1234567
1234567
1234567
1234567
1234567
1234567
1234567
1234567
What does this QoL+ scores tell us
about the quality of life of a person?
56
8
6
What does 2nd QoL+ base line say
about recovery of a person?
56
8
7
Outcome measurement provides a
base for shared decision making
56
8
8
Collecting and analysing outcome
data is possible and meaningful …
Clinical recovery
(according to RCI)
% Recovered
% Reliable improved
% No change
% Reliable aggravated
A
B
C
D
31%
11%
55%
4%
39%
13%
43%
6%
23%
19%
50%
9%
28%
21%
43%
8%
Results of pilot in 2011 of 4 mental health services providers in long
term mental health care on the basis of HONOS questionnaires.
Not corrected or standardised for case mix. RCI = Reliable Change
Index (RCI).
9
… as shown by this comparison of
the aggregated outcomes.
Clinical recovery
(according to RCI)
% Recovered
% Reliable improved
% No change
% Reliable aggravated
A
B
C
D
31%
11%
55%
4%
39%
13%
43%
6%
23%
19%
50%
9%
28%
21%
43%
8%
Results of pilot in 2011 of 4 mental health services providers in long
term mental health care on the basis of HONOS questionnaires.
Not corrected or standardised for case mix. RCI = Reliable Change
Index (RCI).
10
Internal benchmark of mental health
provider in child and youth psychiatry
Uitstroom
Instroom
IOG-EV
IOG-EV
IOG 13/18
IOG 13/18
PMTO
PMTO
IOG 6/12
IOG 6/12
IOG 0/5
IOG 0/5
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100
%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100
%
Geen problemen
Geen problemen
Matige problemen
Matige problemen
Ernstige problemen
Ernstige problemen
11
Accumulation of outcome data are
opportunity to discuss performance
• National Benchmark Institute
collects anonymous outcome
data nationwide.
• LPGGZ (national client platform) is board
member and therefore in the position to
influence criteria performance assessment.
• Local client organisations are able to assess
the performance of their service provider and
discuss results with board of directors.
12
In the nationwide project ROM MH,
clients participated in various ways
• Full member Steering Committee
• Co-author of statement “Vision on Outcome
Monitoring in Mental Health”
• Initiating projects:
– Meetings with client and family councils
– Client expert groups on ROM
– 8 short movies for clients, family and client
councils about questionnaires
– Critical appraisal of existing questionnaires
13
Meetings with client and family
councils with over 100 participants
•
•
•
•
•
What is ROM exactly?
Who makes these questionnaries?
Who uses the outcomes?
What is in it for us?
How do we get the case
worker to discuss my
personal outcomes?
14
Eight short movies on ROM (in Dutch without subtitles): http://www.youtube.com/user/ROMindeggz?feature=watch
15
Room for improvement: develop
questionnaires with peer experts
Checklist ROM-instrumentarium voor de doelgroep Kinderen & Jeugd
Instrument
ASEBA
(CBCL voor
ouders/fam, TRF
voor leerkrachten,
YSR voor
jeugdigen)
Kwaliteit
Goed
Meetpretentie

Ernst van de
problematiek
Inspanning cliënt

CBCL: 15-20 minuten,
beoordelingslijst ouders
TRF: 15-20 minuten,
beoordelingslijst leerkracht
YSR: 10-20 minuten,
zelfinvullijst kind

Waardering gebruik:
onbekend
Voldoende
tot goed

Ernst van de
problematiek
(met aan-vulling op
dagelijks
functioneren)

Dagelijks
functioneren

120 + 20 items
SDQ
Diverse versies tbv
leeftijd kind
25 items + schaal
en 8 items
HoNOSCA
Voldoende
tot goed;


15 items

Papier & potlood: 5 minuten,
zelfinvullijst kind of
observatielijst oudere/familie
of leerkracht
Waardering gebruik:
onbekend
Meest gebruikt als
observatielijst – geen
activiteit door cliënt
Waardering gebruik:
onbekend
Inspanning behandelaar

Scoring & intepretatie: plm. 10
minuten

Terugkoppeling aan cliënt:
‘betrekkelijk snel en efficiënt’

Geen specifieke training nodig.
Algemeen: kennis over
gestandaardiseerde diagnostische
onderzoeksmethoden en opleiding
gericht op werken met ouders en
kinderen

Scoring & intepretatie: 15 minuten

Terugkoppeling aan cliënt:
onbekend

Training: 1 uur vertrouwd raken
met materiaal, instructies en
handleiding. Geen herhaling
noodzakelijk.

Afnameduur: 10 -15 minuten

Terugkoppeling aan cliënt:
onbekend

Training: 1x training, 1x
hertraining en daarna jaarlijkse
supervisie bijeenkomsten
Normering
Ja
Kosten
€ 7,- per 10 stuks
Ja
Paper & pencil:
gratis downloaden;
Online afname of
digitalisering:
€ 0,15 per afname
Nee
Engelse versie
gratis te
downloaden
• Questionnaires made by experts for research
• Appreciation clients was lacking completely
• Reduction of symptoms instead of recovery
16
Outcome monitoring:
driver for client empowerment
• shared decision making in treatment on the
level of clients and professionals;
• professional reflection on the level of teams,
departments and/or providers;
• transparency on relevance and effectiveness
of treatments and guidelines;
• transparency on effectiveness of mental
health care organisations.
17