Systematic review of clinical practice guidelines to identify recommendations for rehabilitation after stroke and other acquired brain injuries

Abstract

Objectives

Rehabilitation clinical practice guidelines (CPGs) contain recommendation statements aimed at optimising care for adults with stroke and other brain injury. The aim of this study was to determine the quality, scope and consistency of CPG recommendations for rehabilitation covering the acquired brain injury populations.

Design

Systematic review.

Interventions

Included CPGs contained recommendations for inpatient rehabilitation or community rehabilitation for adults with an acquired brain injury diagnosis (stroke, traumatic or other non-progressive acquired brain impairments). Electronic databases (n=2), guideline organisations (n=4) and websites of professional societies (n=17) were searched up to November 2017. Two independent reviewers used the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument, and textual syntheses were used to appraise and compare recommendations.

Results

From 427 papers screened, 20 guidelines met the inclusion criteria. Only three guidelines were rated high (>75%) across all domains of AGREE-II; highest rated domains were ‘scope and purpose’ (85.1, SD 18.3) and ‘clarity’ (76.2%, SD 20.5). Recommendations for assessment and for motor therapies were most commonly reported, however, varied in the level of detail across guidelines.

Conclusion

Rehabilitation CPGs were consistent in scope, suggesting little difference in rehabilitation approaches between vascular and traumatic brain injury. There was, however, variability in included studies and methodological quality.

PROSPERO registration number

CRD42016026936.

Correspondence to Dr Natasha A Lannin; [email protected]

Strengths and limitations of this study

• A large comprehensive review of 20 clinical practice guidelines across all acquired brain injury conditions, which identified 2088 separate recommendations for best practice rehabilitation.

• The first review to summarise evidence for individual rehabilitation interventions for acquired brain injury conditions—12 guidelines were related to stroke, 4 were related to traumatic brain injury, the remaining 4 guidelines were discipline specific (occupational therapy n=2, nursing n=1, pharmacological treatment n=1).

• Low Appraisal of Guidelines for Research and Evaluation II applicability rating of included guidelines—poor identification of barriers/facilitators to guideline implementation and resource implications.

• Guideline development groups applied different methods to generate recommendations which led to variability in both quality and scope; universal, international guideline may overcome such limitations.

Introduction 

Acquired brain injury from both vascular and traumatic causes is a major health issue, being a leading cause of disability.¹ Acquired brain injury (brain damage occurring after birth) is an umbrella term that encompasses many aetiologies and includes vascular causes (stroke) and traumatic causes.² Within rehabilitation, clinicians commonly treat impairments and functional limitations rather than according to a specific diagnosis, with little observable difference in rehabilitation approaches between vascular versus traumatic brain injury. Provision of care based on evidence is known to improve patient outcomes^3–6; however, there are documented gaps between the generation of stroke and other health research and its use in clinical practice.⁷ For example, a recent Australian audit of stroke rehabilitation services found that only 20% of patients are discharged without a care plan⁸ despite strong evidence for their routine use.^9–11 Clinical practice guidelines (CPGs) aim to facilitate clinicians’ use of evidence.^{12 13}

In addition to supporting proven interventions, CPGs also assist to raise awareness of ineffective practices.¹⁴ While CPGs are developed with the aim of bridging the research–clinical practice gap, issues regarding their use and implementation still remain. Many countries produce their own national guidelines, updates occur at varying intervals, and CPG content and scope differs with context (eg, country and guideline developer/sponsor). The level of evidence underpinning recommendation statements and the detail of these recommendations also differ across guidelines.^{15 16} Finally, despite rehabilitation approaches often being consistent clinically between vascular and traumatic brain injury, these diagnostic groups are separated in rehabilitation CPGs published to date. From clinicians’ perspective, having multiple guidelines that are inconsistent based on differences in assessments of evidence or scope may be overwhelming and confusing.

Therefore, the research questions for this study were to:

• examine the methodological quality of rehabilitation CPGs for acquired brain injury (vascular and/or traumatic);

• explore the scope of CPGs (ie, what do they include in terms of target population, clinical questions and topics covered);

• examine the consistency of CPG recommendation across guidelines;

• compare CPG recommendations across both diagnoses (vascular and/or traumatic);

• present synthesised recommendations of the five guidelines rated as being of highest methodological quality.

Methods

Identification and selection of guidelines and their recommendations

Eligible guidelines focused on moderate to severe acquired brain injury rehabilitation (inpatient and community rehabilitation settings). The definition of acquired brain injury used “includes traumatic brain injuries, strokes, brain illness, and any other kind of brain injury acquired after birth. However, acquired brain injury does not include degenerative brain conditions such as Alzheimer’s disease or Parkinson’s disease”.¹⁷ Only recommendations pertaining to adults with a moderate or severe acquired brain injury, as defined by the source study’s authors, were included (ie, recommendations pertaining to transient ischaemic attack, mild stroke or brain injury were excluded). Guidelines not published in English were ineligible.

Search for guidelines

Medline and Embase databases were searched from the earliest record until November 2017; guideline repositories including Guidelines International Network, National Guideline Clearinghouse, Intercollegiate Guidelines Network (SIGN), National Collaborating Centre for Chronic Conditions¹⁸ and professional rehabilitation society websites were also searched. Search terms included words related to brain injury, stroke, rehabilitation, guidelines, therapy and practice guidelines. Reference lists of included articles were also reviewed. Titles and abstracts were screened (LJ) and full-text papers retrieved and reviewed independently by two reviewers (LJ and NAL) using predetermined criteria (box 1). Disagreements were adjudicated by an independent reviewer (TH). In instances where guideline development groups updated their guidelines in a modular format (ie, update of specific topic areas) and published these over separate papers, we recognise this as ‘one guideline’ (inclusive of update) and Appraisal of Guidelines for Research and Evaluation (AGREE) rated both papers as one. The search strategy is available in online supplementary appendix 1, and list of the excluded papers with reasons for exclusion is available in online supplementary appendix 2.Box 1

Guideline inclusion criteria

• Systematic literature searches and review of existing scientific evidence published in peer-reviewed journals were performed during the guideline development or the guidelines were based on a systematic review published in 4 years preceding the publication of the guideline (PEDro, 2016).

• The clinical practice guideline was produced under the support of a health professional association or society, public or private organisation, healthcare organisation or plan, or government agency (PEDro, 2016).

• The clinical practice guideline contains systematically developed statements that include recommendations, strategies or information to guide decisions about appropriate healthcare.

• Refer to inpatient rehabilitation and/or community rehabilitation of patients with acquired brain injury diagnosis.

• Guidelines focus on more than one single component of rehabilitation (eg, memory and attention retaining).

• Are published in English, from 1 January 2006 onwards.

Note: PEDro Physiotherapy Evidence Database. Criteria: PEDro, Criteria for inclusion of clinical trials, 2016, https://www.pedro.org.au/english/downloads/criteria/ (accessed Feb 2018).

Appraisal of guidelines

The AGREE-II instrument¹⁹ was used to assess the methodological quality of the included guidelines across six domains: scope and purpose, stakeholder involvement, rigour of development, clarity and presentation, applicability and editorial independence. Additionally, an overall guideline assessment score was assigned by the rater and recommendation decision made (options were yes, yes with modifications or no). The 23-item AGREE-II tool uses a 7-point agreement scale from 1 (strongly disagree) to 7 (strongly agree). Each guideline was independently rated by two authors (LJ and NAL). Major discrepancies in the scores (where assigned scores differed by more than two points) were discussed and independently reassessed by the third author (TH). Domain scores were calculated, whereby a total quality score was obtained for each domain by summing the score of each item.²⁰ The mean domain score (between the two raters) was used to standardise the domain score as a percentage. To measure interobserver agreement across the ordinal categories of the AGREE-II ratings, a weighted kappa was calculated using SPSS V.24.0. This takes into account the degree of disagreement between assessors by assigning less weight to agreement as categories are further apart.^{21 22} An overall kappa was also calculated across all guidelines. A kappa value of <0.2 indicates poor agreement: 0.21–0.4 fair; 0.41–0.6 moderate; 0.61–0.8 good and 0.81–1.0 very good agreement.²³

Synthesis of guideline recommendations

Textual descriptive synthesis was used to analyse the scope, context and consistency (ie, similar or conflicting messaging) of the CPG recommendations. Initially, each guideline was read to gain an overall knowledge of content, one author (LJ) then independently coded the CPG to identify domains covered by the guidelines. Initial codes were identified and refined through constant comparison of each CPG’s recommendations as data collection proceeded. For each domain, guideline recommendations were compared across CPGs to identify similarities and discrepancies. Within each theme, the recommendations were further coded into discrete categories where appropriate (eg, ‘motor therapy’, ‘patient/family education’).

Where a guideline had a generic recommendation without providing details on time frame, approach or assessment or discipline responsible, that is, ‘all patients should be assessed for pressure injury’, these were not included within the relevant category of the scope table. All included guidelines’ levels of evidence and grades have been converted to a unified level of evidence grading of National Health and Medical Research Council (NHMRC)²⁴ for ease of comparison (indicated on table 1 by an double dagger symbol (‡)). Authors (LJ and NAL) compared guidelines for consistency (congruence in content and recommendations), scope (number of different categories of recommendations) and depth (number of recommendations per category). Finally, recommendations from the guidelines rated highest in quality (AGREE-II rating) were synthesised to provide an overview of all recommendations.

Table 1

Characteristics of the included guidelines (n=20)

Guideline organisation/society/authors	Guideline name(s)	Year of publication	Target users	Guideline writers	Guideline review process	Search strategy for evidence	Level of evidence included*	NHMRC grade of recommendation†
USA
Wheeler et al 34	Occupational Therapy Practice Guidelines for Adults with TBI	2016	Occupational therapists, educators, consumers, families, caregivers, third-party payers and policy-makers	Occupational therapists	Guideline development group	Systematic literature review	Level 1–4‡	NS‡
Wolf et al 35	Occupational Therapy Practice Guidelines for Adults with Stroke	2015	Occupational therapists, educators, clients, families, caregivers, third-party payers and policy-makers	Occupational therapists	Guideline development group review	Systematic literature review	Level 1–4‡	A–C, I‡
DVA/DoD AHA36	Management of Stroke Rehabilitation	2010	Healthcare professional in stroke management	Multidisciplinary	Guideline development group review	Systematic literature review	Level 1–4‡	A–C, I, GPP‡
Miller et al 41	Comprehensive Overview of Nursing and Interdisciplinary Rehabilitation Care of the Stroke Patient: a scientific statement from the American Heart Association	2010	Nurses and stroke healthcare clinicians	Multidisciplinary	NS	Systematic literature review	Level 1–4‡	A–C‡
Warden et al 42	Guidelines for the Pharmacologic Treatment of Neurobehavioral Sequelae of Traumatic Brain Injury	2006	NS	Physicians	NS	Systematic literature review	Level 1–4‡	NS
Winstein et al 43	Guidelines for Adult Stroke Rehabilitation and Recovery	2016	NS	Multidisciplinary	Internal and external peer review	Systematic literature review	Level 1–4‡	A–C‡
Australia/New Zealand
Bayley et al 31	INCOG Guidelines for Cognitive Rehabilitation Following Traumatic Brain Injury: methods and overview	2014	Healthcare professionals, rehabilitation support workers, clients and their families	Multidisciplinary	External review by journal publisher	Systematic review of published guidelines	Levels 1–3.3‡	A–C, GPP‡
Stroke Foundation9	Clinical Guidelines for Stroke Management	2017	Administrators, funders, policy makers, health professionals	Multidisciplinary	Public consultation, consumer consultation, peer review by international experts	Systematic literature review	Levels 1–4	A-D, GPP
NZGG32	Traumatic Brain Injury: diagnosis, acute management and rehabilitation	2006	Health practitioners, private providers, case managers, educationalists and funders	Multidisciplinary	External peer review, expert peer review	Systematic literature review	Levels 1–3‡	A–C, GPP‡
SFNZ and NZGG26	Clinical Guidelines for Stroke Management	2010	Health practitioners, administrators, funders and policy-makers	Interdisciplinary	Public consultation, consumer review, stakeholder review	Systematic literature review	Levels 1–4	A–D, GPP
Canada
ABIKUS40	Evidence-Based Recommendations for Rehabilitation of Moderate to Severe Acquired Brain Injury	2007	Healthcare professionals, policy-makers, funding bodies, rehabilitation support workers, clients, families	Multidisciplinary	External individual reviewers	Systematic review of published guidelines	Levels 1–4‡	E‡
CSS27 28	Canadian Stroke Best Practice Recommendations: Stroke Rehabilitation Practice Guidelines, Update 2015	2016	Health professionals, policy-makers, planners, funders, senior managers and administrators	Multidisciplinary	National expert consensus meeting, external expert review	Systematic literature review	Levels 1–4‡	A–C, GPP‡
	Canadian Stroke Best Practice Recommendations: Telestroke Best Practice Guidelines Update 2017	2017	Health professionals, policy-makers, planners, funders, senior managers and administrators	Multidisciplinary	National expert consensus meeting, external expert review	Systematic literature review	Levels 1–4‡	A–C, GPP‡
Khadilkar et al 37	Ottawa Panel Evidence-Based Clinical Practice Guidelines for Post-stroke Rehabilitation	2006	Physiotherapists, occupational therapists, physicians and clients	Multidisciplinary	External expert review and practitioner review	Systematic literature review	Levels 1–3.2‡	A–D‡
RNAO29 30	(1) Nursing Best Practice Guideline. Stroke Assessment across the Continuum of Care	2005	Nurses, healthcare professionals and administrators	Nursing	External stakeholder review (including clients and families) SCORE Project review	Systematic literature review	Levels 1–4‡	A–B, GPP‡
	(2) Stroke Assessment across the Continuum of Care 2011 supplement	2011	Nurses, healthcare professionals and administrators	Nursing	Peer review	Systematic literature review of published guidelines	Levels 1–4‡	E‡
Europe
ESO38 39	Guidelines for Management of Ischaemic Stroke and Transient Ischaemic Attack	2008	NS	Multidisciplinary	NS	Systematic literature review	Levels 1–4‡	A–C, GPP‡
	Evidence-Based Stroke Rehabilitation: an expanded guidance document from the ESO Guidelines for Management of Ischaemic Stroke and Transient Ischaemic Attack 2008*	2009	NS	Multidisciplinary	Editorial group review	Systematic literature review	Levels 1–4‡	E‡
ISWP11	National Clinical Guidelines for Stroke	2012	Funders, clinical staff, managers of stroke services, patients with stroke, their families and friends	Multidisciplinary	Internal and external peer review (national and international)	Systematic literature review	Levels 1–3‡	E‡
NICE18	Stroke Rehabilitation: long-term rehabilitation after stroke	2013	Healthcare professionals, educationalists, consumers	Multidisciplinary	Public consultation	Systematic literature review	Levels 1–3.2‡	E‡
SIGN2	Brain Injury Rehabilitation in Adults	2013	Managers of a health service, healthcare clinicians, clients, their carers and researchers	Multidisciplinary	National open meeting, independently expert review, SIGN editorial group	Systematic literature review	Levels 1–4	A–D, GPP
SIGN33	Management of Patients with Stroke: identification and management of dysphagia (CPG 119)	2010	Healthcare clinicians, healthcare service planners, clients, their families and carers	Multidisciplinary	Consumer review, independent expert review, public consultation, SIGN editorial group.	Systematic literature review	Levels 1–4	A–D, GPP
SIGN10	Management of Patients with Stroke: rehabilitation, prevention and management of complications, and discharge planning (CPG 118)	2010	Health practitioners, specialists in public health, healthcare service planners, clients, families and carers	Multidisciplinary	External expert review, public consultation, SIGN editorial group.	Systematic literature review	Levels 1–4	A–D, GPP

*Level of evidence:

Level 1: A systematic review; meta-analyses of RCTs; well-powered RCTs.

Level 2: An RCT.

Level 3–1: A pseudo-RCT, that is, alternate allocation.

Level 3–2: A comparative study with concurrent controls: non-randomised experimental trial, cohort study, case–control study, interrupted time series with a control group.

Level 3–3: A comparative study without concurrent controls: historical control study, two or more single-arm studies, interrupted time series without a parallel control group.

Level 4: Case studies; a cross-sectional study or case series.

†Grade of the recommendation:

Grade A: Body of evidence can be trusted to guide practice (level 1 or 2 studies with low risk of bias).

Grade B: Body of evidence can be trusted to guide practice in most situations (level 1 or 2 studies with low risk of bias, level 1 or 2 studies with moderate risk of bias).

Grade C: Body of evidence provides some support for recommendation(s) but care should be taken in its application (level 3 studies with low risk of bias, level 1 or 2 studies with moderate risk of bias).

Grade D: Body of evidence is weak and recommendation must be applied with caution (level 4 studies or level 1–3 studies with high risk of bias).

Grade I: Insufficient information to formulate a recommendation.

Grade E: Nil grade system used, alternative approach based on evidence strength and consensus of the guideline development group.

‡Level of evidence and/or grading system converted to NHMRC (2008) classification of evidence.

ABIKUS, Acquired Brain Injury Knowledge Uptake Strategy; CPG, clinical practice guideline; CSS, Canadian Stroke Strategy; DVA/DoD AHA, Department of Veterans Affairs/Department of Defence American Heart Association; ESO, European Stroke Organisation; Grade GPP, Good practice points based on clinical experience/consensus of the guideline development group; INCOG, international cognitive; ISWP, Intercollegiate Stroke Working Party; NHMRC, National Health and Medical Research Council; NICE, National Institute for Health and Care Excellence; NS, none stated; NZGG, New Zealand Guideline Group; RCT, randomised controlled trial; RNAO, Registered Nurses’ Association of Ontario; SCORE, Stroke Canada Optimisation of Rehabilitation by Evidence; SFNZ and NZGG, Stroke Foundation of New Zealand and New Zealand Guideline Group; SIGN, Scottish Intercollegiate Guidelines Network; TBI, traumatic brain injury.

Results

Search and guideline characteristics

The electronic search strategy identified 427 publications with 48 duplicates. After screening and review, 23 documents containing 20 guidelines were included in the review (figure 1 shows Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow chart).²⁵ Included guidelines covered stroke (n=12) and traumatic brain injury (n=4); and some were discipline specific (occupational therapy n=2, nursing n=1, pharmacological treatment=1).

The characteristics and the development processes of each guideline are provided in table 1. Guideline development groups were from Australia/New Zealand (4), Europe (6), USA (6) and Canada (4). All guideline developers conducted a systematic literature search; however, methods used to extract the data and synthesise the evidence varied. Some guideline developers (n=7) graded the level of study evidence included for review, while most graded both the level of study evidence and strength of the recommendations (n=13).

Methodological quality

The AGREE-II domain scores for each guideline (n=20) are shown in table 2. The mean scores (range; SD) for the domains were: scope and purpose 85.1% (53%–100%; SD 18.3); stakeholder involvement 67.9% (14%–100%; SD 25.2); rigour of development 64.0% (9%–96%; SD 26); clarity of presentation 76.2% (22%–100%; 20.5); applicability 36.6% (0%–100%; SD 35.2) and editorial independence 57.9% (0%–100%; 37.2). The kappa values ranged from fair κ_w= 0.38 (95% CI 0.11 to 0.64) to very good 0.94 (95% CI 0.88 to 1.0). The overall inter-rater agreement was intraclass correlation=0.95 (95% CI 0.92 to 0.97), indicating very good strength of agreement.

Table 2

Guideline assessment according to the AGREE-II instrument (n=20)

Guideline organisation/society/authors	Domain scores (%)						Mean domain scores (%)	Agreement between appraisers
	Scope and purpose	Stakeholder involvement	Rigour of development	Clarity and presentation	Applicability	Editorial independence		Weighted kappa coefficient (κ, 95% CI)
USA
Wheeler and Acord-Vira34	86.1	61.1	53.1	88.9	10.4	45.8	57.6	0.93 (0.86 to 1.0)
Wolf and Nilsen35	94.4	58.3	57.3	66.7	0	29.2	51.0	0.74 (0.61 to 0.87)
DVA/DoD AHA36	86.1	63.9	62.5	75	0	0	47.9	0.75 (0.62 to 0.87)
Miller et al 41	69.4	58.3	9.4	22.2	0	50	34.9	0.94 (0.88 to 1.0)
Warden et al 42	80.6	13.9	30.2	50	0	0	29.1	0.67 (0.52 to 0.83)
Weinstein et al 43	27.8	22.2	4.2	38.9	0	79.2	28.7	0.64 (0.41 to 0.87)
Australia/New Zealand
Bayley et al 31	94.4	66.7	81.3	77.8	68.8	83.3	78.7	0.38 (0.11 to 0.64)
Stroke Foundation9	100	100	90.6	100	83.3	100	95.7	0.90 (0.72 to 1.1)
NZGG32	91.7	83.3	70.8	83.3	52.1	75	76	0.73 (0.52 to 0.95)
SFNZ and NZGG26	100	100	89.6	88.9	75	87.5	90.2	0.70 (0.56 to 0.83)
Canada
ABIKUS40	75	55.6	53.1	77.8	0	0	43.6	0.75 (0.59 to 0.90)
CSS27 28	100	91.7	87.5	94.4	66.7	100	90.0	0.91 (0.84 to 0.98)
Khadilkar et al 37	88.9	52.8	70.8	75	0	0	47.9	0.80 (0.68 to 0.91)
RNAO29 30	100	80.56	76	86.1	70.8	66.7	80.0	0.38 (0.16 to 0.60)
Europe
ESO38 39	52.8	30.6	45.8	66.7	0.0	100	49.3	0.86 (0.75 to 0.96)
ISWP11	100	97	91	97	54	100	89.8	0.77 (0.62 to 0.91)
NICE18	91.7	72.2	72.9	66.7	58.3	83.3	74.2	0.64 (0.39 to 0.89)
SIGN2	75	75	56.3	75	35.4	50	61.1	0.46 (0.23 to 0.68)
SIGN33	91.7	75	89.6	94.4	56.3	25	72	0.62 (0.42 to 0.82)
SIGN10	97.2	100	87.5	100	100	83.3	94.7	0.68 (0.36 to 1.0)

ABIKUS, Acquired Brain Injury Knowledge Uptake Strategy; AGREE, Appraisal of Guidelines for Research and Evaluation; CSS, Canadian Stroke Strategy; DVA/DoD AHA, Department of Veterans Affairs/Department of Defence American Heart Association; ESO, European Stroke Organisation; ISWP, Intercollegiate Stroke Working Party; NICE, National Institute for Health and Care Excellence; RNAO, Registered Nurses’ Association of Ontario; SFNZ and NZGG, Stroke Foundation of New Zealand and New Zealand Guideline Group; SIGN, Scottish Intercollegiate Guidelines Network.

Fifteen (75%) guidelines were assessed as ‘recommended’ for use,^{2 9–11 18 26–37} since their quality scores ranged between 5 and 7, representing good-quality to high-quality guidelines. Four (20%) guidelines were ‘recommended for use after modification’, since they were given quality scores of 3 and 4.^38–42 One guideline with an overall score of 2 was ‘not recommended’.⁴³ Three of the 20 guidelines were rated as high (>75%) in all domains of AGREE-II.^{9 10 26} Guidelines updated more frequently were more often of higher quality (ie, had higher AGREE-II scores).

Synthesis of recommendations

The synthesis of clinical management themes and corresponding categories for each guideline are provided in table 3. Five major clinical management themes were identified within the eligible guidelines. These were: medical management (management of depression, pain, behaviour); organisation of services (composition of therapy teams, rehabilitation processes, discharge planning); rehabilitation therapies; managing complications and community management. The primary recommendations from the highest rated guidelines^{9–11 26–28} are synthesised in online supplementary table 1. Comparison of guideline recommendations between the top-rated stroke guideline and the top-rated guideline for traumatic injury³² (ie, where a recommendation is consistent across both aetiologies) has been made and is displayed in online supplementary table 1.

Table 3

Guideline recommendation themes (five) and associated theme categories in acquired brain injury rehabilitation (n=20)

Theme and guideline recommendation category

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

Medication management theme

Depression/mood management

•

•

•

•

•

•

•

•

•

•

Aggression management

•

•

•

•

•

•

Psychosis

•

Memory

•

•

Executive dysfunction

•

•

Arousal and attention

•

•

Hypertension

•

DVT/anticoagulation therapy

•

•

•

•

Cholesterol management

Pain

•

•

•

•

•

•

•

Incontinence

•

•

•

•

HO

•

Spasticity

•

•

•

•

•

•

•

•

•

•

•

Organisation of services theme

Carer support

•

•

•

•

•

•

•

•

•

•

Peer support

•

•

•

•

•

•

Multidisciplinary service coordination

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Specialised rehabilitation unit

•

•

•

•

•

•

•

•

•

Processes/delivery of rehabilitation services

•

•

•

•

•

•

•

•

•

•

•

•

Rehabilitation therapies theme

Amount and intensity

•

•

•

•

•

•

•

•

•

•

•

•

Timing

•

•

•

•

•

•

•

•

•

•

Sensation/sensorimotor

•

•

•

•

•

•

•

•

Communication

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Visual/perceptual deficits

•

•

•

•

•

•

•

•

•

•

•

•

Cognition

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Psychosocial

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Activities of daily living

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Motor function

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Upper limb management

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Family participation in therapy

•

•

•

•

•

•

•

•

•

•

Carer/family training

•

•

•

•

•

•

•

•

•

•

•

•

•

Home programme/self-practice

•

•

•

•

•

•

•

•

Patient/family education

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Goal setting

•

•

•

•

•

•

•

•

•

Managing complications theme

Spasticity

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Contracture

•

•

•

•

•

•

•

•

•

•

•

Subluxation

•

•

•

•

•

•

•

•

•

•

Pain

•

•

•

•

•

•

•

•

•

•

•

Oedema

•

•

•

Fatigue

•

•

•

Behaviour/mood

•

•

•

•

•

•

•

Pressure care

•

•

•

•

•

Falls

•

•

•

•

•

•

•

Nutrition

•

•

•

•

•

•

•

•

•

•

•

•

•

Incontinence

•

•

•

•

•

•

•

•

•

•

•

•

DVT

•

•

•

•

•

•

•

Swallowing (dysphagia)

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

HO

•

Seizure management

•

•

Nursing neurological assessments

•

Community management theme

Driving

•

•

•

•

•

•

•

•

•

•

•

Return to work/volunteer

•

•

•

•

•

•

•

•

•

•

•

Leisure

•

•

•

•

•

•

•

•

•

•

Sexuality

•

•

•

•

•

•

•

•

•

•

•

Psychosocial rehabilitation

•

•

•

•

•

•

•

•

•

•

Outpatient cognitive rehabilitation

•

•

•

•

•

•

•

•

•

Outpatient motor rehabilitation

•

•

•

•

•

•

•

•

•

•

1= Wheeler,³⁴ 2=Wolf,³⁵ 3=DVA/DoD AHA,³⁶ 4=Miller,⁴¹ 5=Warden,⁴² 6=Weinstein,⁴³ 7=Bayley,³¹ 8=Stroke Foundation (Australia),⁹ 9=NZGG,³² 10=SFNZ and NZGG,²⁶ 11=ABIKUS,⁴⁰ 12=CSS,^{27 28} 13=Khadilkar et al,³⁷ 14=RNAO,^{29 30} 15=ESO,^{38 39} 16=ISWP,¹¹ 17=NICE,¹⁸ 18=SIGN,² 19=SIGN,³³ 20=SIGN.¹⁰

ABIKUS, Acquired Brain Injury Knowledge Uptake Strategy; CSS, Canadian Stroke Strategy; DVA/DoD AHA, Department of Veterans Affairs/Department of Defence American Heart Association; DVT, deep vein thrombosis; ESO, European Stroke Organisation; HO, heterotopic ossification; ISWP, Intercollegiate Stroke Working Party; NICE, National Institute for Health and Care Excellence; RNAO, Registered Nurses’ Association of Ontario; SCORE, Stroke Canada Optimisation of Rehabilitation by Evidence; SFNZ and NZGG, Stroke Foundation of New Zealand and New Zealand Guideline Group; SIGN, Scottish Intercollegiate Guidelines Network.

Medical management

Thirteen^{2 9–11 26–28 31 32 36 38–40 42 43} of the 20 guidelines (65%) included recommendations for medical management. Of these thirteen guidelines, the most common category was for spasticity management (85% provided recommendations), followed by depression management (77% provided recommendations), pain management (54% provided recommendations) and aggression management (46% provided recommendations). Few guidelines had recommendations for heterotopic ossification (8.3%), psychosis (8.3%), arousal/attention (17%) and memory (17%). Consistency of guideline recommendations were noted for: the use of botulinum toxin type A for the management of spasticity, minimising the use of benzodiazepines and neuroleptic antipsychotic medications in the management of aggression, not routinely prescribing antidepressants poststroke for the prevention of depression and use of selective serotonin reuptake inhibitors (SSRIs) as first line of drug treatment for depression postbrain injury.

Organisation of services

Eighteen of the included guidelines (90%) contained recommendations related to the organisation of rehabilitation services, which were grouped in the following categories: carer support, peer support, multidisciplinary service delivery, specialised rehabilitation unit of care (stroke/neurological ward) and process/delivery of service (table 3). Guideline recommendations within this theme were consistently reported across guidelines; with 5^{11 18 26 32 40} of the 18 guidelines reporting at least one recommendation in all 5 categories. The most common categories of service organisation recommendations of these 18 guidelines were use of a multidisciplinary team model (88% provided recommendations), followed by processes/delivery of rehabilitation services (67% provided recommendations) and provision of carer support (56% provided recommendations). It is noted that guidelines that have been updated more recently (ie, Stroke Foundation⁹) are removing recommendations related to organisation of services from the guideline, instead referring readers to a national stroke services framework.

Rehabilitation therapies

Nineteen of the 20 guidelines (95%) had recommendations pertaining to rehabilitation therapies. There were 15 categories identified within this theme (table 3). The most common category of recommendations was for ‘motor function’ (95% of the 19 guidelines provided recommendations), ‘activities of daily living’ (89% provided recommendations) ‘cognition’ (84%), ‘upper limb management’ and ‘patient/family education’ (79% each) and ‘communication’ and ‘psychosocial’ (74% each). Few guidelines made recommendations for the categories of ‘sensation/sensorimotor’ rehabilitation (42%) and ‘home programme/self-practice’ (42%).

The guidelines with the broadest scope (ie, had at least one recommendation in most of the 15 categories) were the Stroke Foundation of New Zealand and New Zealand Guideline Group (SFNZ and NZGG),²⁶ Stroke Foundation (Australia) guidelines⁹ and Intercollegiate Stroke Working Party of UK (ISWP)¹¹ with recommendations in all categories (100%). Guidelines narrowest in scope (ie, recommendations in the fewest number of categories) were Khadilkar et al,³⁷ SIGN² and Registered Nurses’ Association of Ontario, Canada (RNAO)^{29 30} with recommendations in 13%, 33% and 33% of categories, respectively. Guideline recommendations were less consistent across categories in rehabilitation therapies, as shown in table 3.

Managing complications

Most (n=18, 90%) guidelines had recommendations for managing complications, which were grouped into: spasticity, contracture, subluxation, pain, oedema, fatigue, behaviour, pressure care, falls, nutrition, incontinence, deep vein thrombosis, swallowing (dysphagia), heterotopic ossification, seizure management and neurological nursing. The Stroke Foundation (Australia) guidelines⁹ was broadest in scope within this category, with complication recommendations in 12 of the 16 categories (75%), followed by SFNZ and NZGG²⁶ and Weinstein,⁴³ both with recommendations in 11 of the 16 categories (69%). It is important to note that while Weinstein⁴³ had broad scope in this category, this guideline was not recommended for use according to the AGREE-II rating.

Community management

Sixteen guidelines (80%) included community management recommendations with the most common categories of recommendations being ‘driving’, ‘return to work/volunteer’ and ‘sexuality’ (11 of the 16 guidelines; 69% made recommendations in these categories). Recommendations in this category varied in terms of specificity; that is, some guidelines stated more general recommendations (ie, therapy should be provided), whereas other guidelines made specific recommendations about therapeutic interventions (ie, task-specific practice).

Overall, we found that the guidelines with the highest AGREE-II ratings of mean domain score percentage (ie, >75% in all six domains) were Stroke Foundation (Australia),⁹ SIGN¹⁰ and SFNZ and NZGG.²⁶ The top four guidelines for breadth of scope and recommendation specificity are NZGG,³² Canadian Stroke Strategy^{27 28} and ISWP¹¹ and for medical management, Acquired Brain Injury Knowledge Uptake Strategy.⁴⁰

Discussion

This systematic review explores the quality and the scope of published CPGs for both vascular and traumatic acquired brain injury rehabilitation in a single, comprehensive review. The quality of the reviewed guidelines, as well as the scope and breadth of recommendations contained in these guidelines varied greatly, which has implications for the clinical use of each CPG. Research has demonstrated an association between stroke outcome and CPG compliance,⁴⁴ thus, providing clinicians with this synthesised set of recommendations (from highly rated guidelines) is the first step in ensuring quality of care universally in rehabilitation, irrespective of type of acquired brain injury or of country of injury.

This review of 20 CPGs, containing more than 2088 recommendations, demonstrated differences between guidelines which could be expected to substantially influence clinical rehabilitation. The methodological quality of the reviewed guidelines varied, with only three guidelines achieving high ratings in all six AGREE-II domains. Across all the guidelines, the highest AGREE-II domain score was for ‘scope and purpose’ and the lowest was for ‘applicability’, suggesting that few guidelines provide information to clinicians for how to implement CPG recommendations into rehabilitation.

While the majority of CPGs were of sufficient quality according to AGREE-II ratings to be recommended, the scope of recommendations along with the depth of recommendations varied. For example, while Miller⁴¹ and RNAO^{29 30} made only one recommendation for incontinence management, NZGG³² provided 11 separate recommendations in the same category. Despite its recent publication (2016), one guideline was not recommended for use⁴³ and contained multiple recommendation statements that were contradictory to the majority of the other guidelines. For example, in this guideline it was stated that ‘routine use of prophylactic antidepressant medications is unclear’ which contradicts recommendations in all five top-rated guidelines, whereby ‘routine use of antidepressants to prevent poststroke depression is not recommended’.^{9–11 26 27} Similarly, this guideline stated ‘acupuncture may be considered as an adjunct treatment for dysphagia’, which directly contradicts the Australian Stroke Foundation’s⁹ updated recommendation, whereby ‘acupuncture should not be used for treatment of dysphagia in routine practice’. Aside from this, there were recommendations which appeared to be universally agreed to by all guideline development groups. These were those specifically pertaining to ‘using a multidisciplinary approach for rehabilitation’, ‘the prescription of SSRIs for the management of poststroke depression’ and the use of ‘task-specific motor retraining’ for impaired movement. Recommendations in these categories were consistent in their clinical recommendations, the research evidence cited in support of the recommendations and the breadth of content summarised. Having such consistency suggests to clinicians that these areas of practice are universally held as representing ‘quality’ rehabilitation.

The differing methods used by each guideline development group may explain some of the observed variation between recommendations. Other explanations may include the year of guideline development (ie, availability of evidence for inclusion may have varied), date of search by guideline development group or the eligibility criteria and prioritisation process used when writing the guideline recommendations. Our findings support the importance of moving towards a universal, international guideline with pooled resources for funding adequate searching and appraisal (such as achieved by the international guidelines for the selection of lung transplant candidates).⁴⁵

Separating out clinical conditions (ie, vascular from trauma) is likely inefficient in clinical practice, given that both conditions are treated consistently with common research evidence findings. Our synthesis found common recommendations across both vascular and trauma CPGs in the areas of organisation of services, rehabilitation therapies, managing complications and community management. We do acknowledge unique guidelines for each condition in the areas of ‘medication’ and ‘behaviour’ management; however, rehabilitation practice recommendations do not appear to differ outside these areas which suggests that a synthesised set of recommendations could substantially improve the quality of rehabilitation. Kirsner and Marston⁴⁶ highlight that variability in guidelines and issues around applicability of recommendations to ‘real-life’ contexts can make the selection and use of guidelines challenging. The usefulness of CPGs rests on the reasonable assumption that following the recommendations will improve care, but having multiple guidelines to apply within a single neurorehabilitation setting is unlikely to achieve this. Factor such as 20 available guidelines, published across 23 separate documents, with updates occurring in a modular format and varying modes of access (online, freely available, paid access) hinder clinicians’ behaviours regarding guideline selection and implementation.

Pragmatically, rehabilitation clinicians are likely to work with mixed acquired brain injury patient populations. Synthesising recommendations of the guidelines with higher methodological quality, as in the present review may improve the future consistency of clinical rehabilitation guidelines and in turn influence the quality of care in this field. Further to this, having direct comparison within a single document between stroke and trauma brain injury recommendations may highlight where rehabilitation practices should differ. Our study has rated all rehabilitation CPGs across both clinical conditions and suggests that clinicians become familiar with those of both high quality and broad scope. While clinicians may be more familiar with their own national/local clinical practice guidelines, findings from our systematic review suggest that these may not always be of the most methodologically rigorous.

The main limitation of the present study is, perhaps also one of its strengths. That is, the use of a standardised method and rating tool. As previously discussed, the AGREE-II instrument assesses how well a CPG development process is reported but not the specific clinical content of the CPG recommendations. As we synthesised only the highest quality guidelines for this review, it must be acknowledged that a guideline could receive a high AGREE-II rating, yet contain low-quality recommendations based on the level of evidence accepted by the guideline development group. Our chosen review method may mean that additional and important aspects of a CPG and its ease of implementation were not rated. For example, since the rating tool selected (AGREE-II) does not rate the level of intervention detail provided in the recommendation statements, these aspects fell outside of the current systematic review findings. We have sought to capture this detail in our qualitative synthesis; however, we recommend that future discussions of CPG rating tools and systematic reviews of CPGs continue to explore this issue.

Summary

Multiple CPGs exist to guide rehabilitation for adults after acquiring a brain injury, reporting on either vascular (stroke) or traumatic literature, which makes selecting a high-quality guideline to implement overwhelming and difficult. Variability exists in guideline quality, breadth and detail of recommendations and availability of information on applicability of these guidelines. This is likely underpinned by the evidence included and method of evidence synthesis employed by each guideline development group. Clinicians need to be aware of quality differences between these guidelines and be prepared to look beyond their local guidelines to use the highest quality guidelines in the rehabilitation of adults with an acquired brain injury from stroke or traumatic causes.

The authors thank Professor Maria Crotty for assistance with textual synthesis analysis.

References

¹ Australian Institute of Health and Welfare. Disability in Australia: acquired brain injury. Canberra: Australian Institute of Health and Welfare, 2007.

² Scottish Intercollegiate Guidelines Network (SIGN). Brain Injury Rehabilitation in Adults: a national clinical guideline. Edinburgh: SIGN, 2013. Publication 130.

³ Hubbard IJ, Harris D, Kilkenny MF, et al. Adherence to clinical guidelines improves patient outcomes in Australian audit of stroke rehabilitation practice. Arch Phys Med Rehabil 2012; 93: 965–71. doi:10.1016/j.apmr.2012.01.011

⁴ Kang C, Schneck M. The role of guidelines in stroke. Seminars in Cerebrovascular Diseases and Stroke 2004; 4: 155–8. doi:10.1053/j.scds.2005.04.007

⁵ Quaglini S, Cavallini A, Gerzeli S, et al. Economic benefit from clinical practice guideline compliance in stroke patient management. Health Policy 2004; 69: 305–15. doi:10.1016/j.healthpol.2003.12.015

⁶ Donnellan C, Sweetman S, Shelley E. Health professionals' adherence to stroke clinical guidelines: a review of the literature. Health Policy 2013; 111: 245–63. doi:10.1016/j.healthpol.2013.05.002

⁷ Bayley MT, Hurdowar A, Richards CL, et al. Barriers to implementation of stroke rehabilitation evidence: findings from a multi-site pilot project. Disabil Rehabil 2012; 34: 1633–8. doi:10.3109/09638288.2012.656790

⁸ Stroke Foundation. National Stroke Audit: rehabilitation services report. Melbourne, Australia, 2016.

⁹ Stroke Foundation. Clinical Guidelines for Stroke Management. Melbourne Australia, 2017.

¹⁰ Scottish Intercollegiate Guidelines Network (SIGN). Management of patients with stroke: rehabilitation, prevention and management of complications, and discharge planning. A national clinical guideline. Edinburgh: SIGN, 2010. Publication 118.

¹¹ Intercollegiate Stroke Working Party. National Clinical Guideline for Stroke. London: Royal College of Physicians, 2012.

¹² Woolf SH, Grol R, Hutchinson A, et al. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ 1999; 318: 527–30. doi:10.1136/bmj.318.7182.527

¹³ Alonso-Coello P, Martínez García L, Carrasco JM, et al. The updating of clinical practice guidelines: insights from an international survey. Implement Sci 2011; 6: 107. doi:10.1186/1748-5908-6-107

¹⁴ Grimshaw JM, Eccles MP, Lavis JN, et al. Knowledge translation of research findings. Implement Sci 2012; 7: 50. doi:10.1186/1748-5908-7-50

¹⁵ Hurdowar A, Graham ID, Bayley M, et al. Quality of stroke rehabilitation clinical practice guidelines. J Eval Clin Pract 2007; 13: 657–64. doi:10.1111/j.1365-2753.2007.00708.x

¹⁶ Rohde A, Worrall L, Le Dorze G. Systematic review of the quality of clinical guidelines for aphasia in stroke management. J Eval Clin Pract 2013; 19: 994–1003. doi:10.1111/jep.12023

¹⁷ Brain Injury Australia: Brain Injury Network, Acquired Brain Injury. http://www.braininjuryaustralia.org.au/acquired-brain-injury/ (accessed Nov 2016).

¹⁸ National Clinical Guideline Centre (NICE). Stroke Rehabilitation: Long-Term Rehabilitation After Stroke. London: NICE, 2013. Clinical guideline no. 162.

¹⁹ The AGREE Collaboration. Appraisal of Guidelines for Research and Evaluation (AGREE-II) instrument. http://www.agreecollaboration.org (accessed Nov 2016).

²⁰ Brouwers MC, Kho ME, Browman GP, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 2010; 182: E839–42. doi:10.1503/cmaj.090449

²¹ Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 1968; 70: 213–20. doi:10.1037/h0026256

²² Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med 2005; 37: 360–3.

²³ Altman DG. Practical statistics for medical research. Boca Raton: Chapman & Hall/CRC, 1991.

²⁴ National Health and Medical Research Council (NHMRC). NHMRC standards and procedures for externally developed guidelines. Canberra: National Health and Medical Research Council, 2007.

²⁵ Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 2009; 339: b2700. doi:10.1136/bmj.b2700

²⁶ Stroke Foundation of New Zealand and New Zealand Guidelines Group. Clinical Guidelines for Stroke Management 2010, 2010.

²⁷ Hebert D, Lindsay MP, McInyre A, et al. Canadian Stroke Best Practice Recommendations: stroke rehabilitation practice guidelines, update 2015. Canadian stroke strategy best practices and standards writing group. Ottawa, Ontario Canada: Canadian Stroke Network, 2016.

²⁸ Blacquiere D, Lindsay MP, Foley N, et al; Canadian stroke best practice recommendations: Telestroke best practice guidelines update 2017. Canadian stroke strategy best practices and standards writing group. Ottawa, Ontario Canada: Canadian Stroke Network, 2016.

²⁹ Registered Nurses’ Association of Ontario (RNAO). Stroke Assessment across the Continuum of Care 2011 supplement. 2011 http://rnao.ca/sites/rnao-ca/files/Stroke_with_merged_supplement_sticker_2012.pdf (accessed Nov 2016).

³⁰ Registered Nurses’ Association of Ontario (RNAO). Nursing Best Practice Guideline: Stroke assessment across the continuum of care, 2005. http://www.rnao.org/Storage/12/652_BPG_Stroke_Assessment.pdf (accessed Nov 2016).

³¹ Bayley MT, Tate R, Douglas JM, et al. INCOG Guidelines for Cognitive Rehabilitation Following Traumatic Brain Injury: methods and overview. J Head Trauma Rehabil 2014; 29: 290–306. doi:10.1097/HTR.0000000000000070

³² New Zealand Guidelines Group. The diagnosis, acute management and rehabilitation of people after traumatic brain injury. 2006 http://www.nzgg.org.nz/guidelines/dsp_guideline_popup.cfm?guidelineID=129 (accessed Nov 2016).

³³ Scottish Intercollegiate Guidelines Network (SIGN). Management of patients with stroke: identification and management of dysphagia: a national clinical guideline. Edinburgh: SIGN, 2010. Publication 119.

³⁴ Wheeler S, Acord-Vira A. Occupational therapy practice guidelines for adults with traumatic brain injury. Bethesda, MD: American Occupational Therapy Association Inc, (AOTA), 2016.

³⁵ Wolf TJ, Nilsen DM. Occupational therapy practice guidelines for adults with stroke. Bethesda, MD: American Occupational Therapy Association (AOTA), 2015.

³⁶ Veterans Affairs Department of Defence American Heart Association. American Stroke Association. VA/DoD Clinical practice guideline management of stroke rehabilitation. http://www.healthquality.va.gov/guidelines/Rehab/stroke/stroke_full_ 221.pdf (accessed Nov 2016).

³⁷ Khadilkar A, Phillips K, Jean N, et al. Ottawa Panel Evidence-Based Clinical Practice Guidelines for Post-stroke Rehabilitation. Top Stroke Rehabil 2006; 13: 1–269. doi:10.1310/3TKX-7XEC-2DTG-XQKH

³⁸ European Stroke Organisation (ESO) Executive Committee. Guidelines for management of ischaemic stroke and transient ischaemic attack 2008. Cerebrovasc Dis 2008; 25: 457–507. doi:10.1159/000131083

³⁹ Quinn TJ, Paolucci S, Sunnerhagen KS, et al. Evidence-based stroke rehabilitation: an expanded guidance document from the European Stroke Organisation (ESO) guidelines for management of ischaemic stroke and transient ischaemic attack 2008. J Rehabil Med 2009; 41: 99–111. doi:10.2340/16501977-0301

⁴⁰ Aquired Brain Injury Knowledge Uptake Strategy (ABIKUS) guideline development group. Evidence based recommendations for rehabilitation of moderate to severe acquired brain injury. 2007 http://www.abiebr.com/pdf/abikus_aug_07.pdf (accessed Nov 2016).

⁴¹ Miller EL, Murray L, Richards L, et al. Comprehensive Overview of Nursing and Interdisciplinary Rehabilitation Care of the Stroke Patient: a scientific statement from the American Heart Association. Stroke 2010; 41: 2402–48. doi:10.1161/STR.0b013e3181e7512b

⁴² Warden DL, Gordon B, et al. on behalf of the Neurobehavioral Guidelines Working Group. Guidelines for the pharmacologic treatment of neurobehavioral sequelae of traumatic brain injury. J Neurotrauma 2006; 23: 1468–501.

⁴³ Winstein CJ, Stein J, Arena R, et al. Guidelines for Adult Stroke Rehabilitation and Recovery: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 2016; 47: e98–e169. doi:10.1161/STR.0000000000000098

⁴⁴ Micieli G, Cavallini A, Quaglini S. Guideline compliance improves stroke outcome. A Preliminary Study in 4 Districts in the Italian Region of Lombardia 2002; 33: 1341–7.

⁴⁵ Maurer JR, Frost AE, Estenne M, et al. International guidelines for the selection of lung transplant candidates. The International Society for Heart and Lung Transplantation, the American Thoracic Society, the American Society of Transplant Physicians, the European Respiratory Society. Transplantation 1998; 66: 951–6.

⁴⁶ Kirsner RS, Marston W. Venous ulcers: so many guidelines, too many guidelines? Wound Repair Regen 2016; 24: 751–2. doi:10.1111/wrr.12441