The role of the practice order: A systematic review about contextual interference in children

Abstract

Aim

We aimed to identify and evaluate the quality and evidence of the motor learning literature about intervention studies regarding the contextual interference (CI) effect (blocked vs. random practice order) in children with brain lesions and typically developing (TD) children.

Method

Eight databases (Cinahl, Cochrane, Embase, PubMed, Pedro, PsycINFO, Scopus and Web of Knowledge) were searched systematically with predefined search terms. Controlled studies examining the CI effect in children (with brain lesions or TD) were included. Evidence level, conduct quality, and risk of bias were evaluated by two authors independently. A best evidence synthesis was performed.

Results

Twenty-five papers evaluating TD children were included. One of these studies also assessed children with cerebral palsy. Evidence levels were I, II, or III. Conduct quality was low and the risk of bias high, due to methodological issues in the study designs or poor description thereof. Best evidence synthesis showed mainly no or conflicting evidence. Single tasks showed limited to moderate evidence supporting the CI effect in TD children.

Conclusion

There is a severe limitation of good-quality evidence about the CI effect in children who practice different tasks in one session, especially in children with brain lesions.

About the Authors:

Judith V. Graser

Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Current address: Paediatric Rehab Research Group, Rehabilitation Centre for Children and Adolescents, University Children’s Hospital Zurich, Affoltern am Albis, Switzerland

Affiliations Paediatric Rehab Research Group, Rehabilitation Centre for Children and Adolescents, University Children’s Hospital Zurich, Affoltern am Albis, Switzerland, Children’s Research Centre CRC, University Children’s Hospital Zurich, Zurich, Switzerland, Research Line Functioning and Rehabilitation CAPHRI, Department of Epidemiology, Maastricht University, Maastricht, the Netherlands

ORCID logo http://orcid.org/0000-0002-9921-8581

Caroline H. G. Bastiaenen

Contributed equally to this work with: Caroline H. G. Bastiaenen, Hubertus J. A. van Hedel

Roles Investigation, Methodology, Validation, Writing – review & editing

Affiliation: Research Line Functioning and Rehabilitation CAPHRI, Department of Epidemiology, Maastricht University, Maastricht, the Netherlands

Hubertus J. A. van Hedel

Contributed equally to this work with: Caroline H. G. Bastiaenen, Hubertus J. A. van Hedel

Roles Funding acquisition, Investigation, Methodology, Resources, Validation, Writing – review & editing

Affiliations Paediatric Rehab Research Group, Rehabilitation Centre for Children and Adolescents, University Children’s Hospital Zurich, Affoltern am Albis, Switzerland, Children’s Research Centre CRC, University Children’s Hospital Zurich, Zurich, Switzerland

Introduction

Children with brain lesions, such as cerebral palsy (CP), frequently have to deal with impairments of the sensorimotor system, leading to restrictions in activities and independence which could affect participation in daily life [1]. Intensive therapeutic interventions are needed to address these limitations. Usually, several tasks or skills are practiced during single therapeutic sessions to cover a broad range of impairments and limitations and to keep the children engaged. However, learning one skill can be influenced by practicing another one during the same session [2]. This so-called contextual interference effect [3] has been established by Battig and has been described later in various motor learning studies. These studies showed that the contextual interference effect was low when different tasks are practiced in a blocked order, meaning that one task is practiced until it is learned before moving to the next [4]. A high contextual interference effect is achieved if different tasks are practiced in a random order [4]. Most evidence about the contextual interference effect has been obtained in healthy young adults with the intent of improving practice schedules in sports. In this population, a low contextual interference effect results in better acquisition but worse transfer and retention of task performance. The findings are the opposite if practicing with high contextual interference [4,5].

For paediatric patients after rehabilitation discharge, it is important that learned tasks can be retained over time and generalised to other conditions or tasks. The evidence is lacking, though, whether this specific population would also benefit from a high contextual interference, and whether this can be achieved by practicing in a random order.

Several aspects seem to influence the contextual interference effect. Magill and Hall mentioned that task characteristics (e.g. non-laboratory tasks such as beanbag throwing vs. laboratory tasks such as coincident anticipation timing tasks) and subject characteristics like age or the level of experience are important, although it remains unclear how age exactly influences the contextual interference effect [5]. Therefore, it remains unclear what the optimal practice order in typically developing children (e.g., [6–8]) and in children with brain lesions undergoing neurorehabilitation is.

Some reviews about contextual interference exist [5,9–12], but none of them included a systematic evaluation regarding the effects and quality of intervention studies in the field of paediatric motor learning, which limits the relevance for the field of paediatric neurorehabilitation. This shortage of knowledge is unfortunate since neurorehabilitation is based on motor learning principles [13], and therapeutic interventions could be improved by adhering to such principles [14]. As we assume that results from contextual interference studies involving typically developing children could be better generalised to children with brain lesions compared to results obtained from healthy adults, the objective of this systematic review was to investigate the evidence of contextual interference in children with congenital or acquired brain lesions and typically developing children. The research question is the following: What is the evidence concerning the contextual interference effect for children with congenital or acquired brain injuries and typically developing children?

Methods

This review was conducted by following certain aspects of the guidelines provided by the American Academy of Cerebral Palsy and Developmental Medicine (AACPDM) [15] and supplemented by the risk of bias tool provided by the Cochrane Collaboration [16]. The procedure is described in detail below.

Since no participants were required for this study, obtaining ethical approval was not necessary.

Inclusion and exclusion criteria

We defined inclusion criteria in line with PICO (Population, Intervention, Control, Outcome) and included studies assessing children (with congenital or acquired brain injuries and/or typically developing) in the age range between 1 and 18 years (Population). We included motor learning studies examining the contextual interference effect with a random practice order group (Intervention) and at least one blocked practice order group (Control). Any outcome evaluating the acquisition, retention, and/or transfer of the learned skill (Outcome) was considered selectable. JG defined the search terms based on PICO and HVH reviewed the search terms. The following search terms were used:

Population: ‘child’, ‘children’, ‘childhood’, ‘paediatrics’, ‘adolescents’, ‘adolescence’, ‘youths’, ‘student’, ‘elementary’, ‘high school’.

Intervention: ‘motor learning’, ‘skill learning’, ‘contextual interference’, ‘practice order’;

Control group: ‘blocked and random’;

Outcome: ‘performance’, ‘acquisition’, ‘retention’, ‘transfer’, ‘generalisation’, and ‘generalisability’.

Search terms were customised for each database including the use of MESH terms when applicable. We refrained from adding methodological criteria (e.g. randomisation procedures for group allocation) to get a broad overview of the existing literature. The search was performed by the first author on the databases Cinahl, Cochrane, Embase, PubMed, Pedro, PsycINFO, Scopus and Web of Knowledge (an example of a detailed search strategy is shown in S1 Table). The reference lists of original research papers and systematic reviews were screened for further eligible studies. The primary search was performed in March 2015 (for the period 1960 to March 2015) and updated in December 2016 (period 2015 to 2016).

We excluded studies that allowed a true practice phase (i.e., not a typical familiarization phase which normally consists of a few trials that are performed to have the participant give an idea about the skill to be learned) before the actual acquisition phase. There is a phenomenon called “learning to learn” [17] which describes the beneficial influence of prior practice experience on an unfamiliar motor task [18]. In humans, this phenomenon has been observed in visuomotor [18,19], and cognitive tasks [20–22]. In a recent study with healthy young adults practicing a dynamic balance task, the “learning to learn” phenomenon could not be reproduced [23]. We included studies with a wide variety of motor tasks. Since there is no general accordance about the “learning to learn” phenomenon we decided to exclude studies with prior practice phase because this would affect the comparability with studies without such a practice phase.

We also excluded conference papers, studies of which only the abstracts were available, unpublished dissertations, and studies in a language other than English or German.

Selection procedure

Firstly, JG and HVH read the titles and abstracts and decided upon eligibility independently. Secondly, the same authors read the full texts of the papers that were considered eligible and decided on final eligibility independently. In cases of disagreement, the authors discussed until consensus was reached.

Data extraction and analysis

JG summarised relevant data using a standardised data extraction sheet. Included were the type of study, participants (population, age, number per group), task, information regarding the acquisition, retention and transfer phases, including time points, duration, used outcome measures (e.g. anticipation timing task) and parameters (e.g. variable and random error), as well as the results. In case of incomplete reporting of patient characteristics or study procedure, we contacted the authors of the original publication.

We had planned to pool data when studies were comparable regarding populations, interventions, outcomes, and types of studies. If we were not able to follow this approach, due to heterogeneity of the studies, pooling within relevant subgroups was considered. When we would choose to refrain from pooling completely, because meaningful subgroups could not be built a best evidence synthesis would be performed using the levels of evidence described by Tulder et al. [24]. The results of each study would be rated as significant (favouring blocked or random order), inconsistent or not significant. Consistency of the results within one study would be given if 75% of the comparisons (e.g. measures, parameters, tasks) would provide similar results (e.g. random was better than blocked for the retention). Then the evidence of the different tasks (several studies per task, if possible) was rated according to the suggestions by Tulder et al. [24]: strong (consistent findings among multiple high quality randomised controlled trials (RCTs)), moderate (consistent findings among multiple low quality RCTs and/or controlled clinical trials (CCTs) and/or high one high quality RCT), limited (one low quality RCT and/or CCT, conflicting (inconsistent findings among multiple RCTs and/or CCTs; inconsistent findings among different parameters within one trial (if only one trial is available) or no evidence from trials (no RCTs or CCTs). Consistency of the studies assessing similar tasks would be given if more than 75% of the studies showed results in the same direction.

Methodological quality assessment

JG and CB assessed the level of evidence and the methodological quality of the eligible studies independently from each other, as recommended by the AACPDM [15]. The detailed descriptions of the evidence levels are displayed in S2 Table. The evaluation of the methodological quality included the seven aspects also described by the AACPDM [15] (for details see S3 Table).

We also evaluated the risk of bias. Bias is defined as any systematic error that results in an incorrect estimate of the true effect of an exposure on the outcome of interest. Bias can result in an over- or underestimation of the true value depending on the type of bias. We considered selection bias (i.e. sequence generation, allocation concealment), performance bias (i.e. blinding participants, personnel), attrition bias (i.e. incomplete outcome data), reporting bias (i.e. selective reporting), and other sources of bias (see also S4 Table). As bias is a potential threat to the trustworthiness of study results, the strength of a conclusion of a systematic review should be adjusted accordingly [16].

JG and CB rated the risk of bias according to recommendations described in the Cochrane Handbook for Systematic reviews of Interventions [16]. Discrepancies between the two authors were discussed until consensus was reached.

Results

Search results

The primary search in the databases led to 503 records (Fig 1). The 11 full texts that were excluded due to topic reasons were not motor learning studies or did not evaluate contextual interference. Thirteen full texts were excluded due to design issues (5 had no random order practice group, 4 had several practice orders within the same group (i.e., no parallel study design), 2 had a preparation phase, in which participants were allowed to practice for several sessions prior to the acquisition phase, 1 study had no blocked practice but a series of trials in blocks, and 1 had no blocked group but two random groups with different levels of variation). By checking the references of eight reviews (four were found during the primary search, three within the references of these reviews and one by coincidence on google scholar) that focussed on contextual interference in general (not specifically for children), we could include two additional studies. The references of the original research studies contained no further eligible studies. The updated search resulted in one additional study (Fig 1).

[Figure omitted. See PDF.]

Fig 1. Flowchart of the search process.

Flowchart of the primary search (time period between 01.01.1960 and 31.03.2015) the updated search (time period of 2015 and 2016), and the inclusion and exclusion process. From: Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med 6(7): e1000097. doi:10.1371/journal.pmed1000097. For more information, visit www.prisma-statement.org.

https://doi.org/10.1371/journal.pone.0209979.g001

We included 25 papers in this systematic review. One paper presented three different experiments with three different samples [25]. This paper is handled as three separate studies in our review. Four of 27 studies assessed typically developing children as well as participants with disorders: Down’s Syndrome [6], learning disabilities [26], mild mental handicaps [27], and CP [28]. Only the groups of typically developing children (i.e. with no diagnoses or disorders) were included for the best evidence synthesis. Concerning patient groups with congenital or acquired brain lesions, we included only the study in which children with CP learned to grasp unfamiliar objects [28]. Information of each study is presented in Table 1.

[Figure omitted. See PDF.]

Table 1. Summary of the included studies.

https://doi.org/10.1371/journal.pone.0209979.t001

The methodological quality of the studies

Evidence levels (Table 2).

Most studies have an evidence level II or III, except for one, which had a level I [34]. Eight studies did not perform a randomisation [7,14,31–33,35,37,45], and were rated as level III. Two studies used cluster randomisation of school classes [30,44]. One study randomly divided the participants into a complex and a simple task group and then further subdivided these groups into subgroups [14], but as this latter subdivision was not described, we did not consider it randomisation.

[Figure omitted. See PDF.]

Table 2. Levels of evidence and conduct quality.

https://doi.org/10.1371/journal.pone.0209979.t002

Quality of conduct (Table 2).

The methodological quality of the studies was low. Twenty-two studies received 0 out of 7 points. No study received a point for the questions 1 (allocation, randomisation), 2 (description and adherence of interventions), 5 (statistics), and 7 (appropriate methods the control confounding and bias). Two studies received 1 point (study by Jones & French [38], experiment 1 from Ste-Marie et al. [25]) and three studies received 2 points (study by Broadbent et al. [31], experiments 2 and 3 from Ste-Marie et al. [25]).

Risk of bias.

Most of the studies had a high risk of bias in all domains, except for Broadbent et al. [31] who defined the primary outcome measure and presented the results for all time points [31]. Therefore, we rated the risk of attrition bias as low.

Combining the study results by pooling the data in a meta-analysis was not appropriate since the studies were too heterogeneous considering the populations, types of motor tasks, intensities, time points (e.g. retention after five minutes, 24 hours or three weeks), and outcome measures. We also refrained from a subgroup analysis due to the low methodological quality and too small sample sizes of studies with sufficient relevant similarities.

Best evidence synthesis

The best evidence synthesis (Table 3) was conducted for the typically developing children. We grouped the studies according to the tasks they evaluated and received 15 task-specific groups. For most tasks, the evidence was conflicting or absent. Single tasks showed limited to moderate evidence supporting the contextual interference effect. Acquisition: there was limited evidence for the benefit of blocked practice over random practice for dance step sequence [29], ball rolling, striking, and kicking [44], and a positioning motor task [40]. Retention: There was limited evidence for the benefit of random practice over blocked practice for throwing different balls [35] and playing tennis in a simulated environment [31]. Transfer: Moderately consistent evidence was found for the benefit of random practice over blocked practice for handwriting skills [25] and limited evidence for throwing different balls [35].

[Figure omitted. See PDF.]

Table 3. Best evidence synthesis according to tasks, learning level and practice order.

https://doi.org/10.1371/journal.pone.0209979.t003

Discussion

We investigated the evidence of contextual interference in children with congenital or acquired brain injuries and typically developing children. Only one study included children with brain lesions. The methodological quality of the studies was low and the risk of bias high, which makes it difficult to formulate recommendations whether children with brain lesions or typically developing children would profit more from a blocked or random approach.

Contextual interference in children with hemiplegic cerebral palsy

The one study examining children with hemiplegic CP (n = 18, mean age 10 years, SD 1.8) also included a group of age-matched typically developing peers (n = 18, mean age 10.4 years, SD 1.7 years) [28].The study consisted of two experiments. In the first experiment, children lifted various known objects while the vertical lifting load force was measured. The second experiment investigated the contextual interference effect. The participants lifted three novel objects with varying weights 27 times. One group did this in blocked order, the other group in random order. Retention was tested immediately after and 24 hours after the practice phase. While during acquisition blocked practice resulted in better differentiation of force rates between the different objects, there was no difference during the retention trials between the practice groups. Based on these two experiments the authors concluded that children with hemiplegic CP have an internal picture of the weight of familiar objects, that they can learn and retain to provide the right amount of force when lifting objects with unknown weights, but that the amount of practice rather than the practice order is essential for this learning process [28]. A conclusion about the contextual interference effect in children with CP is difficult, though, because this was the only study we found and it had some qualitative shortcomings. In the methodological quality assessment, this study received 0 of 7 points (Table 2) and the risk of bias was high. The main reasons for our low rating of this study were the lack of information about the control group at baseline (only the means of the whole groups are reported without a measure of variation), the missing information about the adherence, the psychometric properties of the assessments were not reported, it was unclear whether assessors were masked, the lack of a power calculation, and the number of drop-outs were not reported.

Contextual interference in typically developing children

When considering contextual interference studies with typically developing children, a conclusion also remains unclear. Although the best evidence synthesis showed limited to moderate support of the contextual interference effect for some of the tasks (favouring random practice for better retention and transfer), in the majority of the tasks no evidence (acquisition: n = 7/15, retention: 6/13, transfer: n = 3/10) or conflicting evidence (acquisition: n = 5/15, retention: n = 5/13, transfer: n = 5/10) was found (Table 3). Besides the low methodological quality, several factors could have affected the contextual interference effect contributing to the inconclusiveness of some results [2].

The influence of types of skills and variations

One of these factors might be the kind of skill and its variations that were studied. For example, Magill and Hall already discussed that the generalisability of the contextual interference effect could be influenced by task characteristics like laboratory tasks, such as coincident anticipation timing tasks, versus motor skill performance outside the laboratory or non-laboratory tasks, such as throwing beanbags [5].

In our review, we found four studies that investigated laboratory tasks, namely anticipation timing tasks [6,32,45], and a positioning motor task [40]. The other studies investigated non-laboratory tasks: six examined volleyball skills [30,33,34,38,39,46], four beanbag throwing [7,14,27,37], and three experiments investigated handwriting skills [25]. Further tasks were dance step sequences [29], tennis skills [31], lifting unfamiliar objects [28], mirror tracing tasks [26], throwing different balls [35], hitting different balls with different rackets [36], rolling, striking and hitting balls [44], a propelling task (Crokinole game) [41], throwing tennis balls [42], and playing the clarinet [43].

From a therapeutic point of view, this change of interest from laboratory to non-laboratory tasks is desired. While learning a laboratory task can reflect the capacity of the child, i.e. what a person with a health condition actually is able to do, learning non-laboratory tasks may better resemble daily life activities, i.e. performance (what a person does in his/her usual environment, e.g. skills or tasks needed for self-care, leisure activities, school or work), as described by the World Health Organisation’s International Classification of Functioning, Disability and Health (ICF) [47]. Practicing non-laboratory tasks might improve the translation to other daily life relevant tasks, as these tasks might appear more natural and are probably more frequently occurring in the child’s daily routines than laboratory tasks.

In healthy adults, the evidence is mixed when practicing laboratory tasks, but practicing non-laboratory tasks supports the contextual interference effect [5]. In our review, the best evidence synthesis shows limited to moderate support for the contextual interference effect in five non-laboratory and one laboratory task (Table 3). However, only in a “throwing different balls” [35] task, we found the contextual interference effect for both the retention and transfer. In summary, a clear differentiation about how laboratory or non-laboratory tasks support the contextual interference effect in children cannot be determined.

The influence of experience, age and task difficulty

In adults, it is suggested that the learner needs to have an idea of the movement or some initial experience to profit from variations of the practice schedule, but the relation between age and the contextual interference remains unclear [5]. In children, Jarus and Goreover observed a difference between three age groups (5 years, 7 years, and 11 years) who practiced beanbag throwing [37]. In general, older children performed the bean bag throwing task better. While the group of 7-year-old children acquired and retained better during blocked practice, there was no difference between the practice groups during the transfer [37]. Hence, for this task, blocked practice might be more beneficial for this age group. While the authors argued that this finding could be explained by the low experience level and the young age of the 7-year-old children, these observations were not made for the 5-year-old children, which is not in line with the author’s explanation. Furthermore, Pollock and Lee compared the learning of propelling a small wooden disk with the middle finger (an adaptation of the Crokinole game) between children and adults [41]. They could reconstruct the contextual interference effect in adults and also in children during transfer and retention, but the children showed no difference in task acquisition between the blocked and random groups [41]. Apparently, this pattern has been observed in adults practicing a difficult task and can be explained with a benefit of blocked practice during acquisition of easy tasks only [2,48].

If the difficulty level of a task seems to influence only the acquisition but not the retention and transfer in adults, the random practice order can be recommended in adults, regardless whether the task is simple or difficult. In typically developing children, though, we cannot make such a recommendation, because the evidence is unclear as experience, age, and task difficulty intermingle with each other. It becomes even more complicated when trying to generalise the effects of experience, age, and task difficulty on the contextual interference effect to children with congenital or acquired brain lesions. For example, the question of whether children in neurorehabilitation are novices or whether they are experienced has to be considered carefully. Given that children with congenital brain lesions or acquired brain lesions in a chronic state have had therapy for most of their lives or for a long time, respectively, they could be considered an expert group. Children with a (sub-) acute acquired brain injury most likely could, on the one hand, be regarded as novices when it comes to relearning motor activities of daily life with their impaired sensorimotor and cognitive systems. On the other hand, they might have performed all these activities independently before they experienced the brain injury which puts them on another starting point compared to children with congenital brain lesions. All these aspects need to be incorporated when considering the contextual interference effect in paediatric neurorehabilitation.

Can knowledge about related populations be transferred to children with brain lesions?

The evidence about the contextual interference in typically developing children is limited, yet, more extensive compared to the evidence available for children with brain lesions. In adults with brain lesions, the results are not clearly supporting the contextual interference effect. In adults with chronic stroke, for example, the typical contextual interference effect could not be reconstructed when performing three specific movements (wrist/finger extension, elbow joint extension, and shoulder joint abduction) combined with active neuromuscular stimulation [49]. When practicing a task that was designed to approximate the steps needed take a coffee cup out of the cupboard and put it on the table, the random practice outperformed the blocked group in stroke patients [50]. Schweighofer et al. [51] concluded that these conflicting results might be due to the lack of separation of the patients between high and low working memory capabilities. In their study, individuals with stroke with normal visuospatial working memory retained visuomotor skills better when practicing in random order compared to blocked order, while in participants with low visuospatial working memory retention performance did not differ between practice groups [51]. It seems that also in adults with brain injury results might be influenced by other factors additional to the practice order.

We assume that results obtained in typically developing children (compared to healthy adults) could be better generalised to children with brain lesions. Nevertheless, we should be cautious, because, firstly, the physical requirements are different: damaged sensory pathways and structures involved in processing sensory information, such as found in children with brain lesions, reduce the ability to detect errors and consequently impair motor learning [52,53]. Secondly, learning a motor task with a damaged brain is likely different from learning with an intact, typically developing brain. This stands in contrast with previous observations in adults with a unilateral stroke which suggested that the stroke affected the control and execution, but not the learning of motor skills per se [54]. However, as this issue is under debate, there is still no definite agreement which brain regions and processes are involved in learning and how the learning processes are executed (e.g. [55–57]. Furthermore, the individual lesion areas in combination with many other factors make every patient and their learning abilities and strategies unique. Therefore, further research is needed to understand the relation of pathological changes and motor learning disorders [58]. Thirdly, it has been shown that physiotherapists perceive primary impairments (e.g. muscle tone, movement patterns) and secondary outcomes (e.g. range of motion, joint alignment, muscle strength), as well as personal factors (e.g. motivation) and environmental factors (e.g. support and expectations from the family) as important factors influencing the acquisition of motor abilities in children with CP [59]. These factors could slow down or even hinder learning in children with brain lesions compared to typically developing children.

The methodological quality of the studies

A reconstruction of the methodological approach was challenging in many studies. It was often unclear whether certain methodological aspects were poorly performed or just poorly described. This influenced our assessment of bias and quality. For example, the psychometric properties of the applied outcome measures were unknown or not reported. Several studies mentioned reliability evaluations of their measures, while information on validity or absolute measurements errors (such as the standard error of measurement) was missing. Also, the description of the appropriate statistics and power calculation (both are needed to score a “yes”) was missing. Only one study mentioned a power analysis but did not present it [37].

The oldest papers we included in this review were published in the 1980ies (Fig 2). The Standardised Reporting of Trials (SORT) Statement [60] was published in 1994. Before that checklists for interventional trials were not available. This might partly explain why the older studies did not report all aspects systematically and were therewith rated low in the quality evaluation.

[Figure omitted. See PDF.]

Fig 2. The distribution of the publication years of the articles included in this systematic review.

https://doi.org/10.1371/journal.pone.0209979.g002

Limitations

There are some limitations of this systematic review which need to be mentioned. Our literature search was limited to seven databases and restricted to published articles only. Grey literature was not considered. We excluded studies which performed a proceeding familiarisation phase prior to the actual practice phase, whether or not this affects the learning remains to be discussed. For the best evidence synthesis, we did not subdivide the study results according to long- or short-term learning phases because there were not enough comparable studies to build subgroups. This asks for a cautious interpretation of the results.

Recommendations for future research

We expect that the contextual interference effect in children with brain lesions can influence rehabilitation outcomes. Therefore, we would recommend to design such studies and include these particular patient groups. A careful selection of the motor task to be studied is crucial: it should be clinically relevant and motivating for the child to perform and it should provide objective parameters to quantify the retention or transfer of the task or skill particularly, as these are most relevant for the child after discharge from rehabilitation. The study should be designed and its results reported in accordance with the various internationally accepted checklists to ensure high study quality and low bias.

Conclusion

To recapitulate, there is a persistent demand for increasing our knowledge about the contextual interference effect in children, especially, in children with brain lesions, as the number of existing studies is small, and the methodological quality of the studies is low. For some tasks, we found limited evidence supporting the contextual interference effect in typically developing children. However, we would be cautious in generalising these results to children with brain lesions. To improve movement or sports programmes in typically developing children and advance rehabilitation programmes for children with brain lesions, there is an emerging need to increase our knowledge of the contextual interference effect in these populations.

Supporting information

[Figure omitted. See PDF.]

S1 Table. Example of the search strategy used for the primary search on PsycINFO.

https://doi.org/10.1371/journal.pone.0209979.s001

(DOCX)

S2 Table. Levels of evidence.

Levels of evidence in intervention or group studies and single-case design studies according to the American Academy for Cerebral Palsy and Developmental Medicine (AACPDM) [15]. Abbreviations: ATD = alternating treatment design; MB = multiple baseline; MBD = multiple baseline design; n = number; RCT = randomised controlled trial; SSRD = single subject research design.

https://doi.org/10.1371/journal.pone.0209979.s002

(DOCX)

S3 Table. Conduct questions.

Questions to evaluate the methodology of an intervention study according to the American Academy for Cerebral Palsy and Developmental Medicine [15].

https://doi.org/10.1371/journal.pone.0209979.s003

(DOCX)

S4 Table. The Cochrane Collaboration’s tool for assessing the risk of bias.

The risk of bias tool, presented by the Cochrane handbook for systematic reviews of interventions [16].

https://doi.org/10.1371/journal.pone.0209979.s004

(DOCX)

S5 Table. PRISMA checklist.

https://doi.org/10.1371/journal.pone.0209979.s005

(DOC)

Acknowledgments

We would like to thank all the authors, who responded to our e-mails and providing us with more information about their studies. A very special thank you goes to Yvonne Perathoner and Martina Hediger, the librarians of the library of the Children’s University Hospital Zurich, who supported our search and ordered copies of all the papers we asked for.

Citation: Graser JV, Bastiaenen CHG, van Hedel HJA (2019) The role of the practice order: A systematic review about contextual interference in children. PLoS ONE 14(1): e0209979. https://doi.org/10.1371/journal.pone.0209979

References

1. Rosenbaum P, Paneth N, Leviton A, Goldstein M, Damiano D, Dan B, et al. A report : the definition and classification of cerebral palsy. Dev Med Child Neurol. 2006;49: 8–14.

2. Lee TD, Wulf G, Schmidt RA. Contextual interference in motor learning: dissociated effects due to the nature of task variations. Q J Exp Psychol Sect A Hum Exp Psychol. 1992;44: 627–644.

3. Battig W. Intratask interference as a source of facilitation on transfer and retention. In: Voss J, editor. Topics in learning and performance. New York: Academic Press; 1972. pp. 131–159.

4. Hodges NJ, Lohse KR, Wilson A, Lim SB, Mulligan D. Exploring the dynamic nature of contextual interference: previous experience affects current practice but not learning. J Mot Behav. 2014;46: 455–67. pmid:25226441

5. Magill RA, Hall KG. A review of the contextual interference effect in motor skill acquisition. Hum Mov Sci. 1990;9: 241–289.

6. Edwards JM, Elliot D, Lee TD. Contextual interference effects during skill acquisition and transfer in Down’s Syndrome adolescents. Adapt Phys Act Q. 1986;3: 250–258.

7. Pigott RE, Shapiro DC. Motor schema: the structure of the variability session. Res Q Exerc Sport. 1984;55: 41–45.

8. Del Rey P, Whitehurst M, Wughalter E, Barnwell J. Contextual interference and experience in acquisition and transfer. Percept Mot Skills. 1983;57: 241–242.

9. Brady F. The contextual interference effect and sport skills. Percept Mot Skills. 2008;106: 461–472. pmid:18556902

10. Brady F. A theoretical and empirical review of the contextual interference effect and the learning of motor skills. Quest. 1998;50: 266–293.

11. Merbah S, Meulemans T. Learning a motor skill: effects of blocked versus random practice—a review. Psychol Belg. 2011;51: 15–48.

12. Barreiros J, Figueiredo T, Godinho M. The contextual interference effect in applied settings. Eur Phys Educ Rev. 2007;13: 195–208.

13. Kitago T, Krakauer JW. Motor learning principles for neurorehabilitation. Handb Clin Neurol. 2013;110: 93–103. pmid:23312633

14. Jarus T, Gutman T. Effects of cognitive processes and task complexity on acquisition, retention, and transfer of motor skills. Can J Occup Ther. 2001;68: 280–289. pmid:11765667

15. Darrah J, Hickman R, O ‘Donnell M, Vogtle L, Wiart L. AACPDM Methodology to develop systematic reviews of treatment interventions (revision 1.2) [Internet]. 2008 pp. 1–30. https://www.aacpdm.org/UserFiles/file/systematic-review-methodology.pdf

16. Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011] [Internet]. The Cochrane Collaboration; 2011. www.cochrane-handbook.org.

17. Harlow HF. The formation of learning sets. Psychol Rev. 1948;56: 51–65.

18. Seidler RD. Multiple Motor Learning Experiences Enhance Motor Adaptability. J Cogn Neurosci. 2004;16: 65–73. pmid:15006037

19. Braun DA, Aertsen A, Wolpert DM. Motor task variation induces structural learning. Curr Biol. 2009;19: 352–357. pmid:19217296

20. Kattner F, Cochrane A, Cox CR, Gorman TE, Green CS. Perceptual learning generalization from sequential perceptual training as a change in learning rate. Curr Biol. 2017;27: 840–846. pmid:28262488

21. Bejjanki VR, Zhang R, Li R, Pouget A, Green CS, Lu Z-L, et al. Action video game play facilitates the development of better perceptual templates. Proc Natl Acad Sci U S A. 2014;111: 16961–16966. pmid:25385590

22. Brown A, Kane M. Preschool children can learn to transfer: learning to learn and learning from from example. Cogn Psychol. 1988;20: 493–523. pmid:3191668

23. Giboin L-S, Gruber M, Kramer A. Motor learning of a dynamic balance task: Influence of lower limb power and prior balance practice. J Sci Med Sport. 2018;Article in.

24. Van Tulder M, Furlan A, Bombardier C. Updated method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group. Spine (Phila Pa 1976). 2003;28: 1290–1299.

25. Ste-Marie DM, Clark SE, Findlay LC, Latimer AE. High levels of contextual interference enhance handwriting skill acquisition. J Mot Behav. 2004;36: 115–126. pmid:14766494

26. Gophna S, Jarus T, Weintraub N. Effects of contextual interference on acquisition, retention and transfer of motor skill of children with and without learning disabilities. Isr J Occup Ther. 2007;16: 89–108.

27. Painter MA, Inman KB, Vincent WJ. Contextual interference effects in the acquisition and retention of motor tasks by individuals with mild mental handicaps. Adapt Phys Act Q. 1994;11: 383–395.

28. Duff S V, Gordon AM. Learning of grasp control in children with hemiplegic cerebral palsy. Dev Med Child Neurol. 2003;45: 746–757. pmid:14580130

29. Bertollo M, Berchicci M, Carraro A, Comani S, Robazza C. Blocked and random practice organization in the learning of rhythmic dance step sequences. Percept Mot Skills. 2010;110: 77–84. pmid:20391872

30. Bortoli L, Robazza C, Durigon V, Carra C. Effects of contextual interference on learning technical sports skills. Percept Mot Skills. SAGE Publications; 1992;75: 555–62. pmid:1408620

31. Broadbent DP, Causer J, Ford PR, Williams AM. Contextual interference effect on perceptual–cognitive skills training. Med Sci Sport Exerc. 2015;47: 1243–1250. pmid:25255127

32. Del Rey P, Whitehurst M, Wood J. Effects of experience and contextual interference on learning and transfer by boys and girls. Percept Mot Skills. 1983;56: 581–582.

33. Fialho JVAP, Benda RN, Ugrinowitsch H. The contextual interference effect in a serve skill acquisition with experienced volleyball players. J Hum Mov Stud. 2006;50: 65–77. Available: http://apps.webofknowledge.com/full_record.do?product=UA&search_mode=GeneralSearch&qid=3&SID=S2wJpn5qeFOhXR5X25v&page=10&doc=99

34. French KE, Rink JE, Werner PH. Effects of contextual interference on retention of three volleyball skills. Percept Mot Skills. SAGE Publications; 1990;71: 179–186.

35. Granda Vera J, Montilla MM. Practice schedule and acquisition, retention, and transfer of a throwing task in 6-yr.-old children. Percept Mot Skills. SAGE Publications; 2003;96: 1015–24. pmid:12831284

36. Green DP, Whitehead J, Sugden DA. Practice variability and transfer of a racket skill. Percept Mot Skills. 1995;81: 1275–1281. pmid:8684925

37. Jarus T, Goreover Y. Effects of contextual interference and age on acquisition, retention, and transfer of motor skill. Percept Mot Skills. 1999;88: 437–447. pmid:10483636

38. Jones LL, French KE. Effects of contextual interference on acquisition and retention of three volleyball skills. Percept Mot Skills. 2007;105: 883–890. pmid:18229542

39. Meira CMJ, Tani G. Contextual interference effects assessed by extended transfer trials in the acquisition of the volleyball serve. J Hum Mov Stud. 2003;45: 449–468.

40. Perez CR, Meira CM, Tani G. Does the contextual interference effect last over extended transfer trials? Percept Mot Skills. 2005;100: 58–60. pmid:15773693

41. Pollock BJ, Lee TD. Dissociated contextual interference effects in children and adults. Percept Mot Skills. 1997;84: 851–8. pmid:9172193

42. Saemi E, Porter JM, Varzaneh AG, Zarghami M, Shafinia P. Practicing along the contextual interference continuum: a comparison of three practice schedules in an elementary physical education setting. Kinesiology. 2012;44: 191–198.

43. Stambaugh LA. When repetition isn’t the best practice strategy: effects of blocked and random practice schedules. J Res Music Educ. SAGE PublicationsSage CA: Los Angeles, CA; 2011;58: 368–383.

44. Wegman E. Contextual interference effects on the acquisition and retention of fundamental motor skills. Percept Mot Skills. 1999;88: 182–187. pmid:10214642

45. Wrisberg C, Mead BJ. Developing coincident timing skill in children: a comparison of training methods. Res Q Exerc Sport. 1983;54: 67–74.

46. Zetou E, Michalopoulou M, Giazitzi K, Kioumourtzoglou E. Contextual interference effect in learning volleyball skills. Percept Mot Skills. 2007;104: 995–1004. pmid:17688156

47. World Health Organization. ICF-CY International Classification of Functioning, Disability and Health. Children & Youth Version. Geneva, CH: WHO Press, World Health Organization; 2007.

48. Tsutsui S, Lee TD, Hodges NJ. Contextual interference in learning new patterns of bimanual coordination. J Mot Behav. 1998;30: 151–7. pmid:20037030

49. Cauraugh JH, Kim SB. Stroke motor recovery: active neuromuscular stimulation and repetitive practice schedules. J Neurol Neurosurg Psychiatry. 2003;74: 1562–1566. pmid:14617717

50. Hanlon RE. Motor learning following unilateral stroke. Arch Phys Med Rehabil. 1996;77.

51. Schweighofer N, Lee J, Goh H, Choi Y, Kim SS, Stewart JC, et al. Mechanisms of the contextual interference effect in individuals poststroke. J Neurophysiol. 2011;106: 2632–2641. pmid:21832031

52. Seidler RD, Kwak Y, Fling BW, Bernard JA. Neurocognitive mechanisms of error-based motor learning. Adv Exp Med Biol. 2013;782: 39–60. pmid:23296480

53. Krakauer JW, Ghilardi M-F, Ghez C. Independent learning of internal models for kinematic and dynamic control of reaching. Nat Neurosci. 1999;2: 1026–31. pmid:10526344

54. Winstein C. Motor learning after unilateral brain damage. Neuropsychologia. 1999;37: 975–987. pmid:10426521

55. Gregory E, McCloskey M, Ovans Z, Landau B. Declarative memory and skill-related knowledge: evidence from a case study of amnesia and implications for theories of memory. Cogn Neuropsychol. Taylor & Francis; 2016;33: 220–40. pmid:20945204

56. Steinemann NA, Moisello C, Ghilardi MF, Kelly SP. Tracking neural correlates of successful learning over repeated sequence observations. Neuroimage. Elsevier Inc.; 2016;137: 152–164. pmid:27155129

57. McNamee D, Liljeholm M, Zika O, O’Doherty JP. Characterizing the associative content of brain structures involved in habitual and goal-directed actions in humans: a multivariate FMRI study. J Neurosci. 2015;35: 3764–3771. pmid:25740507

58. Ding Y, Yao B, Lai Q, McAllister JP. Impaired motor learning and diffuse axonal damage in motor and visual systems of the rat following traumatic brain injury. Neurol Res. 2001;23: 193–202. pmid:11320599

59. Bartlett DJ, Palisano RJ. Physical therapists’ perceptions of factors influencing the acquisition of motor abilities of children with cerebral palsy: implications for clinical reasoning. Phys Ther. 2002;82: 237–48. pmid:11869152

60. The Standards of Reporting Trials Group. A proposal for structured reporting of randomized controlled trials. J Am Med Assoc. 1994;272: 1926–1931.