Heterogeneous effects of eccentric training and nordic hamstring exercise on the biceps femoris fascicle length based on ultrasound assessment and extrapolation methods: A systematic review of randomised controlled trials with meta-analyses

Abstract

Objective

To systematically review the effects of eccentric training based on biceps femoris fascicle length using ultrasound assessment and extrapolation methods.

Design

Systematic review and meta-analysis of randomised controlled trials.

Data sources

CENTRAL, CINAHL Plus with full text, PubMed and OpenGrey databases were searched on 6 July 2021.

Eligibility criteria for selecting studies

Randomised controlled trials (RCTs) lasting at least four weeks and presenting data about biceps femoris (BF) fascicle length (FL) as an outcome.

Method

Searching databases, screening studies, performing risk of bias assessments and determining the level of evidence (LoE) for each meta-analysis were applied during the study. PRISMA 2020 statement and Cochrane Handbook for Systematic Reviews of Interventions were used as the guidelines of this systematic review.

Results

Eight randomised controlled trials included in meta-analyses. Based on the very low and low LoE, eccentric training has small (g = 0.29, 95% CI [-0.26, 0.85]), moderate (g = 0.72, 95% CI [0.17, 1.28]) and large (g = 2.20, 95% CI [0.99, 3.41]) effect sizes (ES) based on manual linear extrapolation (MLE), panoramic ultrasound scanning and trigonometric equation methods, respectively. Similarly, Nordic hamstring exercise (NHE) has small (g = 0.23 [-1.02, 1.47]), small (g = 0.38, 95% CI [-0.50, 1.27]) and large (g = 1.98, 95% CI [0.52, 3.44]) ES based on the MLE, panoramic ultrasound scanning and trigonometric equation methods, respectively.

Conclusion

ES of eccentric training, including NHE, vary between the MLE, panoramic ultrasound scanning, and equation methods. The relevant scientific community should have a consensus on measurement standards of the BF FL measurements. Further studies can be conducted to compare the effects of eccentric training based on the ultrasound assessment and extrapolation methods.

About the Authors:

Gokhan Yagiz

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Writing – original draft

* E-mail: [email protected]

Affiliation: School of Human and Behavioural Sciences, Bangor University, Bangor, United Kingdom

ORCID logo https://orcid.org/0000-0002-9214-1948

Esedullah Akaras

Roles Data curation, Formal analysis, Methodology

Affiliations Faculty of Health Sciences, Erzurum Technical University, Erzurum, Turkey, Faculty of Health Sciences, Gazi University, Ankara, Turkey

ORCID logo https://orcid.org/0000-0002-0305-4632

Hans-Peter Kubis

Roles Conceptualization, Supervision, Writing – review & editing

Affiliation: School of Human and Behavioural Sciences, Bangor University, Bangor, United Kingdom

Julian Andrew Owen

Roles Conceptualization, Supervision, Writing – review & editing

Affiliation: School of Human and Behavioural Sciences, Bangor University, Bangor, United Kingdom

Introduction

Hamstring strain injuries (HSIs) appear as an endemic injury among non-contact injuries for the sports that require high-speed running, including Australian Rules football, rugby union and football [1–5]. Despite increased efforts by researchers to provide an optimal injury prevention technique in the last two decades, HSIs have increased based on earlier epidemiologic data in Australian Rules football, rugby union and football [6]. For instance, Ekstrand and coworkers [7] detected a 4% annual increase in HSIs between 2001 and 2014 in professional football. The biceps femoris long head appears to be the most frequently injured muscle among the hamstring muscles [8]. In addition, re-injuries are very frequent in this anatomical section in the event that an adequate rehabilitation process and an adequate instrumental evaluation have not been performed [9].

The hamstring muscles are important contributors for stabilizing the knee joint, and a more balanced hamstring to quadriceps force ratio is shown to reduce lower limb injury [10–12]. The majority of HSIs occur during running activities [13, 14]. The late swing phase of running was defined as the most vulnerable time for hamstrings [15–17]. During the late swing phase of running, the hamstrings behave as an antagonist to the quadriceps femoris and produce eccentric contraction for controlling quadriceps femoris muscle and for decelerating tibia [18]. At this moment, the biceps femoris is exposed to the highest stretch and reaches about 110% of its length, which is greater than semimembranosus (108.2%) and semitendinosus (107.5) [19]. HSIs generally occur when the muscle fibres cannot resist the excessive tensile force [20]. For this reason, insufficient eccentric contraction of the hamstrings during the late swing phase of running was considered the leading cause of HSIs [15, 21]. In the light of this information, researchers have focused on improving the stated insufficient eccentric contraction of hamstrings and proposed eccentric strength training, including the popular Nordic hamstring exercise (NHE) as an injury prevention strategy for HSIs [22–25]. It should also be noted that there is an ongoing debate about whether hamstrings produces eccentric contraction or isometric contraction during the late swing phase of running [26, 27].

Shorter biceps femoris fascicle length (FL) has recently been proposed as a risk factor for HSIs in 2016 [28]. Timmins et al. [28] highlighted that a biceps femoris FL shorter than 10.56 cm increases the risk of an HSI more than fourfold. Since this date, the number of studies examining the effects of eccentric strength training, including NHE, on the biceps femoris FL has been increasing. Additionally, three systematic reviews and meta-analyses reporting effects of general eccentric strength training on the biceps femoris FL [29] or particularly the effects of the NHE [30, 31] on the biceps femoris FL have been published in the last two years.

In the previous systematic reviews and meta-analyses, Cuthbert et al. [30] claimed that the NHE has a very large effect size of more than 2.58 to increase biceps femoris FL; Medeiros, Marchiori and Baroni [31] reported large effect size (0.97) for the effects of NHE on the same parameter, and Gérard et al. [29] calculated a 1.97 cm eccentric strength training-induced increment in the biceps femoris FL. However, the previous meta-analyses [29–31] pooled the studies without consideration of whether the studies used which ultrasound assessment or extrapolation methods. Furthermore, none of the meta-analyses [29–31] explored the underlying reason for their substantial to considerable statistical heterogeneities [32] (I2 = 88.03% [30], I2 = 99% [29], I2 = 71% [31]) that detected by the I2 statistics, which indicates the percentage ratio of the variability in effect estimates caused by heterogeneity rather than chance [32].

Recently, Franchi et al. [33] have compared methods, including panoramic ultrasound scanning (extended field of view (EFOV)), manual linear extrapolation (MLE) and trigonometric equations for estimating biceps femoris FL; they demonstrated that equation methods from a single image significantly overestimate biceps femoris FL compared to the EFOV technique, while no significant difference between EFOV and MLE techniques was observed. Additionally, Franchi et al. [33] criticised the intervention studies used the trigonometric equation method to calculate biceps femoris FL for effects of eccentric training, and reported a high magnitude of biceps femoris FL change.

Despite lacking an intervention study comparing effects of eccentric training on the biceps femoris FL based on estimations via trigonometric equation methods, MLE and panoramic ultrasound scanning, this systematic review aims to recalibrate effect sizes of eccentric training in general and, in particular, effect sizes of the NHE on the biceps femoris FL comparing the ultrasound assessment and extrapolation methods.

Method

The Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) 2020 statement was used as the guideline for this study, which is designed on the basis of systematic reviews of randomised controlled trials consisting of a 27-item checklist [34].

Database search strategy

PubMed, CINAHL Plus with Full Text via Ebsco, The Cochrane Central Register of Controlled Trials (CENTRAL) and OpenGrey databases were searched for all the indicated date range. A combination of the following key terms were used for the database searches: ’Exercis*’, ’Training*’, ’Biceps Femoris’, ’Hamstring*’, ’Knee Flexors’, ’Posterior Thigh’, ’Semitendinosus’, ’Semimembranosus’, ’ACSA’, ’Architectur*’, ’Cross Sectional Area’, ’Cross-sectional Area’, ’Fascic*’, ’Fiber Length’, ’Fibre Length’, ’Pennat*’, ’Pinnat*’, ’Muscle Thickness’, ’Muscle Volume’, ’Muscle Structure’, ’Muscle Length’ and ’PCSA’. When applicable, relevant MeSH terms for ’exercise’ were added to the key terms during the database searches. When "OR" bullion operator was employed within the key term groups, "AND" bullion operator was used between the key term groups. The last search of the databases was conducted on 6 June 2021; all the database searches are shown in the S1 File.

The first author performed the database searches. Once the searches of PubMed, CINAHL Plus with Full Text via Ebsco and The Cochrane Central Register of Controlled Trials (CENTRAL) database were completed, citations were exported to the Endnotex9 citation manager [35]. The first author automatically removed duplicate citations through the Endnote citation manager.

Study selection process and criteria

After removing duplicates, the citations were independently screened based on the title and abstracts by the first and second authors via Rayyan (http://rayyan.qcri.org), a free web and mobile app designed for screening eligible studies for systematic reviews [36]. Additionally, the OpenGrey database was independently screened online on its webpage by the first and second authors. During the study screening period, the first and second authors were blinded to each other’s decisions about all the citations. After screening the studies for eligibility, disagreements regarding selecting eligible studies were resolved by a discussion between the first and second authors. The third and last authors were considered referees for unsolved discussions between the first and second authors for study selection. This process was also applied during the risk of bias assessment and data extraction processes when disagreements arose for selecting eligible studies. Once eligible studies were selected, the lead and second authors also screened reference lists of the included studies.

The following criteria were considered inclusion criteria: (1) being a randomised controlled trial (RCT), (2) eccentric hamstring interventions with at least four weeks of exercise, which was employed by the previous relevant systematic reviews [29–31], (3) presenting effects of eccentric training on biceps femoris FL as an outcome. This systematic review included both sexes as the previous systematic reviews did [29–31], Behan et al. [37] pointed out that biceps femoris FL does not differ between the genders. Additionally, Medeiros, Marchiori and Baroni [31] mentioned that including both sexes is unlikely to impact their meta-analysis.

Outcome measures

Eccentric exercise-induced alterations in biceps femoris FL based on the ultrasound assessment and extrapolation methods.

Risk of bias assessments, data extraction and synthesis

The Cochrane Collaboration’s tool for assessing the risk of bias in randomised trials [38] was independently used for determining the risk of bias in included studies by the first and second authors. By following instructions for risk of the bias assessment tool [38], eligible studies were investigated on the basis of random sequence generation (selection bias), allocation concealment (selection bias), blinding participants and personnel (performance bias), blinding outcome assessment (detection bias), incomplete outcome data (attrition bias), selective reporting (reporting bias) and other bias. Each category in this risk of bias assessment tool was graded as ‘low risk of bias,’ ‘unclear risk of bias,’ or ‘high risk of bias’ for each selected study. Afterwards, the decisions were entered into the RevMan computer program [39]. Any conflicts were resolved by the same discussion process for screening eligible studies. Data were independently extracted from included studies by the first and second authors. When a disagreement arose, it was solved through the same discussion mechanism used in the study selection section of this review. The extracted data comprised authors, years, participants’ characteristics, characteristics of exercise interventions, details of ultrasound measurement techniques and results.

Meta-analyses were performed using the Review Manager (RevMan 5.4.1) program [39]. A non-training placebo or control group was considered a comparator for an exercising group in each study. The mean difference (MD) in cm and the standardised mean difference (SMD) in Hedge’s (adjusted) g effect size were calculated for each meta-analysis as a summary statistic using RevMan [39]. The SMD used in the review was the effect size, namely, Hedges’ (adjusted) g in the RevMan program [40]. Hedges’ g differs from Cohen’s d by adjusting effect size and correcting potentially biased estimates in the case of a small sample (n < 20) [41]. The intervention effect size has been interpreted by the following classification: small (0.2), medium (0.5) or large (0.8), which are commonly used for Cohen’s d [42] and Hedges’ g [43] effect size interpretations [44].

The missing standard deviation (SD) is a common feature in studies presenting continuous outcome data [32]. The missing standard deviations of changes from baseline for a group can be calculated using the following formula [32, 45]:

SDchange corresponds to the SD of the mean changes from baseline, SDbaseline corresponds to the SD of the pre-test, SDfinal represents the SD of the post-test, and the r corresponds to the correlations between the SD baseline and SD final measurements; however, this correlation value is not generally presented in studies. Therefore, typically, it is not possible to calculate the SD of changes from baseline based on only having the SD baseline and SD post-intervention values. This systematic review followed the suggestions of the Cochrane Handbook for Systematic Reviews of Interventions from the starting point [32]. First, additional data, e.g., confidence intervals (CI), P values, t values, F values and standard errors, were checked and missing SD changes from baseline were calculated using the Review Manager (RevMan 5.4.1) program when sufficient information was available [39]. However, due to insufficient information, this type of calculation was not possible in most studies in the systematic review. As a second step, the authors of the eligible studies were contacted and asked to share missing relevant data. Before the meta-analyses, FL data of eligible studies was converted into centimetres (cm), to avoid miscalculations of the mean difference changes in meta-analyses.

When a meta-analysis was performed, heterogeneity was assessed by chi-squared (χ2, or Chi2) statistics. The level of heterogeneity calculated by I2 statistics indicates the percentage ratio of the variability in effect estimates caused by heterogeneity rather than chance [32]. 25%, 50%, and 75% I2 results were grouped as low, moderate and high, respectively [46]. Meta-analyses were performed using a more conservative random effect (RE) model for continuous data, inverse variance and 95% CI [47]. The random effect model was considered as providing a better account for methodological and statistical heterogeneities in a recent systematic review [48].

After performing meta-analyses, the relevant data were exported to GRADEpro GDT software [49], and the level of a body of evidence (LoE) was assessed by applying the GRADE (Grading of Recommendations, Assessment, Development and Evaluation) approach in the GRADE handbook [50]. The usage of the GRADE approach was recommended by the Cochrane Collaboration’s tool for assessing the risk of bias in randomised trials [38] and the Cochrane Handbook for Systematic Reviews of Interventions [32] for clarifying the level of a body of evidence. The GRADE approach classifies the quality of a body of evidence as high, moderate, low and very low [50]. A GRADE evidence profile was assessed via the GRADEpro GDT software for the levels of the bodies of evidence in consideration of study design, risk of bias, inconsistency, indirectness, imprecision and publication bias.

Results

Database search results

Initially, 428 records were identified throughout the database searches. 114 duplicate records were automatically removed via Endnotex9 citation manager [35]. The remaining 314 records were screened based on the title and abstracts via the Rayyan web program [36]. Afterwards, 28 records were included in the full-text screening. As a result, eight RCTs [51–58] were included in meta-analyses. The study selection process is illustrated in the PRISMA 2020 flow diagram (Fig 1). Additionally, and a PRISMA 2020 checklist is presented in the S2 File.

[Figure omitted. See PDF.]

Fig 1. PRISMA 2020 flow diagram.

This diagram illustrates the eligible study identification, screening, inclusion and exclusion processes of this systematic review.

https://doi.org/10.1371/journal.pone.0259821.g001

Characteristics of included studies

The study groups, participants’ ages, genders, physical activity levels, training types, total volumes, ultrasound extrapolation techniques, reliability of ultrasound assessments, mean changes and standard deviations of the mean changes between post and pre-tests, and results are presented in Table 1.

[Figure omitted. See PDF.]

Table 1. Characteristic of the eligible randomised controlled trials.

https://doi.org/10.1371/journal.pone.0259821.t001

Risk of bias assessments

The first and second authors independently completed risk of bias assessments for each included study via the Cochrane Collaboration’s tool for assessing the risk of bias in randomised trials [38]. The low risk of bias scores of the studies in the seven sections [38] ranged from three [51, 55, 56, 58] to five [52, 53]. The risk of bias assessment graph (Fig 2) and a table showing the authors’ conclusions on the each risk of bias parameter for each study (Fig 3) were generated via RevMan [39] for future use to determine the level of evidence for meta-analyses via GRADEpro GDT software [49].

[Figure omitted. See PDF.]

Fig 2. Risk of bias assessment graph.

This graph shows the general percentage ratio of reviewer authors’ judgements about the risk of bias of each bias item for all included studies (generated via RevMan 5.4.1).

https://doi.org/10.1371/journal.pone.0259821.g002

[Figure omitted. See PDF.]

Fig 3. Review authors’ judgements about each risk of bias item for included studies [51–58].

Positive (+) values represent a low risk of bias, question marks (?) represent an unclear risk of bias, and negative (-) values represent a high risk of bias (generated via RevMan 5.4.1).

https://doi.org/10.1371/journal.pone.0259821.g003

Evidence levels of the meta-analyses

The LoE of meta-analyses was determined using the GRADEpro GDT software based on the GRADE approach [50], which categorised the level of a body of evidence as high, moderate, low and very low [50]. The results for each meta-analysis are presented in S3 File.

Meta-analyses

In total, eight RCTs [51–58] were included in the meta-analyses for effects of eccentric training on biceps femoris FL, and six RCTs [51, 52, 54, 56–58] were included in the meta-analyses for effects of the NHE on biceps femoris FL. Concerning the study of Lovell et al. [52], the FL values of the after training-NHE group were not included in meta-analyses for maintaining methodological homogeneity among the studies. The other pooled studies [51, 54, 56–58] in the meta-analyses investigating the effects of Nordic hamstring exercise on the biceps femoris muscle architecture did not perform the NHE after a sports training. In support, the FIFA 11+ program has prescribed the Nordic hamstring exercise before training [59].

Effects of the eccentric training based on the ultrasound assessment and extrapolation methods

Eight RCTs [51–58] were included in the meta-analysis assessing the effects of eccentric training on the biceps femoris FL. In future subgroup analyses, three [51, 52, 56] of the RCTs were included in the trigonometric equation subgroup. Three RCTs [54, 55, 58] were included in the manual linear extrapolation (MLE) subgroup, and the remaining two RCTs [53, 57] were included in the panoramic ultrasound scanning subgroup. Hedge’s (adjusted) g effect sizes were calculated for the random effect model and 95% CI for overall effects of eccentric training, effects of eccentric training based on ultrasound equation, linear extrapolation and panoramic ultrasound assessment methods (Figs 4 and 5). Additionally, mean (cm) changes in biceps femoris FL for overall eccentric training and for the same subgroups were calculated and presented in Figs 6 and 7.

[Figure omitted. See PDF.]

Fig 4. Forest plot effect sizes of eccentric training on biceps femoris fascicle length based on ultrasound assessment and extrapolation methods.

Overall eccentric training has a large effect size on increasing biceps femoris FL (g = 1.06 [0.44, 1.68], I2 = 75%). Eccentric training has a small effect based on the manual linear extrapolation method (g = 0.29 [-0.26, 0.85], I2 = 31%), a medium effect based on the panoramic ultrasound assessments (g = 0.72 [0.17, 1.28], I2 = 0%) and a large effect based on the trigonometric equation method (g = 2.20 [0.99, 3.41], I2 = 76%) (created via RevMan 5.4.1).

https://doi.org/10.1371/journal.pone.0259821.g004

[Figure omitted. See PDF.]

Fig 5. Funnel plot effect sizes of eccentric training on biceps femoris fascicle length based on the ultrasound assessment and extrapolation methods.

Red coloured squares represent studies that used manual linear extrapolation method, black coloured circles represent studies that used panoramic ultrasound scanning method, and green coloured squares represent studies that used trigonometric equation method. The asymmetry in the figure means a publication bias between the study groups that were used different ultrasound assessment methods. (created via RevMan 5.4.1). Acronyms: SE(SMD), standard error of standardised mean differences; SMD, standardised mean difference.

https://doi.org/10.1371/journal.pone.0259821.g005

[Figure omitted. See PDF.]

Fig 6. Forest plot eccentric training-induced mean (cm) changes in biceps femoris fascicle length based on the ultrasound assessment and extrapolation methods.

Eccentric training leads 0.02 cm ([-0.13, 0.17], I2 = 55%), 0.47 cm ([0.15, 0.80], I2 = 0%), and 1.84 cm ([1.33, 2.34], I2 = 52%) increases in biceps femoris FL based on the MLE method, panoramic ultrasound scanning and trigonometric equation methods, respectively (created via RevMan 5.4.1).

https://doi.org/10.1371/journal.pone.0259821.g006

[Figure omitted. See PDF.]

Fig 7. Funnel plot eccentric training-induced mean (cm) changes in biceps femoris fascicle length based on the ultrasound assessment and extrapolation methods.

Red coloured squares represent studies that used manual linear extrapolation method, black coloured circles represent studies that used panoramic ultrasound scanning method, and green coloured squares represent studies that used trigonometric equation method. The asymmetry in the figure means a publication bias between the study groups that were used different ultrasound assessment methods (created via RevMan 5.4.1). Acronyms: SE(MD), standard error of mean differences; MD, mean difference.

https://doi.org/10.1371/journal.pone.0259821.g007

Meta-analyses revealed that overall eccentric training has a large effect size on increasing biceps femoris FL (g = 1.06 [0.44, 1.68], I2 = 75%, LoE = very low). However, subgroup analyses suggested that the effect size of eccentric training on the biceps femoris FL differs from each other based on the ultrasound assessment and extrapolation methods (I2 = 74.7%) (Fig 4), ranging from small to large based on the ultrasound assessment and extrapolation methods for assessing biceps femoris FL (Fig 4). Meta-analyses results showed that eccentric training has a small effect based on the MLE method (g = 0.29 [-0.26, 0.85], I2 = 31%, LoE = low), a medium effect based on the panoramic ultrasound assessments (g = 0.72 [0.17, 1.28]), I2 = 0%, LoE = low) and a large effect based on the trigonometric equation method (g = 2.20 [0.99, 3.41], I2 = 76%, LoE = very low) (Fig 4).

Likewise, meta-analyses that were carried out to assess eccentric training-induced MDs (cm) detected differences in the eccentric training-induced cm changes in biceps femoris FL between the ultrasound assessments and extrapolations (I2 = 95.9) (Fig 6). Subgroup analyses indicated that eccentric training leads 0.02 cm ([-0.13, 0.17], I2 = 55%), 0.47 cm ([0.15, 0.80], I2 = 0%), and 1.84 cm ([1.33, 2.34], I2 = 52%) increases in biceps femoris FL based on the MLE method, panoramic ultrasound scanning and trigonometric equation methods, respectively (Figs 6 and 7).

Effects of the NHE based on the ultrasound assessment and extrapolation methods

Six RCTs [51, 52, 54, 56–58] were included in the meta-analyses that examine the effects of NHE on the biceps femoris FL. A subgroup analysis was performed for the same parameters of the meta-analyses for eccentric training. The overall effect size of the NHE on increasing biceps femoris FL was large (g = 1.09 [0.16, 2.01], I2 = 79%, LoE = very low) (Fig 8). However, the subgroup analysis suggests a difference between the values of the ultrasound assessment and extrapolation methods (Figs 8 and 9). In particular, NHE has a small effect size on increasing the biceps femoris FL based on the MLE method (g =, 0.23 [-1.02, 1.47], I2 = 69%, LoE = very low), has a small effect size on increasing biceps femoris FL based on the panoramic ultrasound scanning (g = 0.38 [-0.50, 1.27], LoE = low), and has a large effect on increasing biceps femoris FL based on the equation methods (g = 1.98 [0.52, 3.44], I2 = 79%, LoE = very low) (Fig 8).

[Figure omitted. See PDF.]

Fig 8. Forest plot effect sizes Nordic Hamstring Exercise (NHE) on biceps femoris fascicle length based on the ultrasound assessment and extrapolation methods.

The overall effect size of the NHE on increasing biceps femoris FL was large (g = 1.09 [0.16, 2.01], I2 = 79%). NHE has a small effect size on increasing the biceps femoris FL based on the MLE method (g =, 0.23 [-1.02, 1.47], I2 = 69%), has a small effect size on increasing biceps femoris FL based on the panoramic ultrasound scanning (g = 0.38 [-0.50, 1.27]), and has a large effect on increasing biceps femoris FL based on the equation methods (g = 1.98 [0.52, 3.44], I2 = 79%) (created via RevMan 5.4.1).

https://doi.org/10.1371/journal.pone.0259821.g008

[Figure omitted. See PDF.]

Fig 9. Funnel plot effect sizes Nordic hamstring exercise on biceps femoris fascicle length based on the ultrasound assessment and extrapolation methods.

Red coloured squares represent studies that used manual linear extrapolation method, black coloured circles represent studies that used panoramic ultrasound scanning method, and green coloured squares represent studies that used trigonometric equation method. The asymmetry in the figure means a publication bias between the study groups that were used different ultrasound assessment methods (created via RevMan 5.4.1). Acronyms: SE(SMD), standard error of standardised mean differences; SMD, standardised mean difference.

https://doi.org/10.1371/journal.pone.0259821.g009

Moreover, the meta-analyses performed to detect the NHE-induced mean (cm) changes found that the NHE leads to 1.08 cm increment ([0.09, 2.07], I2 = 95%) in the biceps femoris FL (Figs 10 and 11). However, subgroup analysis indicated considerable differences between the study groups applied equation, MLE and panoramic ultrasound techniques (I2 = 90.2%) (Fig 10). Subgroup analysis showed that the NHE do leads to 0.24 cm ([-0.52, 1.01], I2 = 71%), 0.29 cm ([-0.35, 0.93]) and 2.04 cm ([1.45, 2.63], I2 = 34%) increases in the biceps femoris fascicle length based on the MLE, panoramic ultrasound scanning and trigonometric equation methods, respectively (Fig 10).

[Figure omitted. See PDF.]

Fig 10. Forest plot Nordic hamstring exercise-induced mean (cm) changes in biceps femoris fascicle length based on the ultrasound assessment and extrapolation methods.

Overall, NHE leads to 1.08 cm increment ([0.09, 2.07], I2 = 95%). NHE do leads to 0.24 cm ([-0.52, 1.01], I2 = 71%), 0.29 cm ([-0.35, 0.93]) and 2.04 cm ([1.45, 2.63], I2 = 34%) increases in the biceps femoris fascicle length based on the MLE, panoramic ultrasound scanning and trigonometric equation methods, respectively (created via RevMan 5.4.1).

https://doi.org/10.1371/journal.pone.0259821.g010

[Figure omitted. See PDF.]

Fig 11. Funnel plot Nordic hamstring exercise induced mean (cm) changes in biceps femoris fascicle length based on the ultrasound assessment and extrapolation methods.

Red coloured squares represent studies that used manual linear extrapolation method, black coloured circles represent studies that used panoramic ultrasound scanning method, and green coloured squares represent studies that used trigonometric equation method. The asymmetry in the figure means a publication bias between the study groups that were used different ultrasound assessment methods (created via RevMan 5.4.1). Acronyms: SE(MD), standard error of mean differences; MD, mean difference.

https://doi.org/10.1371/journal.pone.0259821.g011

Effects of 4–6 weeks of NHE on the biceps femoris FL based on ultrasound assessment and extrapolation methods

Four studies [51, 56–58] with 4–6 weeks duration and with similar participants’ physical activity levels pooled in a meta-analysis in different subgroups based on the ultrasound assessment and extrapolation method for better understanding the possible effects of the total volume of the NHE and on the effect size estimation of the NHE on biceps femoris FL, As a difference, the mid-training data (5 weeks of NHE training and the control group) of Bourne et al. [51] employed this time in the meta-analysis for having closer total volumes between the studies. A forest plot in Fig 12 and a funnel plot in Fig 13 show the studies’ effect sizes. Despite the similar physical activity levels of the participants, four weeks [56] and five weeks [51] of NHE interventions used trigonometric equation methods for estimating the FL showed large effects sizes on increasing biceps femoris FL, while the six weeks of NHE interventions using the MLE [58] or panoramic ultrasound scanning [57] methods were not showing even medium effect sizes on increasing biceps femoris FL.

[Figure omitted. See PDF.]

Fig 12. Forest plot effects of 4–6 weeks of Nordic hamstring exercise on the biceps femoris FL based on ultrasound assessment and extrapolation methods.

NHE interventions used trigonometric equation methods for estimating the FL showed large effects sizes (g = 1.89–3.47) on increasing biceps femoris FL, while the six weeks of NHE interventions using the MLE (g = -0.37) or panoramic ultrasound scanning (g = 0.38) methods were not showing even medium effect sizes on increasing biceps femoris FL (created via RevMan 5.4.1).

https://doi.org/10.1371/journal.pone.0259821.g012

[Figure omitted. See PDF.]

Fig 13. Funnel plot effects of 4–6 weeks of Nordic hamstring exercise on the biceps femoris FL based on ultrasound assessment and extrapolation methods.

The red coloured square represents a study that used the manual linear extrapolation method, the black coloured circle represent a study that used the panoramic ultrasound scanning method, and the green coloured square and blue coloured triangle represent studies that used the trigonometric equation method. The asymmetry in the figure means a publication bias between the study groups that were used different ultrasound assessment methods (created via RevMan 5.4.1). Acronyms: SE(SMD), standard error of standardised mean differences; SMD, standardised mean difference.

https://doi.org/10.1371/journal.pone.0259821.g013

Discussion

To the best of our knowledge, this was the first systematic review performing meta-analyses that compared the effects of eccentric exercise, including NHE, on biceps femoris FL between the RCTs based on an equation method, the MLE method and panoramic ultrasound scanning for estimating biceps femoris fascicle length. Among the previous meta-analyses, Cuthbert et al. [30] reported that NHE has a very large effect size (g ≥ 2.58) on increasing biceps femoris FL. Later, Medeiros, Marchiori and Baroni [31] estimated the effect size of the NHE as 0.97 ([-0.46, 1.48]). Additionally, Gérard et al. [29] found that eccentric strength training leads to a 1.97 cm ([1.48, 2.46] increment in biceps femoris FL. However, the findings of this meta-analysis differ from previous reviews. First, the effect sizes of the NHE were small (g = 0.23 [-1.02, 1.47], small (g = 0.38 [-0.50, 1.27]) and large (g = 1.98 [0.52, 3.44]) based on the MLE, panoramic ultrasound scanning and equation methods, respectively. Second, eccentric training leads 0.02 cm ([-0.13, 0.17], I2 = 55%), 0.47 cm ([0.15, 0.80], I2 = 0%), and 1.84 cm ([1.33, 2.34], I2 = 52%) increases in biceps femoris FL based on the MLE, panoramic ultrasound scanning and trigonometric equation methods, respectively. Additionally, eccentric training has a small effect based on the MLE method (g = 0.29 [-0.26, 0.85]), a medium effect based on the panoramic ultrasound assessments (g = 0.72 [0.17, 1.28])) and a large effect based on the trigonometric equation method (g = 2.20 [0.99, 3.41]).

Despite the fact that the equation method is validated by Kellis et al. [60] for estimating biceps femoris FL, Franchi et al. [33] have recently pointed out that the trigonometric equation method [60] overestimates 1.91 ± 2.1 cm biceps femoris FL compared to panoramic ultrasound (extended field of view) images. In contrast, the manual MLE method and panoramic ultrasound images had no significant differences between them [33]. In the case of this systematic review, three [51, 52, 56] of the eight RCTs used the trigonometric equation method [60]; three RCTs used the manual MLE method [54, 55, 58] and two RCTs employed panoramic ultrasound scanning [53, 57] for calculating the biceps femoris FL. Although initially large effect sizes for the eccentric training and NHE were found to increase biceps femoris FL without considering the calculation methods, subgroup analyses of this review detected differences between the ultrasound scanning and extrapolation methods. This systematic review detected large effect sizes only for those studies that applied trigonometric equation methods to estimate biceps femoris FL when considering the methods. The meta-analyses and subgroup analyses results showed that the eccentric strength training, including NHE, did not show any large effect on the size of biceps femoris FL based on the studies that applied the MLE method and panoramic ultrasound scanning. Additionally, a previous study found a poor agreement between ultrasound assessments using a trigonometric equation method for estimating biceps femoris FL and diffusion tensor MRI measurements on the biceps femoris FL [61]. However, more comparisons between the existing ultrasound and MRI measurement techniques are needed to having an overall idea about the agreement level between MRI and ultrasound assessments of biceps femoris FL. Furthermore, developing a gold standard measurement method, e.g. freehand three-dimensional ultrasound scanning, for biceps femoris FL measurements is needed, as stated by Franchi and colleagues [33].

There might be a possible underlying overestimation of the effect sizes reported by those studies that used the equation method for estimating the biceps femoris FL compared to the MLE and panoramic ultrasound scanning methods. However, this argument still needs evidence. Further studies might be conducted to compare the effects of eccentric training based on the ultrasound assessment and extrapolation methods. Additionally, the relevant scientific community could consider reaching a consensus for biceps femoris FL measurements to assess the impacts of training on this parameter by providing more comparable results between interventions.

In addition to these issues, missing standard deviations of the mean changes from baseline is critical when performing a meta-analysis of RCTs. A lower SD can produce a higher effect size or vice versa. The Cochrane handbook for Systematic Reviews of Interventions [32] describes missing SDs of the mean changes from baseline as a common feature in the literature, and the same handbook identifies the importance of obtaining the SDs. The formula for calculating the SD changes from baseline, and it is difficult to obtain this missing outcome, as explained in the ’data extraction, analysis and synthesis’ section of this systematic review. Previously, a survey reported that 68% of Cochrane reviewers who were aiming to run a meta-analysis for a continuous outcome faced the missing mean or SD value problems, and 85% of the reviewers finally asked the authors of the studies to share their missing outcome data, 76% of whom eventually did not pool the studies with missing outcome data [62]. This systematic review followed the recommendations of the Cochrane Handbook for Systematic Reviews of Interventions [32]. Among the eight RCTs [51–58], only two RCTs [54, 58] reported the required mean change and SDs of the mean changes from baseline. Among the remaining six RCTs, the required data could be calculated from the in-text information that exact P values and standard errors of only one RCT [55] via the Calculator of the RevMan program (RevMan 5.4.1) [55]. The required data of the remaining five studies [51–53, 56, 57] were obtained by contacting the corresponding authors of the studies. Starting from this point, the methodology of this systematic review for obtaining precise data differs from previous meta-analyses that investigated the effects of eccentric strength training [29] or NHE [30, 31] on biceps femoris FL.

Cuthbert and colleagues’ method [30] for meta-analysis differed from this systematic review and other relevant systematic reviews in methods to calculate the effect size of the NHE on biceps femoris FL. Nevertheless, the remaining two systematic reviews [29, 31] conducted the meta-analyses based on the mean changes and SDs of the mean changes from baseline for intervention and control groups, allowing a comparison of the results with those of this review [29, 31]. Four meta-analyses were carried out using the common studies among the present systematic review and recent systematic reviews [29, 31] for all cases of continuous data of MD (cm), 95% CI, fixed effect (FE); MD (cm), 95% CI, RE; SMD (effect size: Hedge’s (adjusted) g), 95% CI, FE; and SMD (effect size: Hedge’s (adjusted) g), 95% CI for establishing the proposed comparisons. All the results are shown in four funnel plots and four forest plots created by the RevMan computer program in S4 File. Additionally, Table 2 demonstrates the meta-analyses results based on the data of this review and the systematic reviews of Gérard et al. [29] and Medeiros, Marchiori& Baroni [31] for common studies. Based on the results, the reported data of previous systematic reviews [29, 31] produced results that were close to the actual centimetre changes in biceps femoris FL for common individual eligible studies [51, 55–57]. However, the reported data of both meta-analyses [29, 31] failed to precisely estimate actual effect sizes of the eccentric strength training or NHE on the biceps femoris FL due to miscalculations of the SDs of mean changes from the baseline. Therefore, this strongly suggests that future meta-analyses for continuous outcomes of RCTs related to the effects of eccentric exercise interventions on the biceps femoris FL should follow the recommendations of the Cochrane Handbooks for Systematic Reviews of Interventions [32], which includes contacting the corresponding authors of eligible studies to obtain mean changes and SDs of the mean changes from the baseline for precise results. Conversely, one limitation of the present review might be the small number of eligible studies pooled in meta-analyses. Nevertheless, this systematic review included eight studies in the quantitative syntheses, more than the previous systematic reviews that included five [29, 30] or four [31] studies. Additionally, a further confounder in the analysis of this review is the heterogeneity of training interventions, which adds non-accountable variability to the outcomes measures.

[Figure omitted. See PDF.]

Table 2. Comparisons of effect sizes and mean changes of each study based on the given in-text data between meta-analyses investigating effects of eccentric strength training on biceps femoris fascicle length.

https://doi.org/10.1371/journal.pone.0259821.t002

Conclusions

Based on the meta-analyses and subgroup analyses of this systematic review, effect sizes on the eccentric strength training vary from small to large among the MLE, panoramic ultrasound scanning, and trigonometric equation methods. The only large effect size was detected in the subgroup consisting of the studies that used the trigonometric equation method for estimating biceps femoris FL. Likewise; the effect size of the NHE was large in the subgroup of the studies that used the trigonometric equation method for estimating biceps femoris FL. A consensus on ultrasound scanning techniques and biceps femoris FL estimation might provide comparable results between the exercise interventions targeting biceps femoris FL. Additionally, a future study can be conducted to compare the effects of eccentric training, which includes the NHE, based on the ultrasound assessment and extrapolation methods.

Supporting information

S1 File. Database searches.

https://doi.org/10.1371/journal.pone.0259821.s001

(DOCX)

S2 File. PRISMA 2020 checklist.

https://doi.org/10.1371/journal.pone.0259821.s002

(DOCX)

S3 File. Level of evidence of the meta-analyses.

https://doi.org/10.1371/journal.pone.0259821.s003

(DOCX)

S4 File. Comparisons.

https://doi.org/10.1371/journal.pone.0259821.s004

(DOCX)

Acknowledgments

The authors would like to thank those authors who shared the requested data with this systematic review. This systematic review will also be published as a chapter of Gokhan Yagiz’s PhD thesis.

Citation: Yagiz G, Akaras E, Kubis H-P, Owen JA (2021) Heterogeneous effects of eccentric training and nordic hamstring exercise on the biceps femoris fascicle length based on ultrasound assessment and extrapolation methods: A systematic review of randomised controlled trials with meta-analyses. PLoS ONE 16(11): e0259821. https://doi.org/10.1371/journal.pone.0259821

References

1. Brooks JH, Fuller CW, Kemp SP, Reddin DB. Epidemiology of injuries in English professional rugby union: part 1 match injuries. Br J Sports Med. 2005;39(10):757–66. pmid:16183774

2. Ekstrand J, Hägglund M, Waldén M. Injury incidence and injury patterns in professional football: the UEFA injury study. Br J Sports Med. 2011;45(7):553–8. pmid:19553225

3. Feeley BT, Kennelly S, Barnes RP, Muller MS, Kelly BT, Rodeo SA, et al. Epidemiology of National Football League Training Camp Injuries from 1998 to 2007. Am J Sports Med. 2008;36(8):1597–603. pmid:18443276

4. Opar DA, Drezner J, Shield A, Williams M, Webner D, Sennett B, et al. Acute hamstring strain injury in track-and-field athletes: A 3-year observational study at the Penn Relay Carnival. Scand J Med Sci Sport. 2014;24(4):e254–e9. pmid:24330073

5. Orchard JW, Seward H, Orchard JJ. Results of 2 decades of injury surveillance and public release of data in the Australian Football League. Am J Sports Med. 2013;41(4):734–41. pmid:23460329

6. Opar D, Williams M, Shield A. Hamstring Strain Injuries Factors that Lead to Injury and Re-Injury. Sports Med. 2012;42:209–26. pmid:22239734

7. Ekstrand J, Waldén M, Hägglund M. Hamstring injuries have increased by 4% annually in men’s professional football, since 2001: a 13-year longitudinal analysis of the UEFA Elite Club injury study. Br J Sports Med. 2016;50(12):731. pmid:26746908

8. Koulouris G, Connell DA, Brukner P, Schneider-Kolsky M. Magnetic resonance imaging parameters for assessing risk of recurrent hamstring injuries in elite athletes. Am J Sports Med. 2007;35(9):1500–6. pmid:17426283

9. Agostini F, Bernetti A, Di Giacomo G, Viva MG, Paoloni M, Mangone M, et al. Rehabilitative Good Practices in the Treatment of Sarcopenia: A Narrative Review. Am J Phys Med Rehabil. 2021;100(3):280–7. pmid:33595941

10. de Sire A, Demeco A, Marotta N, Moggio L, Palumbo A, Iona T, et al. Anterior Cruciate Ligament Injury Prevention Exercises: Could a Neuromuscular Warm-Up Improve Muscle Pre-Activation before a Soccer Game? A Proof-of-Principle Study on Professional Football Players. Appl Sci. 2021;11(11):4958.

11. Lloyd DG, Buchanan TS, Besier TF. Neuromuscular biomechanical modeling to understand knee ligament loading. Med Sci Sports Exerc. 2005;37(11):1939–47. pmid:16286865

12. Marotta N, Demeco A, de Scorpio G, Indino A, Iona T, Ammendolia A. Late Activation of the Vastus Medialis in Determining the Risk of Anterior Cruciate Ligament Injury in Soccer Players. J Sport Rehabil. 2020;29(7):952–5. pmid:31711040

13. Brooks J, Fuller C, Kemp S, Reddin D. Incidence, risk, and prevention of hamstring muscle injuries in professional rugby union. Am J Sports Med. 2006;34:1297–306. pmid:16493170

14. Woods C, Hawkins R, Hulse M, Hodson A. The Football Association Medical Research Programme: an audit of injuries in professional football—analysis of preseason injuries. Br J Sports Med. 2002;36(6):436. pmid:12453838

15. Liu H, Garrett WE, Moorman CT, Yu B. Injury rate, mechanism, and risk factors of hamstring strain injuries in sports: A review of the literature. J Sport Health Sci. 2012;1(2):92–101.

16. Kenneally-Dabrowski CJB, Brown NAT, Lai AKM, Perriman D, Spratford W, Serpell BG. Late swing or early stance? A narrative review of hamstring injury mechanisms during high-speed running. Scand J Med Sci Sports. 2019;29(8):1083–91. pmid:31033024

17. Chumanov ES, Heiderscheit BC, Thelen DG. Hamstring musculotendon dynamics during stance and swing phases of high-speed running. Med Sci Sports Exerc. 2011;43(3):525–32. pmid:20689454

18. Kujala UM, Orava S, Järvinen M. Hamstring injuries. Current trends in treatment and prevention. Sports Med. 1997;23(6):397–404. pmid:9219322

19. Thelen D, Chumanov E, Hoerth D, Best T, Swanson S, Li L, et al. Hamstring Muscle Kinematics during Treadmill Sprinting. Med Sci Sports Exerc. 2005;37:108–14. pmid:15632676

20. Roig Pull M, Ranson C. Eccentric muscle actions: Implications for injury prevention and rehabilitation. Phys Ther Sport. 2007;8(2):88–97.

21. Wood GA. Biomechanical Limitations to Sprint Running. Med Sports Sci. 1987;25:58–71.

22. Arnason A, Andersen TE, Holme I, Engebretsen L, Bahr R. Prevention of hamstring strains in elite soccer: an intervention study. Scand J Med Sci Sports. 2008;18(1):40–8. pmid:17355322

23. Mjølsnes R, Arnason A, Østhagen T, Raastad T, Bahr R. A 10-week randomized trial comparing eccentric vs. concentric hamstring strength training in well-trained soccer players. Scand J Med Sci Sports. 2004;14(5):311–7. pmid:15387805

24. Petersen J, Thorborg K, Nielsen MB, Budtz-Jørgensen E, Hölmich P. Preventive effect of eccentric training on acute hamstring injuries in men’s soccer: a cluster-randomized controlled trial. Am J Sports Med. 2011;39(11):2296–303. pmid:21825112

25. van der Horst N, Smits DW, Petersen J, Goedhart EA, Backx FJ. The preventive effect of the nordic hamstring exercise on hamstring injuries in amateur soccer players: a randomized controlled trial. Am J Sports Med. 2015;43(6):1316–23. pmid:25794868

26. Van Hooren B, Bosch F. Is there really an eccentric action of the hamstrings during the swing phase of high-speed running? part I: A critical review of the literature. J Sports Sci. 2017;35(23):2313–21. pmid:27937671

27. Van Hooren B, Bosch F. Is there really an eccentric action of the hamstrings during the swing phase of high-speed running? Part II: Implications for exercise. J Sports Sci. 2017;35(23):2322–33. pmid:27935419

28. Timmins RG, Bourne MN, Shield AJ, Williams MD, Lorenzen C, Opar DA. Short biceps femoris fascicles and eccentric knee flexor weakness increase the risk of hamstring injury in elite football (soccer): a prospective cohort study. Br J Sports Med. 2016;50(24):1524–35. pmid:26675089

29. Gérard R, Gojon L, Decleve P, Van Cant J. The Effects of Eccentric Training on Biceps Femoris Architecture and Strength: A Systematic Review With Meta-Analysis. J Athl Train. 2020;55(5):501–14. pmid:32216654

30. Cuthbert M, Ripley N, McMahon JJ, Evans M, Haff GG, Comfort P. The Effect of Nordic Hamstring Exercise Intervention Volume on Eccentric Strength and Muscle Architecture Adaptations: A Systematic Review and Meta-analyses. Sports Med. 2020;50(1):83–99. pmid:31502142

31. Medeiros DM, Marchiori C, Baroni BM. Effect of Nordic Hamstring Exercise Training on Knee Flexors Eccentric Strength and Fascicle Length: A Systematic Review and Meta-Analysis. J Sport Rehabil. 2020:1–10. pmid:33049705

32. Higgins J, Thomas J, Chandler J, Cumpston M, Tianjing L, Page M, et al. Cochrane Handbook for Systematic Reviews of Interventions version 6.2: Cochrane; 2021.

33. Franchi MV, Fitze DP, Raiteri BJ, Hahn D, Spörri J. Ultrasound-derived Biceps Femoris Long Head Fascicle Length: Extrapolation Pitfalls. Med Sci Sports Exerc. 2020;52(1):233–43. pmid:31403609

34. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. pmid:33782057

35. The EndNote Team. EndNote. EndNote X9 ed. Philadelphia, PA: Clarivate; 2013.

36. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. pmid:27919275

37. Behan FP, Moody R, Patel TS, Lattimore E, Maden-Wilkinson TM, Balshaw TG. Biceps femoris long head muscle fascicle length does not differ between sexes. J Sports Sci. 2019;37(21):2452–8. pmid:31303128

38. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. pmid:22008217

39. The Cochrane Collaboration. Review Manager [Computer Program]. 5.4.1 ed. Copenhagen: The Nordic Cochrane Centre. 2020.

40. Deeks J, Higgins J. Statistical Algorithms in Review Manager 5. Statistical Algorithms in Review Manager 5. 2007.

41. Lakens D. Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Front Psychol. 2013;4(863). pmid:24324449

42. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.

43. Hedges LV, Olkin I. Statistical methods for meta-analysis: Academic press; 2014.

44. Brydges CR. Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology. Innov Aging. 2019;3(4):igz036–igz. pmid:31528719

45. Borenstein M, Hedges LV, Higgins JPT, R. RH. Effect Sizes Based on Means. Introduction to Meta‐Analysis. 2009. p. 21–32.

46. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. pmid:12958120

47. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88. pmid:3802833

48. Green B, Bourne MN, van Dyk N, Pizzari T. Recalibrating the risk of hamstring strain injury (HSI): A 2020 systematic review and meta-analysis of risk factors for index and recurrent hamstring strain injury in sport. Br J Sports Med. 2020;54(18):1081. pmid:32299793

49. GRADEpro GDT: GRADEpro Guideline Development Tool [Software]. McMaster University, 2020 (developed by Evidence Prime, Inc.). Available from: gradepro.org.

50. Schünemann H BJ, Guyatt G, Oxman A, editors. GRADE handbook for grading quality of evidence and strength of recommendations: GRADE Working Group; 2013.

51. Bourne MN, Duhig SJ, Timmins RG, Williams MD, Opar DA, Al Najjar A, et al. Impact of the Nordic hamstring and hip extension exercises on hamstring architecture and morphology: implications for injury prevention. Br J Sports Med. 2017;51(5):469–77. pmid:27660368

52. Lovell R, Knox M, Weston M, Siegler JC, Brennan S, Marshall PWM. Hamstring injury prevention in soccer: Before or after training? Scand J Med Sci Sport. 2018;28(2):658–66. pmid:28544170

53. Marušič J, Vatovec R, Marković G, Šarabon N. Effects of eccentric training at long-muscle length on architectural and functional characteristics of the hamstrings. Scand J Med Sci Sport. 2020;30(11):2130–2142. pmid:32706442

54. Mendiguchia J, Conceição F, Edouard P, Fonseca M, Pereira R, Lopes H, et al. Sprint versus isolated eccentric training: Comparative effects on hamstring architecture and performance in soccer players. PLoS One. 2020;15(2):e0228283. pmid:32045411

55. Potier TG, Alexander CM, Seynnes OR. Effects of eccentric strength training on biceps femoris muscle architecture and knee joint range of movement. Eur J Appl Physiol. 2009;105(6):939–44. pmid:19271232

56. Ribeiro-Alvares JB, Marques VB, Vaz MA, Baroni BM. Four Weeks of Nordic Hamstring Exercise Reduce Muscle Injury Risk Factors in Young Adults. J Strength Cond Res. 2018;32(5):1254–62. pmid:28459795

57. Seymore KD, Domire ZJ, DeVita P, Rider PM, Kulas AS. The effect of Nordic hamstring strength training on muscle architecture, stiffness, and strength. Eur J Appl Physiol. 2017;117(5):943–53. pmid:28280975

58. Wiesinger HP, Scharinger M, Kösters A, Gressenbauer C, Müller E. Specificity of eccentric hamstring training and the lack of consistency between strength assessments using conventional test devices. Sci Rep. 2021;11(1):13417. pmid:34183742

59. Bizzini M, Junge A, Dvorak J. Implementation of the FIFA 11+ football warm up program: how to approach and convince the Football associations to invest in prevention. Br J Sports Med. 2013;47(12):803–6. pmid:23813485

60. Kellis E, Galanis N, Natsis K, Kapetanos G. Validity of architectural properties of the hamstring muscles: correlation of ultrasound findings with cadaveric dissection. J Biomech. 2009;42(15):2549–54. pmid:19646698

61. Behan FP, Vermeulen R, Smith T, Arnaiz J, Whiteley R, Timmins RG, et al. Poor agreement between ultrasound and inbuilt diffusion tensor MRI measures of biceps femoris long head fascicle length. Transl Sports Med. 2019;2(2):58–63.

62. Christopher W. Practical methods for handling missing summary statistics in meta-analysis of continuous outcomes. Statistical Methods Group webinar: Cochrane Training; 2019. [updated 2019 Nov; cited 2021 July 28]. Available from: https://training.cochrane.org/resource/practical-methods-handling-missing-summary-statistics-meta-analysis-continuous-outcomes.