Correspondence to Professor Luiz Hespanhol; [email protected]
Key messages
What is already known
Some running-related injury prevention strategies have been implemented in practice without a proper investigation of their effectiveness.
Implementing preventive interventions to a broad population without a reasonable understanding of their effectiveness or knowledge on the risk of adverse events may be harmful.
An approach to face this problem may be the application of methods to develop running-related injury prevention programmes from scratch, based on theories of behaviour change, and the application of sports injury prevention frameworks guiding the process from developing to evaluating effectiveness in implementation context.
Developing injury prevention programmes based on behavioural theories may increase the probability of a successful implementation of such programmes, increasing thus the likelihood of being effective in the ‘real world’.
What are the new findings
This study has shown that it is possible to use methods of developing structured health promotion programmes, such as Intervention Mapping, to build sports (running-related) injury prevention programmes.
A running-related injury prevention programme was developed using the Intervention Mapping framework and a participatory approach.
The programme was named ‘RunIn3’ and it is based on providing feedback on running load and running-related injury risk, as well as providing knowledge, skills and self-efficacy on preventive behaviours.
The prevention programme is aimed to be delivered online through a website.
Introduction
Running is an important exercise to stay physically active.1 The health benefits of running include increasing longevity,2 cost-effectiveness in preventing cardiovascular diseases3 and improving health indicators.4 However, running also carries a risk of developing musculoskeletal injuries. The incidence of running-related injuries is estimated at about 7.7 (95% CI 6.9 to 8.7) injuries per 1000 hours of running in adult recreational runners.5 In São Paulo, Brazil, the incidence of running-related injuries in adult recreational runners is estimated at 10.1 (95% CI 7.9 to 12.3) injuries per 1000 hours of running,6 which is comparable with the summary estimate above mentioned. An important possible consequence of running-related injuries is their negative influence on runners’ motivation in running practice.7 This can lead to a higher probability of dropouts and, in turn, may reduce the beneficial health effects of running.7 8
Running-related injury prevention
According to the Translating Research into Injury Prevention Practice (TRIPP) framework, only research that can be translated to stakeholders and accepted, adopted and complied with by the target population can prevent injuries in practice.9 The TRIPP framework describes the process to achieve sports injury prevention using the following steps:9 (1) injury surveillance; (2) establishing aetiology and mechanisms of injury; (3) developing preventive measures; (4) evaluating efficacy in ‘ideal conditions’; (5) describing the intervention context to inform implementation strategies; and (6) evaluating effectiveness in implementation context.
Injury prevention programmes have been shown to reduce the risk of running-related injuries.10 11 Nevertheless, there is limited evidence on the effectiveness of running-related injury prevention strategies.10 Some running-related injury prevention strategies have been implemented in practice without a proper investigation of their effectiveness as suggested by the TRIPP framework.10 12 13 Implementing preventive interventions to a broad population without a reasonable understanding of their effectiveness or knowledge on the risk of adverse events may be harmful, and may lead to a higher risk of developing running-related injuries.13 An approach to face this problem may be the application of methods to develop running-related injury prevention programmes from scratch, based on theories of behaviour change,14 and the application of sports injury prevention frameworks guiding the process from developing to evaluating effectiveness in implementation context.9 This approach might increase the likelihood of effectiveness, since prevention programmes can be built taking into account the running population needs, facilitators and barriers, and opinions in this field.15–17
Intervention Mapping
Intervention Mapping (IM) is a protocol for developing, planning, implementing and/or evaluating health promotion programmes considering behavioural and social science theories and structured processes on health needs.15 The IM framework has six steps with the following purposes: (Step 1) Needs assessment: to determine the general objectives of the programme, including an analysis of the problem addressed in order to establish the behaviours that need to be adopted and/or modified, and who should promote such adoption and/or change (eg, runners, coaches, etc); (Step 2) Matrices of change objectives: to create matrices including each behaviour to be adopted and/or modified and the determinants of such behaviours (eg, belief, knowledge, social influence, etc); (Step 3) Methods and practical applications: to determine the strategies for implementing a new behaviour or changing risk behaviours following a theoretical model; (Step 4) Programme production: to develop the actions of the prevention programme by establishing the tasks for each agent of the programme (eg, runners, coaches, etc), the materials to be used and/or to be disclosed and the operational organisation of the programme; (Step 5) Adoption and implementation: to develop adoption, implementation and maintenance strategies including the creation of systems for the integration of all agents involved in the programme; and (Step 6) Evaluation planning: to monitor and evaluate the prevention programme. IM has been used to guide the development and implementation process of physical activity promotion18 19 and sports injury prevention20 21 programmes.
Behavioural and social science theories
Behavioural and social science theories are being considered essential to develop and implement prevention programmes.14 These theories provide path models showing the influence of determinants on behaviour state, but also factors that might influence such determinants. Factors that influence behaviour are theorised in some behavioural and social science models as actions to be applied and/or cues on how to deliver or implement health promotion strategies. Therefore, behaviour change theories can inform intervention design and delivery. For example, the Integrated Behavioural Model22 has been applied to smoking23 and cancer24 prevention programmes. This theory of behaviour change acts by providing information to optimise awareness factors such as knowledge, cues to action and risk perception that, in turn, would influence motivation factors (attitude, social norms and self-efficacy) towards intention to perform the behaviour. In turn, intention would directly influence ability factors (implementation plans, performance skills and action plans) and behaviour state, while ability factors would mediate the influence of intention on behaviour state.22–24 The Integrated Behavioural Model is derived from the theory of planned behaviour,22 which is one of the theories of behaviour change most commonly used in the sports science field.25 26 From the 21 studies identified in two systematic reviews aimed at investigating the use of behavioural or social science theories or models in sports injury prevention programmes25 26: 38.1% (n=8) used the theory of planned behaviour; 23.8% (n=5) used the health belief model; 9.5% (n=2) used the diffusion of innovation theory; and 4.8% (n=1) used one of the following: the social cognitive theory, the attitude-social influence-self-efficacy model, the refined ecological model, the PRECEDE-PROCEED model (together with the Ottawa Charter), the health action process approach and the self-determination theory.
Rationale and objective of the study
Developing injury prevention programmes based on behavioural theories may increase the probability of a successful implementation of such programmes, increasing thus the likelihood of being effective in the ‘real world’.27 However, even though the importance of sports injury prevention is well known, there is a paucity of studies on behavioural and social science theories and models in this field. Only about 10% of sports injury prevention programmes described the use of theoretical behavioural models for supporting or justifying the intervention strategies contained in such packages.25 Therefore, our objective was to develop a running-related injury prevention programme based on perspectives of behavioural and social science theories, as well as taking a framework development approach.
Methods
Study design
This was a qualitative study using the IM framework for the development of a running-related injury prevention programme. We use the Standards for Reporting Qualitative Research to guide the reporting of this study.28 Important terms related to behavioural sciences and applied in this study were defined in the online supplemental appendix A.
This study is part of a broader project that was informed by the TRIPP framework.9 Stage 1 (‘injury surveillance’)6 29 30 and stage 2 (‘establishing aetiology and mechanisms of injury’)6 31 32 were conducted a priori and the results related to these stages can be found elsewhere.6 29–32 This study addressed stage 3 (‘developing preventive measures’) and we used the IM framework to guide this specific stage. Stage 4 (‘evaluating efficacy in ideal conditions’) will be addressed in a pragmatic hybrid type 1 randomised controlled trial.33 Stage 5 (‘describing the intervention context to inform implementation strategies’) and stage 6 (‘evaluating effectiveness in implementation context’) will be partly addressed in the pragmatic hybrid type 1 randomised controlled trial33 and partly addressed in future implementation studies yet to be designed based on the results of the trial.
Participants
The number of participants was defined considering the focus group method which suggests a minimum of four and a maximum of 12 participants.34 A convenience sample was composed of individuals from different backgrounds but related to running practice at some level (eg, runners, coaches, health professionals, researchers, stakeholders, etc). We decided to recruit individuals with different backgrounds to allow for heterogeneity among the individuals’ opinions on the matters discussed in the steps 1–5 of the IM. In this way, we would capture a broader spectrum on what should have been discussed in each step of the IM process.
Eligible participants should be residents of the Metropolitan Region of São Paulo, since the prevention programme was intended to be implemented in this region. The Metropolitan Region of São Paulo was chosen for two reasons: (1) the average estimate for the incidence of running-related injury in this population (ie, 10.1 injuries/1000 hours of running6) is higher than the upper bound of the 95% CI for the overall running-related injury incidence estimate (ie, 8.7 injuries/1000 hours of running5), indicating a demand for running-related injury prevention programmes in this population (see the Introduction section for detailed information on these estimates); and (2) by convenience, since the researchers and the stakeholders recruited for this study were located and have been working in this region.
Eligible individuals were identified through the network of the researchers involved in this study in two ways: (A) by tracking personal contacts of the researchers; and (B) by searching on social media networks related to running practice. Once identified the eligible individuals, a formal invitation was sent by email or text message (smartphone or social media). In case the invitation was not accepted, we sent an acknowledgement email or text message. In case the invitation was accepted, we sent an additional email with: (1) further information about the project; (2) an electronic copy of the informed consent form, so the participant could read and evaluate this form prior to the first focus group meeting; (3) an explanation regarding the signature of the informed consent form, informing that this would occur at the location and just before the first focus group meeting, and informing that bringing a print copy would not be necessary since we will have the necessary copies of the informed consent form; and (4) asking the available days and times to match the availability of all participants to schedule the first focus group meeting. All participants received a print copy of the informed consent form at the location of the first focus group meeting. They had the necessary time to read the entire informed consent form and clarify any query they might have. Then, all signed the personal informed consent form and handed over to the researchers.
Patient and public involvement
The intervention was developed in this study following a participatory approach. ‘Participatory action approach’ is the process of involving the community in participating and taking actions in investigations towards improving the health of those included in the community.17 In this study, the participatory approach directly involved the running community (runners, coaches, health professionals, researchers and stakeholders) in discussions of the entire programme development process and in designing the pragmatic hybrid type 1 randomised controlled trial aimed at addressing step 6 of IM.33 The benefit of involving the community was the tailoring to the real needs, preferences and reality of the running environment, which may contribute to a successful implementation of the running-related injury prevention programme.35
Data collection
Focus group was used to collect qualitative data during face-to-face meetings.34 The 32-item Consolidated Criteria for Reporting Qualitative Research (COREQ) was used to guide the focus group.36 The COREQ checklist for this study can be found in online supplemental appendix B. A maximum of five focus group meetings were hypothesised a priori in the protocol of this study. The meetings were held until all IM topics related to steps 1–5 had been discussed and agreed by the participants. The number of focus group meetings was dependent on saturation of the information elicited during the focus group. Saturation was considered in this study when no new or additional information had been emerging during the focus group or the information started to repeat itself. All participants were informed about this process through the informed consent form (that all agreed with and signed) and by an explanation given in the beginning of the first focus group meeting. From the five focus group meetings hypothesised a priori, three were actually necessary to achieve saturation regarding steps 1–5 of IM. The topics covered at the meetings can be found in online supplemental appendices C–G. A semistructured guide for conducting the meetings was prepared a priori and was applied during the meetings (online supplemental appendix C). The contents of the focus group meetings were considered cumulative and interchangeable, meaning that there was no content or topic exclusive for each meeting. All contents could have been discussed in all meetings until saturation was reached. The audio was recorded with a laptop computer using the software Simple Recorder V.1.6.1. One of the authors (LH) had prior experience in this type of participatory research and was, therefore, the moderator of the meetings.11
We used the Predisposing, Reinforcing, and Enabling Constructs in Educational Diagnosis and Evaluation (PRECEDE)37 model to structure the needs assessment. The PRECEDE model suggests the following steps to be implemented: first, we identify the health problem of interest in the target population; second, we identify the behaviours that influence the risk of the health problem (behavioural outcomes); and finally, we identify the personal (eg, intention) and environmental (eg, subjective norm) determinants that influence such behaviours (determinants of behavioural outcomes).15 37 Afterwards, we use the logic model of change (what is required to change and how) to create a matrix of change for step 1 of the IM framework.15 The logic model of change has also an order to follow: first, we select the behavioural outcomes that should be changed in order to produce the desired health outcomes; second, we establish statements of what the participants of the programme should do/change in order to perform the health behaviour (performance objectives); and finally, what needs to change in the determinants of behavioural outcomes to accomplish the performance objectives.15
Data analysis
The data analysis was based on semantic thematic approach38 39 and it was conducted following a quantitative content analysis orientation based on inductive reasoning.40–42 Another qualitative study43 was conducted aimed at exploring the ‘participants’ voices’ through the investigation of the facilitators and barriers in developing a running-related injury prevention programme. For the study herein presented, a quantitative content analysis was deemed most suitable to reach our study aim. The data management and analyses were performed in R V.3.3.3 (R Foundation for Statistical Computing, Vienna, Austria). The R Qualitative Data Analysis package was used to assist in the data analysis.44
The transcription (T) of the audios to text and the evaluation of the accuracy of the transcriptions were done by CSV, GMO and GAKM in two phases: (T1) GMO and GAKM performed the transcriptions independently; and (T2) CSV, who was blinded to the transcriptions of T1, performed the evaluation of the accuracy of the text in relation to the audios. The data processing (DP) was performed by CSV and GMO independently in five phases40–42: (DP1) splitting the text transcripts in shorter text units (ie, meaning units); (DP2) condensation of the split text transcripts in shorter text units (ie, condensed meaning units); (DP3) definition of codes by labelling the condensed meaning units using the participants’ own words; (DP4) allocation of the codes into broad categories; and (DP5) allocation of the categories into major themes. In case of disagreements in DP1–DP5, a third researcher (LH) provided a consensus.
The interpretation of the results was performed through discussions among the researchers (CSV, GMO and LH) until a consensus was reached. The counting of the themes elicited in DP5 was performed to facilitate the communication and the disseminations of the results, and it was carried out in two ways: (1) using the frequency of emerging themes (FET), defined as the number of times the participant mentioned the theme content during the interview; and (2) using the number of participants (n), representing the number of individual participants mentioning each theme content, regardless of the number of times they mentioned each theme content during the interview. We believe that both measures are complementary to better inform the importance/weight of each theme identified.
Results
Fifteen individuals were invited to participate, but five (33.3%) declined the invitation due to conflicting agenda. Therefore, 10 participants signed the informed consent form and were included in this study. The participants were: one sports physician (10%); two physiotherapists (20%); two exercise and sports sciences practitioners (ie, running trainers; 20%); two researchers from the biomechanics field (20%); two recreational runners (20%); and one stakeholder who was the owner of a health-related shop (10%). A total of three face-to-face meetings held between February and March 2018 were required to cover all IM steps. These meetings had an average duration of 2.5 hours with an average interval of 4 weeks between the meetings. The outcomes elicited during the focus group meetings can be found in online supplemental appendices D–G. All participants collaborated directly to the design of the running-related injury prevention programme, and all had the opportunity to revise the proposed final product in the last focus group meeting, when the research group presented the prototype to the participants encouraging an open discussion on the matter.
Step 1: needs assessment
The target population of interest identified was adult recreational runners. ‘Adults’ were the focus of this running-related injury prevention programme based on the scientific evidence6 29 and the perception of the participants during the focus group that most recreational runners presenting running-related injury issues in clinical practice in São Paulo are adults. We considered ‘recreational runner’ a classification based on a professionalism scale, where on one end we would have ‘professional runners’ (ie, those who practise running as the main occupation in their lives), and on the other end we would have ‘recreational runners’ (ie, those who practise running only in leisure time). We recognise that between the classifications above mentioned there are a range of possible runner profiles. However, for this study, we have operationalised the definition of ‘recreational runner’ in a pragmatic way aiming at including the population heterogeneity related to this classification in our target population in order to increase the generalisability of the developed running-related injury prevention programme. Therefore, we defined ‘recreational runners’ as those who do not practise running as the main occupation (profession) in their lives. Examples of ‘recreational runner’ profiles could be (but not limited to): (1) experienced runners who run during leisure time and for fun; (2) novice runners who run during leisure time to enhance their health; (3) runners who participate in running events at an amateur level; (4) runners who compete in running events at a professional level, but running is not their main occupation (eg, a lawyer who is also a runner, but her main occupation is advocacy, although she likes to compete for medals).
The reason to target ‘recreational runners’ was that most recreational runners have no or minor professional assistance, and usually they have doubts about injury prevention. By using the PRECEDE37 model, we established ‘running-related injury’ as the health problem. Behaviours of the target population at risk were: (1) not listening to the body; (2) not identifying minor symptoms as the beginning of a potential running-related injury; (3) not following the training schedule; (4) lack of adaptation to running shoes; (5) changing shoes/foot strike pattern; (6) poor running technique (biomechanics); (7) going beyond the limits to ‘show off’ on social media; (8) doing what famous people say/do in social media; (9) feeling ‘pushed’ by being part of a group; (10) not performing conditioning exercises; (11) not learning how to run before starting to run; (12) not seeking for professional help/opinion; and (13) overtraining (beyond limits). The personal determinants towards the adoption of running-related injury risk behaviours identified were: risk perception not accurate; lack of knowledge; attitude towards risk behaviours; subjective norms influencing risk behaviours; low self-efficacy; and poor skills on adhering to preventive behaviours. The PRECEDE model elicited by the evaluation process of this study can be found in online supplemental appendix D.
The broader topics yielded from the needs assessment of the focus group were: (1) monitoring the volume of training by a running schedule (ie, NA.1 and NA.4; table 1), reaching 30.3% (FET=70) of the total mentions regarding the needs assessment codes; (2) attention for some symptoms (ie, NA.3, NA.5 and NA.8; table 1) reaching 28.1% (FET=65); (3) importance of conditioning exercises (ie, NA.2, NA.9 and NA.10; table 1) reaching 19.5% (FET=45); running shoes (ie, NA.6; table 1) reaching 12.1% (FET=28); and biomechanics (ie, NA.7; table 1) reaching 10.0% (FET=23).
Table 1Results of the needs assessment
Code | FET | FET % | n* | n %* |
NA.1 Understand how to get a training schedule; understand the consequences of not following the training schedule. | 40 | 17.3 | 8 | 80.0 |
NA.2 Understand why conditioning exercises are important for prevention of running-related injuries. | 39 | 16.9 | 7 | 70.0 |
NA.3 Understand the importance of having contact with health professionals for the prevention of running-related injuries. | 31 | 13.4 | 8 | 80.0 |
NA.4 Express control in keeping the training schedule. | 30 | 13.0 | 5 | 50.0 |
NA.5 Understand when a minor injury may be a matter of concern. | 28 | 12.1 | 7 | 70.0 |
NA.6 Understand that comfort should be the most important factor when choosing running shoes. | 28 | 12.1 | 7 | 70.0 |
NA.7 Understand that there is no right or wrong foot strike pattern. | 23 | 10.0 | 6 | 60.0 |
NA.8 Understand when it is recommended to seek professionals’ opinion/help. | 6 | 2.6 | 2 | 20.0 |
NA.9 Understand how to perform conditioning exercises; understand how to incorporate conditioning exercises in a week routine. | 5 | 2.2 | 3 | 30.0 |
NA.10 Be able to perform conditioning exercises; be able to incorporate conditioning exercises in a week routine. | 1 | 0.4 | 1 | 10.0 |
Total | 231 | 100 | – | – |
*The sum of ‘n’ and ‘% of n’ equals more than 10 and 100%, respectively, because the participants could report multiple categories.
FET, frequency of emerging themes; n, number of participants; NA, needs assessment.
Step 2: matrix of change objectives
Based on the needs assessment findings, behavioural outcomes of at-risk groups were defined: (1) identification of minor symptoms as the beginning of a potential injury; (2) not seeking professional (health-related or training-related) help/opinion when necessary; (3) not following the training schedule; (4) doubts about running shoes like comfort or adaptations; (5) doubts about biomechanics like running technique and foot strike patterns; and (6) the need and how to perform conditioning exercises underlying with running training. Matrices of change objectives connect the performance objectives with the personal determinants (eg, knowledge, self-efficacy and skills) that would probably/theoretically lead to a change in preventive behaviour. The intersection of the performance objectives with their personal or environmental determinants led to the matrix change objectives described in online supplemental appendix E.
Step 3: methods and practical applications
Based on the matrix of change objectives, the general objectives of the running-related injury prevention programme were established in two broad actions: (1) to provide feedback on individual training characteristics and running-related injury risk; and (2) provide/enhance knowledge, self-efficacy and skills towards running-related injury prevention divided into three specific objectives: (2.1) to provide knowledge on symptoms, foot strike patterns, running shoes and conditioning exercises; (2.2) to facilitate self-efficacy on keeping a running training programme; and (2.3) to enhance skills on incorporating conditioning exercises. Considering the two general and the three specific objectives described, the running-related injury prevention programme was developed based on the Integrated Behavioural Model.22 Table 2 describes the methods and applications for the change objectives.
Table 2Methods and applications to the target population
Change objectives per determinant | Method(s) | Application(s) |
Knowledge | ||
To understand when a minor injury may be a matter of concern. | Belief selection | Explain the relation of tissue damage and the thresholds (pain, performance, participation and time loss), types of signs and symptoms of an injury and the difference between delayed-onset muscle soreness (DOMS) and injury. |
Feedback | Provide feedback on OSTRC-BR outcomes. | |
To understand the importance of having contact with health professionals for the prevention of running-related injuries. | Belief selection | Explain the consequences of not seeking a professional when your symptoms do not go away. |
Persuasive communication | A health professional explaining the importance of having contact with professionals for the prevention of running-related injuries. | |
Reinforcement | Reminding the importance of having contact with health professionals. | |
To understand when it is recommended to seek professionals’ opinion/help. | Belief selection | Explain how a running-related injury can impact in runners’ health and running practice. |
Persuasive communication | A health professional explaining when it is recommended to seek professionals’ opinion/help. | |
Feedback | Provide feedback on OSTRC-BR outcomes. | |
To understand how to get a training schedule. | Belief selection | Explain how and with whom to get a training schedule. |
Persuasive communication | A trainer explaining the importance of having and following a running schedule. | |
Reinforcement | Send messages with tips on how to get a proper running schedule. | |
To understand the consequences of not following the training schedule. | Belief selection | Explain that overtraining and the lack of recovery in appropriate time can lead to injuries. |
Persuasive communication | A physiotherapist/medical doctor explaining the consequences of not following the training schedule. | |
Reinforcement | Send messages with examples on the consequences of not following the training schedule. | |
To understand that comfort should be the most important factor when choosing running shoes. | Belief selection | Explain that comfort should be the most important factor when choosing running shoes. |
Persuasive communication | A trainer/physiotherapist explaining why comfort should be the most important factor when choosing running shoes. | |
To understand that there is no right or wrong foot strike pattern. | Belief selection | Explain foot strike patterns and state there is no right or wrong pattern with regard to running-related injuries. |
Persuasive communication | A trainer/physiotherapist explaining why there is no right or wrong foot strike pattern with regard to running-related injuries. | |
To understand why conditioning exercises are important for the prevention of running-related injuries. | Belief selection | Explain the importance of conditioning exercises for running practice. |
Persuasive communication | A trainer explaining the importance of conditioning exercises for running practice. | |
Reinforcement | Reminding the runner to perform conditioning exercises on a regular basis. | |
To understand how to perform conditioning exercises in different contexts. | Belief selection | Explain how to perform conditioning exercises in different contexts. |
Persuasive communication | A trainer explaining how to perform conditioning exercises in different contexts. | |
Self-efficacy | ||
To develop self-control in keeping the training schedule. | Goal setting | Establish a goal for each running practice or for each training week that is in line with the running schedule. |
Set graded tasks | Slowly progress the running volume and intensity, with periods of recovery and periodisation. | |
Skills | ||
To be able to perform conditioning exercises (eg, at the gym, home or parks). | Facilitation | Instructions and demonstrations on the possibility and how to perform conditioning exercises in different settings/environments. |
To be able to incorporate conditioning exercises in a week routine. | Facilitation | Instructions and demonstrations on when to perform conditioning exercises in different settings/environments. |
OSTRC-BR: Brazilian-Portuguese version of the Oslo Sports Trauma Research Centre Questionnaire on Health Problems.50
Step 4: programme production
The first consensus achieved was that running load monitoring is important for running-related injury prevention. Therefore, runners would answer, every 2 weeks, to a questionnaire in order to provide evidence of running load and progression over time (general objective 1). If any symptom related to running practice is detected by the questionnaire, the runners would be directed to an algorithm that would help them in managing their running training volume for the next 2 weeks if they so desire (online supplemental appendix F). At the end of the algorithm, the participants receive: (1) the suggested training volume for the next 2 weeks ranging from 10% to 30% of the volume previously reported at the beginning of the questionnaire; and (2) an infographic with information on how the calculation was done (online supplemental appendix G). To accomplish the general objective 2 related to providing knowledge (specific objective 2.1), self-efficacy (specific objective 2.2) and skills (specific objective 2.3), a website was created in order to communicate information on the topics shown in table 3.
Table 3Full description of the strategies in the RunIn3 programme
Programme component and delivery time point | Description | Strategy |
Weekly progression First delivery: week 2 Reinforcement: week 28 | Description of weekly progression; discussion of their importance; how to progress weekly volume | Website contains:
|
Warm-up/stretching First delivery: week 4 Reinforcement: week 30 | Description of warm-up; discussion of stretching versus warm-up | Website contains:
|
Warm-up/stretching First delivery: week 6 Reinforcement: week 34 | How to perform a warm-up (examples) | Website contains:
|
Symptoms differentiation—inflammation First delivery: week 10 Reinforcement: week 36 | Description of inflammatory symptoms; most common body regions; description of cryotherapy; how to perform cryotherapy; weekly progression reminder; if persists, it’s time to seek a professional for help | Website contains:
|
Symptoms differentiation—delayed-onset muscle soreness (DOMS) First delivery: week 12 Reinforcement: week 40 | Description of DOMS symptoms; most common body regions for DOMS; adequacy of weekly progression; performing light exercises | Website contains:
|
Foot strike patterns First delivery: week 16 Reinforcement: week 42 | Description of foot strike patterns; explanation of misinterpretation of better/worst foot strike patterns | Website contains:
|
Running shoes First delivery: week 18 Reinforcement: week 46 | Description of types of running shoes (minimalist/maximalist, antipronation/neutral); explanation of misinterpretation of better/worst running shoes | Website contains:
|
Conditioning exercises First delivery: week 22 Reinforcement: week 48* | Description of exercises; discussion of their importance | Website contains:
|
Conditioning exercises First delivery: week 24 Reinforcement: week 48* | How to perform conditioning exercises (examples) | Website contains:
|
*Reinforcement in week 48 contains information of week 22 and week 24.
Step 5: adoption and implementation
The delivery strategy would be done through automated tailored online feedback on the severity of symptoms and running load, just after the runners answered the monitoring questionnaire applied every 2 weeks. In addition, the information aimed at providing knowledge and enhancing self-efficacy and skills will be delivered every month through an internet link referring the runners to the RunIn3 website (http://runin3.com.br). A detailed explanation on the implementation process of the RunIn3 prevention programme can be found elsewhere.33
Step 6: evaluation planning
The RunIn3 prevention programme will be evaluated through a pragmatic hybrid type 1 randomised controlled trial. The protocol describing the methods in detail can be found elsewhere.33 The randomised controlled trial has been prospectively registered in ClinicalTrials.gov under the identifier NCT03892239.
Discussion
The prevention programme was developed based on perspectives of behavioural and social science theories. The Integrated Behavioural Model was chosen to guide the development of the RunIn3 prevention programme because this theory covers all determinants that influence preventive behaviours towards running-related injury prevention established through discussions among the participants of this study during the focus group meetings, considering the preferences of the target population: that is, recreational runners. Therefore, the Integrated Behavioural Model was selected ad hoc to match with what the participants revealed in the focus groups. The determinants (knowledge, self-efficacy and skills) may influence the preventive behaviours towards running-related injuries presented in table 1. These findings reflect the opinions and beliefs of recreational runners.45
We have postulated that there are three major concerns regarding running-related injury prevention programmes. First, most running-related injury preventive strategies implemented in practice are not scientific (or evidence) based.12 Therefore, a strength of this study was to develop an evidence-based running-related injury prevention programme, taking the best scientific knowledge available mixed with the needs and preferences of the target population (ie, recreational runners) and different stakeholders (ie, runners, coaches, running groups, health professionals).
Second, running-related injury preventive strategies are usually based on imposing behaviour changes to runners, such as biomechanical ‘corrections’ or even replacing running shoes, with no consideration regarding runners’ intention to perform such changes.10 27 Another strength of this study was to develop a running-related injury prevention programme taking into consideration a behaviour model of change (ie, Integrated Behavioural Model) and the determinants (ie, knowledge, self-efficacy and skills) that may influence the runners’ intention to perform the behavioural changes that the RunIn3 programme proposes. We believe that this approach will increase the likelihood of runners adopting and sustaining new evidence-based preventive behaviours, or even dropping out old and non-preventive behaviours that are broadcasted in the media nowadays. This is actually the main purpose of social science theories like the Integrated Behavioural Model.22
Third, there is a paucity of using implementation science to effectively implement sports injury prevention programmes.25 For example, the implementation of preventive strategies may present challenges due to lack of financial or technical resources.46 However, even if the financial and/or technical challenges are overcome, the question remains: would people actually adopt this programme or intervention? Is it feasible to be implemented in the ‘real world’? Or even in cases where people are willing to adopt the programme, would its implementation be sustained? All these doubts would be mitigated if the target population participated in the development process of the programme, providing opinions and suggestions.17 Therefore, the participatory action approach used in this study may be an important strength, where runners from the community actually commented on their needs, difficulties and preferences towards running-related injury prevention. We believe this approach will increase the likelihood of the programme being implementable in real life.
The low number of participants may be considered a limitation of this study; however, this low number is inherent to the method of choice. Adding more participants increases the likelihood of some people feeling inhibited and, therefore, not participating in the discussions; this may result in divagating discussions that are beyond the control of the focus group moderator; and this may have several unfavourable outcomes such as the inability to transcribe the recorded audios of the meetings due to noise.47 All these factors being considered, the reduced number of participants in the focus group meetings of this study may have represented a biased view towards running-related injury prevention given the complexity of this matter. To minimise this possible bias, the sample of this study was as heterogeneous as possible in order to gather as much relevant information as possible from different perspectives. The quantitative content analysis approach used in this study may have introduced bias related to personal interpretation and/or deviations from the actual meanings of the transcripts during condensation, coding and/or categorising the qualitative data. However, three researchers were involved in checking and/or reaching a consensus regarding the DP in order to minimise the risk of bias related to personal interpretations.
There is a paucity of effective running-related injury prevention programmes implemented in practice. Therefore, there is a need for the development and evaluation of running-related injury prevention programmes. This might have public health implications, since preventing running-related injuries in large groups (like recreational runners) might improve health, reduce disability, reduce absenteeism from work and reduce costs to the runners and for society.48 49 Running clubs may benefit from this study in order to rely on the fundamentals of creating evidence-based prevention programmes and not from common sense that has substantial biases. Sports injury researchers might benefit from using and/or adapting the methods applied in this study to other sports in order to increase the body of scientific evidence on the prevention of sports injuries based on behavioural and social science theories. This might increase the number of sports injury prevention programmes proven to be effective and implementable in ‘real world’. Furthermore, researchers and/or stakeholders in the field of running-related injury may use the proposed method to support the development of prevention programmes for other populations of runners, such as professional runners.
Conclusions
A running-related injury prevention programme was developed using the IM framework and a participatory approach. The programme was named ‘RunIn3’, and it is based on providing feedback on running load and running-related injury risk, as well as providing knowledge, skills and self-efficacy on preventive behaviours towards running-related injury. The programme is aimed to be delivered online through a website.
We wish to thank Leonardo Oliveira Pena Costa for his contribution on revising the study protocol.
Data availability statement
Data are available upon reasonable request to LH (corresponding author). Deidentified participant data might be available after the consent of all authors and the privacy policy of the Universidade Cidade de São Paulo (UNICID).
Ethics statements
Patient consent for publication
Not required.
Ethics approval
The study was approved by the Research Ethics Committee of the Universidade Cidade de São Paulo (UNICID)–CAAE 69503717.2.0000.0064.
Twitter @LucaHespanhol
Contributors LH conceptualised the study. All authors were involved in designing and conducting the study. CSV, GMO and GAKM cleaned and analysed the data. All authors were involved in interpreting the data. All authors were involved in drafting and revising the entire manuscript for intellectual content, and all approved the final version of the article. All authors had full access to the data (including statistical reports and tables) and can take responsibility for the integrity of the data and the accuracy of the data analysis.
Funding This study was supported by the São Paulo Research Foundation (FAPESP) (grant numbers: 2016/09220-1 to LH, FAPESP Young Investigator Grant; 2017/11665-4 to CSV, FAPESP PhD Scholarship; 2018/03715-4 to GMO, FAPESP Master's Scholarship; 2017/14552-6 to GAKM, FAPESP Scientific Initiation Scholarship).
Competing interests None declared.
Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review Not commissioned; externally peer reviewed.
1 Ooms L, Veenhof C, de Bakker DH. Effectiveness of start to run, a 6-week training program for novice runners, on increasing health-enhancing physical activity: a controlled study. BMC Public Health 2013; 13: 697. doi:10.1186/1471-2458-13-697 http://www.ncbi.nlm.nih.gov/pubmed/23898920
2 Lee D-C, Brellenthin AG, Thompson PD, et al. Running as a key lifestyle medicine for longevity. Prog Cardiovasc Dis 2017; 60: 45–55. doi:10.1016/j.pcad.2017.03.005 http://www.ncbi.nlm.nih.gov/pubmed/28365296
3 Hatziandreu EI, Koplan JP, Weinstein MC, et al. A cost-effectiveness analysis of exercise as a health promotion activity. Am J Public Health 1988; 78: 1417–21. doi:10.2105/AJPH.78.11.1417 http://www.ncbi.nlm.nih.gov/pubmed/3140681
4 Hespanhol Junior LC, Pillay JD, van Mechelen W, et al. Meta-Analyses of the effects of habitual running on indices of health in physically inactive adults. Sports Med 2015; 45: 1455–68. doi:10.1007/s40279-015-0359-y http://www.ncbi.nlm.nih.gov/pubmed/26178328
5 Videbæk S, Bueno AM, Nielsen RO, et al. Incidence of Running-Related injuries per 1000 H of running in different types of runners: a systematic review and meta-analysis. Sports Med 2015; 45: 1017–26. doi:10.1007/s40279-015-0333-8 http://www.ncbi.nlm.nih.gov/pubmed/25951917
6 Hespanhol Junior LC, Pena Costa LO, Lopes AD. Previous injuries and some training characteristics predict running-related injuries in recreational runners: a prospective cohort study. J Physiother 2013; 59: 263–9. doi:10.1016/S1836-9553(13)70203-0 http://www.ncbi.nlm.nih.gov/pubmed/24287220
7 Fokkema T, Hartgens F, Kluitenberg B, et al. Reasons and predictors of discontinuation of running after a running program for novice runners. J Sci Med Sport 2019; 22: 106–11. doi:10.1016/j.jsams.2018.06.003 http://www.ncbi.nlm.nih.gov/pubmed/29934211
8 Kluitenberg B, van Middelkoop M, Diercks RL, et al. The NLstart2run study: health effects of a running promotion program in novice runners, design of a prospective cohort study. BMC Public Health 2013; 13: 685. doi:10.1186/1471-2458-13-685 http://www.ncbi.nlm.nih.gov/pubmed/23890182
9 Finch C. A new framework for research leading to sports injury prevention. J Sci Med Sport 2006; 9: 3–9. doi:10.1016/j.jsams.2006.02.009 http://www.ncbi.nlm.nih.gov/pubmed/16616614
10 Yeung SS, Yeung EW, Gillespie LD. Interventions for preventing lower limb soft-tissue running injuries. Cochrane Database Syst Rev 2011: CD001256. doi:10.1002/14651858.CD001256.pub2 http://www.ncbi.nlm.nih.gov/pubmed/21735382
11 Hespanhol LC, van Mechelen W, Verhagen E. Effectiveness of online tailored advice to prevent running-related injuries and promote preventive behaviour in Dutch TRAIL runners: a pragmatic randomised controlled trial. Br J Sports Med 2018; 52: 851–8. doi:10.1136/bjsports-2016-097025 http://www.ncbi.nlm.nih.gov/pubmed/28855183
12 Richards CE, Magin PJ, Callister R. Is your prescription of distance running shoes evidence-based? Br J Sports Med 2009; 43: 159–62. doi:10.1136/bjsm.2008.046680 http://www.ncbi.nlm.nih.gov/pubmed/18424485
13 Ryan MB, Valiant GA, McDonald K, et al. The effect of three different levels of footwear stability on pain outcomes in women runners: a randomised control trial. Br J Sports Med 2011; 45: 715–21. doi:10.1136/bjsm.2009.069849 http://www.ncbi.nlm.nih.gov/pubmed/20584759
14 Gielen AC, Sleet D. Application of behavior-change theories and methods to injury prevention. Epidemiol Rev 2003; 25: 65–76. doi:10.1093/epirev/mxg004 http://www.ncbi.nlm.nih.gov/pubmed/12923991
15 Bartholomew Eldredge LK, Markham CM, Ruiter RAC. Planning health promotion programs: an intervention mapping approach. 4th ed. Jossey-Bass Public Health, 2016.
16 Fokkema T, de Vos R-J, Bierma-Zeinstra SMA, et al. Opinions, barriers, and facilitators of injury prevention in recreational runners. J Orthop Sports Phys Ther 2019; 49: 736–42. doi:10.2519/jospt.2019.9029 http://www.ncbi.nlm.nih.gov/pubmed/31443623
17 Baum F, MacDougall C, Smith D. Participatory action research. J Epidemiol Community Health 2006; 60: 854–7. doi:10.1136/jech.2004.028662 http://www.ncbi.nlm.nih.gov/pubmed/16973531
18 van Stralen MM, Kok G, de Vries H, et al. The active plus protocol: systematic development of two theory- and evidence-based tailored physical activity interventions for the over-fifties. BMC Public Health 2008; 8: 399. doi:10.1186/1471-2458-8-399 http://www.ncbi.nlm.nih.gov/pubmed/19055806
19 McEachan RRC, Lawton RJ, Jackson C, et al. Evidence, theory and context: using intervention mapping to develop a worksite physical activity intervention. BMC Public Health 2008; 8: 326. doi:10.1186/1471-2458-8-326 http://www.ncbi.nlm.nih.gov/pubmed/18808709
20 Donaldson A, Lloyd DG, Gabbe BJ, et al. We have the programme, what next? Planning the implementation of an injury prevention programme. Inj Prev 2017; 23: 273–80. doi:10.1136/injuryprev-2015-041737 http://www.ncbi.nlm.nih.gov/pubmed/26787739
21 Collard DCM, Chinapaw MJM, van Mechelen W, et al. Design of the iPlay study: systematic development of a physical activity injury prevention programme for primary school children. Sports Med 2009; 39: 889–901. doi:10.2165/11317880-000000000-00000 http://www.ncbi.nlm.nih.gov/pubmed/19827858
22 Glanz K, Romer BK, Viswanath K. Health behavior: theory, research, and practice. 5 ed. Jossey-Bass, 2015.
23 de Vries H, Mudde A, Leijs I, et al. The European smoking prevention framework approach (EFSA): an example of integral prevention. Health Educ Res 2003; 18: 611–26. doi:10.1093/her/cyg031 http://www.ncbi.nlm.nih.gov/pubmed/14572020
24 Vries Hde, Mesters I, van de Steeg H, et al. The general public's information needs and perceptions regarding hereditary cancer: an application of the integrated change model. Patient Educ Couns 2005; 56: 154–65. doi:10.1016/j.pec.2004.01.002 http://www.ncbi.nlm.nih.gov/pubmed/15653244
25 McGlashan AJ, Finch CF. The extent to which behavioural and social sciences theories and models are used in sport injury prevention research. Sports Med 2010; 40: 841–58. doi:10.2165/11534960-000000000-00000 http://www.ncbi.nlm.nih.gov/pubmed/20836582
26 Gabriel EH, McCann RS, Hoch MC. Use of social or behavioral theories in Exercise-Related injury prevention program research: a systematic review. Sports Med 2019; 49: 1515–28. doi:10.1007/s40279-019-01127-4 http://www.ncbi.nlm.nih.gov/pubmed/31187453
27 Verhagen EALM, van Stralen MM, van Mechelen W. Behaviour, the key factor for sports injury prevention. Sports Med 2010; 40: 899–906. doi:10.2165/11536890-000000000-00000 http://www.ncbi.nlm.nih.gov/pubmed/20942507
28 O'Brien BC, Harris IB, Beckman TJ, et al. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med 2014; 89: 1245–51. doi:10.1097/ACM.0000000000000388 http://www.ncbi.nlm.nih.gov/pubmed/24979285
29 Hespanhol Junior LC, Costa LOP, Carvalho ACA, et al. A description of training characteristics and its association with previous musculoskeletal injuries in recreational runners: a cross-sectional study. Rev Bras Fisioter 2012; 16: 46–53. http://www.ncbi.nlm.nih.gov/pubmed/22441228
30 Lopes AD, Hespanhol Júnior LC, Yeung SS, et al. What are the main running-related musculoskeletal injuries? A systematic review. Sports Med 2012; 42: 891–905. doi:10.1007/BF03262301 http://www.ncbi.nlm.nih.gov/pubmed/22827721
31 Hespanhol Junior LC, de Carvalho ACA, Costa LOP, et al. Lower limb alignment characteristics are not associated with running injuries in runners: prospective cohort study. Eur J Sport Sci 2016; 16: 1137–44. doi:10.1080/17461391.2016.1195878 http://www.ncbi.nlm.nih.gov/pubmed/27312709
32 Saragiotto BT, Yamato TP, Hespanhol Junior LC, et al. What are the main risk factors for running-related injuries? Sports Med 2014; 44: 1153–63. doi:10.1007/s40279-014-0194-6 http://www.ncbi.nlm.nih.gov/pubmed/24809248
33 Barros PM, Vallio CS, Oliveira GMde, et al. Cost-effectiveness and implementation process of a running-related injury prevention program (RunIn3): protocol of a randomized controlled trial. Contemp Clin Trials Commun 2021; 21: 100726. doi:10.1016/j.conctc.2021.100726 http://www.ncbi.nlm.nih.gov/pubmed/33553800
34 Masadeh MA. Focus group: reviews and practices. Int J Appl Sci 2012; 2: 63–8.
35 Salimi Y, Shahandeh K, Malekafzali H, et al. Is community-based participatory research (CBPR) useful? A systematic review on papers in a decade. Int J Prev Med 2012; 3: 386–93. http://www.ncbi.nlm.nih.gov/pubmed/22783464
36 Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care 2007; 19: 349–57. doi:10.1093/intqhc/mzm042 http://www.ncbi.nlm.nih.gov/pubmed/17872937
37 Porter CM. Revisiting Precede–Proceed: a leading model for ecological and ethical health promotion. Health Educ J 2016; 75: 753–64. doi:10.1177/0017896915619645
38 Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implications for conducting a qualitative descriptive study. Nurs Health Sci 2013; 15: 398–405. doi:10.1111/nhs.12048 http://www.ncbi.nlm.nih.gov/pubmed/23480423
39 Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006; 3: 77–101. doi:10.1191/1478088706qp063oa
40 Erlingsson C, Brysiewicz P. A hands-on guide to doing content analysis. Afr J Emerg Med 2017; 7: 93–9. doi:10.1016/j.afjem.2017.08.001 http://www.ncbi.nlm.nih.gov/pubmed/30456117
41 Bengtsson M. How to plan and perform a qualitative study using content analysis. NursingPlus Open 2016; 2: 8–14. doi:10.1016/j.npls.2016.01.001
42 Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs 2008; 62: 107–15. doi:10.1111/j.1365-2648.2007.04569.x http://www.ncbi.nlm.nih.gov/pubmed/18352969
43 Oliveira GM, Mota GAK, Vallio CS, et al. What are the facilitators and barriers to develop a running-related injury prevention program? A qualitative study. Physiother Theory Pract 2021.
44 Huang R. RQDA: R-based qualitative data analysis, R package version 0.3-0, 2017. Available: http://rqda.r-forge.r-project.org/
45 Saragiotto BT, Yamato TP, Lopes AD. What do recreational runners think about risk factors for running injuries? A descriptive study of their beliefs and opinions. J Orthop Sports Phys Ther 2014; 44: 733–8. doi:10.2519/jospt.2014.5710 http://www.ncbi.nlm.nih.gov/pubmed/25155860
46 Willy RW. Innovations and pitfalls in the use of wearable devices in the prevention and rehabilitation of running related injuries. Phys Ther Sport 2018; 29: 26–33. doi:10.1016/j.ptsp.2017.10.003 http://www.ncbi.nlm.nih.gov/pubmed/29172095
47 O.Nyumba T, Wilson K, Derrick CJ, et al. The use of focus group discussion methodology: insights from two decades of application in conservation. Methods Ecol Evol 2018; 9: 20–32. doi:10.1111/2041-210X.12860
48 Hespanhol Junior LC, van Mechelen W, Postuma E, et al. Health and economic burden of running-related injuries in runners training for an event: a prospective cohort study. Scand J Med Sci Sports 2016; 26: 1091–9. doi:10.1111/sms.12541 http://www.ncbi.nlm.nih.gov/pubmed/26282068
49 Hespanhol Junior LC, van Mechelen W, Verhagen E. Health and economic burden of Running-Related injuries in Dutch Trailrunners: a prospective cohort study. Sports Med 2017; 47: 367–77. doi:10.1007/s40279-016-0551-8 http://www.ncbi.nlm.nih.gov/pubmed/27222128
50 Pimenta RM, Hespanhol L, Lopes AD. Brazilian version of the OSTRC questionnaire on health problems (OSTRC-BR): translation, cross-cultural adaptation and measurement propertiesquestionnaire on health problems. Braz J Phys Ther 2021.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2021 Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. http://creativecommons.org/licenses/by-nc/4.0/ This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ . Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Background
Running is an important type of exercise to keep people physically active. However, running also carries a risk of developing running-related injuries (RRI). Therefore, effective and evidence-based RRI prevention programmes are desirable, but are scarce in practice. An approach to face this problem might be the application of methods to develop RRI prevention programmes based on theories of behaviour change.
Objective
The purpose of the study was to develop an RRI prevention programme based on perspectives of behavioural and social science theories, as well as taking a framework development approach.
Methods
This was a qualitative study using the Intervention Mapping (IM) framework held between February and March 2018 in São Paulo, Brazil. The participants were involved in running practice. The data collection was conducted during focus group meetings. The data analysis was based on semantic thematic approach using a content analysis orientation based on inductive reasoning.
Results
The target population of the RRI prevention programme identified was ‘adult recreational runners’. The objectives of the RRI prevention programme were established in two broad actions: (1) to provide feedback on individual training characteristics and RRI risk; and (2) provide/enhance knowledge, skills and self-efficacy on RRI preventive behaviours. The programme is aimed to be delivered through an online system.
Conclusion
An RRI prevention programme was developed using the IM framework and a participatory approach. The programme was named ‘RunIn3’, and it is based on providing feedback on running volume and RRI risk, as well as providing knowledge, skills and self-efficacy on RRI preventive behaviours.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details





1 Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo (UNICID), São Paulo, SP, Brazil
2 Department of Physical Therapy, Movement and Rehabilitation Sciences, Northeastern University, Boston, MA, USA
3 Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo (UNICID), São Paulo, SP, Brazil; Department of Public and Occupational Health (DPOH), Amsterdam Public Health Research Institute (APH), Amsterdam Universities Medical Centers, location VU University Medical Center Amsterdam (VUmc), Amsterdam, The Netherlands; Amsterdam Collaboration on Health and Safety in Sports (ACHSS), Amsterdam Movement Sciences, Amsterdam Universities Medical Centers, location VU University Medical Center Amsterdam (VUmc), Amsterdam, The Netherlands