Correspondence to Dr Svetlana V Doubova; [email protected]
Strengths and limitations of this study
The intervention focuses on early chemotherapy and radiotherapy, a critical window in which patients with breast cancer face the most important supportive care needs.
The electronic patient-reported outcome (ePRO) intervention and proactive care model were developed through a multistage design and validation process with patient input and an expert group of advisors; the pilot test will enable the assessment of usability of the web-based ePRO application and inform necessary adjustments.
The limited working hours of the study nurses could affect ePRO application use by patients and therefore the effectiveness of the intervention.
The intervention delivery and assessment will be conducted separately from Mexican Institute of Social Security routine care and health information systems, limiting consideration of implementation requirements.
Individuals of lower socioeconomic status without smartphones or internet access will not benefit from the intervention.
Introduction
Breast cancer is the leading cause of cancer morbidity and mortality in Mexico, with nearly 30 000 incident cases and 8000 deaths in 2020.1 Age-standardised mortality from breast cancer has doubled since 2000 and continues to increase annually.2 Patients with cancer who receive healthcare in public hospitals report multiple unmet supportive care needs and deficiencies in the quality of their care: over half report receiving incomplete information, preventing their participation in decision-making and 7 in 10 receive care they consider inadequate to address their physical and emotional needs.3–6 Unmet supportive care needs negatively affect patients’ quality of life and are associated with a higher probability of using emergency services and unscheduled hospitalisations.7–9
Patient-centred care is intended to meet the needs, expectations and preferences of patients.10 11 To be patient-centred, healthcare providers must be aware of and proactively address patients needs as they arise; therefore, design and evaluation of care models should be informed by assessing patient-reported outcome (PRO) measures.12–14 However, previous studies have found that physicians frequently underestimate the severity of patients’ symptoms during cancer treatment15 16; causing unnecessary patient suffering, excess use of emergency services and hospitalisations.17 18 Orienting cancer care delivery around PROs has the potential to better address patients’ needs and to reduce the use of emergency services and avoidable hospitalisations,19–21 making care more efficient in resource-constrained settings. In Mexico, research has demonstrated that those receiving patient-centred care report notably better health outcomes, but that the major health systems have not integrated PROs within clinical care.22 23 Locally validated models focused on PROs are currently lacking.
Digital health information and communication technologies have emerged as a flexible and scalable approach to increasing patient-centred care. When deployed correctly, digital interventions can reduce patient travel time, facilitate access to clinical information and remote monitoring, improve communication between patients and health personnel to detect and address the treatment side effects in a timely manner and promote active participation of patients in their self-care.24 Digital interventions for patients with cancer have included symptom monitoring, self-care support and digital communication with providers and other patients. In high-income countries, these interventions have demonstrated high patient acceptance and adherence, as well as positive effects on PROs including symptom management.25–30
Research on the design and implementation of digital interventions in Mexico is limited and has not addressed cancer care.31–33 It is not yet known whether incorporating PROs within cancer treatment, using digital interventions to support PRO reporting and using clinical care guidelines to respond to patient-reported needs may be feasible and effective within public oncology services in Mexico.
The objectives of this paper are to describe: (1) the design of a two-component intervention for monitoring electronic patient-reported outcomes (ePROs) among patients with breast cancer using a responsive digital application and proactive follow-up by nurses, (2) intervention pilot testing and (3) an individual randomised clinical trial to assess usability and effectiveness of the intervention.
Methods and analysis
The study protocol development was guided by the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) reporting guideline and the SPIRIT-PRO extension.34 35
Study setting
The study will be conducted in one of the largest public oncology hospitals in Mexico, located in Mexico city and operated by the Mexican Institute of Social Security (Instituto Mexicano del Seguro Social (IMSS)). This hospital provides treatment to ~190 000 patients with cancer annually, including ~2000 new breast cancer cases. General and clinical patient data are collected in an electronic health record primarily for aggregate reporting; standard care does not include collection of PROs.
Patient and public involvement
Patient involvement in the development of the ePRO application and in debriefing following the pilot test was prioritised to ensure that the content and measurement tools are clear and useful to the patient population. Furthermore, patients with breast cancer will be invited to a webinar about the study findings to engage them in disseminating the study results. However, patient participation in design and conduct of the trial is not typically permitted by the IMSS National Research and Ethics Committees.
Study population and eligibility criteria
The study will include women between 20 and 75 years, diagnosed with breast cancer, who have just started or will start neoadjuvant or adjuvant treatment with chemotherapy or radiotherapy within 2 weeks before or after enrolment; who have access to the internet in mobile phone, computer or tablet; and who provide written informed consent (see online supplemental material 1: Consent form). The study will exclude illiterate women and those, who at the time of enrolment, have stage IV breast cancer, blindness or low vision not corrected with glasses, cognitive disability (eg, Alzheimer’s disease, other dementias or other mental illness with intellectual disability) or severe depression (≥12 points on the Hospital Anxiety and Depression Scale).36
Intervention design
We designed an ePRO application to capture patient supportive care needs and a clinical care model to proactively meet such needs. We were guided by the Patient Engagement Framework proposed by the National eHealth Collaborative of the USA and focused on informing, involving, empowering, accompanying and supporting patients with cancer through electronic applications.37–39 The intervention design also followed Jensen et al40 recommendations for successful monitoring of patients with cancer’s ePROs and the ePRO monitoring workflow proposed by Basch et al.41 As shown in figure 1, we adapted this workflow to the resources and processes within IMSS oncology services.
Figure 1. ePRO monitoring workflow. ePRO, electronic patient-reported outcome; PRO, patient-reported outcome; SMS, short messaging service.
Based on these recommendations, we defined our ePRO intervention as a weekly register of patients with breast cancer’s symptoms and supportive care needs combined with proactive follow-up by nurses guided by predefined clinical algorithms and a weekly cellphone message providing an educational video from a recognised cancer association or health institution. The study ePRO application uses a responsive web application design emphasising easy-to-use electronic records with a clear interface, clinically relevant health outcomes and automated communication, including reminders to patients to record data and alerts to health professionals regarding moderate-to-severe or worsening symptoms.40
Intervention development
To develop the intervention content, the lead researcher (SECS) reviewed the available institutional and international evidence-based clinical guidelines for patients with breast cancer’s diagnosis and treatment and identified 20 common symptoms affecting breast cancer women during neoadjuvant and adjuvant chemo and radiotherapy and requiring supportive care from health professionals. These symptoms included (1) pain, (2) fatigue, (3) nausea and/or vomiting, (4) constipation, (5) diarrhoea, (6) anorexia, (7) dyspnoea, (8) insomnia, (9) oral mucositis, (10) pruritus, (11) acute radiodermatitis, (12) palmar-plantar erythrodysesthesia, (13) papulopustular rash, (14) lymphoedema, (15) proctitis, (16) peripheral neuropathy, (17) infusion phlebitis, (18) anxiety and depression, (19) changes in sexuality and other symptoms. After that, SECS proposed an initial set of questions for the weekly symptoms register (95 items grouped into 20 symptom-specific sections) and constructed 21 process-of-care algorithms for proactive follow-up of symptoms by nurses (1 general and 20 symptom-specific). The study algorithms were developed based on the Dennstädt et al method for creating algorithms for clinical decision-making in oncology.42 This method consists of seven steps: definition of the environment, description of the existing evidence, definition of the decision strategy, selection of decision criteria, creation of the clinical algorithm, validation and optimisation.
Next, a group of experts validated the contents of the weekly symptoms record and study algorithms. This group included three medical oncologists, one radiation oncologist, two oncology nurses, one psychologist and one health services researcher, all with clinical and research experience in breast cancer treatment. The experts rated the relevance and clarity of the items in the weekly symptom reporting and each algorithm content using a Likert-type scale: (1) not relevant, (2) somewhat relevant, (3) relevant and (4) very relevant. In the case when specific content was rated as not relevant or somewhat relevant, the experts were asked to explain the reason for this negative rating and to provide suggestions for improvement. Two rounds of rating of the record and algorithm contents were conducted to obtain their final versions, for which agreement on validity was achieved (Content Validity Index (CVI)≥0.70).43
During the validation process, we made 31 changes to the weekly symptoms record (eg, questions rewording, or deletion, adding response options) and 91 changes to the algorithms (eg, reorganisation of processes, adding or modifying general recommendations). The final CVI for algorithm content ranged between 0.92 and 1.00, while the CVI in each symptom-specific section of the weekly record ranged from 0.82 to 1.00.
After the expert group’s validation of the study materials, we conducted two rounds of cognitive interviews,44 each with nine patients with breast cancer, to assess the clarity, comprehension and relevance of the content of weekly symptoms records perceived by women. The median age of women participating was 47 years in the first round and 46 years in the second round. Half of women had a post-secondary) education, while the remainder had secondary (27.8%) or primary school (22.2%). Based on the women’s feedback, seven images were added to the weekly record, including visual illustration of pain and fatigue severity using a 6-point smiley face scale and clinical pictures to illustrate symptoms such as acute radiodermatitis (redness and swelling in the radiation therapy area). Ten terms were modified using simple wording or defining a specific term to achieve better clarity.
A professional web development service was hired to programme the responsive web application. The application was developed in HTML5 with CSS, Bootstrap, Java and PHP Style Sheets to receive and manage the collected data. It can be accessed from different electronic devices (eg, mobile phones, tablets, desktop computers) regardless of operating system (iOS, Android, Symbian, Windows Phone, etc), running through a URL that does not require downloading. The web application has interfaces for (1) intervention group, (2) control group, (3) study nurses and (4) research team (administrators). The intervention group interface includes a baseline record of socio-demographic and clinical characteristics, weekly reporting of symptoms and supportive care needs, questionnaires to assess study outcomes and access to videos on breast cancer-relevant topics on the websites of recognised cancer associations and health institutions. The control group interface includes only modules for baseline records of socio-demographic and clinical characteristics and the questionnaires to assess study outcomes. Online supplemental material 2 provides screenshots illustrating the ePRO application content.
The model of clinical care was designed to align with the ePRO application. Symptom reporting will be linked to automated alerts to the study nurses via WhatsApp/short messaging service (SMS)/email. Those who report mild symptoms or supportive care needs will receive automated messages via SMS/WhatsApp or email (based on the participant’s preference) with general recommendations on how to reduce the presented symptoms/needs. Those who report moderate or severe symptoms/needs will be contacted by phone by the study nurse, who will guide the participant based on the clinical algorithms. Examples of non-pharmacological recommendations provided by the study nurses are presented in table 1.
Table 1Examples of non-pharmacological recommendations
Symptom/supportive care need | Non-pharmacological recommendations |
Pain | Keep tracking your pain using a diary; do not self-medicate; use thermal compresses on the site of pain; practice relaxation techniques and improve sleep quality |
Fatigue | Postpone non-essential activities; moderate activities that involve high energy use; use assistive devices to perform tiring activities |
Nausea and/or vomiting | Practice relaxation techniques; avoid large meals and consumption of fatty, fried or very spicy foods; wear loose and comfortable clothing; avoid strong odours |
Constipation | Consume foods high in fibre daily; increase liquid intake; avoid carbonated beverages and chewing gum; perform gentle abdominal massage |
Diarrhoea | Drink at least one cup of fluid after each bowel movement; do not self-medicate; eat small portions of foods that are easy to digest; avoid eating dairy products, red meat and high-fat foods |
Insomnia | Do not stay awake late; do not use a computer or other electronic devices before going to bed; avoid large meals and drinking coffee or alcohol before bedtime; practice relaxation techniques |
Dyspnoea | Practice relaxation techniques; lie down with the upper body raised to a 45° angle by raising the bed or using pillows; use home air purifier; check your oxygenation with an oximeter |
Oral mucositis | Do not use mouthwashes that contain alcohol; brush teeth gently or use a damp gauze pad or sponge mouth swab instead of a toothbrush; avoid acidic, fried, bitter, spicy, very salty, spicy or hot foods |
Acute radiodermatitis | Wash the skin daily with lukewarm water and neutral soap without fragrance, without scratching; avoid excessive sun exposure; limit activities with sources that generate heat such as cooking, ironing, taking a hot bath or shower; do not use deodorants, perfumes, fragrances and powders |
Lymphoedema | Keep the arm with lymphoedema higher than the heart whenever possible; do not sleep on the affected arm; avoid carrying weight greater than 2 kg; obtain massage performed by a trained specialist |
Peripheral neuropathy | Avoid falls; verify daily the presence of injuries or scratches in the arms, hands, legs and feet; practice relaxation techniques |
Two nurses will be available in the morning shift and one nurse in the evening shift to contact participants from 08:00 to 20:00, from Monday to Friday. Outside these hours, participants will receive only automated messages via SMS, WhatsApp or email (based on the participant preference) with general recommendations. All participants will be informed that if presenting severe symptoms outside these hours or not receiving a response from the study nurse within 30 min after symptom registration, they should go to the emergency room.
Study nurses will be supervised by the lead researcher and study oncologist; all breast cancer treatment decisions will continue to be handled by the IMSS oncologist following standard care procedures.
Training of the study nurses
Prior to the study fieldwork, the lead researcher (SECS) will provide a 1-week training to the three study nurses. In addition to the intervention content, the training will include information on study selection criteria, logistics of patient recruitment, informed consent procedures and retention strategies. Training will be based on a study manual finalised during intervention development.
Study outcomes
Primary and secondary outcome variables are presented in table 2.
Table 2Study outcomes
Variable | Measurement scale | Pilot test assessments timelines | Clinical trial timelines | Source |
Primary study outcome | ||||
Supportive care needs | SCNS Short Form 34, previously validated in Mexico.5 This scale comprises 34 items and assesses 5 domains: (1) psychological needs, (2) health systems and information needs, (3) physical and daily living activities needs, (4) care needs and (5) needs related to sexuality. It uses a 5-point Likert scale to measure if a patient needs support and the extent of such need. Each domain score is standardised and ranges from 0 to 100, with a high score indicating a high need. The study’s primary outcome will focus on health systems and information supportive care needs domain. | Baseline, 4 weeks | Baseline, 1, 3, 6 and 9 months | Patient self-reported questionnaire |
Secondary study outcomes | ||||
Global quality of life and breast symptoms | EORTC (European Organisation for Research and Treatment of Cancer) QLQ-C30.53 This questionnaire comprises 30 items, and it has been validated among Mexican patients with cancer54 and includes five functional scales (physical functioning, role emotional, cognitive and social), three symptom scales (fatigue, pain, nausea/vomiting), a global quality of life scale and six single items (shortness of breath, loss of appetite, insomnia, constipation, diarrhoea and economic difficulties). The complementary breast cancer questionnaire EORTC QLQ-BR2355 will also be used. This questionnaire comprises 23 items, and has been validated among Mexican patients with cancer.54 It includes five symptom scales (body image, sexual functioning, systemic therapy side effects, breast and arm symptoms) and six single items (sexual enjoyment, future perspective and upset by hair loss). For both questionnaires, linear transformation will be applied to standardise raw scores. The standardised scores range from 0 to 100 for each scale, with the higher scores representing a higher quality of life or higher intensity of symptoms.56 57 The study’s secondary outcome will focus on the global quality of life scale as measured by the EORTC QLQ-C30 and breast symptoms as measured by the EORTC QLQ-BR23. | Baseline, 4 weeks | Baseline, 1, 3, 6 and 9 months | Patient self-reported questionnaire |
Other prespecified outcome measures | ||||
Use of emergency services | Number of visits to the emergency room in the previous month. | Baseline, week 4 | Baseline, 1, 3, 6 and 9 months | Patient self-reported questionnaire |
Unscheduled hospitalisations | Number of unscheduled hospitalisations in the previous month. | Baseline, week 4 | Baseline, 1, 3, 6 and 9 months | Patient self-reported questionnaire |
Use of the responsive ePRO application in the intervention group | Frequency of the responsive ePRO application use (site visits by IP address) and completion of a weekly report of symptoms and supportive care needs on the responsive digital application. | Weeks 0–6 | 1, 3 and 6 months | IP address |
Perceived usability of the responsive ePRO application in the intervention group | Perceived usability will be measured by mHealth Application Usability Questionnaire58 translated into Spanish with content validation completed by the study expert group. This questionnaire measures the ease of use, satisfaction, system information arrangement and usefulness of the digital application. | Week 4 | 1, 3 and 6 months | Patient self-reported questionnaire |
ePRO, electronic patient-reported outcome ; IP, Internet Protocol; QLQ, Quality of Life questionnaire; SCNS, Supportive Care Needs Survey .
Study covariates
Participant demographic and clinical characteristics include age, formal educational attainment (primary school or less and secondary school or higher), marital status, number of people who live in the patient’s home, number of people who provide caregiving to the patient, time since cancer diagnosis (in weeks), cancer stage (I, II or III) and type of treatment (chemo, or radiotherapy), local/regional recurrence, chronic diseases prior to cancer diagnosis (eg, diabetes, hypertension).
Pilot test procedures
We will conduct a pilot test of the intervention with 50 patients with breast cancer. We determined the required sample size in consideration of three planned analyses: usability of the ePRO application (primary outcome), preliminary effectiveness in reducing supportive care needs and trial feasibility in preparation for larger studies. Conservatively assuming 10% attrition, the 45 participants provide sufficient sample to yield a 95% CI of width 14% (margin of ±7) on the mHealth Application Usability Questionnaire (MAUQ) score and 90% probability that the CI width will be no larger than 14 in a future study. Based on prior studies among patients with breast cancer providing an average score of 45 (SD=29) on supportive care needs in the health system information domain (4.5), we will have 80% power to detect an improvement of at least 11 points (45 vs 34) between pre-test and post-test on a one-sided paired comparison with alpha set to 0.05 and within-person correlation of 0.5. Finally, the pilot study has a sufficient sample to detect study design problems with an expected prevalence of 6% or greater with 95% confidence.45
Participants will be enrolled within 2 weeks of initiating treatment, provided access and training on the ePRO application and followed for 6 weeks. Participants will also receive a voucher for 1-month prepaid data to support application use. In addition to weekly application use and symptom reporting, study measures will be assessed using questionnaires at baseline and after 4 weeks of follow-up. ePRO application use will be passively monitored for the remaining 2 weeks following the end of the prepaid internet support. Participants will continue receiving care from oncologists according to IMSS standards throughout the pilot and following the study close out. In addition, at the end of the pilot test, up to nine participants, each with incomplete and complete weekly ePRO records, will be contacted and invited to participate in semi-structured feedback interviews on their experiences and difficulties with the application and proactive care and suggestions for improvement. We will conduct structured debriefs with study nurses to identify potential changes in application of the clinical algorithms and other study procedures. At least six key stakeholders within IMSS will be contacted to explore acceptability and alignment of the intervention with organisational priorities.
We will conduct descriptive analysis of socio-demographic and clinical characteristics of initial participants and successfully retained participants compared with all patients with breast cancer within the hospital. We will describe ePRO application use and usability based on the 4-week MAUQ scores and will use paired t-tests to compare supportive care needs between baseline and 4-week assessments. We will refine the ePRO and the study procedures based on the pilot results.
Clinical trial
After finalising the pilot test and adjusting the study application, we will conduct an unblinded, parallel-arm, individual randomised controlled clinical trial. This phase 2 clinical trial focuses on exploring the effect of the intervention on outcomes presented in table 2.
Study groups
The intervention group will be given access to the ePRO application and proactive clinical care, including study nurses responding to ePROs and weekly health information videos for 6 months.
Control group participants will be provided with a list of electronic links to videos on breast cancer-relevant topics on the websites of recognised cancer associations and health institutions.
All participants will continue to receive the usual healthcare provided by the hospital. The intervention will last 6 months with 3 months of additional passive follow-up to allow post-intervention monitoring.
Randomisation
The participants will be randomly allocated to the intervention or control groups using the minimisation technique with MS-DOS Minim program.46 Randomisation will be conducted by a research assistant who will use a pre-prepared list of random numbers to randomise the first six participants. Starting with the seventh participant, randomisation will be carried out using the MS-DOS Minim program. The minimisation technique is recommended as a standard to ensure that clinical trial groups are similar in terms of participant characteristics, such as age, schooling, breast cancer stage and treatment modality.47
Intervention implementation
Each week, the lead researcher will obtain a list of patients with breast cancer who have started or will start neoadjuvant or adjuvant treatment with chemotherapy or radiotherapy within 2 weeks from the oncology hospital. Study nurses will use this list to invite all eligible patients with breast cancer to participate in the study. Patients will be invited by telephone to meet at the hospital or the research unit (located within the oncology hospital) to receive study-related information and to confirm eligibility. Those who meet the inclusion criteria will be provided with the option to participate and invited to provide informed consent prior to participation.
Participants will be provided with username, password and access to the intervention or control interface of the responsive ePRO application and training on its use. All participants will be asked to answer the baseline record of socio-demographic and clinical characteristics and questionnaires to assess study outcomes. Intervention arm participants will be asked to complete the weekly register, and will receive weekly reminders via WhatsApp messaging. Study nurses will contact patients without 2 weekly records to encourage adherence to the intervention.
Study nurses will be supported by the study oncologist/oncology resident to ensure adherence to the intervention activities. Additionally, the nurses will be in regular contact with the study team and will record their activities in the corresponding interface of the responsive ePRO application.
Confidentiality
Consent forms with participant signatures and handwritten information such as field notes or other related research materials will be stored in a locked location only accessible by the principal and leader researchers. All electronic data will be stored on password-protected computers. Data will be anonymised prior to the statistical analysis by the research team. Only de-identified data will be used for reporting, publication and dissemination of findings. Data will be erased and destroyed after 5 years, as per IMSS Ethics and Research Committee guidelines.
Study hypothesis
For primary study outcome
Compared with the control group, the intervention group at the 6-month follow-up:
Will show lower supportive care needs in the domain of health systems and information based on a 10-point difference in this dimension of supportive care needs measured with the Supportive Care Needs Survey (SCNS) Short Form.
For secondary study outcomes
Will report better quality of life based on at least a 10-point difference in the global quality of life scale as measured by the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life questionnaire (QLQ)-C30.
Will report lower breast symptoms based on at least a 10-point difference in the breast symptoms scale as measured by the EORTC QLQ-BR23.
For other prespecified outcome measures
Will report 20% less frequent use of emergency services and unscheduled hospitalisations.
Sample size
We calculated sample size using Power Analysis & Sample Size (PASS) software based on primary analysis of unadjusted outcomes at the 6-month assessment comparing control and intervention groups using two-sample t-tests allowing for unequal variance, setting alpha to 0.05, power of 80% and a dropout rate of 20%; we conservatively assume SD will be larger in the control arm than found in prior studies. Table 3 presents the additional assumptions and the number of participants to include: to address all study objectives, the required sample size is 205 participants per group.
Table 3Sample size
Outcome | Expected control | Expected difference (intervention vs control) | SD (intervention, control) | Participants per group | Enrolment target per group |
Primary study outcome | |||||
Health systems and information supportive care needs | 37.3 points59 | 10 points | 29 points, 35 points5 59 | 164 | 205 |
Secondary study outcomes | |||||
Global quality of life | 68.8 points59 | 10 points | 29 points, 35 points59 | 164 | 205 |
Breast symptoms | 25.5 points60 | 10 points | 24 points, 29 points60 | 113 | 141 |
Other prespecified outcome measures | |||||
Emergency services and unscheduled hospitalisations | 1.97 visits61 | 0.4 visits | 0.4 visits, 0.5 visits61 | 26 | 33 |
Data collection and monitoring
Five evaluations will be performed during the trial: baseline, 1, 3, 6 and 9 months. Main study outcome variables will be measured at each evaluation, while the covariates will be collected only at the beginning of the study and application use and usability will be collected throughout the 6 months of ePRO access. We will also document reasons for dropouts and poor adherence. The information on the study variables will be gathered through the corresponding modules of the responsive ePRO application. Data monitoring will be performed by SECS and SVD to inform aspects of trial recruitment and follow-up. There will be no external data monitoring committee due to the minimal risk designation of this study.
Statistical analysis
Data quality will be assessed before statistical analysis (eg, range checks for numerical values). For the primary analysis, we will examine the effects of the intervention on each outcome variable at 6 months using a two-sample t-test. Anyone measured at 3 but not 6 months will have values carried forward or imputed as an intention-to-treat sensitivity analysis. As an additional analysis, we will use generalised estimating equations with autoregressive correlation structure to estimate time-averaged difference in each continuous outcome over all time points,48 49 adjusting for baseline measures and clinically and conceptually important baseline characteristics.50 The sample size required for the primary analyses is powered at 80% with alpha 0.05 to detect effect sizes of 10 points or more in supportive care needs, symptom reporting and quality of life outcomes. The analysis will be performed using Stata V.14.0 statistical software and R package V.3.6.2.
Ethics and dissemination
The study was authorised by the National Research and Ethics Committees of the Mexican Institute of Social Security (R-2021-785-059). Potential participants will sign an informed consent form prior to joining the study. This form contains the information about study objectives, random assignment of participants to intervention or control groups, study content and duration, relevant ethical considerations (eg, voluntary participation, possible risks and benefits, data custody, security and confidentiality protections) and contact information of the principal investigator and IMSS Ethics Committee (online supplemental material 1).
The trial was registered at ClinicalTrials.gov. Based on the SPIRIT recommendations, any modifications to the protocol that may affect the conduct of the study or the potential benefit or risk of the study participants, such as changes of study objectives, study design, population, sample sizes or study procedures will be submitted as an IMSS IRB amendment to the protocol and modified accordingly on ClinicalTrials.gov. The pilot study began on 15 August 2023; the anticipated start date for the trial is 15 January 2024, with expected completion by the end of 2024. Study findings will be disseminated through publications in peer-reviewed journals, presentations in national and international conferences, a policy-brief to the local authorities and a webinar to patients with breast cancer and health professionals.
Discussion
In Mexico, a substantial unmet need exists to improve health services and outcomes for women with breast cancer. Patient-centred ePRO digital interventions have been proven useful for breast cancer care quality improvement in other settings, but have not been tested in Mexico. The Mexican population is well equipped to adopt digital interventions: there are 86.5 million cell phone users in the country, and 79.9% of the population live in urban areas and use the internet, predominantly via smartphone.51 Moreover, the Mexican government has recognised the importance of implementing eHealth strategies to achieve ‘universal and effective health coverage’ in the country.52 The experience of the COVID-19 pandemic has increased familiarity with telemedicine among patients and providers, showing the benefits of digital approaches, and heightened interest among health system policymakers in validated, scalable models of digital, patient-centred care. Despite that, public health services for patients with cancer in Mexico lack modern and innovative options for remote monitoring and control of cancer symptoms, treatment side effects and supportive care needs. Thus, it is imperative to identify feasible and effective digital health interventions to improve cancer care in Mexico.
The proposed intervention has several strengths. We conducted a comprehensive development and validation process drawing on expert input to ensure the intervention content is complete and accurate and on patient perspectives to confirm clarity and relevance. The final content demonstrated high validity. The intervention design is structured around accessibility from the patient’s perspective, relying on a visually attractive web application that can be used on any device regardless of browser or operating system. The pilot test will provide evidence of the preliminary usability of the web-based ePRO application and generate patient and provider perspectives on necessary adjustments to the intervention or study procedures in preparation for the clinical trial. The intervention focuses on early chemotherapy and radiotherapy, representing a critical window in which patients face the most important supportive care needs.
Several limitations can be noted. First, participation is limited to those capable of interacting with the application, excluding those without access to an internet-capable device as well as illiterate patients, those with limited visual acuity and those with cognitive disability or pre-existing severe depression. Uncontrolled severe depression is characterised by persistent apathy, sadness, poor concentration and loss of interest in activities, symptoms that make it difficult to engage with study activities; women with prior diagnosis of depression receiving effective treatment (reporting Hospital Anxiety and Depression Scale <12) are eligible for participation. This prevents generalising to all patients with breast cancer in Mexico; we will report on the demographic composition of study participants compared with all IMSS patients with breast cancer. Second, the intervention does not include patients with stage IV breast cancer. Although these patients have numerous symptoms and unmet supportive care needs, they will not be included due to the more complex care needs and a limited possibility of improvement of their quality of life. Third, the limited working hours of study nurses (08:00 to 20:00) could affect the use of the ePRO application by patients and, therefore, the effectiveness of this intervention; however, 24-hour support would not be feasible for scale up within IMSS clinical care, so understanding effectiveness with this model will be more relevant to further implementation. Third, study participation and completion of assessment tools require time from women undergoing cancer treatment, who may find it difficult to participate, particularly if no benefit is perceived. Finally, the intervention procedures and evaluation will be conducted separately from routine clinical care; if demonstrated to be effective, considerations of cost and implementation feasibility would need to be addressed within IMSS.
Study materials (eg, content of the ePRO application, clinical algorithms for nurses) are expected to guide the implementations of similar multifaceted ePRO interventions at oncology services of public health institutions in Mexico and other Latin American countries to provide remote monitoring and control of adverse symptoms and supportive care needs of patients with breast cancer, particularly for large oncology hospitals with patient populations similar to the study setting; further local adaptations may be required.
The authors thank psychologist Ingrid Patrica Martinez Vega and nurses Angélica López Silva and Gabriela Meléndez Trejo for their participation in the content analysis of the study materials. SECS (CVU 822323) also thanks the Programa de Maestría y Doctorado en Ciencias Médicas Odontológicas y de la Salud de la Universidad Nacional Autónoma de México, and Consejo Nacional de Humanidades, Ciencias y Tecnologías (CONAHCYT), as well as Dr Marta Zapata Tarrés and Dr Adriana Monroy Guzmán for their academic support during SECS participation in the doctoral programme.
Ethics statements
Patient consent for publication
Not applicable.
Contributors SECS and SVD conceptualised the study, designed the contents of the intervention, drafted and registered the study protocol with the IMSS IRB and ClinicalTrials.gov and elaborated the first draft of the paper. SECS led a content validation of the study materials by the expert group. HHL participated in methodological improvements of the study protocol, obtained funding from the University of California San Francisco (UCSF) Global Cancer Program at the Helen Diller Family Comprehensive Cancer Care Center and critically reviewed the manuscript for significant intellectual content. RGA, AKDB, WJMP, JGNC, FSB, RZV and MGDlB contributed to the design and validation of contents of the study materials and critically reviewed the manuscript for significant intellectual content. All authors read and approved the final manuscript.
Funding The project received an award from the University of California San Francisco (UCSF) Global Cancer Program at the Helen Diller Family Comprehensive Cancer Care Center and the UCSF Academic Senate Committee to support the pilot testing of the intervention and a grant funding from the Research Funding Program of the Mexican Institute of Social Security as part of the 2023 IMSS Call for funding research projects focus on Priority Health issues, Vulnerable Populations and Emerging Issues to finance the clinical trial. N/A for the award/grant number for the UCSF and the IMSS.
Competing interests None declared.
Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
1 International Agency for Research on Cancer (IARC). Cancer today. 2022. Available: https://gco.iarc.fr/today/home
2 International Agency for Research on Cancer (IARC). Cancer over time. 2022. Available: https://gco.iarc.fr/overtime
3 Doubova SV, Pérez-Cuevas R. Association of supportive care needs and quality of patient-centered cancer care with depression in women with breast and cervical cancer in Mexico. Psychooncology 2021; 30: 591–601. doi:10.1002/pon.5608
4 Doubova SV, Martinez-Vega IP, Infante-Castañeda C, et al. Social inequalities in supportive care needs and quality of patient-centered care of cancer patients in Mexico. Support Care Cancer 2021; 29: 1355–67. doi:10.1007/s00520-020-05615-6
5 Doubova SV, Aguirre-Hernandez R, Gutiérrez-de la Barrera M, et al. Supportive care needs of Mexican adult cancer patients: validation of the Mexican version of the Short-Form Supportive Care Needs Questionnaire (SCNS-SFM). Support Care Cancer 2015; 23: 2711–9. doi:10.1007/s00520-015-2634-8
6 Doubova SV, Terreros-Muñoz E, Delgado-Lòpez N, et al. Experiences with health care and health-related quality of life of patients with hematologic malignancies in Mexico. BMC Health Serv Res 2020; 20: 644. doi:10.1186/s12913-020-05498-7
7 Antonuzzo A, Vasile E, Sbrana A, et al. Impact of a supportive care service for cancer outpatients: management and reduction of hospitalizations. preliminary results of an integrated model of care. Support Care Cancer 2017; 25: 209–12. doi:10.1007/s00520-016-3403-z
8 Handley NR, Schuchter LM, Bekelman JE. Best practices for reducing unplanned acute care for patients with cancer. J Oncol Pract 2018; 14: 306–13. doi:10.1200/JOP.17.00081
9 Barkley R, Soobader M-J, Wang J, et al. Reducing cancer costs through symptom management and triage pathways. J Oncol Pract 2019; 15: e91–7. doi:10.1200/JOP.18.00082
10 Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the quality chasm: a new health system for the 21st century. 2001. Available: https://www.ncbi.nlm.nih.gov/books/NBK222274/
11 National Academies of Sciences, Engineering, and Medicine. Crossing the global quality chasm: improving health care worldwide. Washington (DC): National Academies Press (US), 2018.
12 Black N. Patient reported outcome measures could help transform healthcare. BMJ 2013; 346: bmj.f167. doi:10.1136/bmj.f167
13 Porter ME, Larsson S, Lee TH. Standardizing patient outcomes measurement. N Engl J Med 2016; 374: 504–6. doi:10.1056/NEJMp1511701
14 Larson E, Sharma J, Bohren MA, et al. When the patient is the expert: measuring patient experience and satisfaction with care. Bull World Health Organ 2019; 97: 563–9. doi:10.2471/BLT.18.225201
15 Laugsand EA, Sprangers MAG, Bjordal K, et al. Health care providers underestimate symptom intensities of cancer patients: a multicenter European study. Health Qual Life Outcomes 2010; 8: 104. doi:10.1186/1477-7525-8-104
16 Basch E, Jia X, Heller G, et al. Adverse symptom event reporting by patients vs clinicians: relationships with clinical outcomes. J Natl Cancer Inst 2009; 101: 1624–32. doi:10.1093/jnci/djp386
17 Panattoni L, Fedorenko C, Greenwood-Hickman MA, et al. Characterizing potentially preventable cancer and chronic disease-related emergency department use in the year after treatment initiation: a regional study. J Oncol Pract 2018; 14: e176–85. doi:10.1200/JOP.2017.028191
18 Mayer DK, Travers D, Wyss A, et al. Why do patients with cancer visit emergency departments? Results of a 2008 population study in North Carolina. J Clin Oncol 2011; 29: 2683–8. doi:10.1200/JCO.2010.34.2816
19 Rathert C, Wyrwich MD, Boren SA. Patient-centered care and outcomes: a systematic review of the literature. Med Care Res Rev 2013; 70: 351–79. doi:10.1177/1077558712465774
20 Liang H, Tao L, Ford EW, et al. The patient-centered oncology care on health care utilization and cost: a systematic review and meta-analysis. Health Care Manage Rev 2020; 45: 364–76. doi:10.1097/HMR.0000000000000226
21 Venetis MK, Robinson JD, Turkiewicz KL, et al. An evidence base for patient-centered cancer care: a meta-analysis of studies of observed communication between cancer specialists and their patients. Patient Educ Couns 2009; 77: 379–83. doi:10.1016/j.pec.2009.09.015
22 Doubova SV, García-Saisó S, Pérez-Cuevas R, et al. Barriers and opportunities to improve the foundations for high-quality healthcare in the Mexican health system. Health Policy Plan 2018; 33: 1073–82. doi:10.1093/heapol/czy098
23 Guanais F, Doubova SV, Leslie HH, et al. Patient-centered primary care and self-rated health in 6 Latin American and Caribbean countries: analysis of a public opinion cross-sectional survey. PLOS Med 2018; 15: e1002673. doi:10.1371/journal.pmed.1002673
24 Penedo FJ, Oswald LB, Kronenfeld JP, et al. The increasing value of eHealth in the delivery of patient-centred cancer care. Lancet Oncol 2020; 21: e240–51. doi:10.1016/S1470-2045(20)30021-8
25 Børøsund E, Cvancarova M, Moore SM, et al. Comparing effects in regular practice of ecommunication and web-based self-management support among breast cancer patients: preliminary results from a randomized controlled trial. J Med Internet Res 2014; 16: e295. doi:10.2196/jmir.3348
26 Richards R, Kinnersley P, Brain K, et al. Use of mobile devices to help cancer patients meet their information needs in non-inpatient settings: systematic review. JMIR Mhealth Uhealth 2018; 6: e10026. doi:10.2196/10026
27 Ruland CM, Maffei RM, Børøsund E, et al. Evaluation of different features of an eHealth application for personalized illness management support: cancer patients’ use and appraisal of usefulness. Int J Med Inform 2013; 82: 593–603. doi:10.1016/j.ijmedinf.2013.02.007
28 Kearney N, McCann L, Norrie J, et al. Evaluation of a mobile phone-based, advanced symptom management system (ASyMS) in the management of chemotherapy-related toxicity. Support Care Cancer 2009; 17: 437–44. doi:10.1007/s00520-008-0515-0
29 Osborn J, Ajakaiye A, Cooksley T, et al. Do mHealth applications improve clinical outcomes of patients with cancer? A critical appraisal of the peer-reviewed literature. Support Care Cancer 2020; 28: 1469–79. doi:10.1007/s00520-019-04945-4
30 Xu A, Wang Y, Wu X. Effectiveness of E-health based self-management to improve cancer-related fatigue, self-efficacy and quality of life in cancer patients: systematic review and meta-analysis. J Adv Nurs 2019; 75: 3434–47. doi:10.1111/jan.14197
31 Díaz de León-Castañeda C, Góngora-Ortega J. E-health in public health services in Mexico: case study. Región y Sociedad 2020; 32: e1256. doi:10.22198/rys2020/32/1256
32 World Health Organization. Atlas of eHealth country profiles: the use of eHealth in support of universal health coverage. 2016. Available: https://www.who.int/publications/i/item/9789241565219
33 Gallardo-Rincón H, Saucedo-Martínez R, Mujica-Rosales R, et al. Online continuing medical education as a key link for successful Noncommunicable disease self-management: the CASALUDTM model. Diabetes Metab Syndr Obes 2017; 10: 443–55. doi:10.2147/DMSO.S137891
34 Chan A-W, Tetzlaff JM, Gøtzsche PC, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ 2013; 346: e7586. doi:10.1136/bmj.e7586
35 Calvert M, King M, Mercieca-Bebber R, et al. SPIRIT-PRO extension explanation and elaboration: guidelines for inclusion of patient-reported outcomes in protocols of clinical trials. BMJ Open 2021; 11: e045105. doi:10.1136/bmjopen-2020-045105
36 Galindo-Vázquez O, Benjet C, Juárez García F, et al. Psychometric properties of the hospital anxiety and depression scale (HADS) in a Mexican population of cancer patients. Salud Ment 2015; 38: 253–8.
37 National eHealth Collaborative. The patient engagement framework. 2012. Available: http://www.nationalehealth.org/patient-engagementframework
38 Shapiro-Mathews E, Barton AJ. Using the patient engagement framework to develop an institutional mobile health strategy. Clin Nurse Spec 2013; 27: 221–3. doi:10.1097/NUR.0b013e3182a0b9e2
39 Geng Y, Myneni S. Patient engagement in cancer survivorship care through mHealth: a consumer-centered review of existing mobile applications. AMIA Annu Symp Proc 2015; 2015: 580–8.
40 Jensen RE, Snyder CF, Abernethy AP, et al. Review of electronic patient-reported outcomes systems used in cancer clinical care. J Oncol Pract 2014; 10: e215–22. doi:10.1200/JOP.2013.001067
41 Basch E, Cook G. The importance of patient-reported outcomes (pros) in value-based care models. Oncol 2019. Available: https://www.obroncology.com/article/the-importance-of-patient-reported-outcomes-pros-in-value-based-care-models
42 Dennstädt F, Treffers T, Iseli T, et al. Creation of clinical Algorithms for decision-making in oncology: an example with dose prescription in radiation oncology. BMC Med Inform Decis Mak 2021; 21: 212. doi:10.1186/s12911-021-01568-w
43 Veneziano L, Hooper J. A method for quantifying content validity of health-related questionnaires. Am J Health Behav 1997; 21: 67–70.
44 Willis G. Pretesting of health survey questionnaires: cognitive interviewing, usability testing, and behavior coding. In: Johnson TP, ed. Handbook of Health Survey Methods. John Wiley & Sons, Inc, 2015: 217–42. doi:10.1002/9781118594629
45 Viechtbauer W, Smits L, Kotz D, et al. A simple formula for the calculation of sample size in pilot studies. J Clin Epidemiol 2015; 68: 1375–9. doi:10.1016/j.jclinepi.2015.04.014
46 Saghaei M. An overview of randomization and Minimization programs for randomized clinical trials. J Med Signals Sens 2011; 1: 55–61.
47 Treasure T, MacRae KD. Minimisation: the platinum standard for trials BMJ 1998; 317: 362–3. doi:10.1136/bmj.317.7155.362
48 Twisk JWR. Different methods to analyse the results of a randomized controlled trial with more than one follow-up measurement. In: Van Montfoort K, Oud J, Ghidey W, eds. Developments in statistical evaluation of clinical trials. Berlin, Heidelberg: Springer, 2014: 177–93. doi:10.1007/978-3-642-55345-5
49 Ballinger GA. Using generalized estimating equations for longitudinal data analysis. Organ Res Methods 2004; 7: 127–50. doi:10.1177/1094428104263672
50 VanderWeele TJ, Shpitser I. A new criterion for confounder selection. Biometrics 2011; 67: 1406–13. doi:10.1111/j.1541-0420.2011.01619.x
51 Instituto Federal de Telecomunicaciones (IFT). En México hay 80.6 Millones de Usuarios de Internet Y 86.5 Millones de Usuarios de Teléfonos Celulares: ENDUTIH 2019. press Reléase 17/02/2020 IFT. 2020. Available: https://www.ift.org.mx/comunicacion-y-medios/comunicados-ift/es/en-mexico-hay-806-millones-de-usuarios-de-internet-y-865-millones-de-usuarios-de-telefonos-celulares
52 Gobierno Federal. Estrategia Digital Nacional. México: Gobierno Federal, 2013.
53 Aaronson NK, Ahmedzai S, Bergman B, et al. The European Organization for research and treatment of cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 1993; 85: 365–76. doi:10.1093/jnci/85.5.365
54 Cerezo O, Oñate-Ocaña LF, Arrieta-Joffe P, et al. Validation of the Mexican-Spanish version of the EORTC QLQ-C30 and Br23 questionnaires to assess health-related quality of life in Mexican women with breast cancer. Eur J Cancer Care (Engl) 2012; 21: 684–91. doi:10.1111/j.1365-2354.2012.01336.x
55 Sprangers MA, Groenvold M, Arraras JI, et al. The European Organisation for research and treatment of cancer breast cancer-specific quality-of-life questionnaire Module: first results from a three-country field study. J Clin Oncol 1996; 14: 2756–68. doi:10.1200/JCO.1996.14.10.2756
56 Nguyen J, Popovic M, Chow E, et al. EORTC QLQ-Br23 and FACT-B for the assessment of quality of life in patients with breast cancer: A literature review. J Comp Eff Res 2015; 4: 157–66. doi:10.2217/cer.14.76
57 Giesinger JM, Kieffer JM, Fayers PM, et al. Replication and validation of higher order models demonstrated that a summary score for the EORTC QLQ-C30 is robust. J Clin Epidemiol 2016; 69: 79–88. doi:10.1016/j.jclinepi.2015.08.007
58 Zhou L, Bao J, Setiawan IMA, et al. The mHealth App usability questionnaire (MAUQ): development and validation study. JMIR Mhealth Uhealth 2019; 7: e11500. doi:10.2196/11500
59 Doubova SV, Casales-Hernández MG, Perez-Cuevas R. Supportive care needs and association with quality of life of Mexican adults with solid cancers. Cancer Nurs 2018; 41: E1–12. doi:10.1097/NCC.0000000000000492
60 Hou I-C, Lin H-Y, Shen S-H, et al. Quality of life of women after a first diagnosis of breast cancer using a self-management support mHealth App in Taiwan: randomized controlled trial. JMIR Mhealth Uhealth 2020; 8: e17084. doi:10.2196/17084
61 Krzyzanowska MK, Julian JA, Gu C-S, et al. Remote, Proactive, telephone based management of toxicity in outpatients during adjuvant or Neoadjuvant chemotherapy for early stage breast cancer: pragmatic, cluster randomised trial. BMJ 2021; 375: e066588. doi:10.1136/bmj-2021-066588
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2023 Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. http://creativecommons.org/licenses/by-nc/4.0/ This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ . Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Introduction
Nearly 30 000 Mexican women develop breast cancer annually, frequently presenting unmet supportive care needs. In high-income countries, incorporating electronic patient-reported outcomes (ePROs) into cancer care has demonstrated potential for increasing patient-centred care and reducing unmet needs. No such ePRO interventions have been implemented in Mexico. This paper presents the study protocol for designing and evaluating an ePRO digital health application combined with proactive follow-up by nurses.
Methods and analysis
We designed a two-component intervention for women receiving breast cancer treatment: a responsive web application for monitoring ePROs and clinical algorithms guiding proactive follow-up by nurses. We will conduct a pilot test of the intervention with 50 patients with breast cancer for 6 weeks to assess feasibility and adjust the application. We will conduct a parallel arm randomised controlled trial assigning 205 patients each to intervention and control in one of Mexico’s largest public oncology hospitals. The intervention will be provided for 6 months, with additional 3 months of post-intervention observation. The control group will receive usual healthcare and a list of breast cancer information sources. Women diagnosed with stages I, II or III breast cancer who initiate chemotherapy and/or radiotherapy will be invited to participate. The primary study outcome will be supportive care needs; secondary outcomes include global quality of life and breast symptoms. Information on the outcomes will be obtained through web-based self-administered questionnaires collected at baseline, 1, 3, 6 and 9 months.
Ethics and dissemination
The National Research and Ethics Committees of the Mexican Institute of Social Security approved the study (R-2021-785-059). Participants will sign an informed consent form prior to their inclusion. Findings will be disseminated through a policy brief to the local authorities, a webinar for patients, publications in peer-reviewed journals and presentations at national and international conferences.
Trial registration number
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details


1 Epidemiology and Health Services Research Unit CMN Siglo XXI, Instituto Mexicano del Seguro Social, Ciudad de Mexico, Mexico
2 Oncology Department, Oncology Hospital CMN Siglo XXI, IMSS, Ciudad de Mexico, Mexico
3 Radiation Oncology Department, Oncology Hospital CMN Siglo XXI, IMSS, Ciudad de Mexico, Mexico
4 Oncology Department, Speciality Hospital CMN Manuel Ávila Camacho, IMSS, Puebla, Puebla, Mexico
5 Research Division. Oncology Hospital CMN Siglo XXI, Mexican Institute of Social Security, Ciudad de Mexico, Mexico
6 Division of Prevention Science, University of California San Francisco, San Francisco, California, USA