Introduction
Epidermal growth factor receptor (EGFR) is a transmembrane tyrosine kinase receptor found on cells of epithelial origin, which has an important role in cell differentiation, proliferation, migration, apoptosis, angiogenesis, and cytokine regulation.1–3 EGFR signaling is commonly activated in various solid tumors, including colorectal cancer (CRC), and is associated with tumor progression and poor prognosis.4 Agents targeting EGFR are collectively described as EGFR inhibitors (EGFRIs).
Cetuximab and panitumumab, monoclonal antibody (mAb) EGFRIs, have proved efficient, both as single agents and in combination with chemotherapy, in the treatment of metastatic CRC without mutations in the RAS gene.5–9 The majority of patients treated with EGFR mAbs and also those treated with small molecule inhibitors of the EGFR tyrosine kinase domain, such as gefitinib and erlotinib, experience dermatological side effects.10 EGFR is highly expressed in the epidermis, especially in the basal cell layer, and in the epithelium of hair follicles. Although papulopustular skin rash is the most common skin toxicity associated with anti-EGFR mAbs, other cutaneous side effects are also observed, including xerosis, fissures, pruritus, paronychia, and blepharitis.11,12
Cutaneous toxicity is rarely life-threatening; however, it can deeply impact quality of life (QoL) affecting the emotional, psychosocial, and physical well-being of patients. It is important to correctly assess the grade of cutaneous adverse events, since oncological treatment is often modulated based on their severity. Moreover, the adherence of patients to therapy may be severely affected; it has been reported that up to 30% of patients stop therapy due to cutaneous adverse events.13 Interestingly, the occurrence and severity of skin toxicity is associated with improved clinical outcome in patients receiving EGFRI.14 Therefore, optimal management of skin toxicity is crucial to maintain patient adherence and avoid treatment delay or interruption.
One of the problems hindering the effective management of EGFRI-associated dermatological toxicities is the use of inaccurate and inconsistent toxicity evaluation criteria.15 Previously available tools were not designed for reporting EGFRI-associated dermatological events, and this resulted in underreporting and poor grading of side effects. The National Cancer Institute's Common Terminology Criteria for Adverse Events (NCI-CTCAE) was developed as a standardized method for use in oncology clinical trials to document and grade toxic effects of anticancer therapies, including dermatological adverse events.16 The most recent version (NCI-CTCAE v4.0) was published in 2009 and attempted to fill the gaps in the previous, more generic, criteria pertaining to rash, dry skin, and nail changes, by revisions and by grading these features separately.
The assessment and evaluation of the severity of cutaneous involvement in patients with drug-induced acneiform eruption (dAE) are controversial. Patients and physicians often disagree on the severity of dAEs, leading to inconsistencies in reporting of the grade of severity.17 Part of the difficulty could lie in the recognition and reporting of cutaneous signs, with which oncologists may not be familiar. Moreover, CTAE grading systems describe symptoms individually, while several symptoms and signs are often present simultaneously, with their combination contributing to the discomfort of the patient. In addition, it is difficult for healthcare providers to objectively measure the effect of a particular dAE on the health-related quality of life (HRQoL) of a patient. Therefore, it is crucial to develop a strategy to capture the patient's understanding of the severity of dAEs and their effects on HRQoL.
It is sometimes difficult for both healthcare providers and patients to assess and communicate skin conditions, since oncologists are not always familiar with cutaneous lesions and their presentation, while patients do not always adequately express the distress associated with their symptoms. Monitoring, recognition, and early treatment may help to relieve the distress caused by symptoms and raise the adherence of patients to treatment, improving their QoL. The acneiform rash section of NCI-CTCAE v4.0 states that psychological impacts should be considered; however, it does not clearly define how to report these. Moreover, it does not take into account the patient's subjective discomfort. Thus, underreporting the severity of skin toxicities may lead to under-adjustment, or inappropriate discontinuation, of antineoplastic therapy.
Recently, a measure of standardized patient-reported outcomes specific to EGFRI-induced dermatological side effects was proposed, since severity scales, such as NCI-CTCAE v4.0, do not adequately assess the impact of EGFRI on QoL.18 However, alternative grading tools, such as FACT-EGFRI-18 and DIEHL-24, require further evaluation. One alternative grading scale, specific for EGFRI-associated skin toxicity, is the Multinational Association of Supportive Care in Cancer (MASCC) EGFR Inhibitor Skin Toxicity Tool (MESTT).19 Compared with the NCI-CTCAE scale, MESTT tends to report higher toxicity grades for some side effects, such as rash, xerosis, and paronychia.20 Although MESTT allows for more detailed reporting of cutaneous toxicity, there is evidence that it may not be able to efficiently capture the global impact of different cutaneous adverse events on the QoL of patients.21
We recently constructed a composite tool, the Eruption Scoring System (ESS), the concept for which was derived from different acne scoring systems and incorporates several aspects of EGFI adverse events including rash, blepharitis, and paronychia, combined into subjective symptoms, such as pruritus and burning. Final scores generated by the ESS represent an assessment of severity of cutaneous involvement.
This study was designed to assess the correlation between QoL and severity of dermatological toxicity evaluated using the NCI-CTCAE v4.0 and our novel scale (ESS) in metastatic CRC patients treated with first-line chemotherapy combined with cetuximab. We also evaluated the differences between the assessments of cutaneous adverse events by oncologists and dermatologists using both tools.
Patients and methods
Patient population
Patients with histologically confirmed metastatic CRC, untreated with systemic therapy for metastatic disease (prior adjuvant chemotherapy for CRC was permitted), who were scheduled to start first-line chemotherapy (oxaliplatin- or irinotecan-based chemotherapy) combined with cetuximab, were eligible for inclusion in this study.
Other eligibility criteria included patients aged ≥18 years, an Eastern Cooperative Oncology Group performance status of 0–2, adequate hematologic, renal metabolic, and hepatic function, a life expectancy >3 months, and the ability to answer the QoL questionnaires.
Ethics and consent
This study was conducted in accordance with the guidelines from the International Conference on Harmonization-Good Clinical Practice and the Declaration of Helsinki. The study protocol was approved by the Ethical Committee of the University "G d'Annunzio", Chieti-Pescara, Italy. All patients provided written informed consent before participating in the study.
Procedures
Cetuximab was administered on a weekly schedule, with a 400 mg/m2 initial loading dose, followed by 250 mg/m2 weekly infusions until disease progression. Chemotherapy was given according to the standard clinical practice at the investigator site.
Patients underwent clinical investigation, including skin toxicity assessment, at baseline (before starting antineoplastic treatment) and at every subsequent visit. Physical examinations were performed separately by a medical oncologist and a dermatologist. Cutaneous toxicity was evaluated using both the NCI-CTCAE v4.0 and ESS scales. Patients were monitored according to the study protocol until the scheduled date of study completion or up to recovery or stabilization of a followed-up cutaneous adverse event, whichever came last. The patient or physician could decide to withdraw from the study at any time for any reason. The QoL of each patient was assessed by two dermatological specific QoL questionnaires: Skindex-29 and its brief form, Skindex-17. Skindex-29 and Skindex-17 are among the most commonly used dermatology-specific HRQoL instruments. Skindex-29 consists of 29 items, covering burden of symptoms, functioning, and emotional spheres. The questions refer to the previous 4-week period, and scores are provided on a five-point scale, from "never" to "all the time". Greater scores indicate poorer QoL.22 Skindex-17, which is derived from Skindex-29, consists of 17, rather than 29, items, with answers given on a three-point, instead of a five-point, scale.23 These two questionnaires have demonstrated good correlation with other grading tools and with NCI-CTCAE. Moreover, although they are not specifically designed for targeted therapy-related cutaneous rashes, they were appropriate for the assessment of HRQoL in these patients.
No enrolled patients were permitted to receive any prophylactic skin toxicity treatment; however, all patients received treatment after any kind of cutaneous toxicity appeared. Skin treatments were chosen at the discretion of the investigator, according to the toxicity severity, beginning with mild-grade events. The primary objective of this study was to determine the correlation between patient QoL and skin toxicity severity, assessed using the NCI-CTCAE v4.0 and ESS grading systems. Secondary objectives included 1) determination of the incidence rates of skin toxicities and 2) evaluation of interinvestigator concordance rates in skin toxicity evaluation using NCI-CTCAE v4.0 (rash section) and the ESS score systems.
NCI-CTCAE v4.0 allows separate assessment of several aspects of targeted therapy-related adverse events, usually using five grades of severity; for example, the severity of a skin rash is established on the basis of clinical presentation and the reported distress of the patient. However, it has several limitations that may interfere with the optimal assessment of patients. First, dermatological presentations are very specific and their definitions are not always clear; second, the majority of the time patients presents with multiple symptoms (eg, rash and pruritus or paronychia); hence, a classification of severity of each symptom may be misleading in global assessment of the patient; finally, the different grades are based on skin surface involvement, along with the development of psychosocial impact; however, these are not precise parameters, and this can lead to difficulties of interpretation.
The ESS is a composite objective and subjective scoring system, which considers the type of skin lesions, their localization, the presence of paronychia and blepharitis, and takes into account self-reported symptoms, such as pruritus and burning.
ESS score
i)
Local score Four types of skin lesions have been described (Figure 1):
◻
Erythematous macule is defined as a flat, nonpalpable lesion that varies in pigmentation from the surrounding skin.
◻
Papule is defined as a circumscribed, solid elevated lesion, usually <1 cm in diameter.
◻
Pustule is defined as a small elevation of the skin containing purulent material.
◻
Nodule is defined as a circumscribed, solid elevation of the skin, usually >1 cm in diameter, extending in the dermis or subcutaneous fat. The depth of involvement is what differentiates a nodule from a papule.
Each type of a skin lesion is scored 0–4 as reported below:
◻
0: no or one skin lesion ◻
1: >1 erythematous macule ◻
2: >1 papule ◻
3: >1 pustule ◻
4: >1 nodule The maculo-papulopustular eruption appears with different frequencies on different anatomical sites. We supposed that, as it happens in other dermatological diseases such as psoriasis, the most socially visible areas may have a greater impact on psychological distress. Therefore, we arbitrarily decided to divide the body into seven different zones, with specific multiplication factors (indicating the most visible sites), as follows:
I Forehead 2 II Cheek 3 III Chin 2 IV Upper chest 2 V Lower chest 1 VI Upper back 2 VII Lower back 1 Every multiplication factor will be multiplied by 0, 1, 2, 3, or 4, according to the particular type of skin lesion observed in the corresponding body area. The local score will be obtained by adding each of them, as follows: I+II+III+IV+V+VI+VII.
ii)
Pruritus and Burning Visual Analogue Scale (VASP and VASB)
All patients assessed pruritus and burning intensity using the 10-point VAS.
iii)
Blepharitis and paronychia Inflammation of the eyelid and infection of the folds of tissue surrounding the nail of a finger are graded as follows:
Blepharitis (Bs) mild +1 moderate +5 severe +7 mild erythema severe erythema + photophobia severe erythema + photophobia + pain Paronychia (Ps) mild +1 moderate +5 severe +7 mild erythema severe erythema + pain severe erythema + pain + fissures Final score:
The final score will define the severity of cutaneous involvement, employing the added score from the above:
Final score = (Local score I+II+III+IV+V+VI+VII) + VASP+VASB+Bs+Ps The final score identifies the following categories of skin toxicity:
1 No toxicity 1–10 Very mild 16 Mild 30 Moderate 30–40 Severe >41 Very severe Sample size and statistical analyses
In reliability studies, the main aim is not to test but to generate accurate estimates. For this reason, sample size calculations focused on precision, rather than power.24 The minimum required sample size (n=29) for the calculation of a correlation coefficient was determined based on predicted ρ=0.5, with a 95% confidence interval (CI) and an alpha error rate of 5%. Qualitative variables are summarized as frequencies and percentages. Quantitative variables are summarized as means and standard deviation or medians and interquartile range, according to their distribution.
For ESS and NCI-CTCAE v4.0 assessments, median and IQR values were calculated for each measurement for every patient, and for each observer. Interoperator agreement for ESS and NCI-CTCAE v4.0 scoring was assessed by calculating interclass correlation coefficients (ICC) using a two-way random-effects mixed model. ICC values (based on 95% CIs) <0.5, 0.5–0.75, 0.75–0.9, and >0.90 are indicative of poor, moderate, good, and excellent reliability, respectively. Due to significant interobserver agreement, the mean values of all measurements by all observers using the ESS and NCI-CTCAE v4.0 systems were calculated for each patient. Spearman's rank tests were used to evaluate the correlation among mean ESS and mean NCI-CTCAE v4.0, and Skindex-29 and Skindex-17, scores. Analysis of the correlation between ESS and NCI-CTCAE v4.0 scores was also performed. All statistical tests were evaluated at an alpha level of 0.05. Statistical analysis was performed using SPSS® Advanced Statistical 11.0 software (SPSS, Inc., Chicago, IL).
Results
Study population
From May 2013 through May 2015, a total of 30 patients were enrolled in this study. The baseline demographic and clinical characteristics of the patients are reported in Table 1. Twenty patients (66.7%) were males. All enrolled patients were Caucasian, the median age was 59 years (range, 36–77 years), and 73.3% of patients had colon cancer and 26.7% had rectal cancer. Eleven patients (36.6%) had a medical history of rosacea, associated with an increased risk of cutaneous toxicity.
Enlarge this image.Table 1 Baseline demographic and clinical characteristics of patients enrolled in the study Abbreviation: IQR, interquartile range.
Primary end point
Five medical oncologists (three attending physicians and two resident physicians) and six dermatologists (three attending physicians and three resident physicians) evaluated all 30 patients enrolled in the study. Photographic documentation of each patient was available at baseline and during the treatment period.
A positive correlation was found between dermatology HRQoL using the Skindex-29 tool and the severity of dermatological toxicities, assessed using the NCI-CTCAE v4.0 scale for cutaneous papulopustular acneiform rash (ρ=0.483, P=0.001); however, a stronger correlation was documented between HRQoL and the ESS tool (ρ=0.611, P=0.001; Figure 2).
Enlarge this image.Figure 2 Correlation between QoL evaluated with the Skindex-29 and severity of cutaneous toxicity assessed using NCI-CTCAE v4.0 and ESS systems. Abbreviations: ESS, Eruption Scoring System; NCI-CTCAE, National Cancer Institute's Common Terminology Criteria for adverse events; QoL, quality of life.
Similar results were observed using the Skindex-17 tool, including its psychosocial and symptom domains (ρ=0.564, P=0.001 for ESS vs ρ=0.425, P=0.001 for NCI-CTCAE v4.0; Figure 3).
Enlarge this image.Figure 3 Correlation between QoL evaluated with the Skindex-17 and severity of cutaneous toxicity assessed using NCI-CTCAE v4.0 and ESS systems. Abbreviations: ESS, Eruption Scoring System; NCI-CTCAE, National Cancer Institute's Common Terminology Criteria for adverse events; QoL, quality of life.
Secondary end points
Whole skin toxicity occurred in 90% of patients and blepharitis occurred in 50% of patients, whereas hand skin toxicity occurred in 56%. The pruritus and/or burning were strong in 43% of patients and very strong in 13%.
Both NCI-CTCAE v4.0 and ESS tools demonstrated good interobserver agreement for grading of skin toxicity, with ICC coefficients of 0.729 (95% CI: 0.648–0.808; P<0.001) for NCI-CTCAE v4.0 and 0.925 (95% CI: 0.895–0.950; P<0.001) for ESS (Table 2), indicating a moderate interobserver agreement for NCI-CTCAE and an excellent agreement for ESS.
Enlarge this image.Table 2 Median and IQR of each observer for NCI-CTCAE v4.0 and ESS Abbreviations: ESS, Eruption Scoring System; IQR, interquartile range; NCI-CTCAE, National Cancer Institute's Common Terminology Criteria for Adverse Events; Obs, Observer.
The statistical model also demonstrated an estimation of the effect linked to the observer, indicating the bias among observers. This estimation was statistically significant (P=0.002) for NCI-CTCAE, indicating that measurements among observers are not reproducible. While for ESS, the estimation of the effect, indicating the bias between observers, is not statistically significant (P=0.239), indicating that the measurements done by the observers are reproducible for this method (Table 2).
In addition, a significant correlation was found between the two skin toxicity grading systems (NCI-CTCAE v4.0 and ESS; Figure 4).
Enlarge this image.Figure 4 Correlation between NCI-CTCAE v4.0 and ESS. Abbreviations: ESS, Eruption Scoring System; NCI-CTCAE, National Cancer Institute's Common Terminology Criteria for Adverse Events.
The median duration of chemotherapy was 8 months (range, 3–29 months). Twenty-six percent of patients received anti-EGFR treatment with cetuximab for >12 months, whereas 40% of them received it for <6 months. No patients discontinued therapy nor reduced their dose of therapy due to toxicity.
Discussion
In this study, a strong correlation was identified between our novel ESS and the standard NCI-CTCAE v4.0 tool in grading cutaneous toxicity associated with the anti-EGFR mAb cetuximab. ESS can, therefore, be considered a valid instrument to identify and grade the severity of skin toxicity induced by cetuximab, with some advantages over the classical NCI-CTCAE v4.0 scoring system. First, unlike the standard NCI-CTCAE v4.0 grading system, the ESS tool allows for a more accurate evaluation of skin toxicity with crucial implications for clinical management of patients, taking into account all components of cutaneous adverse events and not evaluating them each individually. This may also explain the higher level of correlation found between dermatological HRQoL and the ESS, compared with the NCI-CTCAE v4.0, scoring system. The ESS score allows a better evaluation of the consequences of cutaneous toxicity on the lives of patients similar to other grading systems, such as FACT-EGFRI-18. Moreover, the greater emphasis of the ESS on psychosocial and symptomatic aspects of patient's lives may lead to a greater level of empathy in the patient–physician relationship, with improved patient compliance with treatment.
Second, the ESS allows physicians to perform a more objective evaluation of dermatological toxicity induced by cetuximab, compared with the use of NCI-CTCAE v4.0. In particular, the specific and accurate assessment of each manifestation of cutaneous toxicity may decrease the impact of the experience of the physician in comprehensive evaluation. In fact, we found a strong interobserver correlation in grading the severity of skin toxicity associated with cetuximab, despite the different education and experience of the physicians involved in the study; only one young medical oncologist presented a very low ESS score (observer 7 in Table 2). This observer is an oncologist resident and this discrepancy might be explained by his inexperience. However, this occurrence did not alter the results of the interobserver reproducibility.
Although the ESS does not allow for a very rapid estimation of the severity of skin toxicity reactions, with a consequent potential negative impact on clinical practice, it does induce a deeper physician–patient relationship, resulting in improved clinical management of dermatological adverse events and improved patient compliance. We did not measure the time needed to complete the score. However, after a minor training in recognizing the different cutaneous lesions, the mean time to finalize the score was ~2 minutes per patient. Moreover, the simple structure of the ESS, in which the physician is asked to describe one lesion at a time, may increase the reporting accuracy of physicians that are not accustomed to describing cutaneous lesions and allows the completion of the clinical assessment in a few minutes.
We believe that the high concordance of ESS with HRQoL measurements such as Skindex-17 and Skindex-29 may improve the QoL assessment of patients. In addition, the ESS tool may become available as an app on smartphones and tablets, thereby overcoming its limitations, in terms of requirement for time spent on complex calculations. We are actually planning to add photo samples to improve the recognition and to fasten the ESS completion through a computer data sheet that automatically computes the score.
Conclusion
Here we show that the numerous limitations that the NCI-CTCAE grading system presents when applied to anti-EGFR rash may be overcome by the use of our grading system.
Finally, it will be interesting to investigate the usefulness of the ESS for recognition and grading of the cutaneous toxicity associated with other EGFRIs, such as panitumumab, or the tyrosine kinase inhibitors, erlotinib and gefitinib.
Acknowledgment
This work was supported by the Consorzio Interuniversitario Nazionale per la Bio-Oncologia (CINBO).
Disclosure
The authors report no conflicts of interest in this work.
1. Ciardiello F, Tortora G. A novel approach in the treatment of cancer: targeting the epidermal growth factor receptor. Clin Cancer Res. 2001;7(10):2958–2970.
2. Citri A, Yarden Y. EGF-ERBB signalling: towards the systems level. Nat Rev Mol Cell Biol. 2006;7(7):505–516.
3. Mascia F, Cataisson C, Lee TC, et al. EGFR regulates the expression of keratinocyte-derived granulocyte/macrophage colony-stimulating factor in vitro and in vivo. J Invest Dermatol. 2010;130(3):682–693.
4. Rego RL, Foster NR, Smyrk TC, et al. Prognostic effect of activated EGFR expression in human colon carcinomas: comparison with EGFR status. Br J Cancer. 2010;102(1):165–172.
5. Amado RG, Wolf M, Peeters M, et al. Wild-type KRAS is required for panitumumab efficacy in patients with metastatic colorectal cancer. J Clin Oncol. 2008;26(10):1626–1634.
6. Karapetis CS, Khambata-Ford S, Jonker DJ, et al. K-ras mutations and benefit from cetuximab in advanced colorectal cancer. N Engl J Med. 2008;359(17):1757–1765.
7. Van Cutsem E, Köhne CH, Láng I, et al. Cetuximab plus irinotecan, fluorouracil, and leucovorin as first-line treatment for metastatic colorectal cancer: updated analysis of overall survival according to tumor KRAS and BRAF mutation status. J Clin Oncol. 2011;29(15):2011–2019.
8. Douillard JY, Siena S, Cassidy J, et al. Randomized, phase III trial of panitumumab with infusional fluorouracil, leucovorin, and oxaliplatin (FOLFOX4) versus FOLFOX4 alone as first-line treatment in patients with previously untreated metastatic colorectal cancer: The PRIME study. J Clin Oncol. 2010;28(31):4697–4705.
9. Bokemeyer C, Bondarenko I, Makhson A, et al. Fluorouracil, leucovorin, and oxaliplatin with and without cetuximab in the first-line treatment of metastatic colorectal cancer. J Clin Oncol. 2009;27(5):663–671.
10. Mitchell EP, Perez-Soler R, Van Cutsem E, Lacouture ME. Clinical presentation and pathophysiology of EGFRI dermatologic toxicities. Oncology (Williston Park). 2007;21(11 Suppl 5):4–9.
11. Urban C, Anadkat MJ. A review of cutaneous toxicities from targeted therapies in the treatment of colorectal cancers. J Gastrointest Oncol. 2013;4(3):319–327.
12. Agero AL, Dusza SW, Benvenuto-Andrade C, Busam KJ, Myskowski P, Halpern AC. Dermatologic side effects associated with the epidermal growth factor receptor inhibitors. J Am Acad Dermatol. 2006;55(4):657–670.
13. Joshi SS, Ortiz S, Witherspoon JN, et al. Effects of epidermal growth factor receptor inhibitor-induced dermatologic toxicities on quality of life. Cancer. 2010;116(16):3916–3923.
14. Abdel-Rahman O, Fouad M. Correlation of cetuximab-induced skin rash and outcomes of solid tumor patients treated with cetuximab: a systematic review and meta-analysis. Crit Rev Oncol Hematol. 2015;93(2):127–135.
15. Pinto C, Barone CA, Girolomoni G, et al. Management of skin reactions during Cetuximab treatment in association with chemotherapy or radiotherapy. Am J Clin Oncol. 2016;39(4):407–415.
16. NCI-CTCAE v.4. Available from: http://evs.nci.nih.gov/ftp1/CTCAE/About.html. Accessed November 16, 2016.
17. Basch E, Iasonos A, McDonough T, et al. Patient versus clinician symptom reporting using the National Cancer Institute Common Terminology Criteria for Adverse Events: results of a questionnaire-based study. Lancet Oncol. 2006;7(11):903–909.
18. Wagner LI, Berg SR, Gandhi M, et al. The development of a Functional Assessment of Cancer Therapy (FACT) questionnaire to assess dermatologic symptoms associated with epidermal growth factor receptor inhibitors (FACT-EGFRI-18). Support Care Cancer. 2013;21(4):1033–1041.
19. Lacouture ME, Maitland ML, Segaert S, et al. A proposed EGFR inhibitor dermatologic adverse event-specific grading scale from the MASCC skin toxicity study group. Support Care Cancer. 2010;18(4):509–522.
20. Chan A, Tan EH. How well does the MESTT correlate with CTCAE scale for the grading of dermatological toxicities associated with oral tyrosine kinase inhibitors? Support Care Cancer. 2011;19(10):1667–1674.
21. Lacouture ME, Anadkat MJ, Bensadoun RJ, et al. Clinical practice guidelines for the prevention and treatment of EGFR inhibitor-associated dermatologic toxicities. Support Care Cancer. 2011;19(8):1079–1095.
22. Chren MM, Lasek RJ, Flocke SA, Zyzanski SJ. Improved discriminative and evaluative capability of a refined version of Skindex, a quality-of-life instrument for patients with skin diseases. Arch Dermatol. 1997;133(11):1433–1440.
23. Nijsten TE, Sampogna F, Chren MM, Abeni DD. Testing and reducing skindex-29 using Rasch analysis: Skindex-17. J Invest Dermatol. 2006;126(6):1244–1250.
24. Doros G, Lew R. Design based on intra-class correlation coefficients. Am J Biostat. 2010;1:1–8.
Michele De Tursi,1 Marinella Zilli,1 Consiglia Carella,1 Matteo Auriemma,2 Maria Nadia Lisco,2 Marta Di Nicola,3 Giuseppe Di Martino,4 Clara Natoli,1 Paolo Amerio2
1Department of Medical, Oral and Biotechnological Sciences, Medical Oncology Unit, 2Department of Dermatology and Venereology, 3Laboratory of Biostatistics, Department of Medical, Oral and Biotechnological Sciences, 4Department of Medicine and Aging Science, University degli Studi “G d’Annunzio” Chieti-Pescara, Chieti, Italy
© 2017. This work is licensed under https://creativecommons.org/licenses/by-nc/3.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.