Expert Opinion on Laparoscopic Surgery for Colorectal Cancer Parallels Evidence from a Cumulative Meta-Analysis of Randomized Controlled Trials

Abstract

Background

This study sought to synthesize survival outcomes from trials of laparoscopic and open colorectal cancer surgery, and to determine whether expert acceptance of this technology in the literature has parallel cumulative survival evidence.

Study Design

A systematic review of randomized trials was conducted. The primary outcome was survival, and meta-analysis of time-to-event data was conducted. Expert opinion in the literature (published reviews, guidelines, and textbook chapters) on the acceptability of laparoscopic colorectal cancer was graded using a 7-point scale. Pooled survival data were correlated in time with accumulating expert opinion scores.

Results

A total of 5,800 citations were screened. Of these, 39 publications pertaining to 23 individual trials were retained. As well, 414 reviews were included (28 guidelines, 30 textbook chapters, 20 systematic reviews, 336 narrative reviews). In total, 5,782 patients were randomized to laparoscopic (n = 3,031) and open (n = 2,751) colorectal surgery. Survival data were presented in 16 publications. Laparoscopic surgery was not inferior to open surgery in terms of overall survival (HR = 0.94, 95% CI 0.80, 1.09). Expert opinion in the literature pertaining to the oncologic acceptability of laparoscopic surgery for colon cancer correlated most closely with the publication of large RCTs in 2002–2004. Although increasingly accepted since 2006, laparoscopic surgery for rectal cancer remained controversial.

Conclusions

Laparoscopic surgery for colon cancer is non-inferior to open surgery in terms of overall survival, and has been so since 2004. The majority expert opinion in the literature has considered these two techniques to be equivalent since 2002–2004. Laparoscopic surgery for rectal cancer has been increasingly accepted since 2006, but remains controversial. Knowledge translation efforts in this field appear to have paralleled the accumulation of clinical trial evidence.

About the Authors:

Guillaume Martel

* E-mail: [email protected]

Affiliation: Department of Surgery, Department of Epidemiology & Community Medicine, and Ottawa Hospital Research Institute, The Ottawa Hospital, University of Ottawa, Ottawa, Ontario, Canada

Alyson Crawford

Affiliation: Department of Surgery, Department of Epidemiology & Community Medicine, and Ottawa Hospital Research Institute, The Ottawa Hospital, University of Ottawa, Ottawa, Ontario, Canada

Jeffrey S. Barkun

Affiliation: Department of Surgery & Division of Clinical Epidemiology, McGill University, Montreal, Quebec, Canada

Robin P. Boushey

Affiliation: Department of Surgery, Department of Epidemiology & Community Medicine, and Ottawa Hospital Research Institute, The Ottawa Hospital, University of Ottawa, Ottawa, Ontario, Canada

Craig R. Ramsay

Affiliation: Health Services Research Unit, University of Aberdeen, Aberdeen, Foresterhill, United Kingdom

Dean A. Fergusson

Affiliation: Department of Surgery, Department of Epidemiology & Community Medicine, and Ottawa Hospital Research Institute, The Ottawa Hospital, University of Ottawa, Ottawa, Ontario, Canada

Introduction

Laparoscopic surgical techniques were first introduced as a treatment for colorectal pathologies in 1991 [1], [2]. Since this pioneering work, an abundance of literature has detailed the application of this technology to both benign and malignant colorectal disorders [3]. In the early days, surgeons readily embraced laparoscopic surgery for benign colorectal conditions such as diverticulitis and inflammatory bowel disease, on the basis of perceived improvements in length of stay in hospital, postoperative pain, bowel function, and return to normal activities, as well as obvious cosmetic advantages [3]–[5]. On the other hand, the adoption of laparoscopic surgery to treat colorectal cancer has lagged behind that of benign conditions, and has been highly controversial over the last twenty years.

As with any malignant disorder, novel surgical technologies used to treat patients with curable colorectal cancer must be demonstrated to achieve improved or, at a minimum, equivalent survival outcomes. While surgical innovation has often relied on a trial-and-error approach, many surgeon-scientists now argue that novel technologies must be scrutinized carefully and tested using robust research methods [6]. It is widely agreed that randomized controlled trials (RCTs) provide the highest standard of evidence in evaluating healthcare interventions. In this context, it is not surprising that several RCTs comparing laparoscopic and open surgery for colorectal cancer have been conducted over the years, many of which have now yielded long-term oncologic outcomes.

In spite of an abundance of published data, both RCTs and observational studies, it remains unclear whether surgeons have adopted this novel technology on the basis of published high-level survival evidence. In this context, the objective of this work was to synthesize survival outcomes from RCTs of laparoscopic and open colorectal cancer surgery, and to determine whether expert acceptance of this technology in the literature has parallel cumulative survival evidence from clinical trials.

Materials and Methods

The body of literature required to answer the research question was obtained using systematic review techniques. In the first part of this work, trials were identified and survival data were meta-analyzed. In the second part, review articles were identified and used to grade expert opinions regarding the acceptability of laparoscopy in treating colorectal cancer. Finally, both parts of this work were combined, by comparing accumulating survival data and expert opinions over time. A systematic review protocol was written and followed.

Systematic Review

RCTs and review articles were included, on the basis of pre-determined inclusion and exclusion criteria. All RCTs pertained to patients with primary carcinoma of the colon or rectum of any stage. The primary intent of the citation had to address the treatment of colorectal cancer specifically. Included patients had to undergo a segmental resection of the colon or rectum by laparoscopic or hand-assisted laparoscopic surgery. The control intervention was open surgery. To be considered for inclusion, citations had to provide data on the primary outcome of overall survival. Trials not reporting overall survival were not included in the meta-analysis, but were retrieved to allow for the complete identification of RCTs.

For review papers, inclusion criteria were purposely less strictly defined so as to capture the entire spectrum of publications pertaining to the laparoscopic treatment of colorectal cancer. Acceptable review articles were narrative reviews, systematic reviews/meta-analyses, textbook chapters, and guidelines/policy statements. Reviews were included unless they were limited to single specific outcomes other than oncologic outcomes (eg. postoperative pain). All reviews addressing the surgical care of colorectal cancer in general terms were included, as a lack of discussion of laparoscopy would indicate that the authors did not consider it relevant.

A comprehensive search strategy was designed to identify both primary literature and review citations (see Text S1). This search strategy was designed to be highly sensitive, and was modified from previously published work [7]. Six major databases were searched for relevant citations from 1991–2008 (Ovid MEDLINE, Ovid EMBASE, Cochrane Library, Science Citation Index Expanded, BIOSIS Preview, and BIREME LILACS). An additional thirteen databases were also searched for relevant citations (Database of Abstracts of Reviews of Effectiveness, Heath Technology Assessment Database, NHS Economic Evaluation Database, NIHR Health Technology Assessment Programme, Trip Database, Clinicaltrials.gov, Controlled-trials.com, National Guidelines Clearinghouse, CMA Infobase: Clinical Practice Guidelines, NICE England, SIGN Scotland, NHMRC Australia, New Zealand Guidelines Group). In addition, all editions of nine major surgical textbooks published since 1991 were included for consideration (Schwartz’s Principles of Surgery, Sabiston Textbook of Surgery, Greenfield’s Surgery, Cameron’s Current Surgical Therapy, Shackelford’s Surgery of the Alimentary Tract, Mastery of Surgery, Gordon’s Surgery of the Colon, Rectum and Anus, Corman’s Colon and Rectal Surgery, and Fazio’s Current Therapy in Colon & Rectal Surgery). The reference lists of all included citations were screened to identify missing trials and reviews. No language limitation was applied to the search strategy.

All citation records were retrieved and downloaded electronically using Reference Manager 10 (ISI ResearchSoft, Berkeley, CA), and were then de-duplicated manually. All citations were first screened for inclusion on the basis of titles and abstracts (figure 1). All retained citations were then retrieved in full text. Papers published in languages other than English, French, or Spanish were translated in full. Citations in Asian languages included after the first screen had to be excluded from further consideration due to translation resource limitations. Full-text articles were evaluated for inclusion.

[Figure omitted. See PDF.]

Figure 1. PRISMA flow diagram.

https://doi.org/10.1371/journal.pone.0035292.g001

Included RCTs were examined their risk of bias using the approach advocated by the Cochrane Collaboration [8]. Eight items were appraised: 1) random sequence generation, 2) allocation concealment, 3) blinding of participants and personnel, 4) blinding of outcome assessment, 5) incomplete outcome data, 6) selective reporting, 7) provider expertise bias (surgical skills acquisition and learning curves can influence outcomes in procedures-based trials [9]) and 8) other potential sources of bias (eg. randomization after carrying out a diagnostic laparoscopy).

All eight items were assessed for each trial. Where trials had more than one publication, the trial as a whole as evaluated using all included reports. As well, referenced trial protocols or partial publications not included in this review were also read in an attempt to minimize trial reporting issues. All items were graded as “low risk of bias", “high risk of bias", or “unclear risk of bias". These data were synthesized using descriptive figures. Trials with five or more items with a low risk of bias were arbitrarily defined as high-quality studies.

Data Analysis

Data from included RCTs and review papers were extracted. Data points were checked for accuracy by a second reviewer and discrepancies were resolved by consensus. Although each citation was abstracted separately, trials with multiple publications were identified so as to avoid patient duplication. Individual trial authors were contacted selectively.

Data on overall survival were abstracted in the statistical format provided in individual reports. Relative outcomes were always recorded as a comparison of laparoscopic to open surgery. Where hazard ratios (HR) for survival and confidence intervals were not provided, available data were utilized to generate hazard ratios for each trial using published methods [10]–[12]. Briefly, this technique allows one to derive the ln(HR) and var(ln(HR)) from published statistics. Where this information is unavailable, one can utilize Kaplan-Meier curves to derive conservative estimates of HR. This method assumes that censoring is constant and non-informative across smaller time interval on the Kaplan-Meier curve (eg. 6 months). A Microsoft Excel (Microsoft Corporation, Richmond, WA) macro was utilized to facilitate all computations [12], [13].

Expert opinion in the literature was abstracted from review papers separately for colon and rectal cancers. The author’s global conclusion regarding the acceptability of laparoscopic surgery to treat colon or rectal cancer was extracted. Where multiple conclusions were provided within a single review, the expert author’s opinion regarding the primary outcome of overall survival was considered. Each review paper’s conclusion was graded on a seven-point asymmetric scale, ranging from 1, where laparoscopy was not mentioned in a review paper pertaining to colorectal cancer surgery, to 7, whereby laparoscopy was deemed the standard of care. The other options on the scale were as follows: 2) laparoscopy is inferior, 3) laparoscopy is acceptable only within clinical trials, 4) laparoscopy is equivalent with anatomic limitation, 5) laparoscopy is equivalent among experts, and 6) laparoscopy is equivalent in routine clinical practice. For data synthesis, options 1–2 were considered to indicate that laparoscopy was “inferior" to open surgery, option 3 was considered to describe clinical equipoise, while options 4–6 were deemed to indicate that laparoscopy was “equivalent" to open surgery. This scale was piloted independently by two reviewers using ten distinct review articles for ease of use and congruence among reviewers.

The primary outcome of overall survival analyzed using standard meta-analytic techniques. Derived HR were pooled using inverse variance methods and random effects models. Random effects models were preferred in this work because of the often non-standardized nature of surgery across trials, the variability in trial quality, and the added statistical conservatism provided by this approach. Where multiple publications of the same RCT were identified, only the most mature survival data were used in this meta-analysis. In contrast, a cumulative random effects meta-analysis of the primary outcome was also carried out using the earliest available survival data set for each trial, so as to assess the evolution of this outcome in time. Statistical measures of heterogeneity (Cochran’s Q and I²) were obtained from fixed effects models. Pre-specified sensitivity analyses were carried out based on the inclusion of colon and/or rectal cancer patients, and based on the risk of bias assigned to each trial. All analyses were carried out using Comprehensive Meta-Analysis 2.2 (Biostat, Englewood, NJ).

Grades of opinion for individual review papers were synthesized as yearly proportions, and plotted as a time series. Changing trends in expert opinions were then evaluated visually from these graphs and correlated qualitatively with overall survival data derived from RCTs, as well as compared to the temporal data obtained from the cumulative meta-analysis of overall survival.

Results

A total of 5,800 single citations were evaluated (figure 1). After screening, a total of 38 reports pertaining to 23 individual RCTs were included [14]–[51] (see Table S1). A report of long-term data pertaining to a trial already included was also included, as it became available a few weeks after study selection [52]. In addition, 414 review citations were included, comprising 336 narrative reviews, 30 textbook chapters, 28 guidelines/position statements, and 20 systematic reviews. The full reference list is available upon request.

Among 23 individual RCTs, 5 (22%) were multicenter in design. The smallest multicenter study recruited 3 centers in Greece [41], whereas the largest multinational RCT included 48 centers across the United States and Canada [24], [26], [31], [45]. Patient recruitment varied widely, ranging from 28 patients for the smallest study from Brazil [29] to 1,082 patients for the European COLOR trial [35], [43], [52]. In total, 5,782 patients were randomized between laparoscopic (n = 3,031) and open (n = 2,751) surgery as a primary treatment for colorectal cancer. Among these patients, 58% (n = 3,336) were included as part of trials addressing only colon cancer, whereas 10% (n = 582) took part in trials limited to rectal cancer. The remainder of patients (32%, n = 1,864), were included in trials addressing colorectal cancer in general, with varying definitions as it pertains to the inclusion of rectal cancer patients.

Among the 414 review papers included in this work, 362 (87%) and 332 (80%) provided data pertaining to colon and rectal cancer, respectively. Most reviews (67%, n = 280) addressed both cancer types concurrently.

A total of eight risk of bias items were assessed individually (figure 2). Both items pertaining to selection bias (random sequence generation and allocation concealment), demonstrated the lowest overall risk of bias, with each item being addressed adequately by 57% of trials (n = 13), and all other trials lacking sufficient information to render judgment. Similarly, the issue of provider expertise was addressed satisfactorily by 43% of trials (n = 10), with inadequate reporting in the remainder of studies. Incomplete outcome reporting and selective reporting both also yielded a low risk of bias in 43% of trials, but these items also generated a high risk of bias in 22% and 9% of trials, respectively. In contrast, blinding – whether of patients, study personnel, or outcome assessors – was almost universally not attempted, yielding a high risk of bias in all trials except for three (13%) groups that employed blinded assessors of their primary outcomes. Two trials also demonstrated other high risks of bias, as they elected to carry out a diagnostic laparoscopy prior to randomization so as to determine whether individual patients could undergo a formal oncologic colorectal resection by laparoscopy [16]–[18], [20], [21].

[Figure omitted. See PDF.]

Figure 2. Global risk of bias assessment divided by individual items.

https://doi.org/10.1371/journal.pone.0035292.g002

Analysis of risk of bias judgments at the individual study level identified three trials that achieved “low risk of bias" marks for at least five items [24], [26], [31], [35], [43], [45], [51], [52]. These three trials were all large-scale multicenter multinational RCTs, contributing a total of 2,721 patients to this review. Seven trials obtained four “low risk of bias" marks, as certain items could not be adequately assessed from available trial reports, study protocols, or adjunct publications. Finally, 11 trials obtained a total of two or less “low risk of bias" marks, highlighting a greater overall risk of bias based on reported information. Among these, six trials obtained at least three “high risk of bias" marks [15]–[18], [20], [21], [23], [27], [28], of which five trials did not carry out intention-to-treat analyses.

Data pertaining to overall survival were presented in 16 (41%) publications, originating from 13 (56%) individual trials. Median follow-up time among these trials ranged from 12–95 months. One trial did not report a median follow-up time period for either intervention group [32]. Seven trials presented sufficient data to obtain hazard ratios. Assuming a minimal clinically significant margin of 10% (HR 1.1), laparoscopic surgery for colorectal cancer was found to be non-inferior to open surgery in terms of overall survival after pooling the most mature trial data available (HR = 0.94, 95% CI 0.80, 1.09) (figure 3a). There was no evidence of statistical heterogeneity (Q = 8.996, p = 0.255; I² = 22%). A cumulative meta-analysis using overall survival data as they became available in time for each trial yielded a comparable hazard ratio of 0.93 (95% CI 0.81, 1.06) (figure 3b). Stability of the pooled HR and confidence interval was achieved after publication of the COST trial in 2004 [31].

[Figure omitted. See PDF.]

Figure 3. Meta-analysis of overall survival (random-effects models).

a) Standard technique; b) Cumulative technique.

https://doi.org/10.1371/journal.pone.0035292.g003

Pooling studies including only colon cancer patients (n = 5) yielded a HR of 1.01 (95% CI 0.86, 1.19), with no significant statistical heterogeneity (Q = 4.762, p = 0.313; I² = 16%). The addition of a sixth trial, which included both sigmoid colon and high rectal cancers, did not alter these data significantly (not shown). Pooling trials including only rectal cancer patients (n = 2) yielded a HR of 0.70 (95% CI 0.49, 1.00), with no statistical heterogeneity (Q = 0.174, p = 0.676; I² = 0%). The addition of a third trial including only rectosigmoid cancer patients to the rectal cancer group yielded a HR of 0.75 (95% CI 0.57, 0.99, I² = 0%). Pooling of the two trials with the lowest risk of bias did not significantly alter the results (HR = 1.06, 95% CI 0.89, 1.25, I² = 0%). Similarly, pooling all trials except one with the greatest risk of bias did not alter the outcomes, but it did increase the degree of statistical heterogeneity (HR = 0.93, 95% 0.79, 1.09, I² = 28%). Pre-specified sensitivity analyses based on the risk of bias did not significantly affect the survival results or the degree of heterogeneity (data not shown).

Data on the number of lymph nodes harvested with the surgical specimen was reported by 19/23 trials (83%). Nine trials presented sufficient data to allow for meta-analysis. The range of reported lymph nodes harvested was 5.5–23.0 for laparoscopy, and 7.8–26.0 for open surgery. The pooled weighted mean difference between laparoscopic and open resection was −0.17 lymph nodes (95% CI −0.35, 0.011). This result was highly statistically heterogeneous (Q = 22.64, p = 0.004; I² = 65%). A sensitivity analysis limited to colon resections yielded a similar mean difference (−0.241, 95% CI −0.632, 0.150), but with increased heterogeneity (Q = 22.44, p < 0.001; I² = 82%), indicating that much of the statistical variation originates with trials addressing colon cancer rather than colorectal or rectal cancer. Analysis of rectal cancer trials (n = 2) eliminated this statistical heterogeneity (mean difference −0.129, 95% CI −0.461, 0.203, I² = 0%). The addition of trials addressing colorectal cancer to those limited to rectal cancer yielded a statistically significant mean difference of −0.142 (95% CI −0.271, −0.014), with no statistical heterogeneity (Q = 0.185, p = 0.980; I² = 0%). Finally, excluding high-risk of bias trials from the pooling yielded a mean difference of −0.106 (95% CI −0.211, 0.000, p = 0.05), with no evidence of statistical heterogeneity (Q = 0.974, p = 0.914, I² = 0%).

Distinct trends in expert opinions were identified for colon and rectal cancer. For colon cancer (figure 4), laparoscopy was initially considered inferior to open surgery, with 100% and 75% of expert opinions scoring “inferior" in 1991 and 1992, respectively. As of 1993, expert opinions curves were found to shift towards equipoise, with well over 75% of reviews opinionating that laparoscopic surgery could be considered for colon cancer in the context of prospective trials. This trend was maintained until 2003. Starting in 2003, a second major shift in opinions can be identified, as experts were found to consider laparoscopic surgery equivalent to open surgery in growing proportions. As of 2005, opinion curves were found to have crossed over, with a majority of surgeons favoring equivalency between the two technologies. After 1993, almost no surgeons considered laparoscopy inferior to laparotomy. Similarly, only four reviewers considered laparoscopy superior to open surgery at any given time point.

[Figure omitted. See PDF.]

Figure 4. Temporal summary of expert opinion in the literature pertaining to laparoscopic surgery for colon cancer.

https://doi.org/10.1371/journal.pone.0035292.g004

For rectal cancer (figure 5), experts initially considered laparoscopy inferior to open surgery in 1991–1992. A shift towards equipoise was again noted – albeit not as strongly – from 1993–2006 with 50–78.6% of expert considering laparoscopy appropriate within clinical trials. In contrast to colon cancer, experts continued to consider laparoscopy inferior to open surgery in variable proportions (20.7–50%) from 1993–2004. A much smaller proportion of experts began to regard laparoscopy as equivalent to laparotomy for rectal cancer in 2003 onwards, although the rise was much more gradual than for colon cancer.

[Figure omitted. See PDF.]

Figure 5. Temporal summary of expert opinion in the literature pertaining to laparoscopic surgery for rectal cancer.

https://doi.org/10.1371/journal.pone.0035292.g005

Discussion

We have conducted a systematic review and meta-analysis of trials comparing laparoscopic and open surgery for colorectal cancer, addressing the primary outcome of overall survival. In addition, we have synthesized expert opinion on this topic by utilizing the entire body of relevant review literature as a surrogate for the acceptability of this technology among surgeons.

In summary, this work identified 23 RCTs presented in 39 distinct published reports comparing laparoscopic and open surgery for patients suffering from colorectal cancer. A meta-analysis of time-to-event data on overall survival demonstrated the non-inferiority of laparoscopy. Although other groups have also previously conducted meta-analyses pertaining to oncologic outcomes [53], most have opted to pool survival data using the proportion of patients alive or dead at maximal follow-up. This approach has the potential to introduce bias in a meta-analysis, as the pooling of such a dichotomous outcome involves the combination of trials at different stages of maturity and completely omits information pertaining to the timing of death following cancer surgery. In order to circumvent these issues, we have pooled hazard ratios, which are more appropriate measures of time-to-event data. Unfortunately, these data are not always reported in clinical trials. As such, we have utilized a combination of published data on hazard ratios where possible, together with best estimations of HR obtained from published survival curves. This statistical approach allowed us to generate the most comprehensive and rigorous meta-analysis of survival data pertaining to laparoscopic and open surgery for colorectal cancer available to date, as well as to confirm the non-inferiority of laparoscopy. These results compare favorably with existing meta-analyses [53], including those that employed similar statistical methods [54], [55]. The current review is also unique in its utilization of cumulative meta-analytic techniques and its comparison to expert opinion.

In addition to the above finding, we have also demonstrated that expert opinion pertaining to laparoscopic surgery for colon cancer shifted dramatically in 2003–2004. For rectal cancer, a similar – albeit weaker – trend was noted in 2006. In both instances, the majority opinion deemed that laparoscopic surgery was equivalent to open surgery after a long period of time during which this technique had reached clinical equipoise and was considered only acceptable in clinical trials. We argue that the abrupt shift in opinion in 2003 was a direct result of the publication of the first moderate-size RCT by Lacy and colleagues that presented medium-term survival data [25]. This single-center trial from Barcelona randomized 219 patients to laparoscopic and open surgery for colon cancer and argued that laparoscopy was superior to open surgery in terms of postoperative morbidity, length of hospital stay, tumor recurrence, and cancer-related survival. Overall survival was also found to be superior in an adjusted Cox model, but only trended towards significance in unadjusted data. Despite more modest long-term results [48], this paper was undoubtedly seminal in shifting expert opinion regarding laparoscopy colon cancer surgery. Finally, we also argue that this transition was further promoted by the publication in 2004 of the COST trial, for which the influence was probably greatest in North America where this trial was funded and conducted [31].

The above argument is further supported by the results of the cumulative meta-analysis for overall survival. Indeed, the accumulation of survival data presented in figure 3b demonstrates that both the magnitude and precision of the survival HR has stabilized and remained essentially unchanged since publication of the COST trial 3-year data [31]. In other words, both portions of the current study would indicate that laparoscopic surgery for colon cancer has been non-inferior to open surgery since 2004, and that the surgical literature has been supportive of this finding since 2003. Taken together, these data provide a first example of pragmatic knowledge translation in surgery based on clinical trial evidence.

Regarding rectal cancer surgery, it is not surprising that a notably weaker transition in expert opinion did not occur before 2006, as neither the Lacy [25] nor COST [31] trials included any rectal cancer patients. Although some surgeons may have extrapolated from the data on colon cancer, this is unlikely to have affected the prevailing expert opinion in the literature. In 2005, however, the CLASICC trial from the UK included 381 (48%) patients with rectal cancer [34], and it is likely that this paper had an encouraging influence on expert opinion. Although survival data from this trial were not published until 2007 [44], we argue that this publication together with mounting evidence of non-inferiority for laparoscopic colon cancer surgery began the transition for rectal cancer. That being said, since 2005, only a fraction of patients enrolled in trials of laparoscopic and open surgery have done so for rectal cancer, and it likely that many experts in the field have continued to wait for the publication of further large scale trials addressing this topic. Many surgeons argue that rectal cancer patients included in trials thus far have been carefully selected and have not been representative of challenging mid- to low-rectal lesions [50]. For this reason, it is likely that a full shift from equipoise to equivalency will await results from the ongoing COLOR II [56], ACOSOG Z6051 [57] rectal cancer trials.

There are several limitations to this study. First, our meta-analysis of survival outcomes is limited on the basis of incomplete reporting of data within primary publications. Although we have utilized statistical methods to generate estimates of hazard ratios in order to complete published data, it remains that there were relatively few trials with sufficient long-term data. A second limitation pertains to comparisons between colon and rectal cancers. Although we have pooled survival data for colorectal cancer as a whole, we have also provided sensitivity analyses to account for the important clinical differences between the two cancer types. Our analysis was limited by the relatively small number of patients with rectal cancer included in trials to date. In the absence of individual patient data, which is impractical for 23 distinct surgical trials, the methods used in the current review represent the most robust option for pooling survival data.

Limitations pertaining to our analysis of expert opinion in the literature include a certain degree of subjectivity in grading included review citations, as well as a lack of formal validation of our grading scale. We have attempted to minimize these limitations by piloting the scale prior to implementation. As well, we have constructed a scale that holds great face validity from a clinical standpoint and that reflects terminology and issues that are commonly raised in the in literature on this topic. Finally, it should be mentioned that this type of analysis and semi-quantitative correlation with our meta-analysis cannot determine with certainty the precise reason for shifts in expert opinion, as our evaluation of individual reviews did not seek to capture the reasoning behind opinions. As well, this work has sought to capture only indirect evidence of the adoption of laparoscopic surgery for colorectal cancer. Proof of adoption would indeed require data on actual uptake by surgeons rather than the utilization of a surrogate in the literature. Nevertheless, we argue that the current analysis is highly valuable as it provides a global evaluation of the state of the literature on this topic, which is presumably used by many – if not most – surgeons in evaluating novel technologies. At the very least, this analysis provides important insight into the process of knowledge translation by which a surgical technology is introduced and subsequently taken up into practice.

In conclusion, a large number of trials comparing laparoscopic and open surgery for colorectal cancer can be identified in the literature. Laparoscopic surgery for colon cancer is not inferior to open surgery in terms of overall survival, and has been so since 2004. The majority expert opinion in the literature has considered these two techniques to be equivalent, since the publication of landmark clinical trials in 2002 and 2004. Although increasingly accepted since 2006, laparoscopic surgery for rectal cancer remains controversial, likely owing to the current lack of dedicated large-scale randomized controlled trials. Knowledge translation efforts in the field of laparoscopic surgery for colorectal cancer appear to have paralleled the accumulation of clinical trial evidence.

Supporting Information

[Figure omitted. See PDF.]

Text S1.

Electronic search strategy.

https://doi.org/10.1371/journal.pone.0035292.s001

(DOCX)

Table S1.

Characteristics of included randomized controlled trials.

https://doi.org/10.1371/journal.pone.0035292.s002

(DOCX)

Acknowledgments

Podium presentations at the Canadian Surgery Forum, London, ON, September 17^th, 2011, and at the Annual Meeting of the Society for Clinical Trials, Vancouver BC, May 18^th, 2011.

Author Contributions

Conceived and designed the experiments: GM JSB RPB CRR DAF. Performed the experiments: GM ABC. Analyzed the data: GM ABC RPB CRR DAF. Contributed reagents/materials/analysis tools: GM CRR DAF. Wrote the paper: GM ABC JSB RPB CRR DAF.

Citation: Martel G, Crawford A, Barkun JS, Boushey RP, Ramsay CR, Fergusson DA (2012) Expert Opinion on Laparoscopic Surgery for Colorectal Cancer Parallels Evidence from a Cumulative Meta-Analysis of Randomized Controlled Trials. PLoS ONE 7(4): e35292. https://doi.org/10.1371/journal.pone.0035292

References

1. Fowler DL, White A (1991) Laparoscopy-assisted sigmoid resection. Surg Laparosc Endosc 1: 183–188.DL FowlerA. White1991Laparoscopy-assisted sigmoid resection.Surg Laparosc Endosc1183188

2. Jacobs M, Verdeja JC, Goldstein HS (1991) Minimally invasive colon resection (laparoscopic colectomy). Surg Laparosc Endosc 1: 144–150.M. JacobsJC VerdejaHS Goldstein1991Minimally invasive colon resection (laparoscopic colectomy).Surg Laparosc Endosc1144150

3. Martel G, Boushey RP (2006) Laparoscopic colon surgery: past, present and future. Surg Clin N Am 86: 867–897.G. MartelRP Boushey2006Laparoscopic colon surgery: past, present and future.Surg Clin N Am86867897

4. Milsom JW (2005) Laparoscopic surgery in the treatment of Crohn’s disease. Surg Clin N Am 85: 25–34.JW Milsom2005Laparoscopic surgery in the treatment of Crohn’s disease.Surg Clin N Am852534

5. Senagore AJ (2005) Laparoscopic sigmoid colectomy for diverticular disease. Surg Clin N Am 85: 19–24.AJ Senagore2005Laparoscopic sigmoid colectomy for diverticular disease.Surg Clin N Am851924

6. Barkun JS, Aronson JK, Feldman LS, Maddern GJ, Strasberg SM, et al. (2009) Surgical innovation 1: evaluation and stages of surgical innovation. Lancet 374: 1089–1096.JS BarkunJK AronsonLS FeldmanGJ MaddernSM Strasberg2009Surgical innovation 1: evaluation and stages of surgical innovation.Lancet37410891096

7. Murray A, Lourenco T, de Verteuil R, Hernandez R, Fraser C, et al. (2006) Clinical effectiveness and cost-effectiveness of laparoscopic surgery for colorectal cancer: systematic reviews and economic evaluation. Health Technol Assess 10: 1–141.A. MurrayT. LourencoR. de VerteuilR. HernandezC. Fraser2006Clinical effectiveness and cost-effectiveness of laparoscopic surgery for colorectal cancer: systematic reviews and economic evaluation.Health Technol Assess101141

8. Higgins JPT, Altman DG (2008) Chapter 8: Assessing risk of bias in included studies. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions. Chichester: John Willey & Sons. pp. 187–241.JPT HigginsDG Altman2008Chapter 8: Assessing risk of bias in included studies.JPT HigginsS. GreenCochrane Handbook for Systematic Reviews of InterventionsChichesterJohn Willey & Sons187241

9. Ramsay CR, Grant AM, Wallace SA, Garthwaite PH, Monk AF, et al. (2001) Statistical assessment of the learning curves of health technologies. Health Technol Assess 5: 1–79.CR RamsayAM GrantSA WallacePH GarthwaiteAF Monk2001Statistical assessment of the learning curves of health technologies.Health Technol Assess5179

10. Williamson PR, Smith CT, Hutton JL, Marson AG (2002) Aggregate data meta-analysis with time-to-event outcomes. Statist Med 21: 3337–3351.PR WilliamsonCT SmithJL HuttonAG Marson2002Aggregate data meta-analysis with time-to-event outcomes.Statist Med2133373351

11. Parmar MKB, Torri V, Stewart L (1998) Extracting summary statistics to perform meta-analysis of the published literature for survival endpoints. Statist Med 17: 2815–2834.MKB ParmarV. TorriL. Stewart1998Extracting summary statistics to perform meta-analysis of the published literature for survival endpoints.Statist Med1728152834

12. Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR (2007) Practical methods for incorporating summary time-to-event data into meta-analysis. Trials 8: 16.JF TierneyLA StewartD. GhersiS. BurdettMR Sydes2007Practical methods for incorporating summary time-to-event data into meta-analysis.Trials816

13. Sydes M, Tierney J (2007) M. SydesJ. Tierney2007HR calculation spreadsheet. MRC Clinical Trials Unit, London, UK. Available: http://www.biomedcentral.com/content/supplementary/1745-6215-8-16-S1.xls%5D. Accessed November 2010. HR calculation spreadsheet. MRC Clinical Trials Unit, London, UK. Available: http://www.biomedcentral.com/content/supplementary/1745-6215-8-16-S1.xls%5D. Accessed November 2010.

14. Lacy AM, Garcia-Valdecasas JC, Pique JM, Delgado S, Campo E, et al. (1995) Short-term outcome analysis of a randomized study comparing laparoscopic vs open colectomy for colon cancer. Surg Endosc 9: 1101–1105.AM LacyJC Garcia-ValdecasasJM PiqueS. DelgadoE. Campo1995Short-term outcome analysis of a randomized study comparing laparoscopic vs open colectomy for colon cancer.Surg Endosc911011105

15. Stage JG, Schulze S, Moller P, Overgaard H, Andersen M, et al. (1997) Prospective randomized study of laparoscopic versus open colonic resection for adenocarcinoma. Br J Surg 84: 391–396.JG StageS. SchulzeP. MollerH. OvergaardM. Andersen1997Prospective randomized study of laparoscopic versus open colonic resection for adenocarcinoma.Br J Surg84391396

16. Schwenk W, Böhm B, Haase O, Junghans T, Muller JM (1998) Laparoscopic versus conventional colorectal resection: a prospective randomized study of postoperative ileus and early postoperative feeding. Langenbecks Arch Surg 383: 49–55.W. SchwenkB. BöhmO. HaaseT. JunghansJM Muller1998Laparoscopic versus conventional colorectal resection: a prospective randomized study of postoperative ileus and early postoperative feeding.Langenbecks Arch Surg3834955

17. Schwenk W, Bohm B, Muller JM (1998) Influence of laparoscopic or conventional colorectal resection on postoperative quality of life. Zentralbl Chir 123: 483–490.W. SchwenkB. BohmJM Muller1998Influence of laparoscopic or conventional colorectal resection on postoperative quality of life.Zentralbl Chir123483490

18. Milsom JW, Böhm B, Hammerhofer KA, Fazio V, Steiger E, et al. (1998) A prospective, randomized trial comparing laparoscopic versus conventional techniques in colorectal cancer surgery: a preliminary report. J Am Coll Surg 187: 46–54.JW MilsomB. BöhmKA HammerhoferV. FazioE. Steiger1998A prospective, randomized trial comparing laparoscopic versus conventional techniques in colorectal cancer surgery: a preliminary report.J Am Coll Surg1874654

19. Lacy AM, Delgado S, Garcia-Valdecasas JC, Castells A, Pique JM, et al. (1998) Port site metastases and recurrence after laparoscopic colectomy: a randomized trial. Surg Endosc 12: 1039–1042.AM LacyS. DelgadoJC Garcia-ValdecasasA. CastellsJM Pique1998Port site metastases and recurrence after laparoscopic colectomy: a randomized trial.Surg Endosc1210391042

20. Schwenk W, Bohm B, Muller JM (1998) Postoperative pain and fatigue after laparoscopic or conventional colorectal resections. Surg Endosc 12: 1131–1136.W. SchwenkB. BohmJM Muller1998Postoperative pain and fatigue after laparoscopic or conventional colorectal resections.Surg Endosc1211311136

21. Schwenk W, Bohm B, Witt C, Junghans T, Grundel K, et al. (1999) Pulmonary function following laparoscopic or conventional colorectal resection: a randomized controlled evaluation. Arch Surg 134: 6–12.W. SchwenkB. BohmC. WittT. JunghansK. Grundel1999Pulmonary function following laparoscopic or conventional colorectal resection: a randomized controlled evaluation.Arch Surg134612

22. Delgado S, Lacy AM, Garcia-Valdecasas JC, Balague C, Pera M, et al. (2000) Could age be an indicator for laparoscopic colectomy in colorectal cancer. Surg Endosc 14: 22–26.S. DelgadoAM LacyJC Garcia-ValdecasasC. BalagueM. Pera2000Could age be an indicator for laparoscopic colectomy in colorectal cancer.Surg Endosc142226

23. Curet MJ, Putrakul K, Pitcher DE, Josloff RK, Zucker KA (2000) Laparoscopically assisted colon resection for colon carcinoma: prospective results and long-term outcome. Surg Endosc 14: 1062–1066.MJ CuretK. PutrakulDE PitcherRK JosloffKA Zucker2000Laparoscopically assisted colon resection for colon carcinoma: prospective results and long-term outcome.Surg Endosc1410621066

24. Weeks JC, Nelson H, Gelber S, Sargent D, Schroeder G, et al. (2000) Short-term quality-of-life outcomes following laparoscopic-assisted colectomy vs open colectomy for colon cancer: a randomized trial. JAMA 287: 321–328.JC WeeksH. NelsonS. GelberD. SargentG. Schroeder2000Short-term quality-of-life outcomes following laparoscopic-assisted colectomy vs open colectomy for colon cancer: a randomized trial.JAMA287321328

25. Lacy AM, Garcia-Valdecasas JC, Delgado S, Castells A, Taura P, et al. (2002) Laparoscopy-assisted colectomy versus open colectomy for treatment of non-metastatic colon cancer: a randomized trial. Lancet 359: 2224–2229.AM LacyJC Garcia-ValdecasasS. DelgadoA. CastellsP. Taura2002Laparoscopy-assisted colectomy versus open colectomy for treatment of non-metastatic colon cancer: a randomized trial.Lancet35922242229

26. Winslow ER, Fleshman JW, Birnbaum EH, Brunt LM (2002) Wound complications of laparoscopic vs open colectomy. Surg Endosc 16: 1420–1425.ER WinslowJW FleshmanEH BirnbaumLM Brunt2002Wound complications of laparoscopic vs open colectomy.Surg Endosc1614201425

27. Quah HM, Jayne DG, Eu KW, Seow-Choen F (2002) Bladder and sexual dysfunction following laparoscopically assisted and conventional open mesorectal resection for cancer. Br J Surg 89: 1551–1556.HM QuahDG JayneKW EuF. Seow-Choen2002Bladder and sexual dysfunction following laparoscopically assisted and conventional open mesorectal resection for cancer.Br J Surg8915511556

28. Hasegawa H, Kabeshima Y, Watanabe M, Yamamoto S, Kitajima M (2003) Randomized controlled trial of laparoscopic versus open colectomy for advanced colorectal cancer. Surg Endosc 17: 636–640.H. HasegawaY. KabeshimaM. WatanabeS. YamamotoM. Kitajima2003Randomized controlled trial of laparoscopic versus open colectomy for advanced colorectal cancer.Surg Endosc17636640

29. Araujo SE, da Silva e Sousa AH, de Campos FG, da Silva e Sousa AH, Nahas SC, et al. (2003) Conventional approach x laparoscopic abdominoperineal resection for rectal cancer treatment after neoadjuvant chemoradiation: results of a prospective randomized trial. Rev Hosp Clin Fac Med Sao Paulo 58: 133–140.SE AraujoAH da Silva e SousaFG de CamposAH da Silva e SousaSC Nahas2003Conventional approach x laparoscopic abdominoperineal resection for rectal cancer treatment after neoadjuvant chemoradiation: results of a prospective randomized trial.Rev Hosp Clin Fac Med Sao Paulo58133140

30. Leung KL, Kwok SP, Lam SC, Lee JF, Yiu RY, et al. (2004) Laparoscopic resection of rectosigmoid carcinoma: prospective randomized trial. Lancet 363: 1187–1192.KL LeungSP KwokSC LamJF LeeRY Yiu2004Laparoscopic resection of rectosigmoid carcinoma: prospective randomized trial.Lancet36311871192

31. Clinical Outcomes of Surgical Therapy Study Group (2004) A comparison of laparoscopically assisted and open colectomy for colon cancer. N Engl J Med 350: 2050–2059.Clinical Outcomes of Surgical Therapy Study Group2004A comparison of laparoscopically assisted and open colectomy for colon cancer.N Engl J Med35020502059

32. Zhou ZG, Hu M, Li Y, Lei WZ, Yu YY, et al. (2004) Laparoscopic vs open total mesorectal excision with anal sphincter preservation for low rectal cancer. Surg Endosc 18: 1211–1215.ZG ZhouM. HuY. LiWZ LeiYY Yu2004Laparoscopic vs open total mesorectal excision with anal sphincter preservation for low rectal cancer.Surg Endosc1812111215

33. Kaiser AM, Kang JC, Chan LS, Vukasin P, Beart RW (2004) Laparoscopic-assisted vs. open colectomy for colon cancer: a prospective randomized trial. J Laparoendosc Adv Surg Tech A 14: 329–334.AM KaiserJC KangLS ChanP. VukasinRW Beart2004Laparoscopic-assisted vs. open colectomy for colon cancer: a prospective randomized trial.J Laparoendosc Adv Surg Tech A14329334

34. Guillou PJ, Quirke P, Thorpe H, Walker J, Jayne DG, et al. (2005) Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer (MRC CLASICC trial): multicentre, randomised controlled trial. Lancet 365: 1718–1726.PJ GuillouP. QuirkeH. ThorpeJ. WalkerDG Jayne2005Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer (MRC CLASICC trial): multicentre, randomised controlled trial.Lancet36517181726

35. Colon Cancer Laparoscopic or Open Resection Study Group (2005) Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial. Lancet Oncol 6: 477–484.Colon Cancer Laparoscopic or Open Resection Study Group2005Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial.Lancet Oncol6477484

36. Jayne DG, Brown JM, Thorpe H, Walker J, Quirke P, et al. (2005) Bladder and sexual function following resection for rectal cancer in a randomized clinical trial of laparoscopic versus open technique. Br J Surg 92: 1124–1132.DG JayneJM BrownH. ThorpeJ. WalkerP. Quirke2005Bladder and sexual function following resection for rectal cancer in a randomized clinical trial of laparoscopic versus open technique.Br J Surg9211241132

37. Braga M, Frasson M, Vignali A, Zuliani W, Civelli V, et al. (2005) Laparoscopic vs. open colectomy in cancer patients: long-term complications, quality of life, and survival. Dis Colon Rectum 48: 2217–2223.M. BragaM. FrassonA. VignaliW. ZulianiV. Civelli2005Laparoscopic vs. open colectomy in cancer patients: long-term complications, quality of life, and survival.Dis Colon Rectum4822172223

38. King PM, Blazeby JM, Ewings P, Franks PJ, Longman RJ, et al. (2006) Randomized clinical trial comparing laparoscopic and open surgery for colorectal cancer within an enhanced recovery programme. Br J Surg 93: 300–308.PM KingJM BlazebyP. EwingsPJ FranksRJ Longman2006Randomized clinical trial comparing laparoscopic and open surgery for colorectal cancer within an enhanced recovery programme.Br J Surg93300308

39. Arteaga Gonzalez I, Diaz Luis H, Martin Malagon A, Lopez-Tomassetti Fernandez EM, Arranz Duran J, et al. (2006) A comparative clinical study of short-term results of laparoscopic surgery for rectal cancer during the learning curve. Int J Colorectal Dis 21: 590–595.I. Arteaga GonzalezH. Diaz LuisA. Martin MalagonEM Lopez-Tomassetti FernandezJ. Arranz Duran2006A comparative clinical study of short-term results of laparoscopic surgery for rectal cancer during the learning curve.Int J Colorectal Dis21590595

40. Liang JT, Huang KC, Lai HS, Lee PH, Jeng YM (2007) Oncologic results of laparoscopic versus conventional open surgery for stage II and III left-sided colon cancers: a randomized controlled trial. Ann Surg Oncol 14: 109–117.JT LiangKC HuangHS LaiPH LeeYM Jeng2007Oncologic results of laparoscopic versus conventional open surgery for stage II and III left-sided colon cancers: a randomized controlled trial.Ann Surg Oncol14109117

41. Pechlivanides G, Gouvas N, Tsiaoussis J, Tzortzinis A, Tzardi M, et al. (2007) Lymph node clearance after total mesorectal excision for rectal cancer: laparoscopic versus open approach. Dig Dis 25: 94–99.G. PechlivanidesN. GouvasJ. TsiaoussisA. TzortzinisM. Tzardi2007Lymph node clearance after total mesorectal excision for rectal cancer: laparoscopic versus open approach.Dig Dis259499

42. Braga M, Frasson M, Vignali A, Zuliani W, Capretti G, et al. (2007) Laparoscopic resection in rectal cancer patients: outcomes and cost-benefit analysis. Dis Colon Rectum 50: 64–471.M. BragaM. FrassonA. VignaliW. ZulianiG. Capretti2007Laparoscopic resection in rectal cancer patients: outcomes and cost-benefit analysis.Dis Colon Rectum5064471

43. Janson M, Lindholm E, Anderberg B, Haglind E (2007) Randomized trial of health-related quality of life after open and laparoscopic surgery for colon cancer. Surg Endosc 21: 747–753.M. JansonE. LindholmB. AnderbergE. Haglind2007Randomized trial of health-related quality of life after open and laparoscopic surgery for colon cancer.Surg Endosc21747753

44. Jayne DG, Guillou PJ, Thorpe H, Quirke F, Copeland J, et al. (2007) Randomized trial of laparoscopic-assisted resection of colorectal carcinoma: 3-year results of the UK MRC CLASICC trial group. J Clin Oncol 25: 3061–3068.DG JaynePJ GuillouH. ThorpeF. QuirkeJ. Copeland2007Randomized trial of laparoscopic-assisted resection of colorectal carcinoma: 3-year results of the UK MRC CLASICC trial group.J Clin Oncol2530613068

45. Fleshman J, Sargent DJ, Green E, Anvari M, Stryker SJ, et al. (2007) Laparoscopic colectomy for cancer is not inferior to open surgery based on 5-year data from the COST Study Group Trial. Ann Surg 246: 655–664.J. FleshmanDJ SargentE. GreenM. AnvariSJ Stryker2007Laparoscopic colectomy for cancer is not inferior to open surgery based on 5-year data from the COST Study Group Trial.Ann Surg246655664

46. Chung CC, Ng DCK, Tsang WWC, Tang WL, Yau KK, et al. (2007) Hand-assisted laparoscopic versus open right hemicolectomy: a randomized controlled trial. Ann Surg 246: 728–733.CC ChungDCK NgWWC TsangWL TangKK Yau2007Hand-assisted laparoscopic versus open right hemicolectomy: a randomized controlled trial.Ann Surg246728733

47. Ramacciato G, D’Angelo F, Aurello P, Nigri G, Valabrega S, et al. (2008) Right hemicolectomy for colon cancer: a prospective randomised study comparing laparoscopic vs open technique. Chir Ital 60: 1–7.G. RamacciatoF. D’AngeloP. AurelloG. NigriS. Valabrega2008Right hemicolectomy for colon cancer: a prospective randomised study comparing laparoscopic vs open technique.Chir Ital6017

48. Lacy AM, Delgado S, Castells A, Prins HA, Arroyo V, et al. (2008) The long-term results of a randomized clinical trial of laparoscopy-assisted versus open surgery for colon cancer. Ann Surg 248: 1–7.AM LacyS. DelgadoA. CastellsHA PrinsV. Arroyo2008The long-term results of a randomized clinical trial of laparoscopy-assisted versus open surgery for colon cancer.Ann Surg24817

49. King PM, Blazeby JM, Ewings P, Kennedy PH (2008) Detailed evaluation of functional recovery following laparoscopic or open surgery for colorectal cancer with an enhanced recovery programme. Int J Colorectal Dis 23: 795–800.PM KingJM BlazebyP. EwingsPH Kennedy2008Detailed evaluation of functional recovery following laparoscopic or open surgery for colorectal cancer with an enhanced recovery programme.Int J Colorectal Dis23795800

50. Ng SSM, Leung KL, Lee JFY, Yiu RY, Li JC, et al. (2008) Laparoscopic-assisted versus open abdominoperineal resection for low rectal cancer: a prospective randomized trial. Ann Surg Oncol 15: 2418–2425.SSM NgKL LeungJFY LeeRY YiuJC Li2008Laparoscopic-assisted versus open abdominoperineal resection for low rectal cancer: a prospective randomized trial.Ann Surg Oncol1524182425

51. Hewett PJ, Allardyce RA, Bagshaw PF, Frampton CM, Frizelle FA, et al. (2008) Short-term outcomes of the Australasian randomized clinical study comparing laparoscopic and conventional open surgical treatments for colon cancer: the ALCCaS trial. Ann Surg 248: 728–738.PJ HewettRA AllardycePF BagshawCM FramptonFA Frizelle2008Short-term outcomes of the Australasian randomized clinical study comparing laparoscopic and conventional open surgical treatments for colon cancer: the ALCCaS trial.Ann Surg248728738

52. The Colon Cancer Laparoscopic or Open Resection Study Group (2009) Survival after laparoscopic surgery versus open surgery for colon cancer: long-term outcome of a randomised clinical trial. Lancet Oncol 10: 44–52.The Colon Cancer Laparoscopic or Open Resection Study Group2009Survival after laparoscopic surgery versus open surgery for colon cancer: long-term outcome of a randomised clinical trial.Lancet Oncol104452

53. Martel G, Duhaime S, Barkun JS, Boushey RP, Ramsay CR, et al. (2012) The quality of research synthesis in surgery: the case of laparoscopic surgery for colorectal cancer. Systematic Reviews 1: 14.G. MartelS. DuhaimeJS BarkunRP BousheyCR Ramsay2012The quality of research synthesis in surgery: the case of laparoscopic surgery for colorectal cancer.Systematic Reviews114

54. Jackson TD, Kaplan GG, Arena G, Page JH, Rogers SO (2007) Laparoscopic versus open resection for colorectal cancer: a metaanalysis of oncologic outcomes. J Am Coll Surg 204: 439–446.TD JacksonGG KaplanG. ArenaJH PageSO Rogers2007Laparoscopic versus open resection for colorectal cancer: a metaanalysis of oncologic outcomes.J Am Coll Surg204439446

55. Kuhry E, Schwenk W, Gaupset R, Romild U, Bonjer HJ (2008) Long-term results of laparoscopic colorectal cancer resection. Cochrane Database Syst Rev CD003432: E. KuhryW. SchwenkR. GaupsetU. RomildHJ Bonjer2008Long-term results of laparoscopic colorectal cancer resection.Cochrane Database Syst RevCD003432

56. COLOR II Study Group, Buunen M, Bonjer HJ, Hop WC, Haglind E, et al. (2009) COLOR II. A randomized clinical trial comparing laparoscopic and open surgery for rectal cancer. Dan Med Bull 56: 89–91.COLOR II Study Group, Buunen M, Bonjer HJ, Hop WC, Haglind E, et al.2009COLOR II. A randomized clinical trial comparing laparoscopic and open surgery for rectal cancer.Dan Med Bull568991

57. American College of Surgeons Oncology Group (2011) Laparoscopic-assisted resection or open resection in treating patients with stage IIA, stage IIIA, or stage IIIB rectal cancer. 12: American College of Surgeons Oncology Group2011Laparoscopic-assisted resection or open resection in treating patients with stage IIA, stage IIIA, or stage IIIB rectal cancer.12Available at www.clinicaltrials.gov, identifier NCT00726622. Accessed 2011 February. Available at www.clinicaltrials.gov, identifier NCT00726622. Accessed 2011 February.