Fabrizio Cantini 1 and Stefania Boccia 2 and Delia Goletti 3 and Florenzo Iannone 4 and Emanuele Leoncini 2 and Nikola Panic 2 and Francesca Prignano 5 and Giovanni Battista Gaeta 6
Academic Editor:Luis R. Espinoza
1, Division of Rheumatology, Misericordia e Dolce Hospital, Via Cavour 87/89, 59100 Prato, Italy
2, Section of Hygiene, Institute of Public Health, Department of Public Health, Universita Cattolica del Sacro Cuore, L.go F.Vito 1, 00168 Rome, Italy
3, Translational Research Unit, Department of Epidemiology and Preclinical Research, INMI, Via Portuense 292, 00149 Rome, Italy
4, Rheumatology Unit, Interdisciplinary Department of Medicine, University of Bari, Piazza Giulio Cesare 1, 70124 Bari, Italy
5, Dermatology Clinic/ASF Department of Surgery and Translational Medicine, University of Florence, Via Lorenzo Il Magnifico 104, 50129 Florence, Italy
6, Section of Infectious Diseases, Department of Internal Medicine, Second University of Naples, Via S. Pansini 5, 80131 Naples, Italy
Received 25 March 2014; Revised 26 May 2014; Accepted 11 June 2014; 7 July 2014
This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
1. Introduction
Antitumor necrosis factor-alpha (TNF-α ) agents are widely used for effective treatment of autoimmune rheumatic and dermatological diseases such as rheumatoid arthritis (RA), ankylosing spondylitis (SA), psoriasis (Ps), or psoriatic arthritis (PsA). Nevertheless, anti-TNF-α agents have been associated with growing number of adverse events, particularly infections [1, 2] of which some can be life threatening.
TNF-α is an important proinflammatory cytokine in the host defense mechanism against many intracellular pathogens. It suppresses hepatitis B virus (HBV) replication and promotes HBV eradication by stimulating HBV-specific cytotoxic T-cell response [3-5]. It has been reported that reactivation of HBV infection may occur directly due to lack of TNF-α or indirectly via diminishing T-cell activation [6, 7]. TNF-α inhibitors are therefore likely to induce HBV replication and reactivation in cases when chronic infection is present.
HBV is regarded as a leading cause of acute hepatitis, cirrhosis, and hepatocellular carcinoma [8], being responsible for about 600000 deaths every year [8]. Chronic HBV infection is defined as an overt when hepatitis B surface antigen (HBsAg) is detectable in the serum. Patients who present antibodies to hepatitis B core antigen (anti-HBc) with concurrent HBsAg negativity do not have chronic hepatitis but only experienced HBV infection and were able to clear it. Nevertheless, some of these patients may be occult carriers, harboring intrahepatic HBV replication [9], and therefore can be susceptible to HBV reactivation. Hepatitis B virus (HBV) reactivation in patients treated with anti-TNF-α agents has been frequently reported in the last decade, with inconsistent results [10]. Considering the high socioeconomic burden of HBV infection related conditions, as well as increasing role of anti-TNF-α agents in treatment of autoimmune rheumatic and dermatological diseases, it is highly important to estimate the impact of anti-TNF-α agents to HBV reactivation in these patients.
We have conducted a systematic review and meta-analysis in order to assess the prevalence of HBV reactivation among patients treated with anti-TNF-α agents because of RA, SA, Ps, and PsA.
2. Methods
This systematic review and meta-analysis have been reported following the PRISMA statement [21].
2.1. Search Strategy
We conducted comprehensive literature search of MEDLINE, Scopus, and ISI Web of Knowledge databases using the following search: ([infliximab] OR [rituximab] OR [etanercept] OR [adalimumab] OR [abatacept] OR ["anti-TNF"]) AND ["HBV reactivation"]. The search was limited to human subjects with language restriction to English studies until 1st September 2013. The snowball strategy, including manual search of the references listed by studies retrieved from the online databases and from previously published systematic reviews, was also performed to identify potential additional studies. Abstracts, systematic reviews, editorials, and case reports were not included.
2.2. Inclusion and Exclusion Criteria
The eligibility criteria for inclusion in the review implied that (i) patients should be affected by at least one of the following diseases: rheumatoid arthritis (RA), ankylosing spondylitis (SA), psoriasis (Ps), or psoriatic arthritis (PsA); (ii) study must refer to treatment with one or more of the following biologic agents: infliximab, rituximab, etanercept, adalimumab, and abatacept; (iii) the HBV serological status of patients prior to the pharmacological treatment and the prevalence of HBV reactivation after the treatment should be reported. Studies were excluded if it included only hepatitis C virus (HCV) infected patients (other than those also coinfected with HBV).
2.3. Data Extraction and Outcome Definition
Data from the included studies were independently extracted by two investigators (NP and EL) and entered into an Excel 2010 (Microsoft Corp., Redmond, WA, USA) spreadsheet. Any discrepancies regarding individual study inclusion, data extraction, and interpretation were resolved by consulting a third investigator (SB). We extracted the following data: first author name, year of publication, number of patients, mean age, and gender of patients. Further we extracted data on the HBV serological status of patients, medical conditions for which patients were treated, the biologic agent used, the presence of other disease modifying antirheumatic drugs (DMARDs), and antiviral prophylaxis. The main outcome used in the meta-analysis was the prevalence of HBV reactivation reported as prevalence proportion. The studies with sample size less than 15 were not included in meta-analysis. Additionally, when available, we collected individual-level data on HBV reactivation, namely, age, gender, condition treated for, anti-TNF agent used, and, if any, antiviral prophylaxis. Based on this data we performed additional meta-analyses according to diseases and biologic agents when possible. Based on the serological status, we stratified results of the meta-analysis according to two main subgroups of patients expected to have different prevalence HBV reactivation: patients presenting with overt chronic HBV infection (being HBsAg positive) and patients presenting with occult HBV infection (being HBsAg negative and anti-HBc positive). Based on information reported in the article full text and tables, it was always possible to obtain the data on the subgroups.
2.4. Statistical Analysis
To determine pooled proportions, the variances of the raw proportions [figure omitted; refer to PDF] were stabilized using a Freeman-Tukey-type arcsine square root transformation [22]: [figure omitted; refer to PDF] , with a variance of [figure omitted; refer to PDF] , where [figure omitted; refer to PDF] is the denominator for population size. Pooled proportions from all studies were calculated as the back transform of the weighted mean of the transformed proportions, using a random-effects model [23]. We assessed heterogeneity among studies using the Cochran Q test and quantified inconsistencies across studies and their impact on the analysis by using the [figure omitted; refer to PDF] statistic [24, 25]. As we anticipated large heterogeneity considering the very different clinical presentation of patients, we considered statistically significant heterogeneity when [figure omitted; refer to PDF] . The robustness of pooled proportions was explored by conducting sensitivity and subgroup analyses. The meta-analysis was conducted using Stata software (Stata Corp. 2011. Stata Statistical Software: Release 12. College Station, TX: Stata Corp LP).
3. Results
The results of the literature search are reported in a flow chart (Figure 1). After searching 3 databases we identified 632 relevant articles. Additionally, 4 more relevant papers were identified through reference search of relevant systematic reviews. After removing duplicates, 226 remaining abstracts were examined, and further 161 were excluded because of being unrelated to the subject, 34 were excluded because they referred to medical conditions other than those named in inclusion criteria, and 5 were systematic reviews or meta-analyses. Finally when we retrieved full text of the remaining 26 papers, 5 were excluded as they were case reports.
Figure 1: Systematic review and meta-analysis flow chart.
[figure omitted; refer to PDF]
The characteristics of the 21 studies included in the systematic review are reported in Table 1 [11-20, 26-36]. Six studies included patients with overt chronic HBV infection and 9 included patients with occult HBV infection, while 6 studies addressed both groups of patients. Fourteen studies included patients treated with biologic agents because of rheumatoid arthritis (66.7%), 6 (28.6%) patients treated because of ankylosing spondylitis, 5 (23.8%) because of psoriasis, and 4 (19.0%) because of psoriatic arthritis. In 18 (85.7%) studies patients were treated with etanercept, in 16 (76.2%) with infliximab, in 17 (81.0%) with adalimumab, and in 3 (14.3%) with rituximab. In eleven (52.4%) studies antiviral prophylaxis was administered at least to some of patients prior to treatment with biologic agents.
Table 1
Source | Studydesign | Patients' HBVstatus | Number ofcases@ | Age, y# | Male, % | Followup | Pathological condition | Biologic agent | Antiviralprophylaxis, [figure omitted; refer to PDF] | Other DMARDs used |
Roux et al., 2006 [26] | RS | Overt infection | 3 | 52 | 100% | nr | RA | ETA, INF, ADA | Lamivudine (3) | MTX (33.3%) |
| ||||||||||
Zingarelli et al., 2008 [27] | PR | Overt infection Occult infection | 4 | 63 | 25% | 19 months [figure omitted; refer to PDF] | RA | ETA, INF, ADA, RIT | Lamivudine (4) | MTX (25%); COR (25%); HCL (25%); SSZ (25%) |
| ||||||||||
Charpin et al., 2009 [13] | PR | Occult infection | 21 | 58 | 38% | 27 months# | RA, AS, PsA | ETA, INF, ADA | No | MTX (47.6%); COR (23.8%) |
| ||||||||||
Chung et al., 2009 [28] | RS | Occult infection | 8 | 37 | 63% | nr | RA, AS | ETA, INF, ADA | No | MTX (37.5%); SSZ (50%); |
| ||||||||||
Caporali et al., 2010 [11] | PR | Occult infection | 67 | 57 | 55% | 45.5 months# | RA, AS, PsA | ETA, INF, ADA | No | MTX (76.1%); COR (64.1%); NSAID (77.6%); |
| ||||||||||
Fotiadou et al., 2011 [29] | RS | Overt infection | 7 | 51 | 43% | 6-24 months | Ps | ETA, INF, ADA | Lamivudine (7) | nr |
| ||||||||||
Kim et al., 2010 [14] | RS | Occult infection | 88 | 51 | 51% | nr | RA, AS, PsA | ETA, INF, ADA | no | nr |
| ||||||||||
Prignano et al., 2011 [30] | RS | Occult infection | 12 | 62 | 75% | 6 months# | Ps | ETA, ADA | no | nr |
| ||||||||||
Cassano et al., 2011 [12] | RS | Occult infection | 62 | 54 | 68% | nr | Ps | ETA, INF, ADA | no | nr |
| ||||||||||
Kato et al., 2011 [31] | PR | Occult infection | 6 | 62* | 23%* | 8-124 weeks* | RA | ETA, INF, RIT | no | MTX (2.9%); COR (60%); CYC (42.9%); TAC (17.1%); CYA (2.9%)* |
| ||||||||||
Lan et al., 2011 [15] | RS | Overt infection Occult infection | 88 | 50.1 | 13% | nr | RA | ETA, ADA | Lamivudine (10) | MTX (90.9%) |
| ||||||||||
Mori, 2011 [16] | PR | Overt infection Occult infection | 32 | [figure omitted; refer to PDF] | 37%* | nr | RA | ETA, INF, ADA | Entecavir (1) | MTX (90%); COR (63.3%); TAC (50%); TOC (8.3%)* |
| ||||||||||
Tamori et al., 2011 [18] | PR | Overt infection Occult infection | 44 | 59* | 18%* | 24 months | RA | ETA, INF, ADA | Entecavir (2) | MTX (63.3%)* |
| ||||||||||
Urata et al., 2011 [19] | PR | Occult infection | 52 | nr | nr | 12 months | RA | ETA, INF, ADA, RIT | No | MTX (48.2%); COR (38.5%); SSZ (20.7%); CYC (0.7%); TAC (6.7%); CYA (0.7%); TOC (3.0%); LEF (2.2%); BUC (20%)* |
| ||||||||||
Cho et al., 2012 [32] | RS | Overt infection | 7 | 43 | 86% | 29 months | Ps | ETA, ADA | Lamivudine (1) | nr |
| ||||||||||
Ryu et al., 2012 [17] | RS | Overt infection | 49 | 43 | 61% | nr | RA, AS | ETA, INF, ADA | Lamivudine (15)Entecavir (5) | MTX (32.7%); COR (61.2%); HCL (14.3%); LEF (12.2%) |
| ||||||||||
Giardina et al., 2013 [33] | PR | Overt infection Occult infection | 11 | [figure omitted; refer to PDF] | [figure omitted; refer to PDF] | 24 months [figure omitted; refer to PDF] | RA, AS, PsA | ETA, IFX | Lamivudine (4) | MTX [figure omitted; refer to PDF] ; COR [figure omitted; refer to PDF] |
| ||||||||||
Laurenti et al., 2013 [34] | RS | Overt infection; Occult infection | 8 | 54 | 50% | nr | PsA | ADA | Lamivudine (1) | nr |
| ||||||||||
Navarro et al., 2013 [35] | RS | Overt infection | 4 | 42 | 50% | 25 months#* | Ps | ETA, INF | Lamivudine (3),Entecavir (1),Adefovir (1) | nr |
| ||||||||||
Nishida et al., 2013 [36] | RS | Overt infection | 1 | 60 | 100% | 47 | RA | INF | No | nr |
| ||||||||||
Vassilopoulos et al., 2010 [20] | PR | Overt infection Occult infection | 33 | [figure omitted; refer to PDF] | [figure omitted; refer to PDF] | 24 months [figure omitted; refer to PDF] | RA, AS, PsA | ETA, INF, ADA | Lamivudine (11),Entecavir (3),Tenfovir (1),Telbivudine (1) | nr |
nr: not reported. Study design: RS: retrospective cohort; PR: prospective cohort. Pathological condition: RA: rheumatoid arthritis; AS: ankylosing spondylitis; PsA: psoriatic arthritis; Ps: psoriasis. Biologic agent: ETA: etanercept; INF: infliximab; ADA: adalimumab; RIT: rituximab. Other DMARDs: MTX: methotrexate; COR: corticosteroids; HCL: hydroxychloroquine; SSZ: sulfasalazine; NSAID: nonsteroid anti-inflammatory drug; CYC: cyclophosphamide; TAC: tacrolimus; CYA: cyclosporin A; TOC: tocilizumab; LEF: leflunomide; BUC: bucillamine.
@ Cases included in the analysis.
# Expressed as mean.
[figure omitted; refer to PDF] Expressed as median.
*Data reported for all patients included in study, not just for those treated with anti-TNF agents.
[figure omitted; refer to PDF] Data reported for all patients included in study, not just for those with occult/overt HBV infection.
3.1. Meta-Analysis
Eleven studies (57.1%) out of 21 were excluded because of the small sample size (<15 subjects) [37], so the analysis was restricted to 10 studies. The result of the meta-analysis is reported in Table 2, with a pooled estimate of HBV reactivation being 4.2% (95% CI: 1.4-8.2%, [figure omitted; refer to PDF] : 74.7%), with significant heterogeneity among studies. In the subgroup analyses, the pooled prevalence of HBV reactivation among patients with occult infection was 3.0% (95% CI: 0.6-7.2, [figure omitted; refer to PDF] : 77.1%) and the pooled prevalence of HBV reactivation among patients with overt HBV infection was 15.4% (95% CI: 1.2-41.2%, [figure omitted; refer to PDF] : 79.9%). In both subgroups, high heterogeneity was present (Table 2).
Table 2: Meta-analysis of the prevalence of HBV reactivation among patients treated with biologic agents.
(a)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
All patients |
|
|
|
|
|
Caporali et al., 2010 [11] | 67 | 0 | 0.0 | 0.0-5.4 | 10.9 |
Cassano et al., 2011 [12] | 62 | 0 | 0.0 | 0.0-5.8 | 10.7 |
Charpin et al., 2009 [13] | 21 | 0 | 0.0 | 0.0-15.5 | 7.5 |
Kim et al., 2010 [14] | 88 | 14 | 15.9 | 9.7-24.9 | 11.4 |
Lan et al., 2011 [15] | 88 | 6 | 6.8 | 3.2-14.1 | 11.4 |
Mori, 2011 [16] | 32 | 1 | 3.1 | 0.6-16.2 | 8.9 |
Ryu et al., 2012 [17] | 49 | 3 | 6.1 | 2.1-16.5 | 10.1 |
Tamori et al., 2011 [18] | 44 | 0 | 0.0 | 0.0-7.1 | 9.8 |
Urata et al., 2011 [19] | 52 | 5 | 9.6 | 4.2-20.6 | 10.3 |
Vassilopoulos et al., 2010 [20] | 33 | 1 | 3.0 | 0.5-15.3 | 9.0 |
Pooled estimate |
|
| 4.2 | 1.4 -8.2 | 100.0 |
Heterogeneity chi-squared = 35.55 (d.f. = 9) [figure omitted; refer to PDF] = 0.000.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 74.7%.
(b)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
Patients with overt chronic HBV infection |
|
|
|
|
|
Lan et al., 2011 [15] | 18 | 5 | 27.8 | 12.5-50.9 | 45.5 |
Ryu et al., 2012 [17] | 49 | 3 | 6.1 | 2.1-16.5 | 54.5 |
Pooled estimate |
|
| 15.4 | 1.2-41.2 | 100.0 |
Heterogeneity chi-squared = 4.98 (d.f. = 1) [figure omitted; refer to PDF] = 0.026.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 79.9%.
(c)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
Patients with occult HBV infection |
|
|
|
|
|
Caporali et al., 2010 [11] | 67 | 0 | 0.0 | 0.0-5.4 | 12.3 |
Cassano et al., 2011 [12] | 62 | 0 | 0.0 | 0.0-5.8 | 12.1 |
Charpin et al., 2009 [13] | 21 | 0 | 0.0 | 0.0-15.5 | 8.9 |
Kim et al., 2010 [14] | 88 | 14 | 15.9 | 9.7-24.9 | 12.8 |
Lan et al., 2011 [15] | 70 | 1 | 1.4 | 0.2-7.7 | 12.4 |
Mori, 2011 [16] | 31 | 1 | 3.2 | 0.6-16.2 | 10.2 |
Tamori et al., 2011 [18] | 42 | 0 | 0.0 | 0.0-8.4 | 11.3 |
Urata et al., 2011 [19] | 52 | 5 | 9.6 | 5.4-23.0 | 11.7 |
Vassilopoulos et al., 2010 [20] | 19 | 0 | 0.0 | 0.0-16.8 | 8.6 |
Pooled estimate |
|
| 3.0 | 0.6 -7.2 | 100.0 |
Heterogeneity chi-squared = 34.94 (d.f. = 8) [figure omitted; refer to PDF] = 0.000.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 77.1%.
By restricting the meta-analysis to patients with rheumatoid arthritis the pooled prevalence of HBV reactivation was 3.3% (95% CI: 0.7-7.5%, [figure omitted; refer to PDF] : 62.6%), with significant heterogeneity among studies (Table 3). When these results were stratified according to occult or overt infection, results show that the HBV reactivation for patients with occult infection was 2.6% (95% CI: 0.4-6.6%, [figure omitted; refer to PDF] : 59.2%), compared with 10.7% (95% CI: 1.4-50.2%, [figure omitted; refer to PDF] : 88.8%) among patients with overt chronic infection (Table 3).
Table 3: Meta-analysis on HBV reactivation among patients with rheumatoid arthritis treated with biologic agents.
(a)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
All patients |
|
|
|
|
|
Caporali et al., 2010 [11] | 59 | 0 | 0.0 | 0.0-6.1 | 18.4 |
Lan et al., 2011 [15] | 88 | 6 | 6.8 | 3.2-14.1 | 20.6 |
Mori, 2011 [16] | 32 | 1 | 3.1 | 0.5-15.7 | 14.5 |
Ryu et al., 2012 [17] | 22 | 0 | 0.0 | 0.0-14.9 | 12.1 |
Tamori et al., 2011 [18] | 44 | 0 | 0.0 | 0.0-8.0 | 16.6 |
Urata et al., 2011 [19] | 52 | 5 | 9.6 | 4.2-20.6 | 17.7 |
Pooled estimate |
|
| 3.3 | 0.7 -7.5 | 100.0 |
Heterogeneity chi-squared = 13.37 (d.f. = 5) [figure omitted; refer to PDF] = 0.020.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 62.6%.
(b)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
Patients with overt chronic HBV infection |
|
|
|
|
|
Lan et al., 2011 [15] | 18 | 5 | 27.8 | 12.5-50.9 | 49.5 |
Ryu et al., 2012 [17] | 22 | 0 | 0.0 | 0.0-14.9 | 50.5 |
Pooled estimate |
|
| 10.7 | 1.4 -50.2 | 100.0 |
Heterogeneity chi-squared = 8.91 (d.f. = 1) [figure omitted; refer to PDF] = 0.003.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 88.8%.
(c)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
Patients with occult HBV infection |
|
|
|
|
|
Caporali et al., 2010 [11] | 59 | 0 | 0.0 | 0.0-6.1 | 21.5 |
Lan et al., 2011 [15] | 70 | 1 | 1.4 | 0.2-7.7 | 22.8 |
Mori, 2011 [16] | 31 | 1 | 3.2 | 0.6-16.2 | 16.3 |
Tamori et al., 2011 [18] | 42 | 0 | 0.0 | 0.0-8.4 | 18.8 |
Urata et al., 2011 [19] | 52 | 5 | 9.6 | 4.2-20.6 | 20.5 |
Pooled estimate |
|
| 2.6 | 0.4-6.6 | 100.0 |
Heterogeneity chi-squared = 9.80 (d.f. = 4) [figure omitted; refer to PDF] = 0.044.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 59.2%.
We also addressed the prevalence of HBV reactivation in relation to the anti-TNF agent used. The pooled prevalence of HBV reactivation among patients treated with etanercept was 3.9% (95% CI: 1.1-8.4%, [figure omitted; refer to PDF] : 51.1%) and 3.0% (95% CI: 0.5-7.6%, [figure omitted; refer to PDF] : 49.6%) for those with occult HBV infection (Table 4). Patients treated with adalimumab showed a pooled prevalence of HBV reactivation of 4.6% (95% CI: 0.5-12.5%, [figure omitted; refer to PDF] : 28.7%) (Table 5). No case of HBV reactivation was recorded in studies eligible for meta-analysis among 81 patients treated with infliximab (80 occult carriers and 1 overt). Only one patient was treated with rituximab in studies eligible for meta-analysis.
Table 4: Meta-analysis on HBV reactivation among patients treated with etanercept.
(a)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
All patients |
|
|
|
|
|
Caporali et al., 2010 [11] | 23 | 0 | 0.0 | 0.0-14.3 | 12.4 |
Cassano et al., 2011 [12] | 44 | 0 | 0.0 | 0.0-8.0 | 16.9 |
Lan et al., 2011 [15] | 40 | 3 | 7.5 | 2.6-19.9 | 16.2 |
Mori, 2011 [16] | 19 | 0 | 0.0 | 0.0-16.8 | 11.2 |
Ryu et al., 2012 [17] | 38 | 2 | 5.3 | 1.5-17.3 | 15.9 |
Tamori et al., 2011 [18] | 20 | 0 | 0.0 | 0.0-16.1 | 11.5 |
Urata et al., 2011 [19] | 38 | 5 | 13.2 | 5.7-27.3 | 15.9 |
Pooled estimate |
|
| 3.9 | 1.1 -8.4 | 100.0 |
Heterogeneity chi-squared = 12.26 (d.f. = 6) [figure omitted; refer to PDF] = 0.056.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 51.1%.
(b)
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
Patients with occult HBV infection |
|
|
|
|
|
Caporali et al., 2010 [11] | 23 | 0 | 0.0 | 0.0-14.3 | 15.3 |
Cassano et al., 2011 [12] | 44 | 0 | 0.0 | 0.0-8.0 | 20.6 |
Lan et al., 2011 [15] | 31 | 1 | 3.2 | 0.6-16.2 | 17.7 |
Mori, 2011 [16] | 18 | 0 | 0.0 | 0.0-17.6 | 13.3 |
Tamori et al., 2011 [18] | 19 | 0 | 0.0 | 0.0-16.8 | 13.7 |
Urata et al., 2011 [19] | 38 | 5 | 13.2 | 5.7-27.3 | 19.4 |
Pooled estimate |
|
| 3.0 | 0.5-7.6 | 100.0 |
Heterogeneity chi-squared = 9.93 (d.f. = 5) [figure omitted; refer to PDF] = 0.077.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 49.6%.
Table 5: Meta-analysis on HBV reactivation among patients treated with adalimumab.
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
All patients |
|
|
|
|
|
Caporali et al., 2010 [11] | 19 | 0 | 0.0 | 0.0-16.8 | 35.0 |
Cassano et al., 2011 [12] | 48 | 3 | 0.0 | 2.2-16.8 | 65.0 |
Pooled estimate |
|
| 4.6 | 0.5-12.5 | 100.0 |
Heterogeneity chi-squared = 1.40 (d.f. = 1) [figure omitted; refer to PDF] = 0.236.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 28.7%.
Finally we pooled data on HBV reactivation rate in relation to usage of antiviral prophylaxis. Pooled HBV reactivation rate was 4.0% (95% CI: 1.2-8.3%, [figure omitted; refer to PDF] : 75.6%) for patients without any antiviral prophylaxis (Table 6). Analysis on patients submitted to antiviral prophylaxis as well as stratification on occult and overt carriers was not possible because small numbers of cases were included.
Table 6: Meta-analysis on HBV reactivation among patients with no antiviral prophylaxis.
First author, year | Number of patients | HBV reactivation ( [figure omitted; refer to PDF] ) | HBV reactivation (%) | CI 95% | Weight (%) |
All patients |
|
|
|
|
|
Caporali et al., 2010 [11] | 67 | 0 | 0.0 | 0.0-5.4 | 11.2 |
Cassano et al., 2011 [12] | 62 | 0 | 0.0 | 0.0-5.8 | 11.0 |
Charpin et al., 2009 [13] | 21 | 0 | 0.0 | 0.0-15.5 | 8.0 |
Kim et al., 2010 [14] | 88 | 14 | 15.9 | 9.7-24.9 | 11.7 |
Lan et al., 2011 [15] | 78 | 6 | 7.7 | 3.6-15.8 | 11.5 |
Mori, 2011 [16] | 32 | 1 | 3.1 | 0.5-15.7 | 9.3 |
Ryu et al., 2012 [17] | 29 | 2 | 6.9 | 1.9-22.0 | 9.0 |
Tamori et al., 2011 [18] | 42 | 0 | 0.0 | 0.0-8.4 | 10.1 |
Urata et al., 2011 [19] | 52 | 5 | 9.6 | 4.2-20.6 | 7.7 |
Vassilopoulos et al., 2010 [20] | 19 | 0 | 0.0 | 0.0-16.8 | 10.6 |
Pooled estimate |
|
| 4.0 | 1.2 -8.3 | 100.0 |
Heterogeneity chi-squared = 36.92 (d.f. = 9) [figure omitted; refer to PDF] = 0.000.
[figure omitted; refer to PDF] -squared (variation in ES attributable to heterogeneity) = 75.6%.
4. Discussion
Based on meta-analysis we conducted, we report relatively low pooled prevalence of HBV reactivation in patients treated with anti-TNF-α agents for rheumatic and dermatological conditions. The pooled reactivation rate for all patients included, as well as for those with RA, was several times higher in chronic overt HBV carriers compared to occult carriers. The pooled reactivations rates for those treated with etanercept and adalimumab were similar and also similar to overall pooled reactivation rate. The pooled reactivation rate for patients with no antiviral prophylaxis did not differ from overall pooled reactivation rate.
Several studies addressed the issue whether anti-TNF-α agent induced HBV reactivation, with inconsistent results [10]. We report considerably low overall pooled HBV reactivation rate of 4.2% compared to some authors before, who included both overt and occult patients with reported reactivation rate up to 6.8% [15]. Having this in mind, it could be said that some of previous studies overestimated the risk of HBV reactivation in patients treated for rheumatic and dermatological conditions. This is especially true for the patients with occult infection as Kim et al. [14] and Urata et al. [19] previously reported HBV reactivation rate among occult carriers of 15.6% and 9.6%, respectively, while pooled rate for occult carriers from our analysis is only 3.0%. However, when interpreting these results, substantial heterogeneity among the studies should be taken into account. For example, study by Kim et al. [14] used a 2-fold or greater increase in liver function test as the criteria for reactivation, while most of the others tried to detect HBV DNA. Furthermore regional differences in HBV infection prevalence could also influence the observed reactivation rates because of small samples size. It is possible that presence of certain comorbidities, such as diabetes mellitus or obesity, or some other clinical parameters mediate the risk for HBV reactivation. However no study reported these data so we hope that studies to come will be more informative.
We observed a higher prevalence of HBV reactivation among patients with chronic infection compared to those with the occult one. This is reasonable and expected, as patients positive with anti Hbc antibodies and negative with HBsAg do not necessary harbor undetected intracellular HBV replication. However, the high pooled reactivation rate among overt carriers should be having implication on clinical guidelines, as we consider patients with detectable HBsAg to be eligible for antiviral prophylaxis in order to prevent anti-TNF-α induced HBV reactivation. Unfortunately, we were not able to confirm this in our meta-analysis as numbers of patients included were too few to distinguish between the overt carriers subjected and not subjected to antiviral prophylaxis. Instead we were able to calculate only the pooled reactivation rate for all patients nontaking antiviral prophylaxis, irrespective to their HBV infection status. This rate did not differ significantly from the overall pooled one, but the vast majority of cases included were the occult carriers. The future studies including considerable numbers are needed in order to clearly define the criteria for antiviral prophylaxis in patients treated with anti-TNF-α agents at risk for HBV reactivation.
We also tried to estimate whether HBV reactivation rate is dependent on anti-TNF-α agents used, as well as on underlying condition. However it was possible only to conduct subanalysis on patients treated with etanercept and adalimumab, as on those treated for RA. As observed pooled reactivation rates did not show considerable difference among the subgroups; we did not find any of these to determine patients' susceptibility towards HBV reactivation. Still, if such an association exists it needs to be confirmed in studies to come.
Our meta-analysis has some limitations. We have included only patients treated with anti-TNF-α agents for rheumatic and dermatological conditions. This limits external validity of our findings, as anti-TNF-α agents are also used for treatment of other autoimmune conditions, such as inflammatory bowel diseases, and are part of chemotherapeutic protocols in treatment of B-cell lymphomas. However, with limiting the analysis on specific subgroup of patients we aimed to decrease heterogeneity and therefore make the results more reliable. Further, we believe that certain comorbidities, such as diabetes and obesity, could mediate a risk for HBV reactivation among patients treated with anti-TNF-α agents. Unfortunately none of the studies reported them, so we were not able to include them in the analysis. We were also unable to conduct subanalysis on patients treated with infliximab and rituximab and to distinguish the pooled reactivation rates among overt and occult carriers treated with antiviral prophylaxis. Finally, there is a question of heterogeneity among studies in relation to criteria defining HBV reactivation, which could lead to differences in interpretation of the collected data. Nevertheless, we find our results valuable to the clinicians encountering patients in risk for HBV reactivation being in need for anti-TNF-α agents in everyday practice.
In conclusion, although HBV reactivation rate appears to be relatively low in patients treated with anti-TNF-α agents for rheumatic and dermatological conditions, the antiviral prophylaxis is recommended in patients with overt chronic HBV infection. More informative studies including large number of cases are needed in order to identify if any patient or treatment related factor mediates the reactivation risk. The individual approach and close monitoring of each patient could be an answer in balancing the need for therapy with hazard associated with HBV reactivation.
Conflict of Interests
Authors do not have any conflict of interests to declare.
[1] S. Bernatsky, Y. Habel, E. Rahme, "Observational studies of infections in rheumatoid arthritis: a metaanalysis of tumor necrosis factor antagonists," Journal of Rheumatology , vol. 37, no. 5, pp. 928-931, 2010.
[2] J. B. Galloway, K. L. Hyrich, L. K. Mercer, W. G. Dixon, B. Fu, A. P. Ustianowski, K. D. Watson, M. Lunt, D. P. M. Symmons, "Anti-TNF therapy is associated with an increased risk of serious infections in patients with rheumatoid arthritis especially in the first 6 months of treatment: updated results from the British Society for Rheumatology Biologics Register with special emphasis on risks in the elderly," Rheumatology , vol. 50, no. 1, pp. 124-131, 2011.
[3] G. H. W. Wong, D. V. Goeddel, "Tumor necrosis factors α and β inhibit virus replication and synergize with interferons," Nature , vol. 323, no. 6091, pp. 819-822, 1986.
[4] J. Mestan, W. Digel, S. Mittnacht, H. Hillen, D. Blohm, A. Möller, H. Jacobsen, H. Kirchner, "Antiviral effects of recombinant tumour necrosis factor in vitro," Nature , vol. 323, no. 6091, pp. 816-819, 1986.
[5] D. Ganem, A. M. Prince, "Hepatitis B virus infection-natural history and clinical consequences," The New England Journal of Medicine , vol. 350, no. 11, pp. 1118-1129, 2004.
[6] L. G. Guidotti, K. Ando, M. V. Hobbs, T. Ishikawa, L. Runkel, R. D. Schreiberu, F. V. Chisari, "Cytotoxic T lymphocytes inhibit hepatitis B virus gene expression by a noncytolytic mechanism in transgenic mice," Proceedings of the National Academy of Sciences of the United States of America , vol. 91, no. 9, pp. 3764-3768, 1994.
[7] L. G. Guidotti, T. Ishikawa, M. V. Hobbs, B. Matzke, R. Schreiber, F. V. Chisari, "Intracellular inactivation of the hepatitis B virus by cytotoxic T lymphocytes," Immunity , vol. 4, no. 1, pp. 25-36, 1996.
[8] WHO, "Hepatitis B," http://www.who.int/mediacentre/factsheets/fs204/en/index.html Fact Sheet , no. 204, 2014.
[9] G. Raimondo, T. Pollicino, I. Cacciola, G. Squadrito, "Occult hepatitis B virus infection," Journal of Hepatology , vol. 46, no. 1, pp. 160-170, 2007.
[10] R. Perez-Alvarez, C. Diaz-Lagares, F. Garcia-Hernandez, L. Lopez-Roses, P. Brito-Zeron, M. Perez-De-Lis, S. Retamozo, A. Bove, X. Bosch, J. Sanchez-Tapias, X. Forns, M. Ramos-Casals, "Hepatitis B virus (HBV) reactivation in patients receiving tumor necrosis factor (TNF)-targeted therapy: analysis of 257 cases," Medicine , vol. 90, no. 6, pp. 359-371, 2011.
[11] R. Caporali, F. Bobbio-Pallavicini, F. Atzeni, G. Sakellariou, M. Caprioli, C. Montecucco, P. Sarzi-Puttini, "Safety of tumor necrosis factor α blockers in hepatitis B virus occult carriers (hepatitis B surface antigen negative/anti-hepatitis B core antigen positive) with rheumatic diseases," Arthritis Care and Research , vol. 62, no. 6, pp. 749-754, 2010.
[12] N. Cassano, V. Mastrandrea, M. Principi, F. Loconsole, N. De Tullio, A. Di Leo, G. A. Vena, "Anti-tumor necrosis factor treatment in occult hepatitis B virus infection: a retrospective analysis of 62 patients with psoriatic disease," Journal of Biological Regulators and Homeostatic Agents , vol. 25, no. 2, pp. 285-289, 2011.
[13] C. Charpin, S. Guis, P. Colson, P. Borentain, J. Mattei, P. Alcaraz, N. Balandraud, B. Thomachot, J. Roudier, R. Gerolami, "Safety of TNF-blocking agents in rheumatic patients with serology suggesting past hepatitis B state: results from a cohort of 21 patients," Arthritis Research and Therapy , vol. 11, no. 6, article R179, 2009.
[14] Y. J. Kim, S.-C. Bae, Y.-K. Sung, T.-H. Kim, J.-B. Jun, D.-H. Yoo, T. Y. Kim, J. H. Sohn, H.-S. Lee, "Possible reactivation of potential hepatitis B virus occult infection by tumor necrosis factor-α blocker in the treatment of rheumatic diseases," The Journal of Rheumatology , vol. 37, no. 2, pp. 346-350, 2010.
[15] J. Lan, Y. Chen, T. Hsieh, Y. Chen, C. Hsieh, D. Chen, S. Yang, "Kinetics of viral loads and risk of hepatitis B virus reactivation in hepatitis B core antibody-positive rheumatoid arthritis patients undergoing anti-tumour necrosis factor alpha therapy," Annals of the Rheumatic Diseases , vol. 70, no. 10, pp. 1719-1725, 2011.
[16] S. Mori, "Past hepatitis B virus infection in rheumatoid arthritis patients receiving biological and/or nonbiological disease-modifying antirheumatic drugs," Modern Rheumatology , vol. 21, no. 6, pp. 621-627, 2011.
[17] H. H. Ryu, E. Y. Lee, K. Shin, I. A. Choi, Y. J. Lee, B. Yoo, M. Park, Y. Park, S. Bae, W. H. Yoo, S. I. Kim, E. B. Lee, Y. W. Song, "Hepatitis B virus reactivation in rheumatoid arthritis and ankylosing spondylitis patients treated with anti-TNFα agents: a retrospective analysis of 49 cases," Clinical Rheumatology , vol. 31, no. 6, pp. 931-936, 2012.
[18] A. Tamori, T. Koike, H. Goto, S. Wakitani, M. Tada, H. Morikawa, M. Enomoto, M. Inaba, T. Nakatani, M. Hino, N. Kawada, "Prospective study of reactivation of hepatitis B virus in patients with rheumatoid arthritis who received immunosuppressive therapy: evaluation of both HBsAg-positive and HBsAg-negative cohorts," Journal of Gastroenterology , vol. 46, no. 4, pp. 556-564, 2011.
[19] Y. Urata, R. Uesato, D. Tanaka, K. Kowatari, T. Nitobe, Y. Nakamura, S. Motomura, "Prevalence of reactivation of hepatitis B virus replication in rheumatoid arthritis patients," Modern Rheumatology , vol. 21, no. 1, pp. 16-23, 2011.
[20] D. Vassilopoulos, A. Apostolopoulou, E. Hadziyannis, G. V. Papatheodoridis, S. Manolakopoulos, J. Koskinas, E. K. Manesis, A. I. Archimandritis, "Long-term safety of anti-TNF treatment in patients with rheumatic diseases and chronic or resolved hepatitis B virus infection," Annals of the Rheumatic Diseases , vol. 69, no. 7, pp. 1352-1355, 2010.
[21] A. Liberati, D. G. Altman, J. Tetzlaff, C. Mulrow, P. C. Gøtzsche, J. P. A. Ioannidis, M. Clarke, P. J. Devereaux, J. Kleijnen, D. Moher, "The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration," Italian Journal of Public Health , vol. 6, no. 4, pp. 354-391, 2009.
[22] A. Stuart, J. K. Ord, S. F. Arnold, A. O'Hagan, M. G. Kendall Kendall's Advanced Theory of Statistics , Edward Arnold, London, UK, 1994., 6th.
[23] R. DerSimonian, N. Laird, "Meta-analysis in clinical trials," Controlled Clinical Trials , vol. 7, no. 3, pp. 177-188, 1986.
[24] J. P. T. Higgins, S. G. Thompson, J. J. Deeks, D. G. Altman, "Measuring inconsistency in meta-analyses," British Medical Journal , vol. 327, no. 7414, pp. 557-560, 2003.
[25] J. P. T. Higgins, S. G. Thompson, D. J. Spiegelhalter, "A re-evaluation of random-effects meta-analysis," Journal of the Royal Statistical Society A: Statistics in Society , vol. 172, no. 1, pp. 137-159, 2009.
[26] C. H. Roux, O. Brocq, V. Breuil, C. Albert, L. Euller-Ziegler, "Safety of anti-TNF-α therapy in rheumatoid arthritis and spondylarthropathies with concurrent B or C chronic hepatitis," Rheumatology , vol. 45, no. 10, pp. 1294-1297, 2006.
[27] S. Zingarelli, P. Airò, M. Frassi, C. Bazzani, M. Scarsi, M. Puoti, "Prophylaxis and therapy of HBV infection in 20 patients treated with disease modifying antirheumatic drugs or with biological agents for rheumatic diseases," Reumatismo , vol. 60, no. 1, pp. 22-27, 2008.
[28] S. J. Chung, J. K. Kim, M. C. Park, Y. B. Park, Lee. S. K., "Reactivation of hepatitis B viral infection in inactive HBsAg carriers following anti-tumor necrosis factor-alpha therapy," Journal of Rheumatology , vol. 36, no. 11, pp. 2416-2420, 2009.
[29] C. Fotiadou, E. Lazaridou, D. Ioannides, "Safety of anti-tumour necrosis factor-α agents in psoriasis patients who were chronic hepatitis B carriers: a retrospective report of seven patients and brief review of the literature," Journal of the European Academy of Dermatology and Venereology , vol. 25, no. 4, pp. 471-474, 2011.
[30] F. Prignano, F. Ricceri, L. Pescitelli, F. Zanieri, T. Lotti, "Tumour necrosis factor-α antagonists in patients with concurrent psoriasis and hepatitis B or hepatitis C: a retrospective analysis of 17 patients," British Journal of Dermatology , vol. 164, no. 3, pp. 645-647, 2011.
[31] M. Kato, T. Atsumi, T. Kurita, T. Odani, Y. Fujieda, K. Otomo, T. Horita, S. Yasuda, T. Koike, "Hepatitis B virus reactivation by immunosuppressive therapy in patients with autoimmune diseases: risk analysis in hepatitis B surface antigen-negative cases," The Journal of Rheumatology , vol. 38, no. 10, pp. 2209-2214, 2011.
[32] Y.-T. Cho, C.-H. Chen, H.-Y. Chiu, T.-F. Tsai, "Use of anti-tumor necrosis factor-α therapy in hepatitis B virus carriers with psoriasis or psoriatic arthritis: a case series in Taiwan," Journal of Dermatology , vol. 39, no. 3, pp. 269-273, 2012.
[33] A. R. Giardina, D. Ferraro, F. Ciccia, A. Ferrante, R. Di Stefano, A. Craxì, G. Triolo, "No detection of occult HBV-DNA in patients with various rheumatic diseases treated with anti-TNF agents: a two-year prospective study," Clinical and Experimental Rheumatology , vol. 31, no. 1, pp. 25-30, 2013.
[34] R. Laurenti, F. Giovannangeli, E. Gubinelli, M. T. Viviano, A. Errico, L. Leoni, E. Ballanti, A. Migliore, "Long-term safety of anti-TNF adalimumab in HBc antibody-positive psoriatic arthritis patients: a retrospective case series of 8 patients," Clinical and Developmental Immunology , vol. 2013, 2013.
[35] R. Navarro, E. Vilarrasa, P. Herranz, L. Puig, X. Bordas, J. M. Carrascosa, R. Taberner, M. Ferran, M. Garcia-Bustinduy, A. Romero-Mate, R. Pedragosa, A. Garcia-Diez, E. Dauden, "Safety and effectiveness of ustekinumab and antitumour necrosis factor therapy in patients with psoriasis and chronic viral hepatitis B or C: a retrospective, multicentre study in a clinical setting," The British Journal of Dermatology , vol. 168, no. 3, pp. 609-616, 2013.
[36] T. Nishida, N. Hiramatsu, M. Mizuki, I. Nagatomo, H. Kida, K. Tazumi, S. Shinzaki, M. Miyazaki, T. Yakushijin, T. Tatsumi, H. Iijima, S. Kiso, T. Kanto, M. Tsujii, T. Takehara, "Managing hepatitis B virus carriers with systemic chemotherapy or biologic therapy in the outpatient clinic," Hepatology Research , vol. 43, no. 4, pp. 339-346, 2013.
[37] R. Stasi, A. Sarpatwari, J. B. Segal, J. Osborn, M. L. Evangelista, N. Cooper, D. Provan, A. Newland, S. Amadori, J. B. Bussel, "Effects of eradication of Helicobacter pylori infection in patients with immune thrombocytopenic purpura: a systematic review," Blood , vol. 113, no. 6, pp. 1231-1240, 2009.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Copyright © 2014 Fabrizio Cantini et al. Fabrizio Cantini et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
Introduction. Antitumor necrosis factor-alpha (TNF-α) agents are widely used for treatment of rheumatic and dermatological diseases. We conducted the systematic review and meta-analysis to assess the prevalence of HBV reactivation among patients treated with anti-TNF-α. Methods and Findings. A comprehensive literature search of MEDLINE, Scopus, and ISI Web of Knowledge databases was conducted. From 21 studies included in the systematic review, 9 included patients with occult chronic HBV infection and 6 included patients with overt infection while 6 addressed both groups. Based on 10 studies eligible for meta-analysis we report pooled estimate of HBV reactivation of 4.2% (95% CI: 1.4-8.2%, [superscript] I 2 [/superscript] : 74.7%). The pooled prevalence of reactivation was 3.0% (95% CI: 0.6-7.2, [superscript] I 2 [/superscript] : 77.1%) for patients with occult infection, and 15.4% (95% CI: 1.2-41.2%, [superscript] I 2 [/superscript] : 79.9%) for overt infection. The prevalence of reactivation was 3.9% (95% CI: 1.1-8.4%, [superscript] I 2 [/superscript] : 51.1%) for treatment with etanercept and 4.6% (95% CI: 0.5-12.5%, [superscript] I 2 [/superscript] : 28.7%) for adalimumab. For subgroup of patients without any antiviral prophylaxis the pooled reactivation was 4.0% (95% CI: 1.2-8.3%, [superscript] I 2 [/superscript] : 75.6%). Conclusion. Although HBV reactivation rate is relatively low in patients treated with anti-TNF-α for rheumatic and dermatological conditions, the antiviral prophylaxis would be recommended in patients with overt chronic HBV infection.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer





