Characterization of rubella-specific humoral immunity following two doses of MMR vaccine using proteome microarray technology

Abstract

Introduction//Background

The lack of standardization of the currently used commercial anti-rubella IgG antibody assays leads to frequent misinterpretation of results for samples with low/equivocal antibody concentration. The use of alternative approaches in rubella serology could add new information leading to a fuller understanding of rubella protective immunity and neutralizing antibody response after vaccination.

Methods

We applied microarray technology to measure antibodies to all rubella virus proteins in 75 high and 75 low rubella virus-specific antibody responders after two MMR vaccine doses. These data were used in multivariate penalized logistic regression modeling of rubella-specific neutralizing antibody response after vaccination.

Results

We measured antibodies to all rubella virus structural proteins (i.e., the glycoproteins E1 and E2 and the capsid C protein) and to the non-structural protein P150. Antibody levels to each of these proteins were: correlated with the neutralizing antibody titer (p<0.006); demonstrated differences between the high and the low antibody responder groups (p<0.008); and were components of the model associated with/predictive of vaccine-induced rubella virus-specific neutralizing antibody titers (misclassification error = 0.2).

Conclusion

Our study supports the use of this new technology, as well as the use of antibody profiles/patterns (rather than single antibody measures) as biomarkers of neutralizing antibody response and correlates of protective immunity in rubella virus serology.

About the Authors:

Iana H. Haralambieva

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Mayo Vaccine Research Group, Mayo Clinic and Foundation, Rochester, MN, United States of America

Michael J. Gibson

Roles Investigation, Methodology, Writing – original draft, Writing – review & editing

Affiliation: Mayo Vaccine Research Group, Mayo Clinic and Foundation, Rochester, MN, United States of America

Richard B. Kennedy

Roles Conceptualization, Investigation, Methodology, Project administration, Resources, Supervision, Writing – review & editing

Affiliation: Mayo Vaccine Research Group, Mayo Clinic and Foundation, Rochester, MN, United States of America

Inna G. Ovsyannikova

Roles Conceptualization, Project administration, Resources, Supervision, Writing – review & editing

Affiliation: Mayo Vaccine Research Group, Mayo Clinic and Foundation, Rochester, MN, United States of America

Nathaniel D. Warner

Roles Data curation, Formal analysis, Software, Visualization, Writing – review & editing

Affiliation: Division of Biomedical Statistics and Informatics- Department of Health Science Research, Mayo Clinic and Foundation, Rochester, MN, United States of America

Diane E. Grill

Roles Conceptualization, Data curation, Formal analysis, Methodology, Software, Writing – review & editing

Affiliation: Division of Biomedical Statistics and Informatics- Department of Health Science Research, Mayo Clinic and Foundation, Rochester, MN, United States of America

Gregory A. Poland

Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing – review & editing

* E-mail: [email protected]

Affiliation: Mayo Vaccine Research Group, Mayo Clinic and Foundation, Rochester, MN, United States of America

ORCID http://orcid.org/0000-0001-5057-4457

Introduction

While rubella virus commonly causes mild fever and rash during childhood, serious complications (i.e., miscarriage or birth defects of the fetus/baby, referred to as congenital rubella syndrome/CRS) can arise if infection develops in women during the first months of pregnancy. [1] Rubella virus is able to cross the placenta and replicate in fetal tissues, causing systemic inflammation and resulting in up to a 90% risk of developing CRS depending upon the timing of infection during the pregnancy. [1,2,3] The most common CRS complications include deafness, cataracts and blindness, congenital heart defects, endocrinopathies, microcephaly, encephalopathy, mental retardation, and death. [1,4]

Vaccination programs have drastically reduced the incidence of rubella infection and CRS; however, current estimates suggest that 100,000 cases of CRS still occur worldwide each year. [1] Although endemic rubella transmission has been eliminated in the US, 79 rubella cases and six CRS cases were reported in the US during the 2004–2012 period, primarily in unvaccinated individuals who were infected in other countries. [1,5] Combined with decreasing rates of immunization due to vaccine hesitancy, rubella will remain a public health concern as long as it continues to be endemic or circulate in any area of the world. This points to the necessity of timely and accurate diagnosis of new cases, vaccination of susceptible individuals, monitoring and deeper understanding of vaccine-induced immunity, and the development of newer vaccine candidates.

The rubella virus belongs to the Togaviridae family (genus Rubivirus) and is an enveloped, single-stranded RNA virus with a positive polarity genome confined within a capsid that is composed of capsid (C) protein. The genome encodes three structural (C, E1, and E2) and two non-structural proteins. The two surface glycoproteins, E1 and E2 are associated with virus neutralization and protective immunity, while the non-structural proteins (p90 and p150) are considered non-immunogenic. [6] The E1 protein, in particular, is considered to be the immunodominant and hemagglutation-eliciting antigen that predominantly contributes to protective immunity. [7,8,9,10,11,12] Assays such as whole- rubella virus, recombinant protein and synthetic peptide-based enzyme immunoassays (including immunoblot), hemagglutination inhibition assays, and neutralization assays (including a high-throughput immunocolorimetric-based neutralization assay) have been used in large studies for surveillance of rubella vaccine-induced immunity. [13,14,15,16,17,18,19,20] Recent papers and expert reviews from the literature point to the lack of standardization of the international rubella antibody standard and the currently used commercial anti-rubella IgG antibody (Ab) assays (leading to misinterpretation of results), and recommend improved and/or alternative approaches in rubella serology testing (including qualitative testing and/or testing without the use of the existing RUBI-1-94 international rubella Ab standard for calibration of assays). [1,6,21,22,23] Antigen profiling based on a high-throughput microarray technology offers an exciting new opportunity to interrogate the entire viral proteome and assess effective humoral immune responses to vaccination and/or infection. [24,25,26,27] This technology is well suited for dissecting humoral immunity and in-depth understanding of pathogen-specific immune response in systems biology and population genetics studies. [28,29] We have previously used this technology to profile humoral immune responses to the measles component of the MMR vaccine in a cohort of 150 individuals after two vaccine doses, and we have defined a model predictive of measles-specific neutralizing antibody response. [27] In this study, we used a newly developed rubella virus-specific protein microarray chip and probed IgG rubella-specific humoral immune responses in 75 high neutralizing Ab responders and 75 low neutralizing Ab responders (after two MMR vaccine doses) in order to develop rubella vaccine-specific humoral immune profiles (consisting of antibodies to individual rubella virus proteins) associated with neutralization Ab titers and potentially with protective immunity. The results of this study, in concert with previous results, can lead to an enhanced understanding of humoral immunity and immunogenicity of MMR vaccine. These results may also potentially lead to the development of a combined chip for assessment of humoral immunity after MMR vaccination.

Materials and methods

The methods described herein are similar or identical to those we have previously published.[20,27,30,31,32,33,34,35]

2.1. Study subjects

The study cohort has been described previously; in brief, the cohort was a large population-based sample consisting of three separate recruitment efforts totaling 1,174 healthy children and younger adults (age 11 to 22 years) from all socioeconomic strata in Olmsted county, MN. [31] Of these, 1,101 participants had written records of having received two doses of MMR II vaccine (Merck; each dose containing not less than 1,000 TCID50 of the Wistar RA 27/3-strain of rubella virus) and agreed to participate in the study. One-hundred-fifty study participants with available sample, representing the top and the bottom of the rubella-specific neutralizing Ab responses (75 high Ab responders with a median titer of 219.1 NT50, and 75 low responders with a median titer of 22.4 NT50), were selected from this cohort for microarray profiling of rubella-specific humoral immunity. The Mayo Clinic Institutional Review Board approved the study. Written informed consent was obtained from each adult subject, and from the parents of all children who participated in the study.

2.2. Rubella neutralization assay

We have previously described the modified version of the Centers for Disease Control and Prevention (CDC) immuno-colorimetric-based rubella virus-specific neutralization assay, which was optimized by our laboratory to a high-throughput micro-format and used in large population-based studies. [20,27,30,31,32,33,34,35] Each assay contained the following controls: virus-only control (no serum); uninfected control (no serum or virus); and two reference sera (CDC anti-rubella human serum reference preparation IS2153 and a seronegative serum RP-011 panel member 1 [Biomex GmbH; Heidelberg, Germany]). The neutralization titer was calculated as the highest dilution at which the input virus signal was reduced by at least 50% within the dilution series (NT50). The intra-class correlation coefficient (ICC) based on log-transformed estimates from repeated NT50 measurements was 0.89, which demonstrates a high degree of reproducibility.

2.3. Pathogen array

We used the proteome microarray chips (Antigen Discovery, Inc., Irvine, CA) developed by PCR amplification of cDNA for all rubella virus proteins, as previously described. [24,25,26,27] Briefly, the amplicons were inserted into pXi T7-based exvectors, expressed in coupled in-vitro transcription-translation (IVTT) reactions, and printed onto microarray slides as protein/polypeptide spots representing the individual rubella virus proteins/polypeptides. Serum samples were diluted 1:100 in Protein Array Blocking Buffer (Whatman, Inc.; Sanford, ME) supplemented with 10% DH5-α Escherichia coli lysate (Antigen Discovery, Inc.), incubated for 30 minutes, and probed on arrays overnight at 4°C. The next day, microarray slides were incubated in Fc-specific Biotin-SP-Conjugated Affini-Pure Goat Ant-Human IgG secondary Ab (Jackson ImmunoResearch, Inc.; West Grove, PA). Bound antibodies were detected by incubation with streptavidin-conjugated SureLight® P3 (Columbia Biosciences; Columbia, MD). The array slides were scanned using a GenePix® 4300 Microarray Scanner (Molecular Devices; San Diego, CA) and quantified using GenePix® Pro 7 Microarray Acquisition and Analysis Software (Molecular Devices; Sunnyvale, CA) with spot-specific background correction. Due to the gene (protein) length of P150 and P90, they were amplified in segments overlapping by 150 nucleotides and expressed on the chip as three spots of overlapping polypeptides/fragments for P150 (i.e., P150s1, P150s2, and P150s3), and three spots for P90 (i.e., P90s1, P90s2, and the whole P90). [36] The capsid C protein and Glycoproteins E1 and E2 were expressed on the chip as single spots. All samples were run in triplicate against nine proteins/polypeptides (i.e., the above six polypeptides/proteins plus E1, E2, and C rubella proteins), and the median values were calculated and normalized. Antibody reactivity to each rubella virus protein/polypeptide was considered positive when the intensity value was greater than the corresponding background intensity value (no DNA/no expressed protein control).

2.4. Rubella-specific secreted cytokines

Secreted cytokines were measured after rubella virus stimulation of PBMC cultures, as previously described. [30,34] Briefly, 2 x106/ml PBMCs were stimulated with the W-Therien strain of rubella virus (a gift from Dr. Teryl Frey, Georgia State University; Atlanta, GA) with optimized multiplicity of infection and incubation times (MOI of 5, 24h for IL-6 and MOI of 5, 48h for IFNγ). Secreted cytokines in supernatants were quantified using BD OptEIA™ Human ELISA kits. Absorbance levels were measured using a Molecular Devices SpectraMax 340PC.

2.5. Statistical analyses

As described previously, Normalization of the microarray reactivity was done by dividing the median antibody reactivity (signal intensity) for each protein by the median intensity of the ‘no DNA’(no expressed protein) controls. [27] Normalized results are presented on the log2 scale, and all analyses are done using the log2 of the normalized values. [27] Wilcoxon rank sum tests were used to test for statistically significant differences between the high and low Ab response groups in continuous variables, including rubella virus protein Ab measurements. Differences in sex and race in Ab response groups were tested with Pearson’s chi- square test. Spearman’s non-parametric correlation was used to assess the relationship between the protein Ab measurements and rubella-specific neutralizing antibody titers and secreted cytokines. A multivariate penalized logistic model was constructed using elastic-net regression. Specifically we used the “glmnet” package in the R-statistical software with α = 0.90, and the penalization parameter λ, selected at the minimum misclassification error after 10-fold cross validation.[37] Results are presented as standardized coefficients, and model efficiency is evaluated with the misclassification error and Brier’s score. [38]

Results and discussion

The proposed correlate of protective immunity for rubella is a rubella-specific Ab titer of 10–15 international units per milliliter (IU/mL), corresponding to a neutralization Ab titer of 1:8. [39,40,41] The measurement of rubella-specific antibodies in clinical settings is generally performed using quantitative commercial immunoassays (including automated analytical systems based on immunofluorescence, electrochemiluminiscence, chemiluminiscence, etc.), which report the results in IU/mL using the currently available WHO international reference rubella standard. The lack of appropriate calibration of the international standard and standardization of the commercial IgG rubella virus-specific assays leads to inconsistencies in reporting (i.e. rubella-immune vs. rubella non-immune), particularly for samples with Ab concentration on the lower end of the spectrum. [1,6,21,22,23] Immunoblot and neutralization assays are regularly used as valuable reference assays for assessment of functional rubella humoral immunity and confirmation of equivocal and/or negative results. [21,22] We have previously used a high-throughput colorimetric neutralization assay to measure rubella virus-specific neutralizing antibodies in more than 1,000 samples in a large population-based study. [20,31,32,33,34] To evaluate the ability of a new rubella virus-specific antigen microarray chip to measure antibodies to different rubella virus proteins relevant to neutralizing Ab response, we tested sera from subjects at the extremes of the rubella-specific neutralizing Ab titer in our population-based study (i.e., 75 high Ab responders [high Ab group] and 75 low responders [low Ab group] selected for the current study) following two doses of MMR-II vaccine (Merck), containing the Wistar RA 27/3-strain of rubella virus.

The demographic and clinical variables of the study subjects are summarized in Table 1. Statistically significant differences in vaccine history variables were found between the two vaccine responder groups: the low Ab responders received their second MMR dose earlier and had a longer time interval from second vaccination to enrollment (blood draw) than the high Ab responders (Table 1). In line with these findings, previous studies have demonstrated similar associations between rubella vaccine immune outcomes (including vaccine-induced Ab titer) and vaccine history variables. [42,43,44,45]

[Figure omitted. See PDF.]

Table 1. Demographic and clinical variables of the study cohort.

https://doi.org/10.1371/journal.pone.0188149.t001

The new microarray chip allowed the detection of antibodies to all rubella virus structural proteins (i.e., the glycoproteins E1 and E2 and the capsid C protein, see Table 2), although anti-E2 antibodies were detected in only 15.3% of the study subjects (in 28% of the subjects in the high Ab responder group and 2.67% of the subjects in the low Ab responder group). This is not unexpected given the reported dynamics of humoral immunity to this specific protein since anti-E2 antibodies appear later compared to anti-E1 antibodies, and may be absent several months-to-years post-vaccination/infection. [6,46,47] Antibodies to three proteins/polypeptides (i.e., P90, P90s2, and P150s3), for which positive normalized values were measured in < 10% of the tested individuals, were considered undetectable (by the microarray technology) and removed from further analysis (Table 2). The two non-structural rubella virus proteins P150 and P90 are expressed only in infected cells, are required for viral replication, and are generally considered non-immunogenic. [6] Nevertheless, our data indicate that a percentage of vaccine recipients do develop humoral responses targeting epitopes located in the nonstructural P150 protein (i.e., P150s1 and P150s2, but not the P150s3 portion, Table 2). The relevance of these antibodies as markers of rubella vaccine-induced immunity and/or disease is yet to be determined.

[Figure omitted. See PDF.]

Table 2. Characterization of the rubella-specific humoral immune response to different rubella virus proteins in the study cohort.

https://doi.org/10.1371/journal.pone.0188149.t002

As anticipated, statistically significant differences were observed between the signal intensity values for E1 (antibodies against E1 glycoprotein) of the sera of high Ab responders compared to low Ab responders (p-value = 3.22E-08), as well as for E2 (p-value = 9.45E-12) and C (p-value = 3.15E-08) proteins (Table 2). In addition, subjects in the high Ab responder group also had higher anti-P150s2 antibodies compared to subjects in the low Ab responder group (p = 0.008, Table 2). In concert with this, we observed weak to moderate correlations between Ab reactivity to the same four proteins (E1, E2, C and P150s2) and rubella-specific neutralizing Ab titers (Fig 1). When the analysis was restricted to the high Ab responder group only, the correlations were not significant (S1 Fig). Correlations with other rubella virus-specific immune outcomes (secreted IL-6 and IFNγ) were not found, with the exception of a weak correlation between anti-C Ab reactivity and IFNγ production (p = 0.01).

[Figure omitted. See PDF.]

Fig 1. Correlation between microarray Ab measurements and rubella virus-specific neutralizing Ab titers after two MMR vaccinations.

Panels A, B, C and D demonstrate the positive correlations (using Spearman’s correlation to test for significant relationships) between microarray Ab reactivities (on the y-axis, presented as log2 normalized signal intensity measures) against rubella virus E1, E2, C and P150s2 proteins, respectively, and neutralizing Ab response (presented as log2 value of the NT50 titer). “rs” indicates Spearman’s correlation coefficient.

https://doi.org/10.1371/journal.pone.0188149.g001

Antibodies to the structural proteins—specifically to the surface glycoproteins E1 and E2—are expected to be associated with neutralizing Ab response (as found in our study), since E1 and E2 contain the known neutralization epitopes/specificities. [48] Our study also demonstrates a previously unknown association between antibodies directed against non-structural rubella virus proteins (i.e., P150) and neutralizing Ab response. In concert with this finding, studies of other single-stranded positive polarity RNA viruses (West Nile, yellow fever, dengue, and tick-borne encephalitis viruses) have presented evidence for the protective role of antibodies to viral non-structural proteins in animal models, hence the assessment of humoral immunity to these proteins should be considered in systems biology, seroprevalence and/or other vaccine studies. [28,49,50,51,52]

We applied multivariate penalized logistic regression modeling of rubella-specific neutralizing Ab response to identify Ab profiles associated with neutralization. Our model (Fig 2) points to the positive predictive value of antibodies against all three structural rubella virus proteins (with the highest relative contribution of anti-E2 antibodies) to neutralizing Ab response after rubella vaccination. Ab reactivity to domains in the non-structural proteins (P150s1 and P90s1) was negatively associated with high rubella-specific neutralizing Ab titer. In contrast to the immunodominant E1 glycoprotein, antibodies to E2 have limited neutralizing activity and E2 lacks the ability to elicit antibodies that inhibit hemagglutination. [7,8,9,10,11,12] While antibodies to E1 are functional in virus neutralization by hampering virus attachment/cell entry and E1 conformational changes/trimerization during cell entry, the neutralization mechanism of anti-E2 antibodies remains largely unknown. [48] Glycoprotein E2 function warrants additional studies, but this protein is likely involved in conformational changes during virus entry and maturation, E1 activation, E1 trafficking, and virus membrane budding. [48] Of interest, antibodies directed to E2 are more prevalent in individuals with CRS compared to vaccinations and non-CRS rubella infections, [53,54] and thus can be used, in combination with other antibodies, as a potential marker of rubella virus-specific pathology (CRS). An important limitation of our study is the inability of the microarray technology to measure humoral immunity against conformational antigenic epitopes (dependent on post-translational modification), which is also true for most of the rubella IgG assays. [27] As many of the rubella virus neutralizing epitopes are conformational, this could explain, in part, the moderate to weak correlations we observed (between the neutralizing antibodies and the antibodies directed to the surface rubella virus glycoproteins E1 and E2), as well as the weaker relative contribution of anti-E1 antibodies to neutralizing Ab response (representing functional protective immunity) in our statistical model. Our results and statistical model need further validation in an independent study, which is underway. The strengths of our study include the use of a robust new high-throughput technology and statistical modeling, which allow identification of humoral immune response profiles relevant to rubella virus neutralization. In addition to reactivity to different proteins (and/or polypeptides or epitopes), this method permits the identification of immunoglobulin classes (isotypes) and subclasses, and conceivably, avidity testing, which is important for the comprehensive assessment of immune response to primary (including CRS) and secondary rubella virus infections and immune response to vaccination.

[Figure omitted. See PDF.]

Fig 2. Logistic regression modeling of rubella-specific neutralizing Ab response after vaccination.

Results from the elastic net logistic regression models for the association of the microarray Ab reactivities (to rubella virus proteins) with rubella virus-specific neutralizing Ab response. The modeling excluded antibodies to P90, P90s2 and P150s3, which were considered undetectable (had positive normalized values measured in < 10% of the tested subjects). The standardized logistic regression coefficients were as follows: 1.07 for anti-E2 Ab reactivity; 0.41 for anti-C Ab reactivity, 0.16 for anti-E1 Ab reactivity; -0.22 for anti-P150s1 Ab reactivity and -0.23 for anti-P90s1 Ab reactivity. The results are for the model with the misclassification error rate = 0.2, Brier Score = 0.15.

https://doi.org/10.1371/journal.pone.0188149.g002

In conclusion, the results of our study support the use of microarray technology and Ab profiles/patterns rather than single measures of humoral immunity to rubella virus protein/proteins (or whole virus) in rubella virus serology. The identified profiles can be used as useful biomarkers of rubella-specific neutralizing Ab response and protective immunity in systems biology, population genetics and/or other vaccine studies, while information on potential epitopes (Ab targets) can be applied in the rational design of new and/or improved rubella vaccines.

Supporting information

[Figure omitted. See PDF.]

S1 Fig. Correlation between microarray Ab measurements and rubella virus-specific neutralizing Ab titers (after vaccination) in the high antibody responder group.

https://doi.org/10.1371/journal.pone.0188149.s001

(TIF)

Acknowledgments

We thank the Mayo Clinic Vaccine Research Group staff and the study participants. We thank Caroline L. Vitse for her editorial assistance with the manuscript. This work was supported by the National Institute of Allergy And Infectious Diseases of the National Institutes of Health under Award Numbers R37AI048793-11 and R01AI033144. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Citation: Haralambieva IH, Gibson MJ, Kennedy RB, Ovsyannikova IG, Warner ND, Grill DE, et al. (2017) Characterization of rubella-specific humoral immunity following two doses of MMR vaccine using proteome microarray technology. PLoS ONE12(11): e0188149. https://doi.org/10.1371/journal.pone.0188149

References

1. Lambert N, Strebel P, Orenstein W, Icenogle J, Poland GA (2015) Rubella. Lancet 385: 2297–2307. pmid:25576992

2. Katow S (1998) Rubella virus genome diagnosis during pregnancy and mechanism of congenital rubella. Intervirology 41: 163–169. pmid:10213891

3. Katow S (2004) Molecular epidemiology of rubella virus in Asia: utility for reduction in the burden of diseases due to congenital rubella syndrome. PediatrInt 46: 207–213.

4. Plotkin S (2008) Rubella vaccine. Vaccines. 5 ed. Philadelphia: Saunders. pp. 471.

5. (2013) Three cases of congenital rubella syndrome in the postelimination era—Maryland, Alabama, and Illinois, 2012. MMWR Morbidity and mortality weekly report 62: 226–229.

6. Dimech W, Grangeot-Keros L, Vauloup-Fellous C (2016) Standardization of Assays That Detect Anti-Rubella Virus IgG Antibodies. Clinical Microbiology Reviews 29: 163–174. pmid:26607813

7. Frey TK (1994) Molecular biology of rubella virus. Advances in Virus Research 44: 69–160. pmid:7817880

8. Cordoba P, Lanoel A, Grutadauria S, Zapata M (2000) Evaluation of antibodies against a rubella virus neutralizing domain for determination of immune status. Clin Diagn Lab Immunol 7: 964–966. pmid:11063507

9. Mitchell LA, Zhang T, Ho M, Decarie D, Tingle AJ, Zrein M, et al. (1992) Characterization of rubella virus-specific antibody responses by using a new synthetic peptide-based enzyme-linked immunosorbent assay. Journal of Clinical Microbiology 30: 1841–1847. pmid:1629342

10. Mitchell LA, Ho MKL, Rogers JE, Tingle AJ, Marusyk RG, Weber JM, et al. (1996) Rubella reimmunization: Comparative analysis of the immunoglobulin G response to rubella virus vaccine in previously seronegative and seropositive individuals. Journal of Clinical Microbiology 34: 2210–2218. pmid:8862587

11. Zrein M, Joncas JH, Pedneault L, Robillard L, Dwyer RJ, LaCroix M (1993) Comparison of a whole-virus enzyme immunoassay (EIA) with a peptide-based EIA for detecting rubella virus immunoglobulin G antibodies following rubella vaccination. Journal of Clinical Microbiology 31: 1521–1524. pmid:8314994

12. Wilson KM, Di Camillo C, Doughty L, Dax EM (2006) Humoral immune response to primary rubella virus infection. ClinVaccine Immunol 13: 380–386.

13. Dimech W, Arachchi N, Cai J, Sahin T, Wilson K (2013) Investigation into low-level anti-rubella virus IgG results reported by commercial immunoassays. ClinVaccine Immunol 20: 255–261.

14. Dimech W, Bettoli A, Eckert D, Francis B, Hamblin J, Kerr T, et al. (1992) Multicenter evaluation of five commercial rubella virus immunoglobulin G kits which report in international units per milliliter. Journal of Clinical Microbiology 30: 633–641. pmid:1551980

15. Dimech W, Panagiotopoulos L, Francis B, Laven N, Marler J, Dickeson D, et al. (2008) Evaluation of eight anti-rubella virus immunoglobulin g immunoassays that report results in international units per milliliter. J Clin Microbiol 46: 1955–1960. pmid:18434559

16. Meegan JM, Evans BK, Horstmann DM (1982) Comparison of the latex agglutination test with the hemagglutination inhibition test, enzyme-linked immunosorbent assay, and neutralization test for detection of antibodies to rubella virus. Journal of Clinical Microbiology 16: 644–649. pmid:7153314

17. Truant AL, Barksdale BL, Huber TW, Elliott LB (1983) Comparison of an enzyme-linked immunosorbent assay with indirect hemagglutination and hemagglutination inhibition for determination of rubella virus antibody: evaluation of immune status with commercial reagents in a clinical laboratory. Journal of Clinical Microbiology 17: 106–108. pmid:6338030

18. Watson JC, Hadler SC, Dykewicz CA, Reef S, Phillips L (1998) Measles, mumps, and rubella—vaccine use and strategies for elimination of measles, rubella, and congenital rubella syndrome and control of mumps: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep 47: 1–57.

19. Tosh PK, Kennedy RB, Vierkant RA, Jacobson RM, Poland GA (2009) Correlation between rubella antibody levels and cytokine measures of cell-mediated immunity. Viral Immunol 22: 451–456. pmid:19951182

20. Lambert ND, Pankratz VS, Larrabee BR, Ogee-Nwankwo A, Chen MH, Icenogle JP, et al. (2014) High-throughput Assay Optimization and Statistical Interpolation of Rubella-Specific Neutralizing Antibody Titers. Clinical and Vaccine Immunology 21: 340–346. pmid:24391140

21. Huzly D, Hanselmann I, Neumann-Haefelin D, Panning M (2016) Performance of 14 rubella IgG immunoassays on samples with low positive or negative haemagglutination inhibition results. Journal of clinical virology: the official publication of the Pan American Society for Clinical Virology 74: 13–18.

22. Bouthry E, Furione M, Huzly D, Ogee-Nwankwo A, Hao L, Adebayo A, et al. (2016) Assessing Immunity to Rubella Virus: a Plea for Standardization of IgG (Immuno)assays. Journal of Clinical Microbiology 54: 1720–1725. pmid:27147722

23. Dimech W, Mulders MN (2016) A review of testing used in seroprevalence studies on measles and rubella. Vaccine 34: 4119–4122. pmid:27340096

24. Davies DH, Liang X, Hernandez JE, Randall A, Hirst S, Mu Y, et al. (2005) Profiling the humoral immune response to infection by using proteome microarrays: high-throughput vaccine and diagnostic antigen discovery. Proc NatlAcadSciUSA 102: 547–552.

25. Luevano M, Bernard HU, Barrera-Saldana HA, Trevino V, Garcia-Carranca A, Villa LL, et al. (2010) High-throughput profiling of the humoral immune responses against thirteen human papillomavirus types by proteome microarrays. Virology 405: 31–40. pmid:20554302

26. Kalantari-Dehaghi M, Chun S, Chentoufi AA, Pablo J, Liang L, Dasgupta G, et al. (2012) Discovery of potential diagnostic and vaccine antigens in herpes simplex virus 1 and 2 by proteome-wide antibody profiling. Journal of Virology 86: 4328–4339. pmid:22318154

27. Haralambieva IH, Simon WL, Kennedy RB, Ovsyannikova IG, Warner ND, Grill DE, et al. (2015) Profiling of Measles-Specific Humoral Immunity in Individuals Following Two Doses of MMR Vaccine Using Proteome Microarrays. Viruses 7: 1113–1133. pmid:25763865

28. Kennedy RB, Ovsyannikova IG, Lambert ND, Haralambieva IH, Poland GA (2014) The personal touch: strategies toward personalized vaccines and predicting immune responses to them. Expert Review of Vaccines 13: 657–669. pmid:24702429

29. Pankratz VS, Vierkant RA, O'Byrne MM, Ovsyannikova IG, Poland GA (2010) Associations between SNPs in candidate immune-relevant genes and rubella antibody levels: a multigenic assessment. BMC Immunol 11: 48. pmid:20923569

30. Haralambieva IH, Salk HM, Lambert ND, Ovsyannikova IG, Kennedy RB, Warner ND, et al. (2014) Associations between race, sex and immune response variations to rubella vaccination in two independent cohorts. Vaccine 32: 1946–1953. pmid:24530932

31. Lambert ND, Haralambieva IH, Kennedy RB, Ovsyannikova IG, Pankrantz VS, Poland GA (2015) Polymorphisms in HLA-DPB1 are associated with differences in rubella-specific humoral immunity after vaccination. Journal of Infectious Diseases 211: 898–905. pmid:25293367

32. Kennedy RB, Ovsyannikova IG, Haralambieva IH, Lambert ND, Pankratz VS, Poland GA (2014) Genetic polymorphisms associated with rubella virus-specific cellular immunity following MMR vaccination. Human Genetics 133: 1407–1417. pmid:25098560

33. Haralambieva IH, Lambert ND, Ovsyannikova IG, Kennedy RB, Larrabee BR, Pankrantz VS, et al. (2014) Associations between single nucleotide polymorphisms in cellular viral receptors and attachment factor-related genes and humoral immunity to rubella vaccination. PLos ONE 9: e99997. pmid:24945853

34. Kennedy RB, Ovsyannikova IG, Haralambieva IH, Lambert ND, Pankratz VS, Poland GA (2014) Genome-wide SNP associations with rubella-specific cytokine responses in measles-mumps-rubella vaccine recipients. Immunogenetics 66: 493–499. pmid:24811271

35. Lambert ND, Haralambieva IH, Ovsyannikova IG, Larrabee BR, Pankratz VS, Poland GA (2013) Characterization of humoral and cellular immunity to rubella vaccine in four distinct cohorts. Immunologic Research 58: 1–8.

36. Doolan DL, Mu Y, Unal B, Sundaresh S, Hirst S, Valdez C, et al. (2008) Profiling humoral immune responses to P. falciparum infection with protein microarrays. Proteomics 8: 4680–4694. pmid:18937256

37. Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society Series B 67, part 2: 301–320.

38. Brier GW (1950) Verification of forecasts expressed in terms of probability. Monthly Weather Review 78: 1–3.

39. Plotkin SA (2010) Correlates of protection induced by vaccination. ClinVaccine Immunol 17: 1055–1065.

40. Skendzel LP (1996) Rubella immunity. Defining the level of protective antibody. Am J Clin Pathol 106: 170–174. pmid:8712168

41. Matter L, Kogelschatz K, Germann D (1997) Serum levels of rubella virus antibodies indicating immunity: response to vaccination of subjects with low or undetectable antibody concentrations. Journal of Infectious Diseases 175: 749–755. pmid:9086126

42. LeBaron CW, Forghani B, Matter L, Reef SE, Beck C, Bi D, et al. (2009) Persistence of rubella antibodies after 2 doses of measles-mumps-rubella vaccine. J Infect Dis 200: 888–899. pmid:19659440

43. Ovsyannikova IG, Haralambieva IH, Dhiman N, O'Byrne MM, Pankratz VS, Jacobson RM, et al. (2010) Polymorphisms in the vitamin A receptor and innate immunity genes influence the antibody response to rubella vaccination. J Infect Dis 201: 207–213. pmid:20001730

44. Dhiman N, Haralambieva IH, Vierkant RA, Pankratz VS, Ryan E, Jacobson RM, et al. (2010) Predominant inflammatory cytokine secretion pattern in response to two doses of live rubella vaccine in health vaccinees. Cytokine 50: 24–29. pmid:20117947

45. Lin CC, Yang CY, Shih YL, Huang YY, Yang TH, Liang JY, et al. (2012) Persistence and titer changes of rubella virus antibodies in primiparous women who had been vaccinated with strain RA 27/3 in junior high school. Clinical and vaccine immunology: CVI 19: 1–4. pmid:22072722

46. Cusi MG, Rossolini GM, Cellesi C, Valensin PE (1988) Antibody response to wild rubella virus structural proteins following immunization with RA 27/3 live attenuated vaccine. Archives of Virology 101: 25–33. pmid:3046563

47. Cusi MG, Metelli R, Valensin PE (1989) Immune responses to wild and vaccine rubella viruses after rubella vaccination. Archives of Virology 106: 63–72. pmid:2764728

48. Petrova EK, Dmitrieva AA, Trifonova EA, Nikitin NA, Karpova OV (2016) The key role of rubella virus glycoproteins in the formation of immune response, and perspectives on their use in the development of new recombinant vaccines. Vaccine 34: 1006–1011. pmid:26776468

49. Chung KM, Nybakken GE, Thompson BS, Engle MJ, Marri A, Fremont DH, et al. (2006) Antibodies against West Nile Virus nonstructural protein NS1 prevent lethal infection through Fc gamma receptor-dependent and -independent mechanisms. Journal of Virology 80: 1340–1351. pmid:16415011

50. Schlesinger JJ, Brandriss MW, Walsh EE (1985) Protection against 17D yellow fever encephalitis in mice by passive transfer of monoclonal antibodies to the nonstructural glycoprotein gp48 and by active immunization with gp48. Journal of Immunology 135: 2805–2809.

51. Schlesinger JJ, Foltzer M, Chapman S (1993) The Fc portion of antibody to yellow fever virus NS1 is a determinant of protection against YF encephalitis in mice. Virology 192: 132–141. pmid:8517015

52. Kreil TR, Maier E, Fraiss S, Eibl MM (1998) Neutralizing antibodies protect against lethal flavivirus challenge but allow for the development of active humoral immunity to a nonstructural virus protein. Journal of Virology 72: 3076–3081. pmid:9525632

53. Hyde TB, Sato HK, Hao L, Flannery B, Zheng Q, Wannemuehler K, et al. (2015) Identification of Serologic Markers for School-Aged Children With Congenital Rubella Syndrome. The Journal of Infectious Diseases 212: 57–66. pmid:25362195

54. Mauracher CA, Mitchell LA, Tingle AJ (1993) Selective tolerance to the E1 protein of rubella virus in congenital rubella syndrome. Journal of Immunology 151: 2041–2049.