Safety and immunogenicity of investigational seasonal influenza hemagglutinin DNA vaccine followed by trivalent inactivated vaccine administered intradermally or intramuscularly in healthy adults: An open-label randomized phase 1 clinical trial

Abstract

Background

Seasonal influenza results in significant morbidity and mortality worldwide, but the currently licensed inactivated vaccines generally have low vaccine efficacies and could be improved. In this phase 1 clinical trial, we compared seasonal influenza vaccine regimens with different priming strategies, prime-boost intervals, and administration routes to determine the impact of these variables on the resulting antibody response.

Methods

Between August 17, 2012 and January 25, 2013, four sites enrolled healthy adults 18–70 years of age. Subjects were randomized to receive one of the following vaccination regimens: trivalent hemagglutinin (HA) DNA prime followed by trivalent inactivated influenza vaccine (IIV3) boost with a 3.5 month interval (DNA-IIV3), IIV3 prime followed by IIV3 boost with a 10 month interval (IIV3-IIV3), or concurrent DNA and IIV3 prime followed by IIV3 boost with a 10 month interval (DNA/IIV3-IIV3). Each regimen was additionally stratified by an IIV3 administration route of either intramuscular (IM) or intradermal (ID). DNA vaccines were administered by a needle-free jet injector (Biojector). Study objectives included evaluating the safety and tolerability of each regimen and measuring the antibody response by hemagglutination inhibition (HAI).

Results

Three hundred and sixteen subjects enrolled. Local reactogenicity was mild to moderate in severity, with higher frequencies recorded following DNA vaccine administered by Biojector compared to IIV3 by either route (p <0.02 for pain, swelling, and redness) and following IIV3 by ID route compared to IM route (p <0.001 for swelling and redness). Systemic reactogenicity was similar between regimens. Though no overall differences were observed between regimens, the highest titers post boost were observed in the DNA-IIV3 group by ID route and in the IIV3-IIV3 group by IM route.

Conclusions

All vaccination regimens were found to be safe and tolerable. While there were no overall differences between regimens, the DNA-IIV3 group by ID route, and the IIV3-IIV3 group by IM route, showed higher responses compared to the other same-route regimens.

About the Authors:

Cristina Carter

Contributed equally to this work with: Cristina Carter, Katherine V. Houser

Roles Formal analysis, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Katherine V. Houser

Contributed equally to this work with: Cristina Carter, Katherine V. Houser

Roles Formal analysis, Visualization, Writing – original draft, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

ORCID logo http://orcid.org/0000-0002-2147-186X

Galina V. Yamshchikov

Roles Conceptualization, Data curation, Project administration, Validation, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Abbie R. Bellamy

Roles Data curation, Formal analysis, Validation, Writing – review & editing

Affiliation: The Emmes Corporation, Rockville, MD, United States of America

Jeanine May

Roles Data curation, Formal analysis, Validation, Writing – review & editing

Affiliation: The Emmes Corporation, Rockville, MD, United States of America

Mary E. Enama

Roles Conceptualization, Formal analysis, Project administration, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Uzma Sarwar

Roles Data curation, Project administration, Supervision, Validation, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Brenda Larkin

Roles Conceptualization, Funding acquisition, Resources, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Robert T. Bailer

Roles Data curation, Formal analysis, Investigation, Methodology, Validation, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Richard Koup

Roles Conceptualization, Resources, Supervision, Validation, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Grace L. Chen

Roles Project administration, Supervision, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Shital M. Patel

Roles Data curation, Investigation, Project administration, Supervision, Writing – review & editing

Affiliation: Departments of Medicine and Molecular Virology and Microbiology, Baylor College of Medicine, Houston, TX, United States of America

Patricia Winokur

Roles Data curation, Investigation, Project administration, Supervision, Writing – review & editing

Affiliation: Department of Internal Medicine, Carver College of Medicine, University of Iowa, Iowa City, IA, United States of America

Robert Belshe

Roles Data curation, Investigation, Project administration, Supervision, Writing – review & editing

Affiliation: Division of Infectious Diseases, Allergy and Immunology, Saint Louis University, St. Louis, MO, United States of America

Cornelia L. Dekker

Roles Data curation, Investigation, Project administration, Supervision, Writing – review & editing

Affiliation: Department of Pediatrics (Infectious Diseases), Stanford University Medical Center, Stanford, CA, United States of America

Barney S. Graham

Roles Conceptualization, Funding acquisition, Resources, Validation, Writing – review & editing

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

Julie E. Ledgerwood

Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

* E-mail: [email protected]

Affiliation: Vaccine Research Center, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America

ORCID logo http://orcid.org/0000-0002-2047-6052

the VRC 703 study team

¶Membership of the VRC 703 study team can be found in the Acknowledgments.

Introduction

In the United States, seasonal influenza results in significant disease burden, with estimated ranges of 114,018–633,001 hospitalizations and 4,866–27,810 deaths each year [1]. Vulnerable populations, including older adults, are more susceptible to experiencing severe complications following influenza infection [1–3]. A recent survey spanning three consecutive influenza seasons found that between 54–70% of hospitalizations and 71–85% of deaths occur among adults above 65 years of age [1]. Even in young healthy adults where infection severity is typically milder, illness still results in substantial economic impact through absence from work and healthcare visits [4].

Vaccination is currently the most effective way to protect the population and lessen influenza disease burden. Licensed seasonal influenza vaccines include inactivated, live attenuated, and recombinant vaccines [5, 6]. The trivalent (IIV3) and quadrivalent (IIV4) inactivated influenza vaccines are updated annually to include hemagglutinin (HA) proteins from two circulating influenza A strains (H1N1 and H3N2) and one or two influenza B strains [5, 7, 8]. Inactivated vaccines can be administered by either the intramuscular (IM) route for individuals ≥6 months or by the intradermal (ID) route in adults 18–64 years old [5, 9]. While inactivated vaccines are the most widely administered, randomized controlled trials indicate inactivated vaccine efficacies typically range between only 62–75% for healthy adults, and just 43% for older adults [10–13]. Additional disadvantages to inactivated vaccines include a labor-intensive manufacturing process and, with the exception of recombinant and cell-based vaccines, most require embryonated eggs for production [14, 15].

DNA vaccines are an alternative vaccine platform that may improve immune responses and overcome the aforementioned disadvantages of inactivated influenza vaccines [16]. DNA vaccines consist of plasmids which can be easily modified through recombinant technology, and then rapidly developed and produced. While there are no licensed DNA vaccines to date, they do have an excellent safety profile, as demonstrated in multiple phase 1 clinical trials examining West Nile, SARS, influenza, and Zika [17–30]. Vaccination regimens consisting of a DNA prime followed by a heterologous inactivated boost have been previously explored as a strategy to improve immunogenicity for both seasonal and avian influenza subtypes. To date, such regimens have resulted in improved antibody responses for avian subtypes including H5 and H7 [17–20], but not for seasonal influenza subtypes [21, 22]. Timing of the prime-boost interval after a DNA prime has proven important for optimal antibody responses against novel antigens, including avian influenza subtypes. Antibody responses following DNA priming were higher after an inactivated boost with an interval of 3–6 months compared to an interval of only 1 month [19, 20]. However, the optimal prime-boost interval between a DNA prime and inactivated boost in seasonal influenza is unknown. Another question of interest for seasonal influenza is whether priming with a DNA and inactivated vaccine concurrently may result in an improved antibody response after an inactivated boost. Previously, a concurrent prime resulted in similar HAI titers to a DNA prime alone for an avian H7 subtype [17].

In this phase 1 clinical trial, we compared different priming strategies, prime-boost intervals, and routes of administration to determine whether these variables impacted the antibody response. Specifically, we evaluated whether priming with a DNA vaccine alone or concurrently with an inactivated vaccine would affect the antibody response following an inactivated boost in the same or subsequent influenza season. Additionally, we assessed the antibody response of the regimens in older adults to determine if a DNA prime would improve the vaccine response following an inactivated boost in this population.

Materials and methods

Ethics statement

This study was a phase 1 open-label randomized clinical trial in healthy adults (clinicaltrials.gov, NCT01676402) to compare vaccination schedules over the same or subsequent influenza season (Fig 1). The study enrolled subjects at four sites, and the institutional review board (IRB) at each site approved the trial protocol (Baylor College of Medicine IRB approved the trial on July 3, 2012, University of Iowa on July 17, 2012, Saint Louis University on July 11, 2012, and Stanford University Medical Center on August 24, 2012). Subjects for this study were recruited by each site in accordance with their site IRB standard for recruitment practices. Enrollment for the trial occurred between August 17, 2012 and January 25, 2013, and the last subject visit occurred on April 25, 2014. Each subject signed a written informed consent prior to study participation. The trial registration on clinicaltrials.gov occurred on August 30, 2012, adhering to 42 CFR Part 11 requirements by occurring within 21 days of enrolling the first subject. The trial followed guidelines for conducting clinical research with human subjects from the US Department of Health and Human Services and was performed in accordance with 45 CFR Part 46, US Food and Drug Administration regulations for investigational products, and principles expressed in the Declaration of Helsinki.

[Figure omitted. See PDF.]

Fig 1. CONSORT diagram for VRC 703 clinical trial.

Each group was stratified by age: younger adults (18–50 years) and older adults (51–70 years for IM or 51–64 for ID). All subjects who received at least one vaccination (n = 316) were analyzed for safety and reactogenicity. All subjects who completed the vaccination schedule (n = 299) were also analyzed for immunogenicity.

https://doi.org/10.1371/journal.pone.0222178.g001

Study design and participants

Subjects were randomized in this clinical trial into groups through a staggered enrollment plan. Groups 1 and 2 (same influenza season regimens) consisted of a 2012/13 trivalent HA DNA prime and 2012/13 IIV3 boost administered by either ID or IM route with an approximate interval of 3.5 months (DNA-IIV3 regimen) (Fig 1, Table 1). The 3.5 month interval was chosen based on results from previous phase 1 trials investigating DNA vaccines of avian influenza subtypes which indicated that an improved antibody response is achieved with a 3–6 months interval between DNA prime and inactivated boost [19, 20]. The trial was designed to allow for the prime-boost interval to be shortened in the DNA prime groups (groups 1 and 2 only) when there was a local outbreak of influenza in the community, so that subjects would be able to receive a licensed product while the trial was ongoing. The interval was shortened for 10 subjects at a single site (4 subjects in group 1 and 6 subjects in group 2), and these subjects were included with the remainder of their groups in the immunogenicity analysis. Groups 3 to 6 (subsequent influenza season regimens) consisted of a prime of either 2012/13 IIV3 alone administered by either ID or IM route (groups 3 and 4) or with a concurrent HA DNA vaccine in the opposite arm (groups 5 and 6). These subjects were then boosted with 2013/14 IIV3 using the same route of administration as the IIV3 prime, with an approximate interval of 10 months (IIV3-IIV3 and DNA/IIV3-IIV3 regimens, respectively). Each group was stratified by age: younger adults (18–50 years) and older adults (51–70 years for IM or 51–64 years for ID). The age ranges in the older adults are consistent with the FDA approval for the IIV3 products [9, 31]. Other inclusion criteria included a BMI less than 40 and no prior receipt of the 2012/13 seasonal influenza vaccine. A complete listing of eligibility criteria is provided in the study protocol in the supplementary materials (S1 and S2 Protocols).

[Figure omitted. See PDF.]

Table 1. Vaccine regimens and intervals of each group.

https://doi.org/10.1371/journal.pone.0222178.t001

Subjects self-reported local and systemic reactogenicity on a diary card for seven days after each vaccination, after receiving guidance on the grading of each symptom during the vaccination visit. All adverse events were recorded for 28 days following each vaccination. Serious adverse events (SAE) and influenza-like illnesses (ILI) were recorded for the entire duration of the trial.

Vaccines

The investigational 2012/13 trivalent seasonal HA DNA (VRC-FLUDNA063-00-VP) consisted of identical amounts by weight of three DNA plasmids designed to closely match the recommended HA sequences contained within the licensed seasonal 2012/13 IIV3: VRC-9328 (A/California/04/2009, [A(H1N1)pdm09]), VRC-3027 (A/Victoria/361/2011, H3N2), and VRC-2722 (B/Wisconsin/1/2010) (Table 2). The trivalent HA DNA vaccine was manufactured at the NIAID Vaccine Research Center Vaccine Pilot Plant using Good Manufacturing Practices and formulated at 4mg/mL in PBS. The authors confirm that all ongoing and related trials for this product are registered.

[Figure omitted. See PDF.]

Table 2. Influenza strains included in the vaccines.

https://doi.org/10.1371/journal.pone.0222178.t002

Fluzone (Sanofi Pasteur) was the licensed seasonal IIV3 used for IM (0.5mL, 45mg total HA) and ID (0.1mL, 27mg total HA) administration for both influenza seasons. The strains in the seasonal 2012/13 IIV3 included A/California/07/2009 [A(H1N1)pdm09], A/Victoria/361/2011-like virus (H3N2), and B/Wisconsin/1/2010-like: B/Texas/6/2011 (Table 2). The strains in the seasonal 2013/14 IIV3 included A/California/07/2009 [A(H1N1)pdm09], A/Texas/50/2012 (H3N2), and B/Massachusetts/2/2012 (Table 2).

All DNA vaccines were administered into the deltoid muscle using a needle-free jet injector, Biojector 2000 (Bioject; Tualatin, OR, USA). IIV3 was administered in the deltoid muscle either by ID route using a supplied short-needle microinjection system (groups 1, 3, and 5) or IM route using a needle and syringe (groups 2, 4, and 6).

Randomization and masking

The study followed a staggered enrollment plan, with the same influenza season regimens enrolling first. In this first part, subjects were randomized with equal allocation to groups 1 or 2. Randomization was then opened to the subsequent influenza season regimens with equal allocation to groups 3 to 6. The randomization was staggered so that all subjects could receive the seasonal 2012/13 IIV3 at approximately the same time, soon after it became available. Subjects 65–70 years of age were enrolled only into groups 2, 4, and 6 to ensure IIV3 administration by the IM route. The randomization sequence was generated by the trial statistician using permuted blocked randomization with randomly selected block sizes (2 or 4 in the first part, 4 or 8 in the second part), stratified by age and site. Upon enrollment, each subject’s randomized assignment was displayed in the electronic data entry system and vaccinations were administered open-label.

Immunogenicity assays

Blood samples were collected prior to each vaccination, 3 weeks after both the prime and boost vaccinations, and 6 months after the boost. Subject sera were tested for antibody response by hemagglutination inhibition (HAI). HAI assays were completed at Southern Research, Inc. (Birmingham, AL) using previously described validated methods [21]. Briefly, the HAI assays were performed in V-bottom 96-well plates with four HA units of virus and 0.5% turkey red blood cells.

Statistical analysis

The primary objectives of the study were (1) to assess the safety and tolerability of each vaccination schedule, including concurrent prime of DNA and IIV3 in different arms, and (2) to compare the antibody responses by HAI at 3 weeks after IIV3 administration between the DNA-IIV3 regimen and IIV3 alone. The primary outcomes of safety and tolerability were measured by a combination of solicited and unsolicited reactogenicity for 7 days following each vaccination, and the occurrence of adverse events, serious adverse events, and influenza-like illnesses for the duration of the trial. Solicited reactogenicity included pain/tenderness, swelling, redness, malaise, myalgia, headache, chills, nausea, and temperature. Secondary objectives included evaluating HAI antibody titers in all groups at 3 weeks after each study injection. We analyzed all outcomes on the basis of the intention-to-treat principle. All subjects who received at least one vaccination were analyzed for safety and reactogenicity. All subjects who completed the vaccination schedule were also analyzed for immunogenicity. This trial was designed as a descriptive study with a planned enrollment of 55 subjects per group. The study was not designed to test a formal null hypothesis for superiority or non-inferiority. With the planned sample size, the study was likely to detect event occurring with high frequency (>90% chance to observe at least one safety event if the true rate is at least 0.05 (1 of 20), but would be unlikely (>90% chance of observing no events) occurring at a rate less than 0.002 (1 of 500). This minimum group size allowed for 80% power with significance level 5% to detect a 28% difference in seroconversion rates between two groups if the proportion of responders in the reference group was 40%.

The seroconversion rate for HAI was determined per the FDA definition as either a baseline (Day 0) HAI titer <1:10 and a post boost HAI titer ≥1:40, or a baseline HAI titer ≥1:10 and a minimum four-fold rise from baseline [32]. The magnitude of immune response was calculated as the geometric mean titer (GMT). Comparisons were made between overall groups and between age groups within each overall group. A Fisher’s exact test was used for comparisons of seroconversion rates and the t-test was used to compare magnitudes of log-transformed HAI titers. The primary analysis adjusted for the effect of site using the logistic (seroconversion outcome) and analysis of variance (log-transformed titer response outcome). Chi-square tests were used to compare the distribution of solicited symptom severity between groups. Statistical significance was considered at a level of alpha = 0.05. Adjustment for multiple comparisons was not performed as statistical inferences in this small phase 1 clinical trial are hypothesis-generating, and not confirming. Statistical analyses were performed in SAS 9.3 (SAS Institute, Cary, North Carolina).

Results

Study population and vaccine safety

A total of 316 subjects were enrolled in the study between August 17, 2012 and January 25, 2013 (Fig 1). The group demographics are displayed in Table 3. Overall, there were 125 (39.6%) males and 191 (60.4%) females, with an average age of 41 years. Study vaccinations were completed by 299 subjects (94.6%), and 293 subjects (92.7%) completed the protocol. Reasons for the 23 subjects who did not complete the protocol include: ineligible due to previous receipt of 2012/13 IIV3, failure to disclose hepatitis C infection, withdrawal after diagnosis of pancreatic cancer (unrelated SAE), death by myocardial infarction (unrelated SAE), unrelated ongoing fatigue, and subjects moved or were lost to follow up.

[Figure omitted. See PDF.]

Table 3. Baseline demographics of participants.

https://doi.org/10.1371/journal.pone.0222178.t003

All local reactogenicity was mild to moderate in severity (Table 4). DNA prime administered by Biojector (groups 1, 2, 5 and 6) resulted in significantly higher frequencies of pain and tenderness, redness, and swelling compared to IIV3 by either route (groups 3, 4, 5 and 6) (p <0.02 for all symptoms). IIV3 administered by the ID route resulted in significantly higher frequencies of redness and swelling compared to IIV3 administered by IM route (p <0.001 for both redness and swelling). There was one report of a severe headache following concurrent DNA/IIV3 prime when IIV3 was administered by the ID route and one report of a fever of 102.3°F following IIV3 boost by the ID route that coincided with reports of ILIs in the subjects. One subject reported a combination of severe malaise, headache, and nausea following IIV3 boost by the ID route with no related illness. All of these events resolved without sequelae. Otherwise, systemic reactogenicity was similar among all groups (S1 Table).

[Figure omitted. See PDF.]

Table 4. Summary of solicited local reactogenicity after prime and boost vaccination.

https://doi.org/10.1371/journal.pone.0222178.t004

There were eight SAEs reported during the trial, and all were evaluated as unrelated to the study vaccines. There were 15 reported cases of ILI during the trial; however, no testing was conducted to distinguish influenza infection from other etiologies.

Preexisting antibody responses were present in all groups

Prior to vaccination, all groups had preexisting antibody titers by HAI to the influenza vaccine antigens included in the analysis (S2 Table). The proportion of subjects with baseline titers of ≥1:40 were similar across groups with the following ranges: 35–45% for A/California/07/2009 [A(H1N1)pdm09], 16–26% for A/Victoria/361/2011 (H3N2), and 40–47% for A/Texas/50/2012 (H3N2). Preexisting responses to influenza B strains were lower: 14–26% for both B/Wisconsin/1/2010 and B/Texas/6/2011, and 8–21% to B/Massachusetts/2/2012. Individual baseline titers were not found to have a significant impact on the response to the vaccine regimens in the trial.

DNA priming resulted in higher antibody GMTs and response rates following IIV3 boost compared to a single administration of IIV3 by the ID route

The primary immunogenicity objective was to compare whether the addition of DNA priming would affect the magnitude of the antibody response or seroconversion rates of a single administration of IIV3. To achieve this, two groups of subjects received a DNA prime followed by an IIV3 boost (DNA-IIV3 regimen) approximately 3.5 months later by either ID route (group 1) or IM route (group 2) (Table 1). Low antibody GMTs and seroconversion rates were observed following DNA prime prior to IIV3 administration (S2 and S3 Tables), consistent with previous studies demonstrating that single administrations of DNA vaccines encoding soluble protein antigens do not significantly boost preexisting antibody responses [23]. To compare the antibody response following completion of the DNA-IIV3 regimen to a single administration of IIV3, we evaluated the antibody response after the IIV3 boost in groups 1 and 2 to the antibody response at 3 weeks following the IIV3 prime vaccination in groups 3 (IIV3 by ID route) and 4 (IIV3 by IM route) (Table 1).

Following IIV3 administration via the ID route, the DNA-IIV3 regimen displayed a significant increase compared to a single administration of IIV3 in both the magnitude of the antibody response and the seroconversion rates for B/Texas/6/11 (p values of 0.008 and 0.038, respectively), and the seroconversion rates for A/Victoria/361/11 (p value of 0.040) (groups 1 and 3, Fig 2A). The DNA-IIV3 regimen by the ID route also trended towards increased antibody responses compared to a single administration of IIV3 for all strains tested, although these differences were not statistically significant (groups 1 and 3, Fig 2A).

[Figure omitted. See PDF.]

Fig 2. Magnitude and frequency of antibody responses at three weeks after IIV3 administration for DNA-IIV3 prime-boost, IIV3 prime, or concurrent DNA/IIV3 prime.

The antibody responses were measured for the (A) ID route and (B) IM route by hemagglutination inhibition assay (HAI) and are displayed by group geometric mean titers (GMT) or group seroconversion rates for all 2012/13 vaccine strains, with error bars indicating the 95% CI. Comparisons were made between vaccine regimens for each route. Displayed p values for seroconversion rates were calculated based on Fisher’s Exact test, while GMT comparisons were based on pairwise T-test.

https://doi.org/10.1371/journal.pone.0222178.g002

For regimens administering IIV3 by the IM route, a single administration of IIV3 displayed a significantly higher seroconversion rate compared to the DNA-IIV3 regimen for B/Wisconsin/1/10 (p = 0.018) (groups 2 and 4, Fig 2B). A single administration of IIV3 also trended towards higher antibody responses compared to DNA-IIV3 for all other strains tested, although these differences were not statistically significant (groups 2 and 4, Fig 2B).

Concurrent administration of DNA and IIV3 did not result in improved antibody responses compared to IIV3 alone

We also included a regimen in the trial with a prime vaccination that included a concurrent administration of DNA and IIV3 (DNA/IIV3) to assess whether simultaneous vaccination with DNA and IIV3 in separate arms could improve antibody responses compared with IIV3 (Table 1). This would allow for a single annual vaccination visit rather than a prime-boost regimen requiring two separate visits. Similar to the other vaccine regimens, the IIV3 was administered by either ID route (group 5) or IM route (group 6). Our analysis at 3 weeks following the prime vaccination suggest that administering DNA and IIV3 concurrently did not result in a consistently improved immune response over a single administration of IIV3 by either route (Fig 2).

The DNA-IIV3 regimen by ID route and the IIV3-IIV3 regimen by IM route obtained the highest antibody responses after boost

While DNA priming provides an optimal antibody response with a prime-boost interval between 3–6 months [20], inactivated influenza vaccines are typically given on an annual basis. In order to compare the prime-boost responses of the DNA-IIV3 regimen to a more traditional IIV3 prime-boost schedule, the groups that received a prime administration of IIV3 (groups 3–6) were boosted with a second IIV3 during the subsequent 2013/14 influenza season, with an interval of approximately 10 months (Table 1). For each group, the IIV3 boost was administered through the same route as the initial IIV3. We then compared the antibody responses by HAI for the three completed vaccine regimens (DNA-IIV3, IIV3-IIV3, and DNA/IIV3-IIV3) at 3 weeks post boost (Fig 3).

[Figure omitted. See PDF.]

Fig 3. Vaccine regimen comparison of magnitude and frequency of antibody response at 3 weeks post boost.

The GMT and seroconversion rates are shown for antibody responses measured by HAI for all 2012/13 and 2013/14 vaccine strains for the (A) ID route and (B) IM route, with error bars indicating the 95% CI. Comparisons were made between vaccine regimens for each route. Displayed p values for seroconversion rates were calculated based on Fisher’s Exact test, while GMT comparisons were based on pairwise T-test.

https://doi.org/10.1371/journal.pone.0222178.g003

The DNA-IIV3 regimen by the ID route resulted in significantly higher antibody titers and seroconversion rates compared to the other two vaccine regimens against the influenza B strains: B/Texas/6/11 (overall p values of <0.001 and 0.020, respectively) and B/Massachusetts/2/12 (overall p values of <0.001and 0.033, respectively), and a significantly higher magnitude of antibody response for B/Wisconsin/1/10 (overall p = 0.020) (Fig 3A). The magnitude of antibody response continued to be significantly increased at 6 months post boost for B/Texas/6/11 and B/Massachusetts/2/12 (overall p = 0.012 for both) (S3 Table). No differences were noted in the antibody responses for the influenza A strains between regimens.

Among the regimens where IIV3 was administered by the IM route, the IIV3-IIV3 regimen showed higher seroconversion rates compared to the DNA-IIV3 regimen for the H3N2 strains A/Victoria/361/11 (p = 0.002) and A/Texas/50/12 (p = 0.021), as well as B/Wisconsin/1/10 (p = 0.021) (Fig 3B). Therefore, the DNA-IIV3 regimen trended towards higher antibody responses in influenza B strains among the ID regimens and IIV3-IIV3 trended towards higher seroconversion after boost among the regimens where IIV3 was administered IM.

Administration of IIV3 by ID route was not always dose-sparing

Antibody responses post boost were also evaluated by comparing the ID route to the IM route within each regimen. The ID route is intended to be dose-sparing by providing antibody responses comparable to IM administration while requiring less antigen per dose [33–35]. No consistent improvement in antibody responses was detected between routes for all regimens. However, when significant strain-specific differences were observed, the higher responses were found following IM administration (S1 Fig), indicating that the ID route was not always dose-sparing in this trial. These differences diminished by 6 months post boost (S2 and S3 Tables). Interestingly, in regimens with a DNA only prime (groups 1 and 2), there were no significant differences between IM and ID groups, suggesting that a DNA only prime may augment responses to the low-dose antigen of an IIV3 ID boost.

Neither DNA prime nor ID route improved the vaccine response in older adults

Since IIV3 can be less effective in the older population, we also compared the antibody responses between the younger (18–50 years) and older (51+ years) age groups within each vaccination regimen. In general, there were significantly increased antibody titers and seroconversion rates in the younger population when compared to the older population, at all time points measured (S4 and S5 Tables). These results are consistent with previous studies using DNA vaccines to prime subsequent boosting with conventional inactivated influenza vaccines [22].

We were also interested in determining whether DNA priming would improve the antibody response in older adults. For this analysis, we examined the antibody responses of the three vaccine regimens in the older adults at time points throughout the clinical trial (Fig 4, S4 and S5 Tables). There was no overall improvement at any time point, suggesting that none of the tested regimens resulted in consistently improved antibody responses in older adults. Therefore, neither the addition of a DNA prime with a shorter prime-boost interval nor a concurrent DNA/IIV3 prime with a longer prime-boost interval improved the antibody response in the older population.

[Figure omitted. See PDF.]

Fig 4. Magnitude and frequency of antibody response at 3 weeks post boost in older adults.

The GMT and seroconversion rates are shown for antibody responses measured by HAI for all 2012/13 and 2013/14 vaccine strains in older adults following (A) ID route and (B) IM route, with error bars indicating the 95% CI. Comparisons were made between vaccine regimens for each route. Displayed p values for seroconversion rates were calculated based on Fisher’s Exact test, while GMT comparisons were based on pairwise T-test.

https://doi.org/10.1371/journal.pone.0222178.g004

Antibody responses in the older population were also compared by route of administration at 3 weeks post boost. We did not observe any effect of age on the route comparison due to the different FDA-approved age ranges for IIV3 administration routes in the older adults. Generally, both the magnitude of the antibody response and the seroconversion rates were similar between administration routes for each regimen (S2 Fig). Similar to our observations for the entire study population, when differences were observed, IM administration resulted in higher responses compared to ID administration, suggesting that administration of IIV3 by ID route was not always dose-sparing in these subjects unless they were primed with DNA.

Discussion

In this phase 1 open-label randomized clinical trial, we assessed the safety and tolerability of multiple seasonal influenza vaccination regimens in healthy adults. Local reactogenicity was mild to moderate in severity, with higher frequencies of pain/tenderness, swelling, and redness following DNA vaccination by Biojector compared to IIV3 by either administration route, and higher frequencies of redness and swelling following IIV3 administration by the ID route compared to the IM route. These findings are consistent with previous clinical trials [21, 26, 36]. Overall, all vaccine regimens were found to be safe and well tolerated. We also found that variables including priming vaccines, prime-boost intervals, and administration routes did not consistently impact the antibody response following an IIV3 boost in healthy adults who had substantial levels of preexisting immunity to the vaccine antigens used in this study. A limitation to this study is the small trial size, which is typical of phase 1 clinical trials.

While the antibody responses between the different vaccination regimens did not differ overall, we did observe several trends that remained consistent throughout the trial. After each IIV3 administration we observed the highest antibody responses in the DNA-IIV3 group when IIV3 was administered by the ID route (group 1), and the IIV3-IIV3 group when IIV3 was administered by the IM route (group 4). The observed trend in group 1 may indicate that ID is the preferred route for IIV3 administration following a DNA prime, but only when paired with an optimal prime-boost interval of 3–6 months. If the boost occurs outside of this window, our data suggest that an inactivated prime delivered by IM may provide a superior response. Interestingly, a difference in antibody response was not observed between the concurrent DNA/IIV3-IIV3 regimen by ID route (group 5) or IM route (group 6), perhaps due to immune interference or the prolonged prime-boost interval. Even when compared to a single IIV3, concurrent administrations of DNA and IIV3 did not improve the antibody response, confirming that a DNA prime must be paired with an appropriately timed boost to achieve optimal immunogenicity. This finding suggests that DNA priming establishes a distinct population of responsive memory B cells that are not induced or sustained in the same way by immunization with protein as in the IIV3.

The subjects in group 1 who received the DNA-IIV3 regimen by ID route had significantly higher antibody responses to the influenza B strains B/Wisconsin/1/2010 and B/Texas/6/2011 compared to the other vaccine regimens administered by the ID route. These subjects also exhibited an increased response to the 2013/14 strain B/Massachusetts/2/12, even though this strain was not included in either 2012/13 vaccine product. Since all of the B strains in this trial are of the Yamagata lineage, one possible explanation is that DNA priming allowed for an increased breadth of antibody response against drifted influenza B strains. In a previous trial examining seasonal influenza vaccination with a DNA prime followed by an IIV3 boost, a significant antibody increase was not observed for the influenza B strains tested [22]. However, that trial included a DNA prime with an influenza B strain of the Victoria lineage while the IIV3 boost contained a B strain from the Yamagata lineage. Therefore, DNA priming may induce memory B cells against influenza B that are strain-specific and are not boosted well by antigenically varied vaccines.

In this trial, we did not observe a regimen that was superior for the older population. DNA vaccines have been a strategy of interest in older adults because they are believed to not only expand memory B cell populations, but also induce a variety of T cell responses [37–39]. While we did not directly analyze T cell responses in this study, the regimens that included a DNA prime did not result in significantly improved antibody responses in the older adults. Multiple studies comparing ID and IM routes of administration for inactivated influenza vaccines in older adults have shown comparable immunogenicity outcomes [36, 40, 41]; whereas we observed that the ID route for IIV3 was not always dose-sparing in this trial. However, this phase 1 trial was small in size and not designed with dose-escalations within the ID or IM routes, and therefore not powered for a more conclusive analysis of this observation. Currently, high-dose IIV3 via the IM route (0.5mL, 180 μg total HA) is recommended for older adults because it has been shown to improve immunogenicity via both ID and IM routes [41–43]. Future studies might consider incorporating DNA priming with high-dose IIV3 boosting, and include an assessment of T cell responses, to further evaluate whether DNA priming could improve immunogenicity in the older population.

Since this clinical trial began in 2012 there have been several advances for both DNA and influenza vaccines. Additional clinical trials have been published for DNA vaccines, providing further proof of the safety and immunogenicity of this vaccine platform [24, 30], and preclinical studies have begun evaluating novel delivery routes including microneedle patches [44, 45]. Several new influenza vaccines have also become licensed, including a quadrivalent version of the seasonal inactivated vaccine [5, 7]. This clinical trial began before the quadrivalent vaccine became commercially available, and we were therefore unable to include the IIV4 in our evaluation. However, we predict the IIV4 would result in similar trends as we observed with the IIV3, while possibly providing increased protection against more antigenically drifted influenza B strains.

In summary, we found that all vaccine regimens in the study were safe and well tolerated. We did not observe any consistent improvement in antibody responses by varying the priming vaccination, prime-boost interval, or administration route for IIV3 in this phase 1 study in healthy adults. In the older population, the addition of a DNA prime did not improve the antibody response following an IIV3 boost, but future studies may be warranted to assess responses if paired with a high-dose IIV3.

Supporting information

[Figure omitted. See PDF.]

S1 CONSORT Checklist. CONSORT checklist for VRC 703 clinical trial.

https://doi.org/10.1371/journal.pone.0222178.s001

(DOC)

S1 Protocol. VRC 703 clinical trial protocol.

Protocol version before enrollment.

https://doi.org/10.1371/journal.pone.0222178.s002

(PDF)

S2 Protocol. VRC 703 clinical trial protocol.

Final protocol version.

https://doi.org/10.1371/journal.pone.0222178.s003

(PDF)

S1 Table. Summary of solicited systemic reactogenicity after prime and boost vaccination.

https://doi.org/10.1371/journal.pone.0222178.s004

(PDF)

S2 Table. Seroconversion rates for study groups as measured by HAI.

https://doi.org/10.1371/journal.pone.0222178.s005

(PDF)

S3 Table. Magnitude of antibody responses for study groups as measured by HAI.

https://doi.org/10.1371/journal.pone.0222178.s006

(PDF)

S4 Table. Magnitude of antibody responses for age subgroups as measured by HAI.

https://doi.org/10.1371/journal.pone.0222178.s007

(PDF)

S5 Table. Seroconversion rates for age subgroups as measured by HAI.

https://doi.org/10.1371/journal.pone.0222178.s008

(PDF)

S1 Fig. Route comparison of magnitude and frequency of antibody response in all subjects post boost.

(A) GMT and (B) seroconversion rates are shown for antibody responses measured by HAI at 3 weeks post boost for all 2012/13 and 2013/14 vaccine strains, with error bars indicating the 95% CI. For each vaccination regimen results are displayed for both the ID (blue) and IM (red) routes. Comparisons were made between administration routes for each vaccine regimen. Displayed p values for seroconversion rates were calculated based on Fisher’s Exact test, while GMT comparisons were based on pairwise T-test.

https://doi.org/10.1371/journal.pone.0222178.s009

(PDF)

S2 Fig. Route comparison of magnitude and frequency of antibody response in the older adult subgroups post boost.

(A) GMT and (B) seroconversion rates are shown for antibody responses measured by HAI at 3 weeks post boost for all 2012/13 and 2013/14 vaccine strains, with error bars indicating the 95% CI. For each vaccination regimen results are displayed for both the ID (blue) and IM (red) routes. Comparisons were made between administration routes for each vaccine regimen. Displayed p values for seroconversion rates were calculated based on Fisher’s Exact test, while GMT comparisons were based on pairwise T-test.

https://doi.org/10.1371/journal.pone.0222178.s010

(PDF)

S1 Data. Raw data from VRC 703 clinical trial.

https://doi.org/10.1371/journal.pone.0222178.s011

(XLSX)

Acknowledgments

The VRC 703 Study Team: Joseph Casazza (study team lead, email: [email protected]), Richard Schwartz, Michelle Conan-Cibotti, and Florence Kaltovich from the VRC, and Amy Bray, Thad Zajdowicz, Robert Lindblad, Phyllis Renehan, and Jamie Winestone from the Emmes Corporation.

We would also like to thank Stanford Vaccine Program staff S. Mackey, S. Swope, N. Mastman, T. Trela, T. Quan, A. Goel, and M. Ugur, Baylor College of Medicine staff Celsa Tajonera, the BCM Vaccine Research Center clinical and laboratory staff, the study volunteers for their time and participation, the Emmes Corporation, the VRC, NIAID, and supporting staff who have made this work possible.

Citation: Carter C, Houser KV, Yamshchikov GV, Bellamy AR, May J, Enama ME, et al. (2019) Safety and immunogenicity of investigational seasonal influenza hemagglutinin DNA vaccine followed by trivalent inactivated vaccine administered intradermally or intramuscularly in healthy adults: An open-label randomized phase 1 clinical trial. PLoS ONE 14(9): e0222178. https://doi.org/10.1371/journal.pone.0222178

References

1. Reed C, Chaves SS, Daily Kirley P, Emerson R, Aragon D, Hancock EB, et al. Estimating influenza disease burden from population-based surveillance data in the United States. PLoS One. 2015;10(3):e0118369. pmid:25738736

2. Epperson S, Blanton L, Kniss K, Mustaquim D, Steffens C, Wallis T, et al. Influenza activity—United States, 2013–14 season and composition of the 2014–15 influenza vaccines. MMWR Morb Mortal Wkly Rep. 2014;63(22):483–90. pmid:24898165

3. Mullooly JP, Bridges CB, Thompson WW, Chen J, Weintraub E, Jackson LA, et al. Influenza- and RSV-associated hospitalizations among adults. Vaccine. 2007;25(5):846–55. pmid:17074423

4. Molinari NA, Ortega-Sanchez IR, Messonnier ML, Thompson WW, Wortley PM, Weintraub E, et al. The annual impact of seasonal influenza in the US: measuring disease burden and costs. Vaccine. 2007;25(27):5086–96. pmid:17544181

5. Grohskopf LA, Sokolow LZ, Broder KR, Walter EB, Fry AM, Jernigan DB. Prevention and Control of Seasonal Influenza with Vaccines: Recommendations of the Advisory Committee on Immunization Practices-United States, 2018–19 Influenza Season. MMWR Recomm Rep. 2018;67(3):1–20. pmid:30141464

6. Palache A, Oriol-Mathieu V, Abelin A, Music T, Influenza Vaccine Supply task f. Seasonal influenza vaccine dose distribution in 157 countries (2004–2011). Vaccine. 2014;32(48):6369–76. pmid:25442403

7. FDA. Influenza Virus Vaccine, Quadrivalent, Types A and Types B 2019 [Available from: https://www.fda.gov/vaccines-blood-biologics/vaccines/influenza-virus-vaccine-quadrivalent-types-and-types-b.

8. Ray R, Dos Santos G, Buck PO, Claeys C, Matias G, Innis BL, et al. A review of the value of quadrivalent influenza vaccines and their potential contribution to influenza control. Hum Vaccin Immunother. 2017;13(7):1640–52. pmid:28532276

9. FDA. Approval Letter—Fluzone Intradermal 2011 [Available from: http://wayback.archive-it.org/7993/20170723030613/https://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/ucm255160.htm.

10. Osterholm MT, Kelley NS, Sommer A, Belongia EA. Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. Lancet Infect Dis. 2012;12(1):36–44. pmid:22032844

11. Jefferson T, Di Pietrantonj C, Al-Ansary LA, Ferroni E, Thorning S, Thomas RE. Vaccines for preventing influenza in the elderly. Cochrane Database Syst Rev. 2010(2):CD004876. pmid:20166072

12. Jefferson T, Di Pietrantonj C, Rivetti A, Bawazeer GA, Al-Ansary LA, Ferroni E. Vaccines for preventing influenza in healthy adults. Cochrane Database Syst Rev. 2010(7):CD001269. pmid:20614424

13. Zimmerman RK, Nowalk MP, Chung J, Jackson ML, Jackson LA, Petrie JG, et al. 2014–2015 Influenza Vaccine Effectiveness in the United States by Vaccine Type. Clin Infect Dis. 2016;63(12):1564–73. pmid:27702768

14. Houser K, Subbarao K. Influenza vaccines: challenges and solutions. Cell Host Microbe. 2015;17(3):295–300. pmid:25766291

15. CDC. Influenza vaccines—United States, 2018–19 influenza season 2019 [Available from: https://www.cdc.gov/flu/professionals/vaccines.htm.

16. Ledgerwood JE, Graham BS. DNA vaccines: a safe and efficient platform technology for responding to emerging infectious diseases. Hum Vaccin. 2009;5(9):623–6. pmid:19779298

17. DeZure AD, Coates EE, Hu Z, Yamshchikov GV, Zephir KL, Enama ME, et al. An avian influenza H7 DNA priming vaccine is safe and immunogenic in a randomized phase I clinical trial. npj Vaccines. 2017;2(1):15.

18. Ledgerwood JE, Hu Z, Gordon IJ, Yamshchikov G, Enama ME, Plummer S, et al. Influenza virus h5 DNA vaccination is immunogenic by intramuscular and intradermal routes in humans. Clin Vaccine Immunol. 2012;19(11):1792–7. pmid:22956656

19. Ledgerwood JE, Wei CJ, Hu Z, Gordon IJ, Enama ME, Hendel CS, et al. DNA priming and influenza vaccine immunogenicity: two phase 1 open label randomised clinical trials. Lancet Infect Dis. 2011;11(12):916–24. pmid:21975270

20. Ledgerwood JE, Zephir K, Hu Z, Wei CJ, Chang L, Enama ME, et al. Prime-boost interval matters: a randomized phase 1 study to identify the minimum interval necessary to observe the H5 DNA influenza vaccine priming effect. J Infect Dis. 2013;208(3):418–22. pmid:23633407

21. Houser KV, Yamshchikov GV, Bellamy AR, May J, Enama ME, Sarwar U, et al. DNA vaccine priming for seasonal influenza vaccine in children and adolescents 6 to 17 years of age: A phase 1 randomized clinical trial. PLoS One. 2018;13(11):e0206837. pmid:30388160

22. Ledgerwood JE, Bellamy AR, Belshe R, Bernstein DI, Edupuganti S, Patel SM, et al. DNA priming for seasonal influenza vaccine: a phase 1b double-blind randomized clinical trial. PLoS One. 2015;10(5):e0125914. pmid:25950433

23. Crank MC, Gordon IJ, Yamshchikov GV, Sitar S, Hu Z, Enama ME, et al. Phase 1 study of pandemic H1 DNA vaccine in healthy adults. PLoS One. 2015;10(4):e0123969. pmid:25884189

24. Gaudinski MR, Houser KV, Morabito KM, Hu Z, Yamshchikov G, Rothwell RS, et al. Safety, tolerability, and immunogenicity of two Zika virus DNA vaccine candidates in healthy adults: randomised, open-label, phase 1 clinical trials. Lancet. 2018;391(10120):552–62. pmid:29217376

25. Graham BS, Koup RA, Roederer M, Bailer RT, Enama ME, Moodie Z, et al. Phase 1 safety and immunogenicity evaluation of a multiclade HIV-1 DNA candidate vaccine. J Infect Dis. 2006;194(12):1650–60. pmid:17109336

26. Ledgerwood JE, Hu Z, Costner P, Yamshchikov G, Enama ME, Plummer S, et al. Phase I clinical evaluation of seasonal influenza hemagglutinin (HA) DNA vaccine prime followed by trivalent influenza inactivated vaccine (IIV3) boost. Contemp Clin Trials. 2015;44:112–8. pmid:26275339

27. Martin JE, Louder MK, Holman LA, Gordon IJ, Enama ME, Larkin BD, et al. A SARS DNA vaccine induces neutralizing antibody and cellular immune responses in healthy adults in a Phase I clinical trial. Vaccine. 2008;26(50):6338–43. pmid:18824060

28. Martin JE, Pierson TC, Hubka S, Rucker S, Gordon IJ, Enama ME, et al. A West Nile virus DNA vaccine induces neutralizing antibody in healthy adults during a phase 1 clinical trial. J Infect Dis. 2007;196(12):1732–40. pmid:18190252

29. Martin JE, Sullivan NJ, Enama ME, Gordon IJ, Roederer M, Koup RA, et al. A DNA vaccine for Ebola virus is safe and immunogenic in a phase I clinical trial. Clin Vaccine Immunol. 2006;13(11):1267–77. pmid:16988008

30. Tebas P, Roberts CC, Muthumani K, Reuschel EL, Kudchodkar SB, Zaidi FI, et al. Safety and Immunogenicity of an Anti-Zika Virus DNA Vaccine—Preliminary Report. N Engl J Med. 2017.

31. FDA. Approval Letter- Fluzone 2012 [Available from: http://wayback.archive-it.org/7993/20170723030605/https://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/ucm310580.htm.

32. FDA. Guidance for Industry: Clinical Data Needed to Support the Licensure of Seasonal Inactivated Influenza Vaccines. U. S. DHHS, FDA, CBER.; 2007.

33. Frenck RW Jr., Belshe R, Brady RC, Winokur PL, Campbell JD, Treanor J, et al. Comparison of the immunogenicity and safety of a split-virion, inactivated, trivalent influenza vaccine (Fluzone(R)) administered by intradermal and intramuscular route in healthy adults. Vaccine. 2011;29(34):5666–74. pmid:21699951

34. Gorse GJ, Falsey AR, Fling JA, Poling TL, Strout CB, Tsang PH. Intradermally-administered influenza virus vaccine is safe and immunogenic in healthy adults 18–64 years of age. Vaccine. 2013;31(19):2358–65. pmid:23499604

35. Gorse GJ, Falsey AR, Johnson CM, Morrison D, Fried DL, Ervin JE, et al. Safety and immunogenicity of revaccination with reduced dose intradermal and standard dose intramuscular influenza vaccines in adults 18–64 years of age. Vaccine. 2013;31(50):6034–40. pmid:24055306

36. Marra F, Young F, Richardson K, Marra CA. A meta-analysis of intradermal versus intramuscular influenza vaccines: immunogenicity and adverse events. Influenza Other Respir Viruses. 2013;7(4):584–603. pmid:22974174

37. McElhaney JE, Dutz JP. Better influenza vaccines for older people: what will it take? J Infect Dis. 2008;198(5):632–4. pmid:18652548

38. McElhaney JE, Xie D, Hager WD, Barry MB, Wang Y, Kleppinger A, et al. T cell responses are better correlates of vaccine protection in the elderly. J Immunol. 2006;176(10):6333–9. pmid:16670345

39. Lee LY, Ha do LA, Simmons C, de Jong MD, Chau NV, Schumacher R, et al. Memory T cells established by seasonal human influenza A infection cross-react with avian influenza A (H5N1) in healthy individuals. J Clin Invest. 2008;118(10):3478–90. pmid:18802496

40. Young F, Marra F. A systematic review of intradermal influenza vaccines. Vaccine. 2011;29(48):8788–801. pmid:21968444

41. Tsang P, Gorse GJ, Strout CB, Sperling M, Greenberg DP, Ozol-Godfrey A, et al. Immunogenicity and safety of Fluzone((R)) intradermal and high-dose influenza vaccines in older adults >/ = 65 years of age: a randomized, controlled, phase II trial. Vaccine. 2014;32(21):2507–17. pmid:24120672

42. DiazGranados CA, Dunning AJ, Kimmel M, Kirby D, Treanor J, Collins A, et al. Efficacy of high-dose versus standard-dose influenza vaccine in older adults. N Engl J Med. 2014;371(7):635–45. pmid:25119609

43. Falsey AR, Treanor JJ, Tornieporth N, Capellan J, Gorse GJ. Randomized, double-blind controlled phase 3 trial comparing the immunogenicity of high-dose and standard-dose influenza vaccine in adults 65 years of age and older. J Infect Dis. 2009;200(2):172–80. pmid:19508159

44. Kim YC, Song JM, Lipatov AS, Choi SO, Lee JW, Donis RO, et al. Increased immunogenicity of avian influenza DNA vaccine delivered to the skin using a microneedle patch. Eur J Pharm Biopharm. 2012;81(2):239–47. pmid:22504442

45. Song JM, Kim YC, O E, Compans RW, Prausnitz MR, Kang SM. DNA vaccination in the skin using microneedles improves protection against influenza. Mol Ther. 2012;20(7):1472–80. pmid:22508490