A Text Mining-Based Survey of Pre-Impressions of Medical Staff toward COVID-19 Vaccination in a Designated Medical Institution for Class II Infectious Diseases

Abstract

The present study investigated the pre-impressions of medical staff toward coronavirus disease 2019 (COVID-19) vaccination in a designated medical institution for class II infectious diseases in Sakaide, Japan using a text mining analysis. A total of 387 medical staff were surveyed on their pre-vaccination impressions toward the COVID-19 vaccine using an open-ended questionnaire from March 1st to 7th (the first survey) and from March 22nd to 28th (the second survey) at Sakaide City Hospital, Sakaide, Japan. A total of 296 people answered the question for the first time and 234 people answered for the second time among the 387 people. The vaccination rate was slightly lower for the younger generation than for the older generation. Before the first vaccination, the younger generation expressed concerns about side effects as well as a negative impact on pregnancy. However, before the second vaccination, there were fewer concerns regarding side effects and words of reassurance were also noted. Nurses expressed more opinions about side effects in both the first and second vaccinations than other medical staff. Concerns regarding side effects among medical staff decreased with the progression of COVID-19 vaccination. These data may provide useful information about the promotion of COVID-19 vaccination to the public, particularly in the young generation and women.

1. Introduction

Coronavirus disease 2019 (COVID-19), which originated in Wuhan city, Hubei Province, China, has spread worldwide in a short period of time since December 2019 [1,2,3]. In March 2020, the World Health Organization (WHO) declared a pandemic [4]. COVID-19 was detected in Japan from the beginning of 2020 [5], and infection control measures through behavioral changes, the so-called three Cs, to avoid (1) closed spaces with poor ventilation, (2) crowded places with many people nearby and (3) close-contact settings, such as close-range conversations, have been recommended [6,7].

Sakaide City Hospital [8], which is a designated medical institution for class II infectious diseases with a focus on infectious disease control, and other medical institutions in Japan have been taking a number of measures in accordance with government policies [9,10]. A vaccine, as a core strategy against COVID-19, was approved in Japan in February 2021 [11]; however, vaccination programs outside of Japan were initiated in 2020 [12,13]. At Sakaide City Hospital, the vaccination of medical staff began in early March 2021 [14]. However, in February 2021, limited domestic data were available on the COVID-19 vaccine.

Although medical staff were considered to have better access to information on the vaccine than the general public, they may still have had misconceptions and concerns.

A qualitative analysis using a text mining procedure provides useful information, similar to a conventional quantitative analysis. Yoshikawa et al. investigated childcare-related difficulties encountered by women who gave birth following kidney transplantation using the KH coder procedure [15]. Hasegawa et al. also clarified the potential factors associated with radiation-related anxieties caused by the Fukushima Daiichi Nuclear Power Plant accident [16]. Hemsley et al. reported that the purpose of sociotechnical research was to assess the impact of teaching individuals to use Twitter [17]. These findings demonstrated the usefulness of a qualitative analysis using KH coder.

There have been some studies on the attitudes of healthcare professionals and the general public toward COVID-19 vaccination [18,19,20,21]. However, there is no literature that has qualitatively evaluated by using text mining. We considered an increase in vaccination numbers to be possible by extracting and evaluating any issue at the start of the vaccination program.

Therefore, to obtain data to promote widespread vaccination in the future, we conducted a survey on the pre-impressions of medical staff at Sakaide City Hospital toward COVID-19 vaccination using a text mining analysis.

2. Materials and Methods

2.1. Subjects

Among the 387 medical staff at Sakaide City Hospital, Sakaide, Japan who agreed to participate in a survey of their pre-impressions toward each vaccination (COMIRNATY intramuscular injection, Pfizer Japan Inc., Tokyo, Japan), 296 (71 men and 225 women, 41.7 ± 12.1 years) (76.5%) from the first survey and 234 (64 men and 170 women, 41.6 ± 12 years) (60.5%) from the second survey were used in the analysis (Table 1).

2.2. Clinical Parameters

The sex, age and job title of enrolled subjects were obtained from self-reported questionnaire. Vaccination rate was also evaluated by age, sex and job title.

2.3. Questionnaire

Before each vaccination, an open-ended questionnaire was surveyed from March 1st to 7th (the first survey) and from March 22nd to 28th (the second survey) as follows: “What do you think of the COVID-19 vaccine?”. Questionnaires were distributed through intra-hospital e-mail, and responses were collected and analyzed. Sex, age and job title information were also included in the analysis.

2.4. Statistical Analysis

Data were expressed as the mean ± standard deviation (SD). The χ² test was used to evaluate differences in vaccination rates among groups based on sex, age and job title, where p < 0.05 was considered to be significant. A quantitative analysis of impressions toward the vaccination was performed using text mining software (KH coder 3.0, Koichi Higuchi, Japan) and extracted words were converted into English. KH Coder produces a list of words ordered according to their frequencies and interrelationships as previously described as follows [22,23]: “Step 1: Extract words automatically from data and statistically analyze them to obtain a whole picture and explore the features of the data while avoiding the prejudices of the researcher. Step 2: Specify coding rules, such as “if there is a particular expression, we regard it as an appearance of the concept A”, and extract concepts from the data. Then, statistically analyze the concepts to deepen the analysis” [22]. We used a correspondence analysis, which is an analytical method that allows the relationship between words to be visualized in a scatter plot.

2.5. Ethics

Ethical approval for the present study was obtained from Sakaide City Hospital, Sakaide, Japan (2020-014, 15 February 2021).

3. Results

Table 1 shows the clinical characteristics of subjects enrolled in the present study. There were 296 subjects (39 medical doctors, 158 nurses, 38 other medical staff and 61 administrative staff) in the first survey and 234 (34 medical doctors, 121 nurses, 36 other medical staff and 43 administrative staff) in the second survey (Table 1).

The comparisons of vaccination rates stratified by sex, age and job title in the first and second surveys are shown in Table 2. Significant differences were observed in the vaccination rate with age in the first survey, with the rate of vaccination being lower in the younger generation (83.6%) than in the older generation. However, no significant differences were observed in the vaccination rate between men and women or among job titles in the first survey (Table 2). In the second survey, the vaccination rate significantly differed between men and women only.

Table 3 shows a list of frequently used words among nouns and adjectival nouns. In the first survey, the most common word among 5918 words was “side effects” followed by “vaccination”, “vaccine”, “worry” and “anxiety”. In the second survey, the most common word among 7614 words was “vaccination” followed by “anxiety”, “side effects”, “reaction” and “vaccine”. Therefore, the frequency of “side effects” decreased from the first to the second survey (Table 3). In addition, “reassurance”, which was not observed in the first survey, was noted as the 13th most frequent word in the second survey.

We performed a correspondence analysis to examine the relationships among words according to the manual in the previous reports [22,23] (Figure 1 and Figure 2). We evaluated the relationship between frequently used words and age (Figure 1). The words “side effects”, “scary”, “pregnancy”, “possible” and “future” were more frequently used among subjects in their 20s in the first survey. In the second survey, the words “pregnancy”, “possible” and “future” were not observed in this age group. The relationships between the frequently used words and job titles are shown in Figure 2. In the first survey, characteristic words were “early” and “reaction” in medical doctors, “side effects” and “vaccine” in nurses, “effect” in other medical staff and “concern” in administrative staff. In the second survey, characteristic words were “shoulder” in medical doctors, “scary” and “side effects” in nurses and “next” and “influenza” in other medical staff and administrative staff. Finally, we added the same text mining analysis with 209 participants who answered the questionnaire for the first and second time consecutively. We evaluated the relationship between the frequency used words and age (Figure 3) and obtained almost similar results.

4. Discussion

In the present study, we examined the pre-impressions of medical staff toward COVID-19 vaccination at a designated medical institution for class II infectious diseases using a text mining analysis. The vaccination rate was lower in the younger generation in the first survey and medical staff were less concerned about side effects with the progression of COVID-19 vaccination.

There are some studies about pre-impressions and attitudes toward COVID-19 vaccination. The majority of healthcare workers in Asia are willing to receive a COVID-19 vaccine, and the low potential risk of vaccine harm and pro-socialness are the main reasons [18]. Okubo et al. reported that the proportion of COVID-19 vaccine hesitancy among younger respondents was more than double that among older respondents. Female, living alone, low socioeconomic status and the presence of severe psychological distress were associated with hesitancy [19]. Yoda et al. showed that males showed less hesitancy toward being vaccinated [20]. Machida et al. showed that vaccine acceptance was lower in women, subjects aged 20–49 years and those with a low-income level [21]. In this study, the vaccination rate in younger generations at the first survey and women at the second survey was lower, as previously described [19,20,21]. In addition, we evaluated the pre-impressions toward COVID-19 vaccination by using text mining analysis and found the pre-impressions in specific groups, which was strengthened by the participants who answered the questionnaire for the first and second time consecutively.

Before COVID-19 vaccination, a fear of vaccines and anxiety about adverse reactions were inferred, similar to those previously reported for other vaccinations [24,25]. There were also concerns about pregnancy and the effects of vaccination on the future fetus, similar to influenza vaccination [26]. Okuhara et al. showed that it was more effective to target vaccine-hesitant individuals rather than outright vaccine refusers because their attitudes toward vaccination are more amenable to change [27]. Before the first vaccination, the infection control team, which plays a major role in infection control in hospitals, such as the treatment of infectious diseases and countermeasures against resistant bacteria [28], was not able to provide adequate information on the COVID-19 vaccine to medical staff. After the first vaccination, detailed information on the vaccine, such as its side effects, including effects on pregnancy, was provided. In addition, vaccination became available throughout Japan and information became more readily available, which appeared to be the reason for the change in impressions toward vaccination in the second survey. However, a significant difference was observed in the vaccination rate between the sexes in the second survey (men: 100.0% vs. women: 93.5%). Pulcini et al. and others showed that men were more likely to receive vaccines [29,30,31]. By examining the vaccination rates together with the text mining results, we thought it would be possible to develop an approach to increase vaccination rates in specific populations. More detailed information may need to have been provided to women before the second survey.

Strategies against COVID-19 have become a public health challenge and vaccination is considered to be key in Japan and worldwide [32]. Although the present results were obtained from medical staff, we consider the promotion of vaccination to depend on education and the provision of correct information to the public, particularly the young generation and women.

There are several limitations that need to be addressed. The present study was conducted at one local hospital. Therefore, the results obtained are not applicable throughout Japan. Furthermore, the subjects enrolled in the present study were medical staff, who are considered to be more health conscious than community-dwelling individuals. In addition, among 387 medical staff, the questionnaire was only completed by 296 subjects (76.5%) in the first survey and 234 (60.5%) in the second survey. Moreover, we were unable to evaluate impressions after vaccination. Nevertheless, the results obtained in the present study provide useful information that will promote COVID-19 vaccination in Japan.

5. Conclusions

By analyzing the questionnaire responses with KH Coder, we were able to extract the concerns of healthcare workers before vaccination. These data may be useful for promoting COVID-19 vaccination to the public, particularly the younger generation and women.

Author Contributions

Conceptualization, Y.M. and K.T.; data curation, Y.M. and N.M.; formal analysis, Y.M. and N.M.; investigation, Y.M.; methodology, Y.M. and N.M.; project administration, K.T. and N.M.; supervision, N.M.; validation, K.T. and N.M.; visualization, Y.M., N.M., H.S., S.O. and K.T.; writing—original draft, Y.M. and K.T.; writing—review and editing, Y.M., N.M., H.S., S.O. and K.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and Ethics Committee of Sakaide City Hospital, Sakaide, Japan (2020-014, 15 February 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures and Tables

Figure 1. Correspondence analysis of the relationship between frequently used words and age.

Figure 2. Correspondence analysis of the relationship between frequently used words and job titles.

Figure 3. Correspondence analysis of the relationship between frequently used words and age in subjects who answered the questionnaire for the first and second time consecutively.

Table 1

Clinical characteristics of enrolled subjects.

	Total		The First Survey		The Second Survey
	Number of Subjects	%	Number of Subjects	%	Number of Subjects	%
Age
20–29	91	23.5	67	22.6	50	21.4
30–39	83	21.4	61	20.6	49	20.9
40–49	120	31.0	94	31.8	77	32.9
50–59	61	15.8	50	16.9	38	16.2
60–	32	8.3	24	8.1	20	8.5
Sex
Men	100	25.8	71	24	64	27.4
Women	287	74.2	225	76	170	72.6
Job title
Medical doctor	51	13.2	39	13.2	34	14.5
Nurse	197	50.9	158	53.4	121	51.7
Other medical staff	48	12.4	38	12.9	36	15.4
Administrative staff	91	23.5	61	20.6	43	18.4

Table 2

Comparison of vaccination rates (%).

	The First Survey		The Second Survey
	Vaccination Rate (%)	p	Vaccination Rate (%)	p
Age
20–29	83.6	0.013	90.0	0.176
30–39	91.8		93.9
40–49	94.7		96.1
50–59	98.0		100.0
60–	100.0		100.0
Sex
Men	95.8	0.237	100.0	0.037
Women	91.6		93.5
Job title
Medical doctor	92.3	0.688	97.0	0.838
Nurse	91.8		94.2
Other medical staff	97.4		97.2
Administrative staff	91.8		95.3

Bold: comparisons were performed using χ² test.

Table 3

List of frequently used words among nouns and adjectival nouns.

	The First Survey		The Second Survey
	Word	Word Count	Word	Word Count
1st	Side Effects	148	Vaccination	147
2nd	Vaccination	74	Anxiety	63
3rd	Vaccine	63	Side effects	59
4th	Worry	49	Reaction	59
5th	Anxiety	46	Vaccine	49
6th	Reaction	41	Pain	47
7th	Effectiveness	22	Muscle	39
8th	Allergy	16	Worry	22
9th	Feeling	14	Ingestion	20
10th	Hope	11	Feeling	16

References

1. Harapan, H.; Itoh, N.; Yufika, A.; Winardi, W.; Keam, S.; Te, H.; Megawati, D.; Hayati, Z.; Wagner, A.L.; Mudatsir, M. Coronavirus disease 2019 (COVID-19): A literature review. J. Infect. Public Health; 2020; 13, pp. 667-673. [DOI: https://dx.doi.org/10.1016/j.jiph.2020.03.019]

2. Yu, F.; Du, L.; Ojcius, D.M.; Pan, C.; Jiang, S. Measures for diagnosing and treating infections by a novel coronavirus responsible for a pneumonia outbreak originating in Wuhan, China. Microbes Infect.; 2020; 22, pp. 74-79. [DOI: https://dx.doi.org/10.1016/j.micinf.2020.01.003]

3. Vieira, J.M.; Ricardo, O.M.P.; Hannas, C.M.; Kanadani, T.C.M.; Prata, T.D.S.; Kanadani, F.N. What do we know about COVID-19? A review article. Rev. Assoc. Médica Bras.; 2020; 66, pp. 534-540. [DOI: https://dx.doi.org/10.1590/1806-9282.66.4.534] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32578792]

4. Güner, R.; Hasanoğlu, I.; Aktaş, F. COVID-19: Prevention and control measures in community. Turk. J. Med Sci.; 2020; 50, pp. 571-577. [DOI: https://dx.doi.org/10.3906/sag-2004-146] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32293835]

5. Watanabe, M. The COVID-19 Pandemic in Japan. Surg. Today; 2020; 50, pp. 787-793. [DOI: https://dx.doi.org/10.1007/s00595-020-02033-3]

6. Chao, C.Y.H.; Wan, M.P.; Morawska, L.; Johnson, G.R.; Ristovski, Z.D.; Hargreaves, M.; Mengersen, K.; Corbett, S.; Li, Y.; Xie, X. et al. Characterization of expiration air jets and droplet size distributions immediately at the mouth opening. J. Aerosol. Sci.; 2009; 40, pp. 122-133. [DOI: https://dx.doi.org/10.1016/j.jaerosci.2008.10.003]

7. Chu, D.K.; Akl, E.A.; Duda, S.; Solo, K.; Yaacoub, S.; Schünemann, H.J. COVID-19 Systematic Urgent Review Group Effort (SURGE) study authors. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: A systematic review and meta-analysis. Lancet; 2020; 395, pp. 1973-1987. [DOI: https://dx.doi.org/10.1016/S0140-6736(20)31142-9]

8. Sakaide City Hospital Overview. Available online: https://www.city.sakaide.lg.jp/site/hospital-all-info/byouinngaiyou2601.html (accessed on 15 June 2021). (In Japanese)

9. Lerner, A.M.; Folkers, G.K.; Fauci, A.S. Preventing the Spread of SARS-CoV-2 With Masks and Other “Low-tech” Interventions. JAMA; 2020; 324, pp. 1935-1936. [DOI: https://dx.doi.org/10.1001/jama.2020.21946]

10. Zhang, R.; Li, Y.; Zhang, A.L.; Wang, Y.; Molina, M.J. Identifying airborne transmission as the dominant route for the spread of COVID-19. Proc. Natl. Acad. Sci. USA; 2020; 117, pp. 14857-14863. [DOI: https://dx.doi.org/10.1073/pnas.2009637117]

11. Kosaka, M.; Hashimoto, T.; Ozaki, A.; Tanimoto, T.; Kami, M. Delayed COVID-19 vaccine roll-out in Japan. Lancet; 2021; 397, pp. 2334-2335. [DOI: https://dx.doi.org/10.1016/S0140-6736(21)01220-4]

12. Polack, F.P.; Thomas, S.J.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Pérez Marc, G.; Moreira, E.D.; Zerbini, C. et al. C4591001 Clinical Trial Group. Safety and Efficacy of the BNT162b2 mRNA COVID-19 Vaccine. N. Engl. J. Med.; 2020; 383, pp. 2603-2615. [DOI: https://dx.doi.org/10.1056/NEJMoa2034577] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/33301246]

13. Amit, S.; Regev-Yochay, G.; Afek, A.; Kreiss, Y.; Leshem, E. Early rate reductions of SARS-CoV-2 infection and COVID-19 in BNT162b2 vaccine recipients. Lancet; 2021; 397, pp. 875-877. [DOI: https://dx.doi.org/10.1016/S0140-6736(21)00448-7]

14. Vaccinations Started at Sakaide City Hospital. Available online: https://www.city.sakaide.lg.jp/soshiki/kenkou/singatakoronawakutin.html (accessed on 15 June 2021). (In Japanese)

15. Yoshikawa, Y.; Uchida, J.; Kosoku, A.; Akazawa, C.; Suganuma, N. Childbirth and Care Difficulties of Female Kidney Transplantation Recipients. Transpl. Proc.; 2019; 51, pp. 1415-1419. [DOI: https://dx.doi.org/10.1016/j.transproceed.2019.03.013]

16. Hasegawa, A.; Takahashi, M.; Nemoto, M.; Ohba, T.; Yamada, C.; Matsui, S.; Fujino, M.; Satoh, K. Lexical analysis suggests differences between subgroups in anxieties over radiation exposure in Fukushima. J. Radiat. Res.; 2018; 59, pp. ii83-ii90. [DOI: https://dx.doi.org/10.1093/jrr/rry027]

17. Hemsley, B.; Palmer, S.; Dann, S.; Balandin, S. Using Twitter to access the human right of communication for people who use Augmentative and Alternative Communication (AAC). Int. J. Speech-Lang. Pathol.; 2018; 20, pp. 50-58. [DOI: https://dx.doi.org/10.1080/17549507.2017.1413137] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/29355398]

18. Chew, N.W.S.; Cheong, C.; Kong, G.; Phua, K.; Ngiam, J.N.; Tan, B.Y.Q.; Wang, B.; Hao, F.; Tan, W.; Han, X. et al. An Asia-Pacific study on healthcare workers’ perceptions of, and willingness to receive, the COVID-19 vaccination. Int. J. Infect. Dis.; 2021; 106, pp. 52-60. [DOI: https://dx.doi.org/10.1016/j.ijid.2021.03.069]

19. Okubo, R.; Yoshioka, T.; Ohfuji, S.; Matsuo, T.; Tabuchi, T. COVID-19 Vaccine Hesitancy and Its Associated Factors in Japan. Vaccines; 2021; 9, 662. [DOI: https://dx.doi.org/10.3390/vaccines9060662] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/34204465]

20. Yoda, T.; Katsuyama, H. Willingness to Receive COVID-19 Vaccination in Japan. Vaccines; 2021; 9, 48. [DOI: https://dx.doi.org/10.3390/vaccines9010048] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/33466675]

21. Machida, M.; Nakamura, I.; Kojima, T.; Saito, R.; Nakaya, T.; Hanibuchi, T.; Takamiya, T.; Odagiri, Y.; Fukushima, N.; Kikuchi, H. et al. Acceptance of a COVID-19 Vaccine in Japan during the COVID-19 Pandemic. Vaccines; 2021; 9, 210. [DOI: https://dx.doi.org/10.3390/vaccines9030210]

22. Higuchi, K. A Two-Step Approach to Quantitative Content Analysis: KH Coder Tutorial Using Anne of Green Gables (Part I). Ritsumeikan Soc. Sci. Rev.; 2016; 52, pp. 77-91.

23. Higuchi, K. A Two-Step Approach to Quantitative Content Analysis: KH Coder Tutorial Using Anne of Green Gables (Part II). Ritsumeikan Soc. Sci. Rev.; 2017; 53, pp. 137-147.

24. Sato, R.; Fintan, B. Fear, knowledge, and vaccination behaviors among women in Northern Nigeria. Hum. Vaccines Immunother.; 2020; 16, pp. 2438-2448. [DOI: https://dx.doi.org/10.1080/21645515.2020.1723365] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32083514]

25. Hervé, C.; Laupèze, B.; Del Giudice, G.; Didierlaurent, A.M.; Tavares Da Silva, F. The how’s and what’s of vaccine reactogenicity. NPJ Vaccines; 2019; 4, 39. [DOI: https://dx.doi.org/10.1038/s41541-019-0132-6] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/31583123]

26. Doherty, M.; Schmidt-Ott, R.; Santos, J.I.; Stanberry, L.R.; Hofstetter, A.M.; Rosenthal, S.L.; Cunningham, A.L. Vaccination of special populations: Protecting the vulnerable. Vaccine; 2016; 34, pp. 6681-6690. [DOI: https://dx.doi.org/10.1016/j.vaccine.2016.11.015] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27876197]

27. Okuhara, T.; Ishikawa, H.; Kato, M.; Okada, M.; Kiuchi, T. A qualitative analysis of the beliefs of Japanese anti-influenza vaccination website authors. Heliyon; 2018; 4, e00609. [DOI: https://dx.doi.org/10.1016/j.heliyon.2018.e00609]

28. Sato, T. Infection control in hospitals. Masui; 2010; 59, pp. 56-63. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/20077771]

29. Pulcini, C.; Massin, S.; Launay, O.; Verger, P. Factors associated with vaccination for hepatitis B, pertussis, seasonal and pandemic influenza among French general practitioners: A 2010 survey. Vaccine; 2013; 31, pp. 3943-3949. [DOI: https://dx.doi.org/10.1016/j.vaccine.2013.06.039]

30. Klein, S.L.; Pekosz, A. Sex-based biology and the rational design of influenza vaccination strategies. J. Infect. Dis.; 2014; 209, (Suppl. 3), pp. S114-S119. [DOI: https://dx.doi.org/10.1093/infdis/jiu066]

31. Opstelten, W.; van Essen, G.A.; Ballieux, M.J.; Goudswaard, A.N. Influenza immunization of Dutch general practitioners: Vaccination rate and attitudes towards vaccination. Vaccine; 2008; 26, pp. 5918-5921. [DOI: https://dx.doi.org/10.1016/j.vaccine.2008.08.049]

32. Baack, B.N.; Abad, N.; Yankey, D.; Kahn, K.E.; Razzaghi, H.; Brookmeyer, K.; Kolis, J.; Wilhelm, E.; Nguyen, K.H.; Singleton, J.A. COVID-19 Vaccination Coverage and Intent Among Adults Aged 18–39 Years—United States, March–May 2021. MMWR Morb. Mortal. Wkly. Rep.; 2021; 70, pp. 928-933. [DOI: https://dx.doi.org/10.15585/mmwr.mm7025e2]