1. Introduction
Despite the many advances in cancer treatment, the five-year survival rate for patients with oral squamous cell carcinoma (OSCC) has improved only marginally. Therefore, there is critical need to identify markers for the early diagnosis of OSCC. Biomarkers are molecular signatures and indicators of normal biological and pathological process, and thus may provide useful information for the detection, diagnosis, and prognosis of disease. Many studies have attempted to identify cancer biomarkers in non-invasive samples [1,2,3,4]. Saliva has direct contact with OSCC lesions, which gives it particular potential as a specific and sensitive screening tool. While more than 100 potential salivary biomarkers (DNA, RNA, mRNA, miRNA, and protein) have been previously identified for OSCC (reviewed in [5,6,7,8]), further research is required to validate biomarkers for clinical applications.
A previous review identified several possibilities regarding the confounding influence of oral disease (e.g., inflammation, ulcers, and periodontitis) at the time of saliva collection on the correlation of salivary markers for oral cancer [9]. First, it is possible that controlling for potential external confounders is important for these analyses, or perhaps oral conditions do not affect expression of saliva markers. Previous study showed that chronic periodontitis can affect the levels of potential oral cancer salivary mRNA biomarkers [10,11]. In addition, chronic periodontitis is a risk indicator for oral cavity and/or oropharyngeal cancer [12,13]. Specifically, Moraes reported that 89% of oral cancer patients presented severe chronic periodontitis. The association between periodontitis, and carcinogenesis has been explained by chronic inflammation, presence of bacteria and a reservoir for possible carcinogenic agents [14]. A previous study showed no significant differences in biomarker levels as a result of cigarette smoking [15].
In clinical medicine, the use of multiple biomarkers in combination can improve diagnostic accuracy [16]. Receiver operating characteristic (ROC) curve analysis is an extremely useful method for evaluating the predictive utility of biomarkers or diagnostic tests [17,18]. For markers with continuously distributed data, the ROC curve graphically depicts the diagnostic ability of the marker for all threshold values in a unit square by plotting the proportion of true positives (sensitivity) versus the proportion of false positives (1 - specificity) [19]. Therefore, we compared the area under the ROC curve (AUC) values for OSCC patients vs. the non-tumor group using univariate ROC analyses and multivariate ROC analyses of combinations of two candidate biomarkers. In the present study, we investigated the potential biomarkers in human whole saliva for the early diagnosis of OSCC. Furthermore, we tried to evaluate the association between subjects’ age and salivary mRNA biomarker levels to increase accuracy.
2. Materials and Methods
2.1. Patients and Saliva Collection
All participants were recruited from the Department of Oral and Maxillofacial Surgery of Kyungpook National University Dental Hospital from 2015 to 2017. Informed consent was obtained from all patients before the collection of saliva prior to any treatment. All experimental procedures were conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the Kyungpook National University Hospital (KNUH201401021). The study population consisted of two groups: Group 1 included non-OSCC patients (n = 34) as controls, and Group 2 comprised OSCC patients (n = 33). The control subjects included 13 males and 21 females. The OSCC patient group comprised 22 males and 11 females. Most participants in the control group are patients who visited the hospital for third molars extraction or prosthetic treatment operation. None of the control group had precancerous lesions such as leukoplakia. The major symptoms of OSCC patients were pain, edema, or ulcer, as well as leukoplakia, inflammation, or healing delay. All of them were diagnosed with SCC by incisional biopsy. No patients had suspected symptoms of lichen planus. We included non-tumor control subjects and OSCC patients with mild periodontitis. Mild periodontitis was determined by the amount in clinical attachment loss by records in the Electronic Medical Record database program. In addition, radiographic bone loss was also referred to analyzing radiographic images. The maximum probing depth of mild periodontitis was less than 4 mm and mostly horizontal bone loss [20]. More detailed information of the subjects who participated in this study is shown in Table 1.
Saliva was collected from all of the patients who agreed to participate in this study on their first visit to the hospital. Patients were excluded or included in the non-tumor group according to the diagnosis result. Unstimulated whole saliva samples were collected by previously described methods [10]. Briefly, subjects were requested not to eat, drink, or perform any kind of oral hygiene procedures prior to saliva collection for 1 h. Just before saliva collection, subjects performed oral rinse with a cup of water. Five minutes later, participants were asked to spit into a 50 mL sterile plastic tube. A maximum of 3 mL of saliva was collected within 10 min. After the addition of 3 μL RNase inhibitor, the saliva samples were centrifuged at 5600 rpm, 4 °C for 15 min. The supernatant was transferred to two Eppendorf tubes in 500 μL aliquots and stored at −80 °C until further use.
2.2. Total RNA Extraction
Five hundred microliters of centrifuged saliva was mixed with the same volume of TRIzol solution, followed by incubation for 5 min at room temperature. Then, 200 μL of 1-bromo-2 chloropropane was added, and the contents were mixed by inversion, followed by incubation for 3 min at room temperature. After centrifugation at 12,000 rpm, 4 °C for 15 min, 800 μL of the aqueous phase was transferred into two new Eppendorf tubes in 400 μL aliquots. Then, 800 μL of isopropanol was added, vortexed, and incubated at −20 °C overnight. The next day, the tubes were incubated at room temperature for 10 min, followed by centrifugation at 13,000 rpm, 4 °C for 20 min. The supernatant was discarded, and the pellet was washed with 1 mL of 75% ethanol and centrifuged at 13,000 rpm, 4 °C for 5 min. The RNA pellet was dried at room temperature for 10 min and solubilized with 20 μL of diethyl pyrocarbonate (DEPC) water. The isolated RNA was treated with RNase-free DNase (Ambion Thermo Fisher Scientific, Waltham, MA, USA) according to the manufacturer’s instructions. RNA concentrations were measured using a NanoDrop (Thermo Fisher Scientific, Waltham, MA, USA).
2.3. Primary Candidate Genes and Real-Time PCR (qPCR)
Most previous studies on saliva or serum have explored molecular markers using DNA microarrays. Importantly, substantial differences arise when evaluating mRNA expression of the candidate biomarkers using DNA microarray compared to qPCR. It is currently accepted that the qPCR method has a greater dynamic range and sensitivity than microarray methods [21,22]. Therefore, we selected 30 candidate genes with relevance to cancer according to recent reports in PubMed. Genes that have recently been identified as important in carcinogenesis were also included. Then, mRNA levels of the candidate genes were analyzed by qPCR in saliva samples from non-tumor controls and tumor patients. A list of 30 mRNAs, references, and primer sequences are shown in Table S1.
A total of 500 ng saliva RNA was reverse-transcribed into cDNA using a first-strand cDNA synthesis kit (CELLSCRIPT, LLC. Madison, WI. USA), followed by qPCR. SYBR green PCR master mix was obtained from Enzynomics, Inc. (Daejeon, Korea). All the salivary mRNA samples contained transcripts for GAPDH, which has been used previously as a quality control [23,24]. Therefore, we used GAPDH mRNA level as an internal control. qPCR was carried out using an ABI 7500 real-time PCR system (Applied Biosystems, Foster City, CA, USA) in triplicate. Calculations were performed based on Δcycle threshold (ΔCt) values, which were determined by normalizing the average Ct value of each sample to that of the endogenous GAPDH control and then calculating the 2−ΔΔCt value for each treatment.
2.4. Comparison with NCI GEO Datasets
To evaluate the expression patterns of candidate biomarkers in OSCC tumor tissues and non-tumor control tissues, we examined publicly available gene expression datasets from NCBI GEO databases. The accession numbers were GSE13601, GSE30784, and GSE37991, respectively [25]. The GSE13601 dataset contains data for tumor and matched normal controls from oral tongue SCC patients (n = 20). The GSE 30,784 contains data for OSCC (n = 167) and normal oral tissues (n = 45). The GSE37991 contains tumor and non-tumor pair-wise sample data from 40 male OSCC patients. The microarray data of GSE13601 and GSE30784 were based on GPL8300 (Affymetrix Human Genome U95 Version 2 Array, Affymetrix Inc., Santa Clara, CA, USA) and GPL570 (Affymetrix Human Genome U133 Plus 2.0 Array), respectively. The microarray data of GSE37991 were based on GPL6883 (Illumina HumanRef-8 v3.0 expression beadchip, Illumina Inc., San Diego, CA, USA).
2.5. Statistical Analysis
Subjects’ age was described by mean values and standard deviations. One-way ANOVA for continuous and chi-square test for non-continuous variables were used to check the distribution between two groups. To evaluate the difference of mRNA level between control and OSCC group, Shapiro–Wilk normality test was performed. Both groups showed non-normal distribution for salivary mRNA level. Therefore, the difference of ΔΔCt of each mRNA between the two groups was evaluated using unpaired two-sample Wilcoxon test. The correlation between saliva mRNA levels and OSCC status was calculated using the logistic regression test to yield a linear combination of markers with the ability to discriminate non-tumor subjects from OSCC patents. The area under the ROC curve was used to evaluate the diagnostic accuracy of each mRNA as a potential biomarker for OSCC [26]. The algorithm for the combined analysis of candidate biomarkers is summarized as follows: calculate the empirical AUC value of the ROC curve of each mRNA; order the empirical AUC from largest to smallest; combine the first two candidate mRNAs [27]; create a set of combined mRNAs based on the risk coefficients in the aforementioned step; combine it with the next biomarker; and follow the aforementioned two steps until all candidate biomarker RNAs are included. These data were calculated using R software. p values ≤ 0.05 were considered statistically significant. All statistical analyses were performed using the R program (R.3.6.1., The R Foundation, Vienna, Austria).
3. Results
3.1. Candidate mRNA Levels in Saliva from Non-Tumor Control and OSCC Groups
On average, 75.2 ± 20.3 ng (n = 57) of total RNA was obtained from 500 μL of saliva supernatant. There was no significant difference in total RNA quantity or quality between the OSCC patients and non-tumor controls. Among the 30 saliva transcripts tested in the present study, six targets, namely MAOB (monoamine oxidase B), NAB2 (NGFI-A binding protein 2), COL3A1 (collagen, type III, alpha 1), CYP27A1 (cytochrome P450, family 27, subfamily A, polypeptide 1), NPIPB4 (nuclear pore complex interacting protein family, member B4), and SIAE (sialic acid acetyltransferase), were significantly decreased in the OSCC group (Figure 1 and Table 2). Among the six candidate genes, MAOB (fold change = 0.18) and NAB2 (fold change = 0.23) showed the most reduced mRNA level in the OSCC group compared to control subjects. To predict OSCC with the ΔΔCt value of each candidate gene, the subjects showing each mRNA level below the non-tumor group’s average ΔΔCt −SD were marked as “low level” mRNA (cancer), which is represented as green color in Figure 2. On the contrary, the subjects who showed greater ΔΔCt than this value (control) were marked as “high level” expression, which is marked with red color in Figure 2.
3.2. AUC Analysis with Individual or Combinations of Candidate mRNAs
The AUC values from the ROC curves were analyzed for the six candidate mRNAs showing significant differences between OSCC patients and controls. The detailed statistics of the AUCs from ROC curves, sensitivities, and specificities are listed in Table 3. In the univariate ROC analysis, SIAE (AUC, 0.70; sensitivity, 0.79; and specificity, 0.50) mRNA performed most favorably for predicting OSCC among the six potential biomarkers. The AUC values of the six candidate transcripts ranged from 0.63 to 0.70. To improve diagnostic accuracy, we performed combination analysis of the candidate markers. As shown in Table 3, the CYP27A1 + SIAE combination was superior to any other gene sets (AUC, 0.84; sensitivity, 0.73; and specificity, 0.80). MAOB+NAB2 also showed a favorable result (AUC, 0.80; sensitivity, 0.97; and specificity, 0.62).
3.3. AUC Analysis of Subjects under 60 Years of Age in Both Groups
We separated the patients into those above 60 years of age and those below to obtain a similar number of samples in each group. Average mRNA level of candidate genes and their cut-off values for cancer diagnosis are shown in Table S2. Figure 3 shows salivary transcript levels of subjects under 60 from both groups. The subjects showing expression of each mRNA below the cut-off from non-tumor group’s average ΔΔCt−S.D. were marked as “low level” mRNA (cancer). which is represented as green color in Figure 3. On the contrary, the subjects who showed greater ΔΔCt than this value (control) were marked as “high level” expression, which is marked with red color in Figure 3.
As shown in Table 4, all six potential biomarkers showed remarkably more favorable AUC values in the under–60 group compared to the patients over 60 years of age. In particular, MAOB, COL3A1, and CYP27A1 showed remarkably increased AUC values in the under–60 age group (Table 4). When multivariate analysis was performed on the candidate genes in the under-60 group, MAOB + NAB2 showed an AUC of 0.91 with a sensitivity of 0.92 and specificity of 0.86, which was the most favorable set among the combination data.
3.4. Expression Profiles of the Candidate Biomarkers in Tumor Tissue Datasets
Figure 4 shows the significant expression differences (adjusted p value < 0.05) between OSCC and normal oral tissues for each GSE dataset. MAOB, NPIPB4, CYP27A1, and SIAE showed significantly lower expression levels in OSCC tumor tissues compared to normal tissues. However, the expression of NAB2 was higher in OSCC tissues in the GSE30784 dataset. COL3A1 also showed a significantly higher mRNA expression level in OSCC tissues in the three datasets analyzed in this study.
4. Discussion
Molecular diagnostic markers have been developed for various tumors, and some biomarkers are used clinically. However, OSCC has few available molecular markers for early diagnosis. The use of body fluids such as saliva or serum has shown considerable promise for the early diagnosis of cancer [28,29], but there are few data indicating which salivary transcripts or proteins are up- or down-regulated in cancer patients for use as early diagnostic or prognostic biomarkers. Most of the transcript biomarkers found by microarray are expressed at high levels in cancer patients, while the decreased transcripts have not been actively studied. This study provides novelty by showing that mRNA levels of MAOB, NAB2, COL3A1, NPIPB4, CYP27A1, and SIAE were significantly reduced in the saliva of oral cancer patients. When designing the diagnosis kit for disease, positive or negative control is critical for precise decision. We can anticipate genes of high expression only with negative control, in particular, but positive control plays an important role when it comes to genes that showed decreased expression. Thus, we expect greater difficulty in accurate diagnosis when using biomarkers with decreased expression. Nonetheless, with advanced technology in diagnosis kit development, we expect better use of genes with decreased expression in cancer diagnosis.
Three datasets from the NCI GEO profile database obtained from OSCC tumor tissues were analyzed to compare with our mRNA expression results in OSCC and normal tissues. Although the mRNA sample sources were different from our study, we thought it might be possible to obtain relevant gene expression information in OSCC patients. Interestingly, the mRNA levels of MAOB, NABNPIPB4, CYP27A1, and SIAE were lower in OSCC tumor tissues as compared to normal tissues, which is consistent with our results in the saliva samples. However, NAB2 showed a significantly higher mRNA level in OSCC tissues compared to normal tissues in the GSE30784 dataset. Salivary mRNA of COL3A1 also showed an opposite expression pattern in OSCC tissues (GSE13601 and GSE37991). A previous study has shown that mRNA expression trends can vary between tissue RNA and plasma circulating RNA [30]. Because the potential differences in mRNA expression between tumor tissues and saliva cannot be easily deduced, further study is needed.
In the present study, as the age of the control group and patients decreased, the accuracy of some candidate mRNAs as a biomarker tended to increase. Therefore, the subjects were divided based on the age of 60, which is close to the mean age of the two groups, to evaluate the AUC pattern of candidate mRNAs as OSCC biomarkers according to their ages. Interestingly, salivary COL3A1 mRNA pattern showed no difference between OSCC patients and control groups in patients over 60 years of age (Figure 3). Overall, the AUC values for individual genes and double gene combinations were more favorable in the under–60 age group than the over–60 group (Table 4). These findings suggest the importance of using specific mRNA biomarkers according to patient age in order to diagnose cancer using patient saliva. A previous study showed that the methylation levels of some genes decreased with age and were lower in cancer patients compared with the normal group. Therefore, these genes were considered potential cancer risk markers that were influenced by age in the process of carcinogenesis [31].
MAOB (monoamine oxidase B) is an enzyme located in the mitochondrial outer membrane. It catalyzes the oxidative deamination of biogenic and xenobiotic amines and plays an important role in the metabolism of neuroactive and vasoactive amines in the central nervous system and peripheral tissues [32]. Sharpe et al. reported that MAOB was highly expressed in human gliomas [33].
However, Chen et al. presented data showing that the protein expression of MAOA was significantly decreased in oral cancer tissues compared with adjacent noncancerous tissues [34], which corroborates our data. NAB2 (NGFI-A binding protein 2) repress the transcriptional activation mediated by early growth response 1. The human NAB2 gene is located on chromosome 12q13.3–14.1, a region that shows rearrangements in several tumor types. Our previous study showed that NAB2-overexpressing CAFs promote HNSCC progression [35]. However, Abdulkadir et al. showed that NAB2 protein expression is lost in a majority of primary prostate carcinoma specimens early in the tumorigenic process [36]. The expression of COL3A1 (collagen, type III, alpha 1) in CAFs is known to predict poor prognosis of HNSCC [37]. High COL3A1 levels were associated with a poor prognosis in bladder cancer [38]. Yuan et al. suggested that COL3A1 is associated with breast cancer progression by regulating the MAPK signaling pathway. [38] However, the human protein atlas website showed that COL3A1 is not prognostic in head and neck cancer (ENSG00000168542COL3A1). CYP27A1 (cytochrome P450, family 27, subfamily A, polypeptide 1) is a vitamin D-regulated enzyme that converts cholesterol to 27-hydroxycholesterol, potentially lowering intracellular cholesterol levels. High CYP27A1 expression is known to be prognostic for recurrence-free and overall survival [39]. NPIPB4 (nuclear pore complex interacting protein family, member B4) is a ubiquitously expressed gene in various tissues. The function of this family is unknown, but it shows good conservation from African apes to humans. SIAE (sialic acid acetyl esterase) removes acetyl moieties from the hydroxyl groups of sialic acid. Mutations in this gene are associated with susceptibility to autoimmune disease [40]. There have been no data showing a direct relationship between SIAE and carcinogenesis. However, higher expression of O-acetylated sialic acids has been observed in childhood ALL [41], skin melanoma [42], and human breast cancer [43], suggesting the association of SIAE and tumor suppression.
There is still much debate about the limitations of non-tumor controls in the development of biomarkers for early diagnosis of cancer. For OSCC diagnosis, the factors that appeared most commonly in relevant studies include periodontitis, alcohol drinking, and smoking in the control group. Previous study showed that chronic periodontitis can affect the levels of potential oral cancer salivary mRNA biomarkers [10,11]. These data suggest that chronic periodontitis may reduce the accuracy of the diagnosis of oral cancer. As shown in the Table 1, however, since fewer than 10% of all control subjects had mild periodontitis, we anticipate no significant influence on salivary biomarker level in our study. To determine whether periodontitis, smoking, or drinking in the control group affect biomarker levels, we divided the control subjects into a group with one or more of these three factors (n = 15) and a group without all three (n = 19) and then compared them with the OSCC group. As a result, periodontitis, alcohol drinking, or smoking did not significantly affect the results of this study (data not shown). In addition, the ideal size of control and cancer group for this study was 90–100 at 95% confidence with a 10% sample error, considering the entire Korean population and the OSCC patients who were newly diagnosed during the subjects’ collection period (Korean Statistical Information Service). While more studies with independent cohorts of patients is necessary, our result is valuable for further investigation seeking to improve screening algorithms for the early detection of OSCC. For example, even though general medical history such as diabetes, high blood pressure, and cardiovascular diseases are well-known to have an influence on the salivary mRNA level, the sample size of OSCC patients in our study was too small for such detailed classification. In consideration of the shortcomings, we thus aim to trace the identified biomarkers in future studies and make further investigations on general diseases. In addition, further research is required to evaluate the reliability and validity of these panels for clinical application. More studies involving patients from different ethnic groups may also be necessary to demonstrate the generalizability of these results.
The AUC value is the most popular index used to evaluate overall discrimination accuracy and is commonly used for biomarker evaluation. Higher AUC values indicate superior discriminatory ability of a given diagnostic test or biomarker over all threshold values. Use of biomarker combinations can enhance accuracy, highlighting the importance of developing combinations in diagnostic models [44]. Rather than repeating studies with higher samples sizes performing meta-analyses of multiple studies, ROC analysis is a useful method for evaluating the clinical utility of potentially “promising” biomarkers [45]. While no consensus exists regarding a specific AUC value of ROC curves that represents good predictive power, some publications have recommended an AUC > 0.8 for pursuing the clinical utility of predictive markers, which we support [45]. In addition, our data suggest that salivary mRNA expression may vary according to age independent of disease.
No previous study has demonstrated the association between age and salivary mRNA level for early cancer diagnosis. In conclusion, our study showed that the two-mRNA panel of CYP27A1 + SIAE had the highest AUC value (0.84) for early OSCC diagnosis. In particular, MAOB + NAB2 showed an AUC of 0.91 in the under–60 age group of non-tumor and cancer patients together. Therefore, in the diagnosis of diseases using salivary markers, these data suggest the importance of considering patient age for increased accuracy.
Conceptualization, S.Y.O., S.-H.H., and S.-Y.C.; Methodology, S.-H.H., S.Y.O., H.-J.L., and S.-M.K.; Validation, S.-Y.C., S.Y.O., S.-M.K., H.-J.L., and S.H.K.; Investigation, S.-Y.C., T.-G.K., and S.-T.L.; Resources, J.-W.K. and S.-T.L.; Data curation, S.-M.K., S.H.K., T.-G.K., and J.-W.K.; Writing—Original Draft, S.-H.H., S.Y.O., and J.-W.K.; Writing—Review and Editing, S.-Y.C., T.-G.K., and S.-T.L.; Visualization, S.-H.H., S.Y.O., H.-J.L., and S.-H.H.; Supervision, S.-H.H. and S.-Y.C.; Project Administration, S.Y.O., S.H.K., and S.-M.K.; and Funding Acquisition, S.-H.H. and S.-Y.C. All authors have read and agreed to the published version of the manuscript.
This work was supported by the Basic Science Research Program through a National Research Foundation of Korea grant funded by the Korean Government (2015R1D1A1A01056880, 2017R1C1B2004732, and 2018R1A2B6005005).
The authors thank Kyungwon Kim (University of Michigan, USA) for her assistance with the statistical analysis used in this report.
The authors declare no potential conflicts of interest.
Figure 1. Comparison of salivary mRNAs between control and oral squamous cell carcinoma (OSCC) patients with the relative level (fold change) of the six candidate genes by qPCR analysis. Boxes extend from the third quartile to first quartile, with the line at the median. OSCC: oral squamous cell carcinoma.
Figure 2. Direct comparison of each mRNA level in the two groups to predict oral squamous cell carcinoma (OSCC). The subjects representing the ΔΔCt below non-tumor group’s average ΔΔCt−SD are marked as “low level” mRNA, which is represented as green color (cancer). The subjects who showed greater ΔΔCt than this value were marked as “high level” expression, which is represented with red color (control). The cut-off of ΔΔCt for cancer diagnosis of each mRNA is 2.80 for MAOB, 1.69 for NAB2, 1.35 for COL3A1, 1.62 for NPIPB4, 1.34 for CYP27A1, and 0.94 for SIAE.
Figure 3. Direct comparison of candidate mRNA levels according to age in the two groups together. The subjects representing the ΔΔCt below non-tumor group’s average ΔΔCt−S.D. are marked as “low level” mRNA, which is represented as green color. The subjects who showed higher ΔΔCt than this value were marked as “high level” expression, which is marked with red color. The cut-off of ΔΔCt for cancer diagnosis (low level) of each mRNA under-60 group is 1.66 for MAOB, 1.65 for NAB2, 1.02 for COL3A1, 1.27 for NPIPB4, 1.22 for CYP27A1, and 0.93 for SIAE.
Figure 4. Expression profiles of the candidate mRNAs in OSCC tumor tissues. The expression patterns of the candidate genes in OSCC tumor tissues and non-tumor control tissues were extracted from gene expression datasets of three independent microarray databases (GSE13601, GSE30784, and GSE37991) at NCBI GEO website. The GSE13601 dataset contains data for tumor and matched normal controls from oral tongue SCC patients (n = 20). The GSE 30,784 contains data for OSCC (n = 167) and normal oral tissues (n = 45). The GSE37991 contains tumor and non-tumor pair-wise sample data from 40 male OSCC patients.
Subjects participated in this study.
Group | Non-Tumor | OSCC | p Value | |
---|---|---|---|---|
Number | 34 | 33 | ||
Age | Mean ± SD | 53.2 ± 17.4 | 61.2 ± 18.1 | 0.007 |
Range | 25–83 | 24–97 | ||
Gender | Male | 15 | 22 | 0.07 |
Female | 19 | 11 | ||
Mild periodontitis | Yes | 3 | 10 | 0.02 |
No | 31 | 23 | ||
Smoking | Yes 1 | 9 | 9 | 0.94 |
No 2 | 25 | 24 | ||
Alcohol history | Yes 3 | 13 | 11 | 0.67 |
No | 21 | 22 |
1 Regular smoking, 2 non-smoking or occasional smoking, 3 at least once a week. OSCC: oral squamous cell carcinoma.
Average mRNA levels of six candidate genes in non-tumor controls and oral squamous cell carcinoma (OSCC) groups.
Gene | Non-Tumor (ΔΔCt ± SD) | OSCC |
Relative Fold Change (OSCC/Non-Tumor) | p Value | ΔΔCt for |
---|---|---|---|---|---|
MAOB | 4.01 ± 1.20 | 0.70 ± 0.27 | 0.18 | 0.0009 | below 2.80 |
NAB2 | 2.11 ± 0.42 | 0.49 ± 0.05 | 0.23 | 0.0023 | below 1.69 |
COL3A1 | 1.55 ± 0.20 | 0.62 ± 0.12 | 0.4 | 0.0002 | below 1.35 |
NPIPB4 | 1.89 ± 0.26 | 0.77 ± 0.14 | 0.41 | 0.0059 | below 1.62 |
CYP27A1 | 1.57 ± 0.23 | 0.68 ± 0.12 | 0.44 | 0.0016 | below 1.34 |
SIAE | 1.18 ± 0.24 | 0.73 ± 0.11 | 0.62 | 0.0370 | below 0.94 |
Sensitivities, specificities, and area under the curve (AUC) values for OSCC samples vs. non-tumor controls.
Gene No. | Gene(s) | Sensitivity | Specificity | AUC | 95% CI |
---|---|---|---|---|---|
One gene | MAOB | 0.97 | 0.35 | 0.63 | 0.44–0.82 |
NAB2 | 1 | 0.35 | 0.69 | 0.45–0.95 | |
COL3A1 | 0.85 | 0.53 | 0.67 | 0.47–0.79 | |
NPIPB4 | 0.85 | 0.53 | 0.64 | 0.47–0.79 | |
CYP27A1 | 0.88 | 0.5 | 0.64 | 0.43–0.82 | |
SIAE | 0.79 | 0.5 | 0.7 | 0.56–0.92 | |
Two genes | MAOB + NAB2 | 0.97 | 0.62 | 0.8 | 0.52–1.0 |
MAOB + SIAE | 0.82 | 0.76 | 0.76 | 0.63–0.94 | |
NAB2 + CYP27A1 | 0.88 | 0.71 | 0.81 | 0.70–0.95 | |
NAB2 + SIAE | 0.82 | 0.59 | 0.78 | 0.62–0.97 | |
COL3A1 + SIAE | 0.7 | 0.76 | 0.74 | 0.59–0.91 | |
CYP27A1 + SIAE | 0.73 | 0.8 | 0.84 | 0.67–1.0 |
Age-related Sensitivity, specificity, and AUC values for OSCC vs. control.
Gene No. | Gene (s) | Age < 60 | Age ≥ 60 | ||||
---|---|---|---|---|---|---|---|
Sensitivity | Specificity | AUC | Sensitivity | Specificity | AUC | ||
One |
MAOB | 0.92 | 0.43 | 0.74 | 1.0 | 0.43 | 0.56 |
NAB2 | 1.0 | 0.43 | 0.70 | 1.0 | 0.23 | 0.63 | |
COL3A1 | 0.77 | 0.71 | 0.73 | 0.88 | 0.15 | 0.38 | |
NPIPB4 | 0.69 | 0.62 | 0.68 | 0.94 | 0.39 | 0.69 | |
CYP27A1 | 0.77 | 0.62 | 0.73 | 0.94 | 0.31 | 0.56 | |
SIAE | 0.70 | 0.52 | 0.68 | 0.94 | 0.46 | 0.69 | |
Two |
MAOB + NAB2 | 0.92 | 0.86 | 0.91 | 1.0 | 0.39 | 0.69 |
MAOB + SIAE | 0.70 | 0.76 | 0.83 | 0.88 | 0.46 | 0.70 | |
NAB2 + CYP27A1 | 0.77 | 0.86 | 0.88 | 1.0 | 0.38 | 0.69 | |
NAB2 + SIAE | 0.69 | 0.62 | 0.69 | 0.88 | 0.54 | 0.77 | |
COL3A1 + SIAE | 0.54 | 0.91 | 0.79 | 0.82 | 0.54 | 0.67 | |
CYP27A1 + SIAE | 0.54 | 0.9 | 0.82 | 0.88 | 0.62 | 0.72 |
Supplementary Materials
The following are available online at
References
1. Wu, L.; Qu, X. Cancer biomarker detection: Recent achievements and challenges. Chem. Soc. Rev.; 2015; 44, pp. 2963-2997. [DOI: https://dx.doi.org/10.1039/C4CS00370E] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25739971]
2. Afrifa, J.; Zhao, T.; Yu, J. Circulating mitochondria DNA, a non-invasive cancer diagnostic biomarker candidate. Mitochondrion; 2019; 47, pp. 238-243. [DOI: https://dx.doi.org/10.1016/j.mito.2018.12.003] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/30562607]
3. Fernandez-Mercado, M.; Manterola, L.; Larrea, E.; Goicoechea, I.; Arestin, M.; Armesto, M.; Otaegui, D.; Lawrie, C.H. The circulating transcriptome as a source of non-invasive cancer biomarkers: Concepts and controversies of non-coding and coding RNA in body fluids. J. Cell. Mol. Med.; 2015; 19, pp. 2307-2323. [DOI: https://dx.doi.org/10.1111/jcmm.12625] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26119132]
4. Li, G.; Li, X.; Yang, M.; Xu, L.; Deng, S.; Ran, L. Prediction of biomarkers of oral squamous cell carcinoma using microarray technology. Sci. Rep.; 2017; 7, 42105. [DOI: https://dx.doi.org/10.1038/srep42105]
5. Khurshid, Z.; Zafar, M.S.; Khan, R.S.; Najeeb, S.; Slowey, P.D.; Rehman, I.U. Role of Salivary Biomarkers in Oral Cancer Detection. Adv. Clin. Chem.; 2018; 86, pp. 23-70. [DOI: https://dx.doi.org/10.1016/bs.acc.2018.05.002]
6. Radhika, T.; Jeddy, N.; Nithya, S.; Muthumeenakshi, R.M. Salivary biomarkers in oral squamous cell carcinoma—An insight. J. Oral. Biol. Craniofac. Res.; 2016; 6, pp. S51-S54. [DOI: https://dx.doi.org/10.1016/j.jobcr.2016.07.003]
7. Wu, J.Y.; Yi, C.; Chung, H.R.; Wang, D.J.; Chang, W.C.; Lee, S.Y.; Lin, C.T.; Yang, Y.C.; Yang, W.C. Potential biomarkers in saliva for oral squamous cell carcinoma. Oral. Oncol.; 2010; 46, pp. 226-231. [DOI: https://dx.doi.org/10.1016/j.oraloncology.2010.01.007]
8. Gualtero, D.F.; Suarez Castillo, A. Biomarkers in saliva for the detection of oral squamous cell carcinoma and their potential use for early diagnosis: A systematic review. Acta Odontol. Scand.; 2016; 74, pp. 170-177. [DOI: https://dx.doi.org/10.3109/00016357.2015.1110249]
9. Stuani, V.T.; Rubira, C.M.; Sant’Ana, A.C.; Santos, P.S. Salivary biomarkers as tools for oral squamous cell carcinoma diagnosis: A systematic review. Head Neck; 2017; 39, pp. 797-811. [DOI: https://dx.doi.org/10.1002/hed.24650]
10. Cheng, Y.L.; Jordan, L.; Chen, H.S.; Kang, D.; Oxford, L.; Plemons, J.; Parks, H.; Rees, T. Chronic periodontitis can affect the levels of potential oral cancer salivary mRNA biomarkers. J. Periodonta Res.; 2017; 52, pp. 428-437. [DOI: https://dx.doi.org/10.1111/jre.12407]
11. Horvath, J.; Szabo, A.; Tar, I.; Dezso, B.; Kiss, C.; Marton, I.; Scholtz, B. Oral Health May Affect the Performance of mRNA-Based Saliva Biomarkers for Oral Squamous Cell Cancer. Pathol. Oncol. Res.; 2018; 24, pp. 833-842. [DOI: https://dx.doi.org/10.1007/s12253-017-0296-1] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28861772]
12. Moraes, R.C.; Dias, F.L.; Figueredo, C.M.; Fischer, R.G. Association between Chronic Periodontitis and Oral/Oropharyngeal Cancer. Braz. Dent. J.; 2016; 27, pp. 261-266. [DOI: https://dx.doi.org/10.1590/0103-6440201600754] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/27224557]
13. Javed, F.; Warnakulasuriya, S. Is there a relationship between periodontal disease and oral cancer? A systematic review of currently available evidence. Crit. Rev. Oncol. Hematol.; 2016; 97, pp. 197-205. [DOI: https://dx.doi.org/10.1016/j.critrevonc.2015.08.018] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26343577]
14. Mantovani, A.; Allavena, P.; Sica, A.; Balkwill, F. Cancer-related inflammation. Nature; 2008; 454, pp. 436-444. [DOI: https://dx.doi.org/10.1038/nature07205] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/18650914]
15. SahebJamee, M.; Eslami, M.; AtarbashiMoghadam, F.; Sarafnejad, A. Salivary concentration of TNFalpha, IL1 alpha, IL6, and IL8 in oral squamous cell carcinoma. Med. Oral. Patol. Oral. Cir. Bucal.; 2008; 13, pp. E292-E295. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/18449112]
16. Yan, L.; Tian, L.; Liu, S. Combining large number of weak biomarkers based on AUC. Stat. Med.; 2015; 34, pp. 3811-3830. [DOI: https://dx.doi.org/10.1002/sim.6600]
17. Soreide, K. Receiver-operating characteristic curve analysis in diagnostic, prognostic and predictive biomarker research. J. Clin. Pathol.; 2009; 62, pp. 1-5. [DOI: https://dx.doi.org/10.1136/jcp.2008.061010]
18. Hajian-Tilaki, K. Receiver Operating Characteristic (ROC) Curve Analysis for Medical Diagnostic Test Evaluation. Caspian J. Intern. Med.; 2013; 4, pp. 627-635.
19. Shapiro, D.E. The interpretation of diagnostic tests. Stat. Methods Med. Res.; 1999; 8, pp. 113-134. [DOI: https://dx.doi.org/10.1177/096228029900800203]
20. Papapanou, P.N.; Sanz, M.; Buduneli, N.; Dietrich, T.; Feres, M.; Fine, D.H.; Flemmig, T.F.; Garcia, R.; Giannobile, W.V.; Graziani, F. et al. Periodontitis: Consensus report of workgroup 2 of the 2017 World Workshop on the Classification of Periodontal and Peri-Implant Diseases and Conditions. J. Periodontol.; 2018; 89, (Suppl. S1), pp. S173-S182. [DOI: https://dx.doi.org/10.1002/JPER.17-0721]
21. Allanach, K.; Mengel, M.; Einecke, G.; Sis, B.; Hidalgo, L.G.; Mueller, T.; Halloran, P.F. Comparing microarray versus RT-PCR assessment of renal allograft biopsies: Similar performance despite different dynamic ranges. Am. J. Transplant.; 2008; 8, pp. 1006-1015. [DOI: https://dx.doi.org/10.1111/j.1600-6143.2008.02199.x] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/18416738]
22. Rajeevan, M.S.; Ranamukhaarachchi, D.G.; Vernon, S.D.; Unger, E.R. Use of real-time quantitative PCR to validate the results of cDNA array and differential display PCR technologies. Methods; 2001; 25, pp. 443-451. [DOI: https://dx.doi.org/10.1006/meth.2001.1266] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/11846613]
23. Li, Y.; St John, M.A.; Zhou, X.; Kim, Y.; Sinha, U.; Jordan, R.C.; Eisele, D.; Abemayor, E.; Elashoff, D.; Park, N.H. et al. Salivary transcriptome diagnostics for oral cancer detection. Clin. Cancer Res.; 2004; 10, pp. 8442-8450. [DOI: https://dx.doi.org/10.1158/1078-0432.CCR-04-1167] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/15623624]
24. Li, Y.; Zhou, X.; St John, M.A.; Wong, D.T. RNA profiling of cell-free saliva using microarray technology. J. Dent. Res.; 2004; 83, pp. 199-203. [DOI: https://dx.doi.org/10.1177/154405910408300303] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/14981119]
25. Zhao, X.; Sun, S.; Zeng, X.; Cui, L. Expression profiles analysis identifies a novel three-mRNA signature to predict overall survival in oral squamous cell carcinoma. Am. J. Cancer Res.; 2018; 8, pp. 450-461.
26. Grunkemeier, G.L.; Jin, R. Receiver operating characteristic curve analysis of clinical risk models. Ann. Thorac. Surg.; 2001; 72, pp. 323-326. [DOI: https://dx.doi.org/10.1016/S0003-4975(01)02870-3]
27. Pepe, M.S.; Thompson, M.L. Combining diagnostic test results to increase accuracy. Biostatistics; 2000; 1, pp. 123-140. [DOI: https://dx.doi.org/10.1093/biostatistics/1.2.123]
28. McGrath, S.; Christidis, D.; Perera, M.; Hong, S.K.; Manning, T.; Vela, I.; Lawrentschuk, N. Prostate cancer biomarkers: Are we hitting the mark?. Prostate Int.; 2016; 4, pp. 130-135. [DOI: https://dx.doi.org/10.1016/j.prnil.2016.07.002]
29. Tozzoli, R.; D’Aurizio, F.; Falcomer, F.; Basso, S.M.; Lumachi, F. Serum Tumor Markers in Stage I-II Breast Cancer. Med. Chem.; 2016; 12, pp. 285-289. [DOI: https://dx.doi.org/10.2174/1573406412666151116144520]
30. Zhou, D.; Tang, W.; Liu, X.; An, H.X.; Zhang, Y. Clinical verification of plasma messenger RNA as novel noninvasive biomarker identified through bioinformatics analysis for lung cancer. Oncotarget; 2017; 8, pp. 43978-43989. [DOI: https://dx.doi.org/10.18632/oncotarget.16701]
31. Wang, Y.; Zhang, J.; Xiao, X.; Liu, H.; Wang, F.; Li, S.; Wen, Y.; Wei, Y.; Su, J.; Zhang, Y. The identification of age-associated cancer markers by an integrative analysis of dynamic DNA methylation changes. Sci. Rep.; 2016; 6, 22722. [DOI: https://dx.doi.org/10.1038/srep22722] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26949191]
32. Lewinsohn, R.; Glover, V.; Sandler, M. Beta-phenylethylamine and benzylamine as substrates for human monoamine oxidase A: A source of some anomalies?. Biochem. Pharmacol.; 1980; 29, pp. 777-781. [DOI: https://dx.doi.org/10.1016/0006-2952(80)90556-0]
33. Sharpe, M.A.; Baskin, D.S. Monoamine oxidase B levels are highly expressed in human gliomas and are correlated with the expression of HiF-1alpha and with transcription factors Sp1 and Sp3. Oncotarget; 2016; 7, pp. 3379-3393. [DOI: https://dx.doi.org/10.18632/oncotarget.6582] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26689994]
34. Chen, P.H.; Huang, B.; Shieh, T.Y.; Wang, Y.H.; Chen, Y.K.; Wu, J.H.; Huang, J.H.; Chen, C.C.; Lee, K.W. The influence of monoamine oxidase variants on the risk of betel quid-associated oral and pharyngeal cancer. Sci. World J.; 2014; 2014, 183548. [DOI: https://dx.doi.org/10.1155/2014/183548] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25389533]
35. Choi, S.Y.; Oh, S.Y.; Kang, S.H.; Kang, S.M.; Kim, J.; Lee, H.J.; Kwon, T.G.; Kim, J.W.; Hong, S.H. NAB 2-Expressing Cancer-Associated Fibroblast Promotes HNSCC Progression. Cancers; 2019; 11, 388. [DOI: https://dx.doi.org/10.3390/cancers11030388]
36. Abdulkadir, S.A.; Carbone, J.M.; Naughton, C.K.; Humphrey, P.A.; Catalona, W.J.; Milbrandt, J. Frequent and early loss of the EGR1 corepressor NAB2 in human prostate carcinoma. Hum. Pathol.; 2001; 32, pp. 935-939. [DOI: https://dx.doi.org/10.1053/hupa.2001.27102]
37. Kartha, V.K.; Stawski, L.; Han, R.; Haines, P.; Gallagher, G.; Noonan, V.; Kukuruzinska, M.; Monti, S.; Trojanowska, M. PDGFRbeta Is a Novel Marker of Stromal Activation in Oral Squamous Cell Carcinomas. PLoS ONE; 2016; 11, e0154645. [DOI: https://dx.doi.org/10.1371/journal.pone.0154645]
38. Yuan, L.; Shu, B.; Chen, L.; Qian, K.; Wang, Y.; Qian, G.; Zhu, Y.; Cao, X.; Xie, C.; Xiao, Y. et al. Overexpression of COL3A1 confers a poor prognosis in human bladder cancer identified by co-expression analysis. Oncotarget; 2017; 8, pp. 70508-70520. [DOI: https://dx.doi.org/10.18632/oncotarget.19733]
39. Kimbung, S.; Chang, C.Y.; Bendahl, P.O.; Dubois, L.; Thompson, J.W.; McDonnell, D.P.; Borgquist, S. Impact of 27-hydroxylase (CYP27A1) and 27-hydroxycholesterol in breast cancer. Endocr. Relat. Cancer; 2017; 24, pp. 339-349. [DOI: https://dx.doi.org/10.1530/ERC-16-0533]
40. Surolia, I.; Pirnie, S.P.; Chellappa, V.; Taylor, K.N.; Cariappa, A.; Moya, J.; Liu, H.; Bell, D.W.; Driscoll, D.R.; Diederichs, S. et al. Functionally defective germline variants of sialic acid acetylesterase in autoimmunity. Nature; 2010; 466, pp. 243-247. [DOI: https://dx.doi.org/10.1038/nature09115]
41. Sinha, D.; Mandal, C.; Bhattacharya, D.K. Identification of 9-O acetyl sialoglycoconjugates (9-OAcSGs) as biomarkers in childhood acute lymphoblastic leukemia using a lectin, AchatininH, as a probe. Leukemia; 1999; 13, pp. 119-125. [DOI: https://dx.doi.org/10.1038/sj.leu.2401239] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/10049046]
42. Ritter, G.; Boosfeld, E.; Markstein, E.; Yu, R.K.; Ren, S.L.; Stallcup, W.B.; Oettgen, H.F.; Old, L.J.; Livingston, P.O. Biochemical and serological characteristics of natural 9-O-acetyl GD3 from human melanoma and bovine buttermilk and chemically O-acetylated GD3. Cancer Res.; 1990; 50, pp. 1403-1410. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/2302705]
43. Marquina, G.; Waki, H.; Fernandez, L.E.; Kon, K.; Carr, A.; Valiente, O.; Perez, R.; Ando, S. Gangliosides expressed in human breast cancer. Cancer Res.; 1996; 56, pp. 5165-5171. [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/8912852]
44. Linkov, F.; Lisovich, A.; Yurkovetsky, Z.; Marrangoni, A.; Velikokhatnaya, L.; Nolen, B.; Winans, M.; Bigbee, W.; Siegfried, J.; Lokshin, A. et al. Early detection of head and neck cancer: Development of a novel screening tool using multiplexed immunobead-based biomarker profiling. Cancer Epidemiol. Biomark. Prev.; 2007; 16, pp. 102-107. [DOI: https://dx.doi.org/10.1158/1055-9965.EPI-06-0602] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/17220337]
45. English, P.A.; Williams, J.A.; Martini, J.F.; Motzer, R.J.; Valota, O.; Buller, R.E. A case for the use of receiver operating characteristic analysis of potential clinical efficacy biomarkers in advanced renal cell carcinoma. Future Oncol.; 2016; 12, pp. 175-182. [DOI: https://dx.doi.org/10.2217/fon.15.290]
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
We evaluated potential biomarkers in human whole saliva for the early diagnosis of oral squamous cell carcinoma (OSCC). We selected 30 candidate genes with relevance to cancer from recent reports in PubMed. Saliva samples were obtained from 34 non-tumor control and 33 OSCC patients. Real-time PCR was performed, and mRNA levels were compared. Normalized mRNA levels of six genes (NGFI-A binding protein 2 (NAB2), cytochrome P450, family 27, subfamily A, polypeptide 1 (CYP27A1), nuclear pore complex interacting protein family, member B4 (NPIPB4), monoamine oxidase B (MAOB), sialic acid acetyltransferase (SIAE), and collagen, type III, alpha 1 (COL3A1)) were significantly lower in saliva of OSCC patients. Receiver operating characteristics (ROC) analysis was used to individually evaluate the predictive power of the potential biomarkers for OSCC diagnosis. The area under the curve (AUC) values were evaluated for the OSCC vs. non-tumor groups via univariate ROC analyses, as well as multivariate ROC analyses of combinations of multiple potential biomarkers. The combination of CYP27A1 + SIAE showed a favorable AUC value of 0.84. When we divided saliva samples into two groups according to age using a 60-year cut-off, with OSCC patients and controls evaluated together, the AUC of MAOB–NAB2 was more predictive of OSCC in the under-60 group (AUC, 0.91; sensitivity, 0.92; and specificity, 0.86) than any other gene combination. These results are expected to aid the early diagnosis of OSCC, especially in patients under 60 years of age. While more studies with larger numbers of patients are necessary, our result suggest that salivary mRNA would be a potent biomarker for early OSCC diagnosis.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details



1 Department of Microbiology and Immunology, School of Dentistry, Kyungpook National University, Daegu 700-412, Korea;
2 Department of Oral and Maxillofacial Surgery, School of Dentistry, Kyungpook National University, Daegu 700-412, Korea;