Factors Influencing Superimposition Error of 3D Cephalometric Landmarks by Plane Orientation Method Using 4 Reference Points: 4 Point Superimposition Error Regression Model

Abstract

Superimposition has been used as a method to evaluate the changes of orthodontic or orthopedic treatment in the dental field. With the introduction of cone beam CT (CBCT), evaluating 3 dimensional changes after treatment became possible by superimposition. 4 point plane orientation is one of the simplest ways to achieve superimposition of 3 dimensional images. To find factors influencing superimposition error of cephalometric landmarks by 4 point plane orientation method and to evaluate the reproducibility of cephalometric landmarks for analyzing superimposition error, 20 patients were analyzed who had normal skeletal and occlusal relationship and took CBCT for diagnosis of temporomandibular disorder. The nasion, sella turcica, basion and midpoint between the left and the right most posterior point of the lesser wing of sphenoidal bone were used to define a three-dimensional (3D) anatomical reference co-ordinate system. Another 15 reference cephalometric points were also determined three times in the same image. Reorientation error of each landmark could be explained substantially (23%) by linear regression model, which consists of 3 factors describing position of each landmark towards reference axes and locating error. 4 point plane orientation system may produce an amount of reorientation error that may vary according to the perpendicular distance between the landmark and the x-axis; the reorientation error also increases as the locating error and shift of reference axes viewed from each landmark increases. Therefore, in order to reduce the reorientation error, accuracy of all landmarks including the reference points is important. Construction of the regression model using reference points of greater precision is required for the clinical application of this model.

About the Authors:

Jae Joon Hwang

Affiliation: Department of Oral and Maxillofacial Radiology, Dental Hospital of Yonsei University of College of Dentistry, Seoul, Korea

Kee-Deog Kim

Affiliation: Department of General Dentistry, Dental Hospital of Yonsei University of College of Dentistry, Seoul, Korea

Hyok Park

Affiliation: Department of Oral and Maxillofacial Radiology, Dental Hospital of Yonsei University of College of Dentistry, Seoul, Korea

Chang Seo Park

Affiliation: Department of Oral and Maxillofacial Radiology, Dental Hospital of Yonsei University of College of Dentistry, Seoul, Korea

Ho-Gul Jeong

* E-mail: [email protected]

Affiliation: Department of Oral and Maxillofacial Radiology, Dental Hospital of Yonsei University of College of Dentistry, Seoul, Korea

Introduction

Inevitably, error due to the position change of patient occurs during every x-ray taking despite the patient alignment protocol such as the bite material. Therefore, superimposition has been used as a method to evaluate the changes of orthodontic or orthopedic treatment.

Two-dimensional (2D) cephalometric analysis, introduced by Hofrath [1] and Broadbent [2] in 1931, has been the gold standard for clinical measurement tool in orthodontics and craniofacial surgery for the last decades. In traditional analysis, superimposition using anterior cranial base is a method to show the changes due to the growth and due to orthodontic treatment. But superimposition of anatomic structures in 2D images has limitations such as difficulty in determining landmarks and overestimating changes in the superimposed direction [3], [4].

With the introduction of cone beam CT (CBCT), evaluating changes three-dimensionally after orthodontic or orthopedic treatment became possible by superimposing images. [5]–[8] Newly introduced methods of 3D superimposition include superimposing the landmarks of the bone surface, setting up a new plane orientation and superimposing a certain selected area.

Many studies reported high reliability of identifying cephalometric landmarks with CBCT, especially on multiplanar reconstruction (MPR) images compared to 3D surface models. [9], [10] Because landmarks for superimposition should have high reproducibility, recent studies superimposed CBCT images by reorientation adopting widely used landmarks/planes as reference coordinates/planes on MPR images. [11], [12] But there have not been any studies about statistical analysis and mathematical modelling on the factors influencing superimposition error. The purposes of this study were 1) to find the factors influencing 4 point plane reorientation error, and 2) to find whether the orthodontic landmarks had sufficient reproducibility as reference landmarks and as points for analyzing superimposition error.

Materials and Methods

Ethics Statement

This study was approved by the IRB of Yonsei University Dental Hospital (Approval number: 13-0103(2-2013-0049)). A written or verbal informed consent was not obtained by any participants because this study was a non-interventional retrospective design and all data were analyzed anonymously. The IRB of Yonsei University Dental Hospital waived the need for individual informed consent.

Sample

In this study, the CBCT data of 20 patients (9 males and 11 females; ranging in age from 23 to 72 years, 53.6 mean age) who visited the hospital for temporomandibular joint evaluation and took CBCT for suspected condylar pathologic bone change were selected for analysis. CBCT volumetric data (Alphard3030, Alphard Roentgen Ind., Ltd., Kyoto, Japan) were taken at 80 kV, 5 mAs with scanning time of 17 s. These images were taken using ‘P mode (154 mm×154 mm FOV)’. The voxel size was 0.30 mm. All CT images were stored using DICOM 3.0 as a medical image file format (512×512 pixel) into a Window 7-based graphics workstation (Intel Core i5 3570, 4 GByte, calibrated 21.3-inch color monitor, resolution 1563×2048 pixel, NVIDIA Quadro 2000 graphic card) and subsequently transferred toward OnDemand 3D 3Dceph application (Cybermed, CA, USA). Sagittal, axial and coronal volumetric slices as well as the 3D image reconstruction were used to determine the landmark location.

Landmarks determination

19 landmarks were located manually by ‘Tracing’ function of the software on 3D MPR images. (Figure 1).

[Figure omitted. See PDF.]

Figure 1. Landmarks before reorientation.

https://doi.org/10.1371/journal.pone.0110665.g001

MLWS was defined as the midpoint between the most posterior points of bilateral lesser wings of sphenoid bone. The MLSW was selected as the center of reorientation because it was close to the sella turcica in the midsagittal plane and the bilateral lesser wings had sharp posterior points, which were thought to be highly precise. All landmarks except MLWS are commonly used craniofacial structures in orthodontics and can be located without difficulty [13]. Landmarks used in the present study are defined in Table 1. Landmarks were placed by using mouse firstly on the bone surface of reconstructed CBCT images and revised secondly on MPR images. After a radiologist located all 19 landmarks, at least 1 week apart, same radiologist repeated the procedure on the same images. During the procedures, the x, y, z coordinates were gained. Locating error was obtained by measuring the absolute value of the coordinate difference and distance between the repeatedly marked landmarks.

[Figure omitted. See PDF.]

Table 1. Definition of the three spatial planes of the 19 points used in this study.

https://doi.org/10.1371/journal.pone.0110665.t001

Reorientation procedure and Measurement of reorientation error

After all 19 landmarks were defined (Figure 1), the reorientation procedure was accomplished 3 times by using ‘Reorientation’ function of the software (Figure 2).

[Figure omitted. See PDF.]

Figure 2. Landmarks after reorientation.

N, ROr and RPo each refers to MLWS, S and Ba according to the initial setting of Ondemand 3Dceph module.

https://doi.org/10.1371/journal.pone.0110665.g002

Four reference landmarks out of total 19 landmarks were used to define a 3D reference co-ordinate system. Using four landmarks as the setting point is one of the simplest way of plane reorientation which can be readily applicable in the clinic. The nasion (Na), sella turcica (S) and basion (Ba) were selected for axes determination. The orientation of y (anteroposterior) axis was parallel to the line which passes through Na and S. Z (vertical) axis was parallel to the line which is orthogonal to y axis and passes through Ba. (Figure 3) Orientation of x(transverse) axis was orthogonal to the y and z axis. And MLWS was set to a new starting point of the reoriented Cartesian co-ordinate system.(Figure 4).

[Figure omitted. See PDF.]

Figure 3. Reorientation axes.

y and ź are lines parallel to y and z axis respectively.

https://doi.org/10.1371/journal.pone.0110665.g003

[Figure omitted. See PDF.]

Figure 4. MLWS as a new starting point.

x, y and z axis each represent reoriented transverse, anteroposterior and vertical axis.

https://doi.org/10.1371/journal.pone.0110665.g004

After plane orientation, the x, y, z coordinates were measured by the new starting point, and the vertical distance from the new x axis was measured for each point.

Reorientation error was defined as the distance of repeatedly marked landmarks after reorientation procedure.

Statistical analysis

Statistical analysis was carried out with SPSS 20.0 (SPSS Inc., Chicago, III). Intraclass correlation Coefficient (ICC) was obtained for all coordinates of 19 landmarks. Reoriented 15 commonly used orthodontic landmarks were analyzed by stepwise linear regression tests for finding statistically significant independent variables of reorientation error.

Results

ICC (Intra-examiner reliability) and Locating error

ICC for x, y and z coordinates for all landmarks were above 0.99. However, there were large average locating errors in the x coordinates of OrR (0.89 mm), OrL (0.68 mm) and PoR (0.61 mm) (Table 2, Figure 5). Standard deviation was large at the locating error of A (0.74), OrR (0.58), OrL (0.48), PoR (0.45), PoL (0.55), GoR (0.52) and GoL (0.49) in comparison to MLWS (0.22), Ba (0.28), Ans (0.28), CoR (0.32) and CoL (0.29) (Table 3).

[Figure omitted. See PDF.]

Figure 5. Locating error (coordinate).

https://doi.org/10.1371/journal.pone.0110665.g005

[Figure omitted. See PDF.]

Table 2. Locating error (coordinate).

https://doi.org/10.1371/journal.pone.0110665.t002

[Figure omitted. See PDF.]

Table 3. Reorientation error (RE) and factors influencing RE.

https://doi.org/10.1371/journal.pone.0110665.t003

Reorientation error

Reorientation error was greater than locating error on every landmarks (Table 3). In Table 3, when locating error, vertical distance from x axis, sum of angle errors from Na, S, Ba increases, reorientation error increased as well, but all three did not show proportional change.

Linear regression model for Reorientation error

According to the stepwise method, multiple linear regression model which explains reorientation error was found from a viewpoint of each landmark, as follows.(1)

(Y =  Reorientation error,

Db =  Locating error before reorientation (Figure 6),

[Figure omitted. See PDF.]

Figure 6. DB: Locating error (distance) of a landmark (A).

represents an averaged landmark of A.

https://doi.org/10.1371/journal.pone.0110665.g006

DX =  vertical distance from reoriented x axis (Figure 7),

[Figure omitted. See PDF.]

Figure 7. DX: Distance from X-axis to an averaged landmark.

() The rotated arrow around X axis represents pitch rotation

https://doi.org/10.1371/journal.pone.0110665.g007

A3r (α+β+γ) =  sum of angle errors of reference points located twice (Figure 8),

[Figure omitted. See PDF.]

Figure 8. A3r: Sum of angle errors (S, Na, Ba) from an averaged landmark.

() α, β and γ represent angle errors viewed from an averaged landmark () respectively.

https://doi.org/10.1371/journal.pone.0110665.g008

All the coefficient are from multiple regression of total data).

Where a and b refer to the different measurement trial of the same image and stands for the average coordinate of a landmark (A) between two trials (Figure 6, 7, 8).

The model shown in 1 was statistically significant (P = 0.000) for all T1–T2, T1–T3, T2–T3 and total analysis. The Adjusted R-square (r²) was around 0.23 (Table 4).

[Figure omitted. See PDF.]

Table 4. Variables included in multiple regression model.

https://doi.org/10.1371/journal.pone.0110665.t004

Table 4 also shows that all 3 independent variables of tested model are all statistically significant (P<0.05), and multicollinearity does not exist between the independent variables (VIF≒1).

Discussion

3D reproducibility of cephalometric landmarks

Generally, marking on 2D cephalometry is quite straightforward, and 1 mm is traditionally accepted as the precise measurement. Identifying the cephalometric landmarks in 3D CBCT was reported reliable in many studies, especially on MPR images. [9], [13] But locating error is larger in 3D than 2D, and this seems to be the reason why 3D cephalometry is not widely used clinically [14].

Table 2 and 3 showed reproducibility of some widely used cephalometric points were not very high in 3D MPR images. The locating errors were about 1 mm on average. However, some points at the third quartile had 1.2–1.5 mm locating errors, and some of the locating errors were greater than 2 mm. This results correlates partially with the study of Zamora et al. [10] which reporting high errors in A, OrR, OrL, PoR, B and GoR. In addition, Hassan et al. [9] reported large locating errors (average 1.2∼2.1 mm) in PoR, PoL and GoL. In Table 2 and figure 5, most of the landmarks showed the largest locating errors on the x coordinates. These results can be assumed to have been produced due to defining of the cephalometric landmarks on lateral view without the consideration of the transversal plane.

Na, S, Ba used as reference landmarks generally showed good reproducibility.(Table 2 and 3) However, the S point tended to exhibit slightly higher locating error than Na and Ba. MLWS showed better reproducibility than Na, S, Ba in this study. The locating error of MLWS (mean 0.33, SD 0.22) was similar to the smallest locating error (mean 0.31, SD 0.19) of the upper left incisor in the study of Hassan et al. [9].

Plane orientation system for superimposition

Superimposition methods that use 3D anatomical landmarks or surface has recently become the focus of interest. [15], [16] But when superimposition is made on bone surface landmarks or certain areas, the superimposition error increases as it gets further from the superimposition area or growth area.

Lagravère et al. [11] used 4 landmarks at the skull base, a stable structure, for carrying out plane orientation but a different superimposition method was used compared to this study. In this study, 4 landmarks were also used for plane orientation, but unlike the study above in which the new starting point was fixed on the new axes, the two were separated, making it a more flexible reorientation system.

If multiple landmarks are marked on the skull base, the results would be more accurate, but time consuming and clinically inefficient, making the reorientation system more complicated and harder to analyze statistically. So in this study, Na, S, Ba were used which have previously been used [17]–[19] or recommended [10] cephalometric landmarks in several studies, as reference points of axes set up. Also, the most accurate MLWS was used as the center of reorientation and made a plane reorientation system considering both efficiency and accuracy.

Reorientation error

Increased error after reorientation.

After reorientating the landmarks which were positioned repeatedly at the same image in this study, reorientation error increased than locating error (Table 3). This is because every point, including the reference landmarks, differs whenever it is located, so the landmark at each trial is reoriented by different axes and origin.

Factors influencing reorientation error.

In a previous study [11], factors influencing reorientation were mentioned as voxel size and locating error of the center point. This study showed voxel size imposes smallest measurement uncertainty (0.25 mm) that makes errors when determining reference points and planes. And those errors can produce up to 1 mm error after transformation in one axis of reference points. Ondemand 3D program could enlarge MPR images and measure up to second decimal number and therefore, was hardly influenced by voxel size.

Same study mentioned that as the errors which are imposed at origin increase, errors of reference points increase after transformation, but, in this study there was no further quantitative explanation except the increase is not directly proportional.

Until now, the factors that produce errors during reorientation using cephalometric landmarks have never been analyzed statistically. In this study, the plane orientation error was analyzed by multiple regression. When making this model, the understanding of transformation was changed by analyzing axes change from a peripheral viewpoint (each landmark), rather than center perspective (origin and reference axes).

This linear regression model (1) could explain reorientation error (distance of a landmark after reorientation, Y) of this plane orientation system about 1/4 with 3 simple factors below.

First, Db stands for locating error of each landmark itself. As locating error before transformation (Db) increases 1 mm, reorientation error increases approximately 0.76 mm in this system. This explains that the locating error is reflected on the reorientation error up to approximately 76%.

Second, DX stands for vertical distance from reoriented x axis to each landmark. As DX increases 10 cm, reorientation error increases approximately 1.8 mm in this system. This means that mandibular chin area which is about 13 cm away from the newly set x axis can get approximately 2.3 mm reorientation error only due to its far location from reoriented x axis.

Third, A3r stands for shift of reference axes viewed from each landmark during two landmark determination trial. As one (1) degree of A3r from a point increases, reorientation error increases about 0.55 mm. This result shows that small axes shift can affect the reorientation error substantially.

This model shows that A3r with DX may have possibility to be ‘position scalar’ in a system which consists of limited number of points (eg. cephalometric analysis). A3r alone has the difficulty in explaining reorientation error. However, by analyzing A3r with DX, the approximate reorientation error can be predicted which is the outcome of vector transformation. This idea of ‘position scalar’ can be established because the locating error of reference landmarks is small enough to produce the unique value of A3r combine with DX.

Among the above values, if the accuracy of the landmarks including the reference could be improved, the Db & A3r value and the coefficient of DX would decrease, thereby reducing the reorientation error. However, in terms of the A3r value, assuming that Na, S, Ba are sufficiently accurate, the patient’s anatomical structures are likely to have a greater impact than the locating error of those three points.

The hypothesis that the distance of each point from MLWS as well as the perpendicular distance from the reoriented y, z axes could have an effect on the amount of reorientation error has been denied through regression analysis.

Limitation of this study and works to be done

The selected Na, S, Ba points for the determination of the reorientation axes are positioned on the mid sagittal plane. Therefore, even though the location error of these points were relatively small, the pitch direction of the reoriented x axis will be the most greatly affected. This is the reason for the increase in reorientation error with increase in DX. In this model, the points with large DX can already be expected to have a large reorientation error; hence, accurate superimposition will be difficult to achieve. Thus, to promote clinical application, accurate setting of the reference landmarks will be required to reduce the value of the constant in front of DX, and further research will be needed to minimize the increase in reorientation error caused by DX.

As shown by the above data, a locating error of 1 mm on average may result in the increase of 0.76 mm in reorientation error. When the other two factors that affect the reorientation error are considered, further research necessitates the selection of accurate points with locating errors less than 1 mm.

The difference in adjusted R-square value between T1–T2, T1–T3 and T2–T3 can be explained by the low reproducibility of some of the landmarks that would have acted as outliers to weaken the explanation power of the regression model (table 4). This is another reason why this model can be considered limited yet for clinical application.

Future plane orientation exercises should utilize precise reference points rather than the well-known orthodontic landmarks. The highly precise reference points of this experiment include sharp points such as ANS and PNS, midpoints of two sharp points such as MLWS, as well as an end point of a protruding eminence such as Ba. Previous studies [11], [20] indicate that center points of foramina are also highly precise points of reference. In further studies, regression models based on such precise reference points should be evaluated for its accuracy after CBCT image superimposition based on 4 point plane orientation.

Conclusions

In present study, 3D reproducibility of some widely used cephalometric points was not adequate for accurate evaluation of 4 point plane reorientation error. This model showed that locating error, vertical distance from reoriented x axis and shift of reference plane viewed from each landmark are important factors that explain the reorientation error.

Supporting Information

[Figure omitted. See PDF.]

Table S1.

Coordinates before and after reorientation (Sample Number 1).

https://doi.org/10.1371/journal.pone.0110665.s001

(XLSX)

Table S2.

Coordinates before and after reorientation (Sample Number 2).

https://doi.org/10.1371/journal.pone.0110665.s002

(XLSX)

Table S3.

Coordinates before and after reorientation (Sample Number 3).

https://doi.org/10.1371/journal.pone.0110665.s003

(XLSX)

Table S4.

Coordinates before and after reorientation (Sample Number 4).

https://doi.org/10.1371/journal.pone.0110665.s004

(XLSX)

Table S5.

Coordinates before and after reorientation (Sample Number 5).

https://doi.org/10.1371/journal.pone.0110665.s005

(XLSX)

Table S6.

Coordinates before and after reorientation (Sample Number 6).

https://doi.org/10.1371/journal.pone.0110665.s006

(XLSX)

Table S7.

Coordinates before and after reorientation (Sample Number 7).

https://doi.org/10.1371/journal.pone.0110665.s007

(XLSX)

Table S8.

Coordinates before and after reorientation (Sample Number 8).

https://doi.org/10.1371/journal.pone.0110665.s008

(XLSX)

Table S9.

Coordinates before and after reorientation (Sample Number 9).

https://doi.org/10.1371/journal.pone.0110665.s009

(XLSX)

Table S10.

Coordinates before and after reorientation (Sample Number 10).

https://doi.org/10.1371/journal.pone.0110665.s010

(XLSX)

Table S11.

Coordinates before and after reorientation (Sample Number 11).

https://doi.org/10.1371/journal.pone.0110665.s011

(XLSX)

Table S12.

Coordinates before and after reorientation (Sample Number 12).

https://doi.org/10.1371/journal.pone.0110665.s012

(XLSX)

Table S13.

Coordinates before and after reorientation (Sample Number 13).

https://doi.org/10.1371/journal.pone.0110665.s013

(XLSX)

Table S14.

Coordinates before and after reorientation (Sample Number 14).

https://doi.org/10.1371/journal.pone.0110665.s014

(XLSX)

Table S15.

Coordinates before and after reorientation (Sample Number 15).

https://doi.org/10.1371/journal.pone.0110665.s015

(XLSX)

Table S16.

Coordinates before and after reorientation (Sample Number 16).

https://doi.org/10.1371/journal.pone.0110665.s016

(XLSX)

Table S17.

Coordinates before and after reorientation (Sample Number 17).

https://doi.org/10.1371/journal.pone.0110665.s017

(XLSX)

Table S18.

Coordinates before and after reorientation (Sample Number 18).

https://doi.org/10.1371/journal.pone.0110665.s018

(XLSX)

Table S19.

Coordinates before and after reorientation (Sample Number 19).

https://doi.org/10.1371/journal.pone.0110665.s019

(XLSX)

Table S20.

Coordinates before and after reorientation (Sample Number 20).

https://doi.org/10.1371/journal.pone.0110665.s020

(XLSX)

Acknowledgments

We are grateful to Dr. Jin Young Park, Yonsei University Dental Hospital for his helpful advice on the English grammar and graphical representation of this journal article.

Author Contributions

Conceived and designed the experiments: JJH. Performed the experiments: JJH. Analyzed the data: JJH HGJ HP CSP. Contributed reagents/materials/analysis tools: KDK HGJ HP CSP. Contributed to the writing of the manuscript: JJH HGJ KDK. Obtained ethics approval from the Institutional Review Board of Yonsei university dental hospital: JJH HGJ.

Citation: Hwang JJ, Kim K-D, Park H, Park CS, Jeong H-G (2014) Factors Influencing Superimposition Error of 3D Cephalometric Landmarks by Plane Orientation Method Using 4 Reference Points: 4 Point Superimposition Error Regression Model. PLoS ONE 9(11): e110665. https://doi.org/10.1371/journal.pone.0110665

References

1. Hofrath H (1931) Importance of teleroentgenograms for diagnosis of maxillary abnormalities. J Orofac Orthop 1: 232–258.

2. Broadbent BH (1931) A new X-ray technique and its application to orthodontia. Angle Orthod 1: 45–66.

3. Gu Y, McNamara Jr JA (2008) Cephalometric superimpositions: A comparison of anatomical and metallic implant methods. Angle Orthod 78: 967–976.

4. Arat ZM, Rübendüz M, Akgül AA (2003) The displacement of craniofacial reference landmarks during puberty: A comparison of three superimposition methods. Angle Orthod 73: 374–380.

5. Berkowitz S (1999) A multicenter retrospective 3D study of serial complete unilateral cleft lip and palate and complete bilateral cleft lip and palate casts to evaluate treatment: Part 1 - The participating institutions and research aims. Cleft Palate Craniofac J 36: 413–424.

6. Seckel NG, Van der Tweel I, Elema GA, Specken TFJM (1995) Landmark positioning on maxilla of cleft lip and palate infant - A reality? Cleft Palate Craniofac J 32: 434–441.

7. Sachdeva R (2001) SureSmile technology in a patient-centered orthodontic practice. J Clin Orthod 35: 245–253.

8. Ashmore J, Kurland B, King G, Wheeler TT, Ghafari J, et al. (2002) A 3-dimensional analysis of molar movement during headgear treatment. Am J Orthod Dentofacial Orthop 121: 18–29.

9. Hassan B, Nijkamp P, Verheij H, Tairie J, Vink C, et al. (2013) Precision of identifying cephalometric landmarks with cone beam computed tomography in vivo. Eur J Orthod 35: 38–44.

10. Zamora N, Llamas JM, Cibrian R, Gandia JL, Paredes V (2012) A study on the reproducibility of cephalometric landmarks when undertaking a three-dimensional (3D) cephalometric analysis. Med Oral Patol Oral Cir Bucal 17: e678–688.

11. Lagravere MO, Major PW, Carey J (2010) Sensitivity analysis for plane orientation in three-dimensional cephalometric analysis based on superimposition of serial cone beam computed tomography images. Dentomaxillofac Radiol 39: 400–408.

12. Swennen G, Schutyser F, Barth E, De Groeve P, De Mey A (2006) A new method of 3-D cephalometry part I: The anatomic cartesian 3-D reference system. J Craniofac Surg 17: 314–325.

13. Zamora N, Llamas J, Cibrián R, Gandia J, Paredes V (2012) A study on the reproducibility of cephalometric landmarks when undertaking a three-dimensional (3D) cephalometric analysis. Med Oral Patol Oral Cir Bucal 17: e678–e688.

14. Lagravere MO, Low C, Flores-Mir C, Chung R, Carey JP, et al. (2010) Intraexaminer and interexaminer reliabilities of landmark identification on digitized lateral cephalograms and formatted 3-dimensional cone-beam computerized tomography images. Am J Orthod Dentofacial Orthop 137: 598–604.

15. Hoffmann J, Westendorff C, Leitner C, Bartz D, Reinert S (2005) Validation of 3D-laser surface registration for image-guided cranio-maxillofacial surgery. J Craniofac Surg 33: 13–18.

16. Kang SH, Kim MK, Kim JH, Park HK, Park W (2012) Marker-free registration for the accurate integration of CT images and the subject’s anatomy during navigation surgery of the maxillary sinus. Dentomaxillofac Radiol 41: 679–685.

17. Maeda M, Katsumata A, Ariji Y, Muramatsu A, Yoshida K, et al. (2006) 3D–CT evaluation of facial asymmetry in patients with maxillofacial deformities. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 102: 382–390.

18. Kitaura H, Yonetsu K, Kitamori H, Kobayashi K, Nakamura T (2000) Standardization of 3-D CT measurements for length and angles by matrix transformation in the 3-D coordinate system. Cleft Palate Craniofac J 37: 349–356.

19. Katsumata A, Fujishita M, Maeda M, Ariji Y, Ariji E, et al. (2005) 3D–CT evaluation of facial asymmetry. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 99: 212–220.

20. Schlicher W, Nielsen I, Huang JC, Maki K, Hatcher DC, et al. (2012) Consistency and precision of landmark identification in three-dimensional cone beam computed tomography scans. Eur J Orthod 34: 263–275.