Skip to main content
Download PDF

Virtual reconstruction of midfacial bone defect based on generative adversarial network

Head & Face Medicine volume 18, Article number: 19 (2022) Cite this article

Abstract

Background

The study aims to evaluate the accuracy of the generative adversarial networks (GAN) for reconstructing bony midfacial defects.

Methods

According to anatomy, the bony midface was divided into five subunit structural regions and artificial defects are manually created on the corresponding CT images. GAN is trained to reconstruct artificial defects to their previous normal shape and tested. The clinical defects are reconstructed by the trained GAN, where the midspan defects were used for qualitative evaluation and the unilateral defects were used for quantitative evaluation. The cosine similarity and the mean error are used to evaluate the accuracy of reconstruction. The Mann–Whitney U test is used to detect whether reconstruction errors were consistent in artificial and unilateral clinical defects.

Results

This study included 518 normal CT data, with 415 in training set and 103 in testing set, and 17 real patient data, with 2 midspan defects and 15 unilateral defects. Reconstruction of midspan clinical defects assessed by experts is acceptable. The cosine similarity in the reconstruction of artificial defects and unilateral clinical defects is 0.97 ± 0.01 and 0.96 ± 0.01, P = 0.695. The mean error in the reconstruction of artificial defects and unilateral clinical defects is 0.59 ± 0.31 mm and 0.48 ± 0.08 mm, P = 0.09.

Conclusion

GAN-based virtual reconstruction technology has reached a high accuracy in testing set, and statistical tests suggest that it can achieve similar results in real patient data. This study has preliminarily solved the problem of bony midfacial defect without reference.

Peer Review reports

Background

The bony midface has a complex structure and is very important for facial appearance and function [1, 2]. Various reasons may cause midfacial defects [3, 4], and how to restore the normal shape and function of the midface has become an urgent clinical problem [5, 6]. Imaging data, such as CT, CBCT, MRI, etc. can be used to reconstruct the soft and hard tissue morphology [7, 8]. However, due to the lack of normal imaging data as a reference, doctors can only rely on personal experience for surgery [4, 9,10,11].

Virtual reconstruction methods of facial bone mainly include mirror technology, normal template and deformable template technology [2, 12,13,14,15] (Fig. 1). The mirror technology is the most classic, and its basic principle is to project the normal skull of the healthy side onto the affected side to repair the defect [7, 16,17,18]. However, it cannot use for midspan and bilateral defects. Although the normal template and the deformable template technology fill the gap in this part, the repeatability and interactivity restrict their clinical application [13, 15, 19]. Therefore, there is an urgent need for a method to achieve intelligent reconstruction of bony midface in clinical practice.

Fig. 1
figure 1

Main reconstruction methods of facial bone defects: A Three-dimensional image of a facial bone defect. B The mirror technology. C The normal template technology. D The deformable template technology 

Full size image

Ideal virtual bone reconstruction should base on the remaining bone information to obtain more accurate additional information to repair the defect accurately. The deep learning technology makes the above process become reality, which could learn from a large number of complex samples to find specific rules by imitating the human brain [6, 20, 21]. As a new deep learning algorithm, GAN is widely used in the field of medical data processing, showing excellent image generation ability [22,23,24].

Methods

This study aims to use GAN to repair the bony midfacial defect and evaluate its accuracy. To address the research purpose, CT data of the healthy person and real patient were selected from the database of digital cloud platform (http://dsurgery.cn/huaxicloud/) which is a craniofacial CT database of West China Hospital of Stomatology and a display platform for virtual surgery plans. The inclusion criteria of the former were as follows: 1) having no obvious facial deformity 0.2) the interlayer spacing of CT images was 1 mm with tube voltage 120 kV and tube current 335 mA. The inclusion criteria of the latter was that the defects must be confined to bony midface.

This study was approved by the Ethics Committee of West China Hospital of Stomatology, and the safe use of health and medical data was also ensured.

Data acquisition

The normal and real patient images of CT data in DICOM format were downloaded from the database of digital cloud platform.

Artificial defects construction

According to the anatomy, the bony midface was divided into five sub-unit structural regions (Fig. 2). Normal CT data were imported into Mimics 16.0 (Materialise, Leuven, Belgium) to obtain the normal 3D model. Then sphere, cuboid or semi-cylindrical phantoms were constructed in the model to simulate bone defects (Fig. 3). Finally, the artificial defect images were obtained and exported in DICOM format for later use.

Fig. 2
figure 2

Sub-unit partition of midfacial bone: frontal sinus-frontal bone (I), naso-orbital-ethmoid (II), infraorbital margin-maxillary sinus (III), zygomatic complex (IV), and residual maxilla (V)

Full size image
Fig. 3
figure 3

Five kinds of artificial defect construction of bony midface

Full size image

GAN completes training and testing

The normal data and corresponding artificial defects were imported into GAN for training. All data are divided into training set and testing set with a ratio of 8:2. The GAN structure used in this study is shown in Fig. 4, which contains a generator and a discriminator. Its interference factors were artificially set as follows to improve learning difficulty and prevent overfitting: 1) Image preprocessing-including random horizontal flipping of CT slices (probability 0.5); 2) random scaling with ratio from 0.8 to 1.2; 3) random rotation (maximum rotation angle was 11°); 4) adding Gaussian noise.

Fig. 4
figure 4

Basic structure of GAN: The normal image (A) is artificially constructed to form a defect image (B), and the generator generates a reconstructed image (C). Discriminator verifies the similarity between normal image (A) and reconstructed image (C)

Full size image

The generative model is a Resnet101 [25] pretrained on ImageNet, which takes the random variable z and the defect image x with resolution of 512 × 512 as the inputs, and the output is the reconstructed image G(x,z) with resolution of 512 × 512. The discriminative model takes x and the generated G(x,z) as inputs, followed by 3 convolution layers with kernel size of 3, batch normalization with leakyReLU [26] as activation function, and outputs a comprehensive similarity score D(x,G(x,z)). The model is implemented via PyTorch [27] which is already publicly available and Adam [28] optimizer with the initial learning rate of 0.002. The server is Linux OS with the hardware of CPU Intel Xeon E5-2620 @2.4 GHz, four NVIDIA Tesla Titan GPUs, and 128 GB of RAM. After GAN completes training, the reconstructed images in JPG format were generated. These images can be imported into separate software for evaluation.

Clinical defects reconstruction

The real patient data were imported into Mimics 16.0 to obtain the clinical 3D model. A surgeon placed an aforesaid phantom on the model to cover the defect, and imported the model into GAN for reconstructing. For unilateral defects, the surgeon additionally used mirror technology to reconstruct the same delineated area. Specifically, a series of anatomic landmarks on the facial midsagittal plane were selected to represent the mirroring plane [29]. Combined with fine manual adjustment, the reconstructed shape of a mirror technology can be considered correct (Fig. 5).

Fig. 5
figure 5

Delineation of the region of interest and usage of mirror technology

Full size image

Accuracy assessment

Firstly, the reconstructed images were paired with the correct images to calculate the cosine similarity, which is a significant indicator to evaluate the similarity of two objects [30]. The CT images are converted to grayscale images with 8 bits per pixel using a Python script (Python version 3.9). Then, the reconstructed images were imported into MIMICS 16.0 to obtain the reconstructed 3D model. The reconstructed 3D model and the correct 3D model were imported into Geomagic Studio 2013 software (Raindrop Geomagic Studio 2013®, Raindrop Geomagic, Inc., NC, USA) for registering and calculating the mean error of the two surfaces. As for midspan clinical defects, 4 experienced maxillofacial/plastic surgeons were invited to evaluate the effect of the reconstructed area. The content of the evaluation is anatomical similarity, edge continuity, and whether the overall shape meets physiological and aesthetic requirements.

Statistical analysis

The SPSS 26.0 statistical software package (IBM, Armonk, NY, USA) was used for data analysis. All values are presented as the mean ± standard deviation. For the two-group comparison, P values were derived from the Mann–Whitney U test to determine differences between groups with unbalanced non-normal data. For all comparisons, P < 0.05 was considered statistically significant.

Results

This study included 518 normal CT data, with 415 in training set and 103 in testing set, and 17 real patient data, of which 15 cases of unilateral defects were included in the statistical analysis. The model was trained for 40 h on Linux OS with the hardware of CPU Intel Xeon E5-2620 @2.4 GHz, four NVIDIA Tesla Titan GPUs, and 128 GB of RAM. The cosine similarity and the mean error in the reconstruction of artificial defects are respectively 0.97 ± 0.01 and 0.59 ± 0.31 mm. The sub-units and the overall situation are shown in Table 1. The reconstruction effect of partial artificial defect is shown in Fig. 6. The cosine similarity and the mean error in the reconstruction of clinical defects are respectively 0.96 ± 0.01 and 0.48 ± 0.08 mm. Causes of defect and accuracy of reconstruction in 15 cases of real patient data are shown in Table 2. The reconstruction effect of partial unilateral clinical defect is shown in Fig. 7.

Table 1 The results of the cosine similarity and the mean error of the reconstruction of artificial defects in each sub-unit and overall 
Full size table
Fig. 6
figure 6

Partial reconstruction effect of five sub-units in the artificial defects

Full size image
Table 2 The causes of defect and the results of the cosine similarity and the mean error of the reconstruction of clinical defects in each case
Full size table
Fig. 7
figure 7

Partial reconstruction effect in the unilateral clinical defects: A Three-dimensional model of clinical defect. B Reconstructed model C Registration of the reconstructed model with the correct reference 

Full size image

Figure 8 shows 3D models and reconstructed models of two midspan clinical defects, which was considered acceptable by experts.

Fig. 8
figure 8

Reconstruction effect in the midspan clinical defects: A Three-dimensional model of clinical defect and region of interest. B Reconstructed model. C The shape of the reconstructed bone block

Full size image

The box plots show that the reconstruction accuracy for unilateral clinical defects and artificial defects is similar in distribution (Fig. 9). The results show that the difference between the cosine similarity (P = 0.695 > 0.05, U = 724) and the mean error (P = 0.09 > 0.05, U = 459) in the two types of defects’ reconstruction were not statistically significant.

Fig. 9
figure 9

Comparison of the cosine similarity and the mean error (mm) for reconstruction of artificial defects and unilateral clinical defect

Full size image

Discussion

The virtual reconstruction technology provides a crucial reference for the reconstruction of the defect in the bony midface, which is a contribution to priori operative procedure [31, 32]. Fuessinger et al. exploited statistical shape model (SSM) to reconstruct naso-orbital-ethmoid and infraorbital region (similar to region II and III in this study), with the mean error of 0.81 mm and 0.75 mm respectively [9]. GASS et al. improved SSM with an average error of 0.26–0.34 mm in orbital floor reconstruction (part of region III) [13]. Semper-Hogg et al. also used SSM to reconstruct zygomatic complex defects (similar to region IV), with a mean error of 0.85 mm [33]. Combining the SSM and Convolution neural network (CNN) which is used to obtain the initial bone shape obtained from pre-traumatic photographs, Xiao et al. reconstructed the large facial defects with a mean error of 3.68 mm [34]. Comparing to the reconstruction results above, the mean error of 0.78 mm in region II, 0.64 mm in region III、and 0.44 mm in region IV were obtained, which indicates that the GAN technology has a higher accuracy. However, it is worth noting that region II has the highest mean error among the five sub-units, which may be due to the more complex cavity structure in the naso-orbital-ethmoid region. These error values can only be used as a reference and other error evaluation methods need to be involved.

It is worth criticizing that most studies did not consider the accuracy of the reconstruction of clinical data or only gave a subjective evaluation [35]. However, real patient data often lack the correct reference. Kodym et al. took the expert-designed cranial implant as the ideal shape of reconstruction [35]. This study used a similar method, through mirror technology to get the correct reference. Through manual fine adjustment, the reconstructed bone block could fit the defect region well. Due to limited clinical data, we used the Mann–Whitney U test to prove whether the good performance in artificial defect reconstruction can be applied to the clinic. The statistical results had shown that the reconstruction effect of GAN-based virtual reconstruction technology on normal data and real patient data is the same.

The main principle of GAN-based virtual reconstruction technology is to reconstruct and repair these defect images layer by layer. Therefore, this study uses cosine similarity to evaluate the similarity between reconstructed images and normal images. The principle is to judge whether the direction of the vector is consistent by transforming the picture into a high-dimensional vector and calculating the cosine value of the angle formed by the two vectors. After the image is represented by vector, the cosine similarity between the reconstructed image \(\mathop{a}\limits^{\rightharpoonup}\) and the corresponding normal image \(\mathop{b}\limits^{\rightharpoonup}\) is calculated. Therefore, the closer cosine similarity is 1, the more accurate it is.

Experts believe that the reconstruction effect of the midspan defects is acceptable, where mirroring technology cannot be applied in this situation. This article found that the effect of reconstruction is not as “excellent” as that of artificial defects. Overfitting of the training set, complexity of clinical cases, and possible artefacts can all affect the accuracy of the reconstruction. But this is enough to save a lot of work, leaving the surgeon with some optional finishing.

Previous virtual reconstruction methods have their own shortcomings. Mirror technology, the gold standard, can only be applied to the unilateral bone defect. The asymmetry of the human craniomaxillofacial bone itself also brings errors to the mirroring technique [36]. The normal template technology looks for normal human skull as a reference [12]. However, it is very difficult to match craniomaxillofacial bones with complex three-dimensional structures only by the naked eye or linear parameters. The manual operation of our method is just to select the reconstruction range of CT images. The total training process takes 40 h, and the reconstruction of a single case only takes 7–8 min, which makes GAN technology more efficient than the above technologies. But there is a high demand for equipment to build GAN networks, so the software of GAN-based technology and open network platform are our next goal.

Based on the GAN technology and preoperative virtual design software, this study optimized the procedure of preoperative virtual plan, which directly draws the region of interest. Taking the reconstruction results as a reference, the new preoperative virtual plan can also be applied to tumor reconstruction, fracture reduction and contour shaping. The quick and simple strategy can realize automatic, intelligent and personalized design of virtual reconstruction, which is more suitable for clinical application. Through the application on artificial and clinical defect, we find the GAN-assisted virtual reconstruction has a higher accuracy, stability and feasibility compared the above methods.

Taking normal human data as a reference for defect repair has become the mainstream of virtual repair, which heavily relies on the quality of data. Many observational reports have shown that gender and age may affect the parameters of the three-dimensional morphology of craniofacial bones [37, 38]. Including population of different genders and ages as much as possible could balance the samples. The generalization and accuracy of the GAN technology could be improved through the following two ways: The one is to expand the number of samples, rationalizing the composition of training set, validation set and test set data to prevent overfitting; The other is to establish the identification system in the database, in order to improve the sample quality. By screening CT data with similar characteristics to the target to be reconstructed, better results can be achieved on the basis of small sample training. The method can also be applied to other bones or other digital imaging techniques.

Conclusion

The GAN-based virtual reconstruction technology can achieve accurate reconstruction. Compared with existing technologies, GAN-based technology has higher accuracy and has the potential to become the standard technology.

Data Availability

The data presented in this study are available on request from the corresponding author.

Code availability

Not applicable.

Abbreviations

GAN:

Generative adversarial network

CT:

Computerized tomography

CBCT:

Cone-beam computed tomography

MRI:

Magnetic resonance imaging

DICOM:

Digital Imaging and Communications in Medicine

SSM:

Statistical shape model

References

  1. Hill JL, Vasconez HC. Midfacial fractures. Ferraro’s Fundamentals of Maxillofacial Surgery: Springer; 2015. p. 185–190.

  2. Fuessinger MA, Schwarz S, Gass M, Poxleitner P, Brandenburg L, Schlager S, et al. The statistical shape model as a quality assurance measure in the treatment of complex midface fractures: a case control study. Head & Face Medicine. 2021;17(1):1–7.

    Article  Google Scholar 

  3. Ghosh R, Kulandaswamy G. Facial fractures. J Craniofac Surg. 2018;29:e334–40.

    Article  Google Scholar 

  4. Oh J-h. Recent advances in the reconstruction of cranio-maxillofacial defects using computer-aided design/computer-aided manufacturing. Maxillofac Plast Reconstr Surg. 2018;40(1):1–7.

    Article  Google Scholar 

  5. Bell RB. Computer planning and intraoperative navigation in cranio-maxillofacial surgery. Oral and Maxillofacial Surg Clin. 2010;22(1):135–56.

    Article  Google Scholar 

  6. Kodym O, Španěl M, Herout A. Skull shape reconstruction using cascaded convolutional networks. Comput Biol Med. 2020;123:103886.

    Article  Google Scholar 

  7. Schramm A, Suarez-Cunqueiro M, Rücker M, Kokemueller H, Bormann KH, Metzger M, et al. Computer-assisted therapy in orbital and mid-facial reconstructions. Int J Med Robot. 2009;5(2):111–24.

    CAS  Article  Google Scholar 

  8. Ramanathan M, Panneerselvam E, Raja VKK. 3D planning in mandibular fractures using CAD/CAM surgical splints—A prospective randomized controlled clinical trial. J Craniomaxillofac Surg. 2020;48(4):405–12.

    Article  Google Scholar 

  9. Fuessinger MA, Schwarz S, Neubauer J, Cornelius C-P, Gass M, Poxleitner P, et al. Virtual reconstruction of bilateral midfacial defects by using statistical shape modeling. J Craniomaxillofac Surg. 2019;47(7):1054–9.

    Article  Google Scholar 

  10. Ehrenfeld M, Manson PN, Prein J. Principles of internal fixation of the craniomaxillofacial skeleton.Trauma and Orthognathic Surgery: Thieme; 2012.

  11. Rückschloß T, Ristow O, Kühle R, Weichel F, Roser C, Aurin K, et al. Accuracy of laser-melted patient-specific implants in genioplasty—A three-dimensional retrospective study. J Craniomaxillofac Surg. 2020;48(7):653–60.

    Article  Google Scholar 

  12. Buonamici F, Furferi R, Genitori L, Governi L, Marzola A, Mussa F, et al. Reverse engineering techniques for virtual reconstruction of defective skulls: an overview of existing approaches. Comput Aided Des Appl. 2018;16(1):103–12.

    Article  Google Scholar 

  13. Gass M, Füßinger MA, Metzger MC, Schwarz S, Bähr JD, Brandenburg L, et al. Virtual reconstruction of orbital floor defects using a statistical shape model. J Anat. 2022;240(2):323–9.

    Article  Google Scholar 

  14. Hierl T, Doerfler HM, Huempfner-Hierl H, Kruber D. Evaluation of the Midface by Statistical Shape Modeling. J Oral Maxillofac Surg. 2021;79(1):202.e1–202.e6.

    Article  Google Scholar 

  15. Verma S, Gonzalez M, Schow SR, Triplett RG. Virtual Preoperative Planning and Intraoperative Navigation in Facial Prosthetic Reconstruction: A Technical Note. Int J Oral Maxillofac Implants. 2017;32(2):e77–81.

    Article  Google Scholar 

  16. Egger J, Gall M, Tax A, Ücal M, Zefferer U, Li X, et al. Interactive reconstructions of cranial 3D implants under MeVisLab as an alternative to commercial planning software. PLoS ONE. 2017;12(3):e0172694.

    Article  Google Scholar 

  17. Kwon T-G, Park H-S, Ryoo H-M, Lee S-H. A comparison of craniofacial morphology in patients with and without facial asymmetry—a three-dimensional analysis with computed tomography. Int J Oral Maxillofac Surg. 2006;35(1):43–8.

    Article  Google Scholar 

  18. Wagner MEH, Lichtenstein JT, Winkelmann M, Shin HO, Gellrich NC, Essig H. Development and first clinical application of automated virtual reconstruction of unilateral midface defects. J Craniomaxillofac Surg. 2015;43(8):1340–7.

    Article  Google Scholar 

  19. Buonamici F, Furferi R, Genitori L, Governi L, Marzola A, Mussa F, et al. Reverse Engineering Techniques for Virtual Reconstruction of Defective Skulls: an Overview of Existing Approaches. Comput-Aided Des Appl. 2018;16(1):103–12.

    Article  Google Scholar 

  20. Barragan-Montero A, Javaid U, Valdes G, Nguyen D, Desbordes P, Macq B, et al. Artificial intelligence and machine learning for medical imaging: A technology review. Phys Med. 2021;83:242–56.

    Article  Google Scholar 

  21. Chang AX, Funkhouser T, Guibas L, Hanrahan P, Huang Q, Li Z, et al. Shapenet: An information-rich 3d model repository. Technical Report arXiv. 2015:1512.03012.

  22. Lan L, You L, Zhang Z, Fan Z, Zhao W, Zeng N, et al. Generative adversarial networks and its applications in biomedical informatics. Front Public Health. 2020;8:164.

    Article  Google Scholar 

  23. Litany O, Bronstein A, Bronstein M, Makadia A, editors. Deformable shape completion with graph convolutional autoencoders. Proceedings of the IEEE conference on computer vision and pattern recognition. 2018;1886–95.

  24. Yuan Z, Jiang M, Wang Y, Wei B, Li Y, Wang P, et al. SARA-GAN: Self-Attention and Relative Average Discriminator Based Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction. Front Neuroinform. 2020;14:58.

    Article  Google Scholar 

  25. He K, Zhang X, Ren S, Sun J, editors. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 770–8.

  26. He K, Zhang X, Ren S, Sun J, editors. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE international conference on computer vision. 2015;1026–34.

  27. Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, et al. Automatic differentiation in pytorch. In: NIPS Workshop. 2017. p. 4–9.

    Google Scholar 

  28. Kingma DP, Ba J. Adam: a method for stochastic optimization. arXiv preprint arXiv. 2014:1412.6980.

  29. Gui H, Yang H, Zhang S, Shen SG, Ye M, Schmelzeisen R. Mirroring Tool: The Simplest Computer-Aided Simulation Technology? J Craniofac Surg. 2015;26(7):2115–9.

    Article  Google Scholar 

  30. Wei G, Wang J, Lu M, Wu J, Wei C. Similarity measures of spherical fuzzy sets based on cosine function and their applications. IEEE Access. 2019;7:159069–80.

    Article  Google Scholar 

  31. Xiao D, Lian C, Wang L, Deng H, Lin HY, Thung KH, et al. Estimating Reference Shape Model for Personalized Surgical Reconstruction of Craniomaxillofacial Defects. IEEE Trans Biomed Eng. 2021;68(2):362–73.

    Article  Google Scholar 

  32. Steinbacher DM. Three-Dimensional Analysis and Surgical Planning in Craniomaxillofacial Surgery. J Oral Maxillofac Surg. 2015;73(12):S40–56.

    Article  Google Scholar 

  33. Semper-Hogg W, Fuessinger MA, Schwarz S, Ellis E 3rd, Cornelius CP, Probst F, et al. Virtual reconstruction of midface defects using statistical shape models. Journal of Cranio-Maxillofacial Surgery. 2017;45(4):461–6.

    Article  Google Scholar 

  34. Xiao D, Wang L, Deng H, Thung KH, Zhu J, Yuan P, et al. Estimating Reference Bony Shape Model for Personalized Surgical Reconstruction of Posttraumatic Facial Defects. Med Image Comput Comput Assist Interv. 2019;11768:327–35.

    PubMed  PubMed Central  Google Scholar 

  35. Kodym O, Spanel M, Herout A. Deep learning for cranioplasty in clinical practice: Going from synthetic to real patient data. Comput Biol Med. 2021;137:104766.

    Article  Google Scholar 

  36. Kim T-Y, Baik J-S, Park J-Y, Chae H-S, Huh K-H, Choi S-C. Determination of midsagittal plane for evaluation of facial asymmetry using three-dimensional computed tomography. Imaging science in dentistry. 2011;41(2):79–84.

    CAS  Article  Google Scholar 

  37. Wong R, Chau A, Hägg U. 3D CBCT McNamara’s cephalometric analysis in an adult southern Chinese population. Int J Oral Maxillofac Surg. 2011;40(9):920–5.

    CAS  Article  Google Scholar 

  38. Özer CM, Öz II, Serifoglu I, Büyükuysal MÇ, Barut Ç. Evaluation of eyeball and orbit in relation to gender and age. J Craniofac Surg. 2016;27(8):e793–800.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Regional Innovation Cooperation Project of Sichuan Province (grant number: 2020YFG0012) and Shenzhen Fundamental Research Program (grant number: JCYJ20180228164057158).

Author information

Author notes

  1. Yu-Tao Xiong and Wei Zeng contributed equally to this work. 

Authors and Affiliations

  1. State Key Laboratory of Oral Diseases and National Clinical Research Centre for Oral Diseases and Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University, No.14, 3rd section of Ren Min Nan Road, Chengdu, 610041, China

    Yu-Tao Xiong, Wei Zeng, Chang Liu, Jun-Tian Chen & Wei Tang

  2. Machine Intelligence Laboratory, College of Computer Science, Sichuan University, Chengdu, 610065, China

    Lei Xu & Ji-Xiang Guo

  3. Department of Stomatology, the People’s Hospital of Longhua, Shenzhen, 518109, China

    Xin-Ya Du

Authors
  1. Yu-Tao Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ji-Xiang Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Chang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jun-Tian Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Xin-Ya Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Wei Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Yu-Tao Xiong: Conceptualization, data curation and labelling, Writing—Original Draft. Wei Zeng: Investigation, data curation, writing—review & editing. Lei Xu: Methodology, validation, data curation. Ji-Xiang Guo: Investigation, writing—review & editing. Chang Liu: Methodology, resources, supervision. Jun-Tian Chen: Methodology, validation, data curation. Xin-Ya Du: Methodology, validation. Wei Tang: Methodology, project administration, writing—review & editing, supervision, resources. All authors read and approved the final manuscript. 

Corresponding author

Correspondence to Wei Tang.

Ethics declarations

Ethics approval and consent to participate

The data of a normal and clinical patient were selected for the purpose of study. This study was approved by the ethics committee of West China Hospital of Stomatology (No. WCHSIRB-D-2021–063).

Informed consent was obtained from all individual participants included in the study. 

Consent for publication

The participant has consented to the submission of the case report to the journal.

Conflicts of interests

The authors declare no conflict of interest.

Footnotes

This article has two supplements. Additional file 1 shows the CT image reconstructed by GAN, and Additional file 2 shows 3D models of unilateral clinical data from 15 cases.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

(PDF 624 kb)

Additional file 2.

(PDF 873 kb)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Xiong, YT., Zeng, W., Xu, L. et al. Virtual reconstruction of midfacial bone defect based on generative adversarial network. Head Face Med 18, 19 (2022). https://doi.org/10.1186/s13005-022-00325-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13005-022-00325-2

Keywords

  • Virtual Surgical Planning
  • Midface Reconstruction
  • Generative Adversarial Networks

Head & Face Medicine

ISSN: 1746-160X

Contact us