Fully automatic landmarking of syndromic 3D facial surface scans using 2D images

JJ Bannister, SR Crites, JD Aponte, DC Katz, M Wilms… - Sensors, 2020 - mdpi.com
JJ Bannister, SR Crites, JD Aponte, DC Katz, M Wilms, OD Klein, FPJ Bernier, RA Spritz…
Sensors, 2020mdpi.com
3D facial landmarks are known to be diagnostically relevant biometrics for many genetic
syndromes. The objective of this study was to extend a state-of-the-art image-based 2D
facial landmarking algorithm for the challenging task of 3D landmark identification on
subjects with genetic syndromes, who often have moderate to severe facial dysmorphia. The
automatic 3D facial landmarking algorithm presented here uses 2D image-based facial
detection and landmarking models to identify 12 landmarks on 3D facial surface scans. The …
3D facial landmarks are known to be diagnostically relevant biometrics for many genetic syndromes. The objective of this study was to extend a state-of-the-art image-based 2D facial landmarking algorithm for the challenging task of 3D landmark identification on subjects with genetic syndromes, who often have moderate to severe facial dysmorphia. The automatic 3D facial landmarking algorithm presented here uses 2D image-based facial detection and landmarking models to identify 12 landmarks on 3D facial surface scans. The landmarking algorithm was evaluated using a test set of 444 facial scans with ground truth landmarks identified by two different human observers. Three hundred and sixty nine of the subjects in the test set had a genetic syndrome that is associated with facial dysmorphology. For comparison purposes, the manual landmarks were also used to initialize a non-linear surface-based registration of a non-syndromic atlas to each subject scan. Compared to the average intra- and inter-observer landmark distances of 1.1 mm and 1.5 mm respectively, the average distance between the manual landmark positions and those produced by the automatic image-based landmarking algorithm was 2.5 mm. The average error of the registration-based approach was 3.1 mm. Comparing the distributions of Procrustes distances from the mean for each landmarking approach showed that the surface registration algorithm produces a systemic bias towards the atlas shape. In summary, the image-based automatic landmarking approach performed well on this challenging test set, outperforming a semi-automatic surface registration approach, and producing landmark errors that are comparable to state-of-the-art 3D geometry-based facial landmarking algorithms evaluated on non-syndromic subjects.
MDPI
以上显示的是最相近的搜索结果。 查看全部搜索结果