Glasses-free Three Dimensional Endoscopic Display System with Multi-face Detection

LENG Yilin; XU Zhaohui

doi:10.3969/j.issn.1671-7104.2022.01.002

Chinese Journal of Medical Instrumentation > 2022 > 46(1): 5-9. > DOI: 10.3969/j.issn.1671-7104.2022.01.002

LENG Yilin, XU Zhaohui. Glasses-free Three Dimensional Endoscopic Display System with Multi-face Detection[J]. Chinese Journal of Medical Instrumentation, 2022, 46(1): 5-9. DOI: 10.3969/j.issn.1671-7104.2022.01.002

Citation:

PDF (1935 KB)

Glasses-free Three Dimensional Endoscopic Display System with Multi-face Detection

LENG Yilin¹,
XU Zhaohui^2, ,

1 School of Communication and Information Engineering, Shanghai University, Shanghai, 200444;
2 Aviation Industry Corporation of China Huadong Photoelectric (Shanghai), Shanghai, 201114

More Information

Received Date: April 18, 2021
Available Online: February 19, 2024

Graphical Abstract

Abstract

Abstract

The glasses-free three dimensional(3D) endoscopic display system provides the surgeon with the depth information of the minimally invasive surgery scene obtained from the binocular perspective, which can effectively relieve the surgeon’s posture fatigue and visual fatigue during the long-term surgery, and assist in the operation of surgical instruments more accurately to reduce the damage to the surrounding tissues of the operation area. However, the glasses-free 3D display device currently has the problem of a narrow optimal viewing zone and easy crosstalk, especially in the surgical teaching application scenario, which performs poorly. In order to overcome the limitation of the narrower field of view, we introduce deep learning algorithms to detect and locate multiple faces, fine-tune the 3D display grating of the endoscope, rearrange pixels, and change the best view area, so that more people can get the best view. The experimental results show that the face detection accuracy of the method is 97.88%, and the detection time is 135 frames/ms, which achieves high accuracy while maintaining real-time performance.
- glasses-free three dimensional display,
- endoscope,
- surgery teaching,
- face detection

FullText(HTML)

References (12)

References

[1]	LIU C, SHI C, WANG T, et al. Bio-inspired multimodal 3D endoscope for image-guided and robotic surgery[J]. Opt Express, 2021, 29(1):145-157.
[2]	谷东兴, 江娟娟, 李建军, 等. 裸眼三维电子腹腔镜系统设计与实现[J]. 中国医疗器械杂志, 2017, 41(5):317-321.
[3]	MAGALHES D S F, SERRA R L, VANNUCCI A L, et al.Glasses-free 3D viewing systems for medical imaging[J].Opt Las Tech, 2012, 44(3):650-655.
[4]	郑民华, 马君俊, 蔡正昊, 等. 腹腔镜手术技术中国专家共识版[J]. 中国实用外科杂志, 2019, 39(11):1136-1141.
[5]	黄可南, 丁新宇, 陈子豪, 等. 裸眼3D胸腔镜与2D胸腔镜在微创食管癌根治术中的临床对比研究[J]. 中国胸心血管外科临床杂志, 2020, 27(4):441-445.
[6]	VIOLA P, JONES M. Robust real-time face detection[J]. Int J Comput Vis, 2004, 57(2):137-154.
[7]	王爱红, 王琼华. 光栅式自由立体显示器概述[J]. 现代显示, 2009(10):12-17.
[8]	REZATOFIGHI H, TSOI N, GWAK J Y, et al. Generalized intersection over union:a metric and a loss for bounding box regression[C]. CVPR. IEEE, 2019:658-666.
[9]	VIDIT J, ERIK L. FDDB:a benchmark for face detection in unconstrained settings[R]. Amherst:University of Massachusetts, 2010.
[10]	YANG S, LUO P, LOY C C, et al.WIDER face:a face detection benchmark[C]. CVPR. IEEE, 2016:5525-5533.
[11]	REDMON J, FARHADI A.YOLOV3:An incremental improvement[C]. Proceedings of 2018 CVPR.IEEE. Washington D.C, USA:IEEE Press, 2018:1-6.
[12]	BOCHKOVSKIY A, WANG C, LIAO H.YOLOv4:optimal speed and accuracy of object detection[C]. arXiv 2020, arXiv:2004. 10934.