Abstract:
With the development of artificial intelligence technology and the increasing demand for minimally invasive surgery, the intelligentization of minimally invasive surgery has become a current research hotspot. Surgical instrument segmentation is a highly promising technology that can improve the performance of minimally invasive endoscopic imaging systems, surgical video analysis systems, and other related systems. This article summarizes the semantic and instance segmentation methods of minimally invasive surgical instruments based on deep learning, deeply analyzes the supervision methods of training algorithms, network structure improvements, and attention mechanisms, and then discusses the methods based on the Segment Anything Model. Given that deep learning methods have extremely high requirements for data, current data augmentation methods have also been explored. Finally, a summary and outlook on instrument segmentation technology are provided.