Research Vision

Equip marine machinery with "sharp" and "intelligent" eyes.

 Research Focus

Mainly engaged in marine machine vision, underwater robot visual positioning, and marine robot control research.

 Awards

- 2023: "Director's Innovation Award - Outstanding Engineer," Integrated Department, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences

- 2022: Second Prize, Science and Technology Progress Award, Chinese Society of Image and Graphics, for the project "Key Technologies and Applications of High-Realism 3D Human Body Modeling"

- 2022: First Prize in Monocular Indoor Scene Depth Estimation at the 24th+25th National CAD & CG Academic Conference, China Computer Federation (CCF)

- 2021: "President's Scholarship - Special Award," Shenzhen Institute of Advanced Technology, University of Chinese Academy of Sciences

Social Activities and Positions

- Guest Editor for the special issue of Photonics

- Reviewer for several prestigious journals including Expert Systems With Applications, Artificial Intelligence Review (IF=12.0), Infrared Physics & Technology, and NPL

- 2023: Board Member of the "Joint Laboratory of 3D Machine Vision and Intelligent Systems," Shenzhen Institute of Advanced Technology and Shenzhen Mingrui Ideal Technology Co., Ltd.

- Member of IEEE Young Professionals, IEEE Member, Member of Chinese Society of Image and Graphics, and Member of Asiagraphics

 Project Experience

Vertical Projects

As Principal Investigator:

1. "Research on High-Resolution Real-Time 3D Reconstruction Methods and Systems for Faces," 2019B010149002-2, ¥1.5 million, Principal Investigator, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

As Participant:

1. "High-Precision High-Resolution 4D Imaging Proof-of-Concept Center," ¥3 million, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

2. "Laser Composite Additive Manufacturing Repair and Remanufacturing Technology and Equipment (Task Two: Online 3D Measurement, Model Reconstruction, and Path Planning)," 2017YFB1103602, ¥2.28 million, Major Participant, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

3. "Key Technologies for 3D Visual Perception and Guidance for Industrial Robots," U1613213, ¥2.6 million, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

4. "Development and Industrialization of Human-Robot Collaboration Robots," 2020B090925001, ¥16 million, Participant, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

5. "Technical Service Platform for Inspection, Identification, and Risk Control of Pneumatic Guns and Parts (Components)," GGFW2018020618063670, ¥4.5 million, Participant, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

Horizontal Projects

As Principal Investigator:

1. "Research on Fast Registration Methods in Dynamic 3D Scanning Systems," ¥XX , Fujian University of Technology, Ongoing

As Participant:

1. "Joint Laboratory of 3D Digital Dental Diagnosis and Treatment Technology," SIAT-2023023(210), ¥3 million, Major Participant, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

2. "Joint Laboratory of 3D Machine Vision and Intelligent Systems," SIAT-2023007(194), ¥3 million, Major Participant, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Completed.

Publications

Published 13 SCI journal papers (9 as first/co-first author), 18 EI papers, 3 Chinese papers; holds 19 invention patents (8 authorized), 5 PCT patents, and 1 utility model patent.

 Journal Papers (according to the ranking at the time of publication)

13. Yuping Ye, Feifei Gu, Jixin Liang, Zhenzhong Tang, Zhan Song, "Accuracy of a Novel Stereophotogrammetry System for Full-Arch Digital Implant Impressions: An In Vitro Study and Clinical Case," Measurement (2024) (Accepted, SCI, JCR-Q1, CAS TOP Tier 2)

12. Bingchuan Li, Yuping Ye, Junfeng Yao, Yong Yang, Weixing Xie, Mengyuan Ge. "A Detail-Preserving Method for Medial Mesh Computation in Triangular Meshes," Graphical Models (2024) (SCI, JCR-Q2, CCF-B)

11. Jixin Liang, Yuping Ye*, Di Wu, Siyuan Chen, Zhan Song. "High-efficiency Automated Triaxial Robot Grasping System for Motor Rotors Using 3D Structured Light Sensor," Machine Vision and Applications 35, 132 (2024) (Co-first author, SCI, JCR-Q2)

10. Yuping Ye, Juncheng Han, Jixin Liang, Di Wu, Zhan Song. "Retargeting of Facial Model for Unordered Dense Point Cloud," Computers & Graphics 122 (2024) (CODE, SCI, CCF-C, JCR-Q2)

9. Fang Liu, Wei Cao, Yuping Ye, Feifei Gu, Shiyang Long, Zhan Song. "SGVM: Semantic-Guided Variational Model for Sealing Nail Defect Extraction within Albedo Domain via Photometric Stereo," IEEE Access 11, 121882-121891 (2023) (SCI, JCR-Q2)

8. Jixin Liang, Yuping Ye*, Feifei Gu, Jiankai Zhang, Juan Zhao, Zhan Song. "A Polarized Structured Light Method for the 3D Measurement of High-Reflective Surfaces," Photonics 6, 695 (2023) (Co-first author, SCI, CSOE-T3, JCR-Q3)

7. Yuping Ye, Siyuan Hao, Zhan Song, Feifei Gu, Juan Zhao. "A novel triangular stereo model for 3D reconstruction of uniaxial MEMS-based structured light system," Optics and Lasers in Engineering 166, 107596-107578 (2023) (SCI, JCR-Q1)

6. Wei Cao, Ruiping Wang, Yuping Ye*, Chu Shi, Zhan Song. "CSIE: Coded strip-patterns image enhancer embedded in structured light-based methods," Optics and Lasers in Engineering 166, 107561-107569 (2023) (Co-first author, SCI, JCR-Q1)

5. Yuping Ye, Zhan Song, Juan Zhao. "High-fidelity 3D real-time facial animation using infrared structured light sensing system," Computers & Graphics 104, 46-58 (2022) (SCI, CCF-C, JCR-Q2). This work received extensive coverage from ScienceNet and various media, including People's Daily.

4. Yuping Ye, Zhan Song, Junguang Guo, Yu Qiao. "SIAT-3DFE: a high-resolution 3D facial expression dataset," IEEE Access 8, 48205-48211 (2020) (DATASET, SCI, JCR-Q2)

3. Yuping Ye, Hongguang Chang, Zhan Song, Juan Zhao. "Accurate infrared structured light sensing system for dynamic 3D acquisition," Applied Optics 59.17, E80-E88 (2020) (SCI, CSOE-T2). This paper received over 70,000 views within two months and a thank-you letter from the Optical Society of America. It was also included in the 2024 list of scientific instruments independently developed by the Chinese Academy of Sciences.

2. Zhao Song, Zhan Song, Yuping Ye. "Eliminating the Effect of Reflectance Properties on Reconstruction in Stripe Structured Light System," Sensors 20.22, 6564 (2020) (SCI, JCR-Q2)

1. Lei Nie, Yuping Ye, Zhan Song. "Method for calibration accuracy improvement of projector-camera-based structured light system," Optical Engineering 56.7, 074101 (2017) (SCI, CSOE-T3)

Conference Papers

1. Juncheng Han, Yuping Ye, Di Wu, Shiyang Long, Zhan Song. "High-precision 3D Facial Landmark Detection with Curvature-fused Graph Attention Network." Bioinformatics and Biomedicine (BIBM). IEEE, 2024 (CODE, EI, CCF-B, Accepted).

2. Hongyu Sun, Siyuan Hao, Yuping Ye#, Juan Zhao, and Zhan Song. "High-accuracy 3D Reconstruction of MEMS Mirrors with Linear Transition Function." 2nd International Conference on Optical Imaging and Measurement (ICOIM), Xi'an, China, 2023, pp. 7-13 (EI, Corresponding Author).

3. Junkai Duan, Zhan Song, Yuping Ye, Feifei Gu. "360 Degree Unique and Robust Matching Method for the Infrared Optical Features of Handheld Target." Proc. SPIE 13070, Speckle 2023: VIII International Conference on Speckle Metrology, 1307003 (EI).

4. Yijun Wang, Yuping Ye, Feifei Gu, Zhan Song, Xiaodong Bai. "Adaptive Head Pose Estimation with Real-time Structured Light." ICASSP 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023 (EI, CCF-B, Top Conference in Signal Processing).

5. Jingjing Wang, Yuping Ye, Wei Cao, Juan Zhao, and Zhan Song. "3D Fingerprint Reconstruction and Registration Based on Binocular Structured Light." In Chinese Conference on Biometric Recognition, pp. 73-84. Singapore: Springer Nature Singapore, 2023 (EI).

6. Jixin Liang, Yuping Ye, Siyuan Chen, Zhan Song. "Automated Triaxial Robot Grasping System for Motor Rotors Using 3D Structured Light Sensor." In 2023 IEEE International Conference on Robotics and Biomimetics (ROBIO), IEEE, 2023 (EI).

7. Di Wu, Yuping Ye, Feifei Gu, Zhan Song. "A Quick Means for the Burnt Skin Area Calculation via Multiple-view Structured Light Sensors." In 2023 IEEE International Conference on Robotics and Biomimetics (ROBIO), IEEE, 2023 (EI).

8. Yijun Wang, Yuping Ye, Zhan Song. "An Efficient 3D Registration Means for Dense Point Clouds Obtained by a Real-Time Structured Light System." In 2023 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp. 239-244. IEEE, 2023 (EI).

9. Chuan Xu, Yuping Ye, Jiankai Zhang, Zhan Song, Juan Zhao, Feifei Gu. "A Few-shot Learning Method for the Defect Inspection of Lithium Battery Sealing Nails." In Proceedings of the 2023 4th International Conference on Computing, Networks and Internet of Things (CNIOT ’23). Association for Computing Machinery, New York, USA, 983–989, 2023 (EI).

10. Wei Cao, Yuping Ye*, Chu Shi, Zhan Song. "CSIE: Coded Strip-patterns Image Enhancement Embedded in Structured Light-based Methods." In Proceedings of the Asian Conference on Computer Vision, pp. 2188-2203, 2022 (Co-first author, EI, CCF-C).

11. Yuping Ye, Zhan Song, and Juan Zhao. "Facial Micro-expression Analysis via a High Speed Structured Light Sensing System." Journal of Image and Graphics 9, no. 1 (2021): 15-19 (EI).

12. Pengju Xie, Yuping Ye, Lijun Shu, and Zhan Song. "A Full-body 3D Reconstruction Using Planar Mirrors." In 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp. 543-547. IEEE, 2021 (EI).

13. Junguang Guo, Feifei Gu, Yuping Ye, and Zhan Song. "An Accurate Speckle 3D Reconstruction System Based on Binocular Endoscope." In 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp. 703-708. IEEE, 2021 (EI).

14. Yuping Ye, Lijun Shu, and Zhan Song. "A Flexible and Accurate Calibration Method for Line Structured Light." In 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp. 709-713. IEEE, 2021 (EI).

15. Lingsheng Kong, Zhan Song, Yuping Ye, Junguang Guo, and Feifei Gu. "A Dual-SLS for Efficient 3D Scanning of Dynamic Objects." In 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1756-1761. IEEE, 2019 (EI).

16. Hualie Jiang, Yuping Ye, Zhan Song, Suming Tang, and Yuming Dong. "An Automatic 3D Textured Model Building Method Using Stripe Structured Light System." In International Conference on Computer Vision Systems, pp. 615-625. Springer, Cham, 2017 (EI).

17. Yuping Ye, and Zhan Song. "An Accurate 3D Point Cloud Registration Approach for the Turntable-based 3D Scanning System." In 2015 IEEE International Conference on Information and Automation, pp. 982-986. IEEE, 2015 (CODE, EI).

18. Yuping Ye, and Zhan Song. "A Practical Means for the Optimization of Structured Light System Calibration Parameters." In 2016 IEEE International Conference on Image Processing (ICIP), pp. 1190-1194. IEEE, 2016 (EI, CCF-C).

 Chinese Papers

1. 王卫军, 徐川, 黄晨, 叶于平. "高精度锻造磨球的不良圆度和飞边视觉检测研究." 集成技术, 2024, 13(4): 108-116.

2. 郑东鑫, 叶于平, 赵娟, 宋展. "基于微机电系统振镜的多频相移正弦结构光系统相位展开误差分析." 集成技术, 2023, 03(02): 11-19.

3. 郭俊广, 谷飞飞, 叶于平, 宋展. "基于双目内窥镜的散斑三维重建系统研究." 集成技术, 2022, 11(01): 13-26.

 Patents

 PCT Patents

1. Jixin Liang, Zhan Song, Yuping Ye, Juan Zhao. "Highly Reflective Surface Three-dimensional Reconstruction Method and Apparatus Based on Polarized Structured Light Camera." WO2024/148994(A1), Date: 2024-07-18.

2. Zhan Song, Dongxin Zheng, Yuping Ye. "Calibration Method for MEMS Galvanometer-based Structured Light Three-dimensional Scanning System." WO2024/183379(A1), Date: 2023-12-08.

3. Zhan Song, Yijun Wang, Yuping Ye. "Face Posture Estimation Method and Apparatus Based on Structured Light System." WO2024/109772(A1), Date: 2023-11-21.

4. Zhan Song, Yuping Ye, Juan Zhao. "Gaze Tracking Method and Apparatus." WO2022/032911(A1), Date: 2020-11-17.

5. Zhan Song, Yuping Ye. "Method and Device for Calibrating Structured-light Three-dimensional Scanning System." WO2017/101150(A1), Date: 2017-06-22.

Here is the polished version of the Chinese Patents section:

Chinese Patents

1. 谷飞飞, 唐振中, 宋展, 叶于平. 口腔种植印模定位仪扫描转移杆的参数标定装置及方法 [P]. 广东省：CN202410548000.9, 2024-05-06.

2. 宋展, 杜烜, 叶于平, 赵娟, 张健凯. 基于实时结构光重建技术的虚拟会议场景交互方法及系统 [P]. 广东省：CN202410278559.4, 2024-03-12.

3. 宋展, 叶于平, 梁积鑫. 点云配准方法、装置、计算机设备及存储介质 [P]. 广东省：CN202311653479.4, 2023-12-04.

4. 叶于平, 梁积鑫, 宋展. 机械臂末端工具中心点标定方法、装置、设备及存储介质 [P]. 广东省：CN202311623751.4, 2023-11-28.

5. 宋展, 王晶晶, 曹伟, 吴迪, 叶于平, 赵娟, 张健恺. 基于双目结构光的3D目标重建方法与装置 [P]. 广东省：CN202310694946.1, 2023-09-08.

6. 刘炫志, 叶于平, 梁积鑫, 郑泽凡, 徐川, 宋展. 自动视觉识别方法及分拣系统 [P]. 广东省：CN202310216821.8, 2023-06-06.

7. 宋展, 郑东鑫, 叶于平. 基于MEMS振镜的结构光三维扫描系统标定方法 [P]. 广东省：CN202310252176.5, 2023-03-06.

8. 梁积鑫, 宋展, 叶于平, 赵娟. 基于偏振结构光相机的高反光表面三维重建方法及装置 [P]. 广东省：CN202310024635.4, 2023-01-09.

9. 宋展, 汪奕鋆, 叶于平, 赵娟. 基于结构光系统的人脸姿态估计方法及装置 [P]. 广东省：CN202211475210.7, 2022-11-23.

10. 黄晓红, 张梅, 叶于平, 倪涧钊. 颞下颌关节腔冲洗及注射导板生成方法及终端 [P]. 福建省：CN2023116302354, 2023-12-01. (已授权)

11. 曹伟, 宋展, 叶于平. 低光图像增强方法、系统、终端以及存储介质 [P]. 广东省：CN115358943A, 2022-11-18.

12. 宋展, 陈思园, 叶于平. 机械手的定位方法、装置、计算机设备和存储介质 [P]. 广东省：CN114677429B, 2022-08-30. (已授权)

13. 宋展, 曹化钊, 王豆豆, 叶于平, 张强. 牙科种植体三维参数获取方法及装置 [P]. 广东省：CN114748201A, 2022-07-15. (已授权)

14. 宋展, 谢鹏举, 叶于平. 基于二维的三维表情拟合方法、装置、设备及存储介质 [P]. 广东省：CN114581572A, 2022-06-03.

15. 宋展, 陈思园, 叶于平. 甲片贴合方法、装置、计算机设备和存储介质 [P]. 广东省：CN113505791B, 2022-02-11. (已授权)

16. 宋展, 叶于平, 赵娟. 视线追踪方法及装置 [P]. 广东省：CN112099622B, 2022-02-01. (已授权)

17. 宋展, 叶于平. 三维激光扫描系统的标定方法、装置和计算机设备 [P]. 广东省：CN113494893B, 2021-11-23. (已授权)

18. 宋展, 叶于平. 多角度三维数据配准方法及装置 [P]. 广东省：CN105574812B, 2018-09-25. (已授权)

19. 宋展, 叶于平. 结构光三维扫描系统的标定方法及装置 [P]. 广东省：CN105551039B, 2017-12-08. (已授权)

Utility Model Patent

1. 苏全新, 叶于平, 谢双云, 赖安. 人体三维扫描设备 [P]. 广东省：CN211674249U, 2020-10-16.