长江科学院院报 ›› 2024, Vol. 41 ›› Issue (3): 30-36.DOI: 10.11988/ckyyb.20221436

• 水环境与水生态 • 上一篇    下一篇

基于关键点检测的鱼类游动轨迹提取

石小涛1, 马欣1,2, 黄志勇1,3, 胡晓1,2, 威力斯3   

  1. 1.三峡大学 湖北省鱼类过坝技术国际科技合作基地,湖北 宜昌 443002;
    2.三峡大学 水利与环境学院,湖北 宜昌 443002;
    3.三峡大学 计算机与信息学院,湖北 宜昌 443002
  • 收稿日期:2022-10-28 修回日期:2023-01-01 出版日期:2024-03-01 发布日期:2024-03-05
  • 通讯作者: 黄志勇(1979-),男,湖北武汉人,副教授,博士,主要从事计算机视觉方面的研究。E-mail: hzy@hzy.org.cn
  • 作者简介:石小涛(1981-),男,湖北红安人,教授,博士,主要从事生态水利方面的研究。E-mail:fishlab@163.com
  • 基金资助:
    国家自然科学基金项目(52179070);国家优秀青年科学基金项目(51922065)

Fish Trajectory Extraction Based on Landmark Detection

SHI Xiao-tao1, MA Xin1,2, HUANG Zhi-yong1,3, HU Xiao1,2, WEI Li-si3   

  1. 1. Hubei International Science and Technology Cooperation Base of Fish Passage, China Three Gorges University, Yichang 443002, China;
    2. College of Hydraulic and Environmental Engineering, China Three Gorges University, Yichang 443002, China;
    3. College of Computer and Information Technology, China Three Gorges University, Yichang 443002, China
  • Received:2022-10-28 Revised:2023-01-01 Online:2024-03-01 Published:2024-03-05

摘要: 针对现有的鱼类游动轨迹提取方法不能兼顾轨迹提取效率和准确率的局限性,提出了一种基于鱼类关键点识别与定位的鱼类游动轨迹提取方法。该方法在RetinaFace算法的基础上,通过改进网络结构和损失函数、优化锚框的尺寸设计、编解码鱼类关键点(头部点和形心点)、为鱼类目标的关键点添加额外的标注并制作成鱼类关键点数据集等改进策略,构建了基于关键点识别的鱼类轨迹提取模型。研究结果表明,本研究方法对鱼体关键点识别的精度很高,准确率、召回率、平均精度均值3项精度评价指标分别为97.12%、95.72%、96.42%;所提取的轨迹坐标平均相对偏差为MREx(0.065%,0.092%)、MREy(0.112%,0.011%),与鱼类的实际游动轨迹基本吻合;鱼类目标关键点的识别速度可达32帧/s,能够满足实时提取鱼类轨迹的需求。

关键词: 鱼类, 鱼道监测, 鱼类关键点检测, 鱼类游动轨迹提取, RetinaFace模型

Abstract: The existing fish trajectory extraction methods fail to balance efficiency and accuracy. This study introduces a fish trajectory extraction approach based on fish landmark recognition and location utilizing the RetinaFace algorithm. The method entails constructing a fish trajectory extraction model through enhanced network structure and loss function for landmark detection, optimizing anchor size design, and encoding and decoding fish landmarks (specifically, the head point and centroid point). Additionally, it involves supplementing landmarks of fish targets with extra labels and generating a fish key point dataset. The findings demonstrate that the proposed research method achieves high accuracy in identifying fish landmarks, with precision evaluation indices including an accuracy rate of 97.12%, a recall rate of 95.72%, and a mean average precision of 96.42%. Moreover, the average relative deviation of the extracted trajectory coordinates is MREx(0.065%,0.092%) and MREy(0.112%,0.011%), aligning closely with the actual swimming trajectory of fish. The recognition rate for landmarks of fish targets reaches 32 frames per second, which meets the real-time extraction requirements for fish trajectory recognition.

Key words: fish, fishway monitoring, detection of fish landmark, fish trajectory extraction, RetinaFace model

中图分类号: