欢迎您访问《智慧农业(中英文)》官方网站! English

Smart Agriculture ›› 2022, Vol. 4 ›› Issue (4): 144-155.doi: 10.12133/j.smartag.SA202210001

• 信息处理与决策 • 上一篇    下一篇

基于深度图像的多姿态肉牛体尺自动测量方法

叶文帅1,2(), 康熙2,3, 贺志将1,2, 李孟飞1,2, 刘刚1,2()   

  1. 1.中国农业大学智慧农业系统集成研究教育部重点实验室,北京 100083
    2.中国农业大学农业农村部农业信息获取技术重点实验室,北京 100083
    3.浙大宁波理工学院 计算机与数据工程学院,浙江 宁波 315000
  • 收稿日期:2022-10-06 出版日期:2022-12-30
  • 基金资助:
    国家重点研发计划项目(2021YFD1300502)
  • 作者简介:叶文帅(1997-),男,硕士研究生,研究方向为农业关键信息技术。E-mail:yewenshuai@cau.edu.cn
  • 通信作者:

Automatic Measurement of Multi-Posture Beef Cattle Body Size Based on Depth Image

YE Wenshuai1,2(), KANG Xi2,3, HE Zhijiang1,2, LI Mengfei1,2, LIU Gang1,2()   

  1. 1.Key Lab of Smart Agriculture Systems, Ministry of Education, China Agricultural University, Beijing 100083, China
    2.Key Laboratory of Agricultural Information Acquisition Technology, Ministry of Agriculture and Rural Affairs, China Agricultural University, Beijing 100083, China
    3.School of Computing and Data Engineering, NingboTech University, Ningbo 315200, China
  • Received:2022-10-06 Online:2022-12-30

摘要:

养殖场中肉牛较为活跃,采集得到的图像数据中肉牛姿态多变,肉牛姿态端正帧较少,导致自动测量肉牛体尺困难。针对以上问题,本研究通过分析肉牛骨架特征和肉牛图像边缘轮廓特征,提出一种多姿态肉牛体尺自动测量方法。首先,利用深度相机Azure Kinect DK从正上方采集肉牛俯视深度视频数据,对视频数据进行分帧处理;其次,对原始深度图像进行预处理,将肉牛从复杂的背景中提取出来;再次,利用Zhang-Suen算法提取目标图像肉牛骨架,检测骨架交点和端点,分析肉牛头部特征,并确定头部去除点,去除图像中肉牛头部信息;最后,利用改进的U弦长曲率算法提取肉牛轮廓曲率曲线,根据曲率值确定体尺测点,将体尺测点转换到三维空间中,计算体尺参数。本研究通过分析大量深度图像数据,将图像中肉牛姿态分为左歪、右歪、姿态端正、低头和抬头五类。试验结果表明,本研究提出的基于骨架的多姿态肉牛头部去除方法在5种姿态下的头部去除成功率均高于92%;在23头肉牛不同姿态共46帧深度图像中,利用基于改进U弦长曲率的体尺测点提取方法,测得体直长测量的平均绝对误差为2.73 cm,体高测量的平均绝对误差为2.07 cm,腹宽测量的平均绝对误差为1.47 cm。研究结果可为精确测量多姿态下肉牛体尺提供支撑。

关键词: 肉牛体尺测量, 深度图像, 多姿态, Zhang-Suen算法, 改进的U弦长曲率算法

Abstract:

Beef cattle in the farm are active, which leads the collection of posture of the beef cattle changeable, so it is difficult to automatically measure the body size of the beef cattle. Aiming at the above problems, an automatic measurement method for beef cattle's body size under multi-pose was proposed by analyzing the skeleton features of beef cattle head and the edge contour features of beef cattle images. Firstly, the consumer-grade depth camera Azure Kinect DK was used to collect the top-view depth video data directly above the beef cattle and the video data were divided into frames to obtain the original depth image. Secondly, the original depth image was processed by shadow interpolation, normalization, image segmentation and connected domain to remove the complex background and obtain the target image containing only beef cattle. Thirdly, the Zhang-Suen algorithm was used to extract the beef cattle skeleton of the target image, and calculated the intersection points and endpoints of the skeleton, so as to analyze the characteristics of the beef cattle head to determine the head removal point, and to remove the beef cattle head information from the image. Finally, the curvature curve of the beef cattle profile was obtained by the improved U-chord curvature method. The body measurement points were determined according to the curvature value and converted into three-dimensional spaces to calculate the body size parameters. In this paper, the postures of beef cattle, which were analyzed by a large amount of depth image data, were divided into left crooked, right crooked, correct posture, head down and head up, respectively. The test results showed that the head removal method proposed based on the skeleton in multiple postures hads head removel success rate higher than 92% in the five postures. Using the body measurement point extraction method based on the improved U-chord curvature proposed, the average absolute error of body length measurement was 2.73 cm, the average absolute error of body height measurement was 2.07 cm, and the average absolute error of belly width measurement was 1.47 cm. The method provides a better way to achieve the automatic measurement of beef cattle body size in multiple poses.

Key words: beef body size measurement, depth image, multi-gesture, body size measurement, Zhang-Suen algorithm, improved U-chord curvature body

中图分类号: