Gait Phase Recognition of Dairy Cows based on Gaussian Mixture Model and Hidden Markov Model

doi:10.12133/j.smartag.SA202204003

Abstract

Abstract:

The gait phase of dairy cows is an important indicator to reflect the severity of lameness. IThe accuracy of available gait segmentation methods was not enough for lameness detection. In this study, a gait phase recognition method based on Gaussian mixture model (GMM) and hidden Markov model (HMM) was proposed and tested. Firstly, wearable inertial sensors LPMS-B2 were used to collect the acceleration and angular velocity signals of cow hind limbs. In order to remove the noise of the system and restore the real dynamic data, Kalman filter was used for data preprocessing. The first-order difference of the angular velocity of the coronal axis was selected as the eigenvalue. Secondly, to analyze the long-term continuous recorded gait sequences of dairy cows, the processed data was clustered by GMM in the unsupervised way. The clustering results were taken as the input of the HMM, and the gait phase recognition of dairy cows was realized by decoding the observed data. Finally, the cow gait was segmented into 3 phases, including the stationary phase, standing phase and swing phase. At the same time, gait segmentation was achieved according to the standing phase and swing phase. The accuracy, recall rate and F₁ of the stationary phase were 89.28%, 90.95% and 90.91%, respectively. The accuracy, recall rate and F₁ of the standing phase recognition in continuous gait were 91.55%, 86.71% and 89.06%, respectively. The accuracy, recall rate and F₁ of the swing phase recognition in continuous gait were 86.67%, 91.51% and 89.03%, respectively. The accuracy of cow gait segmentation was 91.67%, which was 4.23% and 1.1 % higher than that of the event-based peak detection method and dynamic time warping algorithm, respectively. The experimental results showed that the proposed method could overcome the influence of the cow's walking speed on gait phase recognition results, and recognize the gait phase accurately. This experiment provides a new method for the adaptive recognition of the cow gait phase in unconstrained environments. The degree of lameness of dairy cows can be judged by the gait features.

Key words: dairy cow lameness, gait phase, gait segmentation, gaussian mixture model, hidden Markov model, Kalman filtering

CLC Number:

ZHANG Kai, HAN Shuqing, CHENG Guodong, WU Saisai, LIU Jifang. Gait Phase Recognition of Dairy Cows based on Gaussian Mixture Model and Hidden Markov Model[J]. Smart Agriculture, 2022, 4(2): 53-63.

Figures/Tables 11

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Table 1

Fig. 9

Table 2

References 20

1	TADICH N, FLOR E, GREEN L. Associations between hoof lesions and locomotion score in 1098 unsound dairy cows[J]. The Veterinary Journal, 2010, 184(1): 60-65.
2	OEHM A W, KNUBBEN-SCHWEIZER G, RIEGER A, et al. A systematic review and meta-analyses of risk factors associated with lameness in dairy cows[J]. BMC Veterinary Research, 2019, 15(1): ID 346.
3	邵军, 林为民, 孙新文, 等. 石河子地区奶牛肢蹄病类型和发病情况调查分析[J]. 中国奶牛, 2017(1): 30-33.
	SHAO J, LIN W, SUN X, et al. Investigation and analysis of limb hoof disease types and incidence in dairy cows in Shihezi area[J]. China Dairy Cattle, 2017 (1) : 30-33.
4	韩书庆, 张晶, 程国栋, 等. 奶牛跛行自动识别技术研究现状与挑战[J]. 智慧农业(中英文), 2020, 2(3): 21-36.
	HAN S, ZHANG J, CHENG G, et al. Research status and challenges of automatic identification technology for cow lameness[J]. Smart Agriculture, 2020, 2 (3) : 21-36.
5	程国栋, 吴建寨, 邢丽玮, 等. 基于IMU的细粒度奶牛行为判别[J]. 中国农业大学学报, 2022, 27(4):179-186.
	CHENG G, WU J, XING L, etc. The behavior discrimination of fine-grained dairy cows based on IMU[J].Journal of China Agricultural University, 2022, 27 (4):179-186.
6	LI Z, ZHANG Q, LYU S, et al. Fusion of RGB, optical flow and skeleton features for the detection of lameness in dairy cows[J]. Biosystems Engineering, 2022, 218: 62-77.
7	ALSAAOD M, NIEDERHAUSER J J, BEER G, et al. Development and validation of a novel pedometer algorithm to quantify extended characteristics of the locomotor behavior of dairy cows[J]. Journal of Dairy Science, 2015, 98(9): 6236-6242.
8	ZHAO K, BEWLEY J M, HE D, et al. Automatic lameness detection in dairy cattle based on leg swing analysis with an image processing technique[J]. Computers and Electronics in Agriculture, 2018, 148: 226-236.
9	宋怀波, 姜波, 吴倩, 等. 基于头颈部轮廓拟合直线斜率特征的奶牛跛行检测方法[J]. 农业工程学报, 2018, 34(15): 190-199.
	SONG H, JIANG B, WU Q, et al. Detection method of cow lameness based on fitting straight line slope characteristics of head and neck contour[J]. Transactions of the CASE, 2018, 34 (15) : 190-199.
10	JIANG B, SONG H, HE D. Lameness detection of dairy cows based on a double normal background statistical model[J]. Computers and Electronics in Agriculture, 2019, 158: 140-149.
11	PENG Y, KONDO N, FUJIURA T, et al. Classification of multiple cattle behavior patterns using a recurrent neural network with long short-term memory and inertial measurement units[J]. Computers and Electronics in Agriculture, 2019, 157: 247-253.
12	HALADJIAN J, BRÜGGE B, NÜSKE S. An approach for early lameness detection in dairy cattle[C]// The 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and The 2017 ACM International Symposium on Wearable Computers. New York, USA: Association for Computing Machinery, 2017.
13	苏力德, 张永, 王健, 等. 基于改进动态时间规整算法的奶牛步态分割方法[J]. 农业机械学报, 2020, 51(7): 52-59.
	SU L, ZHANG Y, WANG J, et al. Gait segmentation method for dairy cows based on improved dynamic time warping algorithm[J]. Transactions of the CSAM, 2020, 51 (7) : 52-59.
14	张向刚, 唐海, 付常君, 等. 一种基于隐马尔科夫模型的步态识别算法[J]. 计算机科学, 2016, 43(7): 285-289, 302.
	ZHANG X, TANG H, FU C, et al. A gait recognition algorithm based on hidden Markov model[J]. Computer Science, 2016, 43 (7) : 285-289, 302.
15	HAJI GHASSEMI N, HANNINK J, MARTINDALE C F, et al. Segmentation of gait sequences in sensor-based movement analysis: A comparison of methods in Parkinson's disease[J]. Sensors (Basel), 2018, 18(1):ID 145
16	ROTH N, KUDERLE A, ULLRICH M, et al. Hidden Markov model based stride segmentation on unsupervised free-living gait data in Parkinson's disease patients[J]. Journal of Neuro Engineering and Rehabilitation, 2021, 18(1): ID 93.
17	王东源, 王玉舜, 谷禹, 等. 天津地区奶牛蹄病分析研究[J]. 天津农学院学报, 2015, 22(2): 37-39.
	WANG D, WANG Y, GU Y, et al. Analysis of cow hoof disease in Tianjin[J]. Journal of Tianjin Agricultural University, 2015, 22(2): 37-39.
18	XIA R, ZHANG Q, DENG X. Multiscale Gaussian convolution algorithm for estimate of Gaussian mixture model[J]. Communications in Statistics-Theory and Methods, 2018, 48(23): 5889-5910.
19	RABINER L R. A Tutorial on Hidden Markov models and selected applications in speech recognition[M]// WAIBEL A, LEE K-F. Readings in speech recognition. San Francisco: Morgan Kaufmann, 1990.
20	ALSAAOD M, LUTERNAUER M, HAUSEGGER T, et al. The cow pedogram—Analysis of gait cycle variables allows the detection of lameness and foot pathologies[J]. Journal of Dairy Science, 2017, 100(2): 1417-1426.

时相	初始概率	权重	均值	方差
静立相	0	1	0.002	0.027
站立相	0	1	-0.251	3.904
摆动相	1	1	0.357	1976.724

时相	P/%	R/%	Sp/%	Se/%	F₁/%
静立相	89.28	90.95	93.83	90.95	90.91
站立相	91.55	86.71	95.51	86.71	89.06
摆动相	86.67	91.51	93.58	91.51	89.02

[1]	GUO Xiuming, ZHU Yeping, LI Shijuan, ZHANG Jie, LYU Chunyang, LIU Shengping. Scale Adaptive Small Objects Detection Method in Complex Agricultural Environment: Taking Bees as Research Object [J]. Smart Agriculture, 2022, 4(1): 140-149.
[2]	ZHANG Xiaoqing, SHAO Song, GUO Xinyu, FAN Jiangchuan. High-Throughput Dynamic Monitoring Method of Field Maize Seedling [J]. Smart Agriculture, 2021, 3(2): 88-99.
[3]	WANG Zijie, LIU Guohai, ZHANG Duo, SHEN Yue, YAO Zhen, ZHANG He. Path Following Model Predictive Control of Four Wheel Independent Drive High Ground Clearance Sprayer [J]. Smart Agriculture, 2021, 3(3): 82-93.
[4]	WANG Fang, TENG Guifa, YAO Jingfa. Multi-Objective Vegetable Transportation and Distribution Path Optimization with Time Windows [J]. Smart Agriculture, 2021, 3(3): 152-161.
[5]	HAO Wangli, YU Peiyan, HAO Fei, HAN Meng, HAN Jiwan, SUN Weirong, LI Fuzhong. Foxtail Millet Ear Detection Approach Based on YOLOv4 and Adaptive Anchor Box Adjustment [J]. Smart Agriculture, 2021, 3(1): 63-74.
[6]	ZHU Chao, WU Fan, LIU Changbin, ZHAO Jianxiang, LIN Lili, TIAN Xueying, MIAO Teng. Tassel Segmentation of Maize Point Cloud Based on Super Voxels Clustering and Local Features [J]. Smart Agriculture, 2021, 3(1): 75-85.
[7]	LI Yan, SHEN Jie, XIE Hang, GAO Guangyin, LIU Jianxiong, LIU Jie. Detection and Grading Method of Pomelo Shape Based on Contour Coordinate Transformation and Fitting [J]. Smart Agriculture, 2021, 3(1): 86-95.
[8]	MAO Wenju, LIU Heng, WANG Dongfei, YANG Fuzeng, LIU Zhijie. Improved AODV Routing Protocol for Multi-Robot Communication in Orchard [J]. Smart Agriculture, 2021, 3(1): 96-108.
[9]	ZHU Dengsheng, FANG Hui, HU Shaoming, WANG Wenquan, ZHOU Yansuo, WANG Hongyan, LIU Fei, HE Yong. Development and Application of an Intelligent Remote Management Platform for Agricultural Machinery [J]. Smart Agriculture, 2020, 2(2): 67-81.
[10]	Zhou Chengquan, Ye Hongbao, Yu Guohong, Hu Jun, Xu Zhifu. A fast extraction method of broccoli phenotype based on machine vision and deep learning [J]. Smart Agriculture, 2020, 2(1): 121-132.
[11]	Wan Liang, Cen Haiyan, Zhu Jiangpeng, Zhang Jiafei, Du Xiaoyue, He Yong. Using fusion of texture features and vegetation indices from water concentration in rice crop to UAV remote sensing monitor [J]. Smart Agriculture, 2020, 2(1): 58-67.
[12]	Zhang Haifeng, Li Yang, Zhang Yu, Song Lijuan, Tang Lixin, Bi Hongwen. Design and implementation of intelligent terminal service system for greenhouse vegetables based on cloud service:A case study of Heilongjiang province [J]. Smart Agriculture, 2019, 1(3): 87-99.
[13]	Gao Wanlin, Zhang Ganghong, Zhang Guofeng, Huang Feng, Wu Dehua, Tao Sha, Wang Minjuan. Original innovation of key technologies leading healthy development of smart agricultural [J]. Smart Agriculture, 2019, 1(1): 8-19.
[14]	Zhu Yeping, Li Shijuan, Li Shuqin. Research on key technologies of crop growth process simulation model and morphological 3D visualization [J]. Smart Agriculture, 2019, 1(1): 53-66.
[15]	Liang Hao, Liu Sichen, Zhang Yinuo, Lv Ke. Framework design and application prospect of agricultural product information blockchain [J]. Smart Agriculture, 2019, 1(1): 67-75.