Grain Production Big Data Platform: Progress and Prospects

doi:10.12133/j.smartag.SA202409014

Abstract

Abstract:

[Significance] The explosive development of agricultural big data has accelerated agricultural production into a new era of digitalization and intelligentialize. Agricultural big data is the core element to promote agricultural modernization and the foundation of intelligent agriculture. As a new productive forces, big data enhances the comprehensive intelligent management decision-making during the whole process of grain production. But it facing the problems such as the indistinct management mechanism of grain production big data resources, the lack of the full-chain decision-making algorithm system and big data platform for the whole process and full elements of grain production. [Progress] The big data platform for grain production is a comprehensive service platform that uses modern information technologies such as big data, Internet of Things, remote sensing and cloud computing, and provides intelligent decision-making support for the whole process of grain production based on intelligent algorithms for data collection, processing, analysis and monitoring related to grain production. This paper reviews the progress and challenges in grain production big data, monitoring and decision-making algorithms, as well as big data platforms in China and worldwide. With the development of the Internet of Things and high-resolution multi-modal remote sensing technology, the massive agricultural big data generated by the "Space-Air-Ground" Integrated Agricultural Monitoring System, has laid an important foundation for smart agriculture and promoted the shift of smart agriculture from model-driven to data-driven. However, there are still some problems in field management decision-making, such as the requirements for high spatio-temporal resolution and timeliness of the information are difficult to meet, and the algorithm migration and localization methods based on big data need to be studied. In addition, the agricultural machinery operation and spatio-temporal scheduling algorithm based on remote sensing and Internet of Things monitoring information to determine the appropriate operation time window and operation prescription, needs to be further developed, especially the cross-regional scheduling algorithm of agricultural machinery for summer harvest in China. Aiming at the problems that the monitoring and decision-making algorithms of grain production are not bi-connected, and the integration of agricultural machinery and information perception is insufficient, a framework of the grain production big data intelligent platform is proposed based on digital twins. The platform is based on multi-source heterogeneous grain production big data, incorporates with the full-chain standardized algorithms including data acquisition, information extraction, knowledge map construction, intelligent decision-making, full-chain collaboration of agricultural machinery operations, involving the typical application scenarios such as irrigation, fertilization, pests and diseases, drought and flood disaster emergency response, by digital twins. [Conclusions and Prospects] The emphasis should be the requirements of monitoring at macro-level management and intelligent production at micro-level farm, fully integrating big data technology with artificial intelligence, digital twin, cloud-edge computing, and other emerging technologies. The suggestions and trend for development of grain production big data platform are summarized in three aspects. (1) Creating an open, symbiotic grain production big data platform, with core characteristics such as open interface for crop and environmental sensors, maturity grading and cloud-native packaging mechanism of the core algorithms, highly efficient response to data and decision services. (2) Focusing on the typical application scenarios of grain production, take the exploration of technology integration and bi-directional connectivity as the base, and the intelligent service as the soul of the development path for the big data platform research. (3) the data-algorithm-service self-organizing regulation mechanism, the integration of decision-making information with the intelligent equipment operation, and the standardized, compatible and open service capabilities, can form the new quality productivity forces ensuring food safety, and green efficiency grain production.

Key words: grain production, big data platform, agricultural condition monitoring, intelligent algorithm, decision support, new productive forces

CLC Number:

S126

YANG Guijun, ZHAO Chunjiang, YANG Xiaodong, YANG Hao, HU Haitang, LONG Huiling, QIU Zhengjun, LI Xian, JIANG Chongya, SUN Liang, CHEN Lei, ZHOU Qingbo, HAO Xingyao, GUO Wei, WANG Pei, GAO Meiling. Grain Production Big Data Platform: Progress and Prospects[J]. Smart Agriculture, doi: 10.12133/j.smartag.SA202409014.

Figures/Tables 7

Table 1

Table 2

The big data of grain production in China and abroad

数据类型		国内	国外
农业综合大数据		全国农业科教云平台：全国节水肥料、栽培植保、农情调度、春耕生产、市场等13类涉农信息（www.agricoop.net）；农业农村部大数据发展中心：以农业农村用地一张图中中国10亿多地块信息为基础，涵盖农情、农事、农机、农资、农技、销售和金融等方面数据（https：//www.abdc.org.cn/）	美国农业部：气象、土壤、水文、农业调查等近10大类近30年农业大数据（www.nass.usda.gov；fas.usda.gov/data）；欧盟农业部Agri-food Data Portal：作物类别、种植结构、生育期、农情、灾害监测和市场交易等方面的数据（agridata.ec.europa.eu）
农业专题大数据	农情监测数据	中国农业科学院CHARMS系统、中国科学院CropWatch系统，提供全球或全国农情监测和产量预报服务（http：//cropwatch.com.cn/）	美国CropExplorer和欧盟MARS提供全球农情监测和粮食安全评估数据（https：//ipad.fas.usda.gov/cropexplorer/； https：//joint-research-centre.ec.europa.eu/monitoring-agricultural-resources-mars_en）
	生产数据	中化MAP涵盖遥感、气象、土壤、种植、农田管理等数据，线上服务农田超667万公顷，数据规模PB级（https：//www.sinochem.com.cn/）	FBN涵盖地块、种植、气象、病虫害、市场、物流、农资等数据，汇集0.563亿公顷1 000亿个数据点农田数据和6 800个品种的信息（https：//www.fbn.com/）
	气象数据	中国气象科学数据中心大气再分析数据CMA-RA：1979年至今，10 km逐时（http：//www.nmic.cn/）	欧洲中期天气预报中心ERA5，1940年至今，0.1°逐时；美国NCEP，1948年至今，2.5°逐6小时。（https：//www.ecmwf.int/）
	农机作业数据	全国农机作业远程监测与智能管理调度平台监管全国13个省6.8万台农机，作业地块1 800万个、面积2 666万公顷，总数据55 TB	德国科乐收（CLAAS）公司研发的TELEMATICS系统能够访问机器性能参数、电子数据、作业数据，并进行远程故障维修和智能运维服务（https：//www.claas.co.uk/）
	农业知识图谱	中国农业科学院农业信息研究所构建了农业专业知识服务系统，包含2 000万条农业知识规则，其中粮食生产相关知识不足20% （https：//agri.nais.net.cn/index.html）	Google公司2020年发布了面向通用领域的包含570亿实体关系的大规模知识图谱，但农业领域知识图谱及知识挖掘的应用较少（https：//cloud.tencent.com/developer/news/716354）

Table 2

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

References 47

1	习近平. 发展新质生产力是推动高质量发展的内在要求和重要着力点[J]. 求知, 2024, 6: 4-6.
	XI J P. Developing new productive forces is an intrinsic requirement and an important focus of promoting high-quality development[J]. Seeking knowledge, 2024, 6: 4-6.
2	赵春江. 智慧农业的发展现状与未来展望[J]. 华南农业大学学报, 2021, 42(6): 1-7.
	ZHAO C J. Current situations and prospects of smart agriculture[J]. Journal of South China agricultural university, 2021, 42(6): 1-7.
3	JIANG Q, LI W Y, FAN Z D, et al. Evaluation of the ERA5 reanalysis precipitation dataset over Chinese Mainland[J]. Journal of hydrology, 2021, 595: ID 125660.
4	王彩霞, 黄安宁, 郑鹏, 等. 中国第一代全球陆面再分析(CRA40/Land)气温和降水产品在中国大陆的适用性评估[J]. 高原气象, 2022, 41(5): 1325-1334.
	WANG C X, HUANG A N, ZHENG P, et al. Applicability evaluation of China's first generation of global land surface reanalysis(CRA40/land) air temperature and precipitation products in China mainland[J]. Plateau meteorology, 2022, 41(5): 1325-1334.
5	宋长青, 温孚江, 李俊清, 等. 农业大数据研究应用进展与展望[J]. 农业与技术, 2018, 38(22): 153-156.
	SONG C Q, WEN F J, LI J Q, et al. Progress and prospect of agricultural big data research and application[J]. Agriculture and technology, 2018, 38(22): 153-156.
6	AHMAD BHAT S, HUANG N F. Big data and AI revolution in precision agriculture: Survey and challenges[J]. IEEE access, 2021, 9: 110209-110222.
7	CRAVERO A, PARDO S, GALEAS P, et al. Data type and data sources for agricultural big data and machine learning[J]. Sustainability, 2022, 14(23): ID 16131.
8	DOSHI Z, NADKARNI S, AGRAWAL R, et al. AgroConsultant: Intelligent crop recommendation system using machine learning algorithms[C]// 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA). Piscataway, New Jersey, USA: IEEE, 2018.
9	DUTTA R, LI C, SMITH D, et al. Big data architecture for environmental analytics[M]// IFIP Advances in Information and Communication Technology. Cham: Springer International Publishing, 2015: 578-588.
10	AIKEN V C F, DÓREA J R R, ACEDO J S, et al. Record linkage for farm-level data analytics: Comparison of deterministic, stochastic and machine learning methods[J]. Computers and electronics in agriculture, 2019, 163: ID 104857.
11	VON LÜCKEN C, ACOSTA A, ROJAS N. Solving a many-objective crop rotation problem with evolutionary algorithms[M]// Smart Innovation, Systems and Technologies. Singapore: Springer Singapore, 2021: 59-69.
12	FENZ S, NEUBAUER T, FRIEDEL J K, et al. AI- and data-driven crop rotation planning[J]. Computers and electronics in agriculture, 2023, 212: ID 108160.
13	ZHANG D Y, DING Y, CHEN P F, et al. Automatic extraction of wheat lodging area based on transfer learning method and deeplabv3+ network[J]. Computers and electronics in agriculture, 2020, 179: ID 105845.
14	HAJIMIRZAJAN A, VAHDAT M, SADEGHEIH A, et al. An integrated strategic framework for large-scale crop planning: Sustainable climate-smart crop planning and agri-food supply chain management[J]. Sustainable production and consumption, 2021, 26: 709-732.
15	WU L, TIAN J F, LIU Y L, et al. Multi-objective crop planting structure optimisation based on game theory[J]. Water, 2022, 14(13): ID 2125.
16	WANG H B, CHANG W Q, YAO Y, et al. Cropformer: A new generalized deep learning classification approach for multi-scenario crop classification[J]. Frontiers in plant science, 2023, 14: ID 1130659.
17	SEYDI S T, AMANI M, GHORBANIAN A. A dual attention convolutional neural network for crop classification using time-series Sentinel-2 imagery[J]. Remote sensing, 2022, 14(3): ID 498.
18	吴刚, 彭要奇, 周广奇, 等. 基于多光谱成像和卷积神经网络的玉米作物营养状况识别方法研究[J]. 智慧农业(中英文), 2020, 2(1): 111-120.
	WU G, PENG Y Q, ZHOU G Q, et al. Recognition method for corn nutrient based on multispectral image and convolutional neural network[J]. Smart agriculture, 2020, 2(1): 111-120.
19	ZHANG Y, HUI J, QIN Q M, et al. Transfer-learning-based approach for leaf chlorophyll content estimation of winter wheat from hyperspectral data[J]. Remote sensing of environment, 2021, 267: ID 112724.
20	YUE J B, YANG G J, LI C C, et al. Analyzing winter-wheat biochemical traits using hyperspectral remote sensing and deep learning[J]. Computers and electronics in agriculture, 2024, 222: ID 109026.
21	NEVAVUORI P, NARRA N, LIPPING T. Crop yield prediction with deep convolutional neural networks[J]. Computers and electronics in agriculture, 2019, 163: ID 104859.
22	REN Y T, LI Q Z, DU X, et al. Analysis of corn yield prediction potential at various growth phases using a process-based model and deep learning[J]. Plants, 2023, 12(3): ID 446.
23	ZHAO Y, HAN S Y, MENG Y, et al. Transfer-learning-based approach for yield prediction of winter wheat from planet data and SAFY model[J]. Remote sensing, 2022, 14(21): ID 5474.
24	ZHAO Y, HAN S Y, ZHENG J, et al. ChinaWheatYield30m: A 30 m annual winter wheat yield dataset from 2016 to 2021 in China[J]. Earth system science data, 2023, 15(9): 4047-4063.
25	SHAHI T B, XU C Y, NEUPANE A, et al. Recent advances in crop disease detection using UAV and deep learning techniques[J]. Remote sensing, 2023, 15(9): ID 2450.
26	AKBAR M, ULLAH M, SHAH B, et al. An effective deep learning approach for the classification of Bacteriosis in peach leave[J]. Frontiers in plant science, 2022, 13: ID 1064854.
27	LAMBA S, KUKREJA V, BALIYAN A, et al. A novel hybrid severity prediction model for blast paddy disease using machine learning[J]. Sustainability, 2023, 15(2): ID 1502.
28	AJILOGBA C F, WALKER S. Using crop modeling to find solutions for wheat diseases: A review[J]. Frontiers in environmental science, 2023, 10: ID 987765.
29	ARGENTO F, ANKEN T, ABT F, et al. Site-specific nitrogen management in winter wheat supported by low-altitude remote sensing and soil data[J]. Precision agriculture, 2021, 22(2): 364-386.
30	HEIß A, PARAFOROS D S, SHARIPOV G M, et al. Modeling and simulation of a multi-parametric fuzzy expert system for variable rate nitrogen application[J]. Computers and electronics in agriculture, 2021, 182: ID 106008.
31	GOBBO S, DE ANTONI MIGLIORATI M, FERRISE R, et al. Evaluation of different crop model-based approaches for variable rate nitrogen fertilization in winter wheat[J]. Precision agriculture, 2022, 23(6): 1922-1948.
32	FONTANET M, FERNÀNDEZ-GARCIA D, RODRIGO G, et al. Combined simulation and optimization framework for irrigation scheduling in agriculture fields[J]. Irrigation science, 2022, 40(1): 115-130.
33	CORBARI C, SALERNO R, CEPPI A, et al. Smart irrigation forecast using satellite LANDSAT data and meteo-hydrological modeling[J]. Agricultural water management, 2019, 212: 283-294.
34	STOREY G, MENG Q G, LI B H. Leaf disease segmentation and detection in apple orchards for precise smart spraying in sustainable agriculture[J]. Sustainability, 2022, 14(3): ID 1458.
35	AMARASINGAM N, HAMILTON M, KELLY J E, et al. Autonomous detection of mouse-ear hawkweed using drones, multispectral imagery and supervised machine learning[J]. Remote sensing, 2023, 15(6): ID 1633.
36	VASILEIOU M, KYRGIAKOS L S, KLEISIARI C, et al. Transforming weed management in sustainable agriculture with artificial intelligence: A systematic literature review towards weed identification and deep learning[J]. Crop protection, 2024, 176: ID 106522.
37	NØRREMARK M, NILSSON R S, SØRENSEN C A G. In-field route planning optimisation and performance indicators of grain harvest operations[J]. Agronomy, 2022, 12(5): ID 1151.
38	JING Y P, LUO C M, LIU G. Multiobjective path optimization for autonomous land levelling operations based on an improved MOEA/D-ACO[J]. Computers and electronics in agriculture, 2022, 197: ID 106995.
39	UTAMIMA A, REINERS T. Navigating route planning for multiple vehicles in multifield agriculture with a fast hybrid algorithm[J]. Computers and electronics in agriculture, 2023, 212: ID 108021.
40	李子康, 张璠, 滕桂法, 等. 基于深度强化学习的收割机省内协同调度优化策略[J]. 农业工程学报, 2024, 40(14): 23-32.
	LI Z K, ZHANG F, TENG G F, et al. Deep reinforcement learning-based optimization strategy for the cooperative scheduling of harvesters[J]. Transactions of the Chinese society of agricultural engineering, 2024, 40(14): 23-32.
41	KIRAN KUMARA T M, KANDPAL A, PAL S. A meta-analysis of economic and environmental benefits of conservation agriculture in South Asia[J]. Journal of environmental management, 2020, 269: ID 110773.
42	SINGH S N, BISARIA J, SINHA B, et al. Developing a composite weighted indicator-based index for monitoring and evaluating climate-smart agriculture in India[J]. Mitigation and adaptation strategies for global change, 2024, 29(2): ID 12.
43	PartnersIPC Global. Integrated food security phase classification technical manual version 2.0[M]. Evidence and Standards for Better Food Security Decisions. Rome: FAO, 2012.
44	KRISHNAMURTHY R P K, FISHER J B, SCHIMEL D S, et al. Applying tipping point theory to remote sensing science to improve early warning drought signals for food security[J]. Earth's future, 2020, 8(3): ID e2019EF001456.
45	PYLIANIDIS C, OSINGA S, ATHANASIADIS I N. Introducing digital twins to agriculture[J]. Computers and electronics in agriculture, 2021, 184: ID 105942.
46	PELADARINOS N, PIROMALIS D, CHEIMARAS V, et al. Enhancing smart agriculture by implementing digital twins: A comprehensive review[J]. Sensors, 2023, 23(16): ID 7128.
47	刘羽飞, 何勇, 刘飞, 等. 农业传感器技术在我国的应用和市场: 现状与未来展望[J]. 浙江大学学报(农业与生命科学版), 2023, 49(3): 293-304.
	LIU Y F, HE Y, LIU F, et al. Application and market of agricultural sensor technology in China: Current status and future perspectives[J]. Journal of Zhejiang university (agriculture and life sciences), 2023, 49(3): 293-304.

国内	国外
中化现代农业平台（Modern Agriculture Platform， MAP）：涵盖遥感、气象等基础数据，数据规模PB级；提供品种规划、测土配肥、定制植保、农机服务、农业金融和农用柴油供应等“7+3”服务项目，服务时效3~5天；将服务1 500多个示范农场，覆盖面积约200万公顷（https：//www.sinochem.com.cn/）	Climate FieldView（德国拜耳）：涵盖遥感、金融保险、土壤分析等70多个生产模块，覆盖生产全要素全过程大数据达EB级；基于大数据分析和决策核心算法，提供农场尺度的气象/土壤分析、病虫害诊断，精准施肥/药、农业保险、销售管理等全生产流程实时在线服务，为全球约1亿公顷农田提供服务（https：//www.climatefieldview.co.uk）
爱科农智慧种植决策系统：以自主研发的植物-土壤-大气连续体模型为基础，提供地力评估、田间环境大数据分析、农作物分布与长势分析、科学水肥管理、灾害预警、产量预测六大服务，并致力于打造了1.33万公顷爱科农试验示范基地“超级田”（https：//www.aikenong.com.cn）	xarvio数字农业服务平台（巴斯夫）：包括三个主要产品：xarvio SCOUTING， xarvio FIELD MANAGER和xarvio HEALTHY FIELDS，提供拍照识别农田和病虫害杂草、种植规划及生产决策、植保策略等服务（https：//www.basf.com/）
大疆智慧农业服务平台：提供无人机快速巡田、长势分析、农机作业指导和监管等服务（https：//ag.dji.com）	美国FBN：利用大数据技术引导农业革命，创新独特的基于农业大数据的商业模式，提供农田管理决策服务和农资及农产品营销渠道和金融渠道（https：//www.fbn.com/）

[1]	ZHAO Ruixue, YANG Chenxue, ZHENG Jianhua, LI Jiao, WANG Jian. Agricultural Intelligent Knowledge Service: Overview and Future Perspectives [J]. Smart Agriculture, 2022, 4(4): 105-125.
[2]	MA Weihong, LI Jiawei, WANG Zhiquan, GAO Ronghua, DING Luyu, YU Qinyang, YU Ligen, LAI Chengrong, LI Qifeng. Design and Key Technologies of Big Data Platform for Commercial Beef Cattle Breeding [J]. Smart Agriculture, 2022, 4(2): 99-109.