DOI: 10.5281/zenodo.15851681
title: Benchmark dataset for agricultural KGML model development with PyKGML

description: This benchmark dataset works as the demonstrative data in the testing of PyKGML, the Python library for the efficient development of knowledge-guided machine learning (KGML) models.

The dataset are developed using agroecosystem data in the two KGML studies: 

1. "KGML-ag: A Modeling Framework of Knowledge-Guided Machine Learning to Simulate Agroecosystems: A Case Study of Estimating N2O Emission using Data from Mesocosm Experiments".Licheng Liu, Shaoming Xu, Zhenong Jin*, Jinyun Tang, Kaiyu Guan, Timothy J. Griffis, Matt D. Erickson, Alexander L. Frie, Xiaowei Jia, Taegon Kim, Lee T. Miller, Bin Peng, Shaowei Wu, Yufeng Yang, Wang Zhou, Vipin Kumar.

2. "Knowledge-guided machine learning can improve carbon cycle quantification in agroecosystems".

Licheng Liu, Wang Zhou, Kaiyu Guan, Bin Peng, Shaoming Xu, Jinyun Tang, Qing Zhu, Jessica Till, Xiaowei Jia, Chongya Jiang, Sheng Wang, Ziqi Qin, Hui Kong, Robert Grant, Symon Mezbahuddin, Vipin Kumar, Zhenong Jin.



All the files belong to Dr. Licheng Liu, University of Minnesota. lichengl@umn.edu

 

 

There are two parts in this dataset, the CO2 data from study 1 and the N2O data from study 2, both contain a pre-training subset and a fine-tuning subset.  Data descriptions are as follows:

 



1. CO2 dataset:



Synthetic data of ecosys:



- 100 simulations at random corn fields in the Midwest.

- Daily sequences over 18 years (2000-2018).



Field observations:



Eddy-covariance observations from 11 flux towers in the Midwest.

A total of 102 site-years of daily sequences.



Input variables (19):



Meterological (7): solar radiation (RADN), max air T (TMAX_AIR), (max-min) air T (TDIF_AIR), max air humidity (HMAX_AIR), (max-min) air humidity (HDIF_AIR), wind speed (WIND), precipitation (PRECN).

Soil properties (9): bulk density (TBKDS), sand content (TSAND), silt content (TSILT), field capacity (TFC), wilting point (TWP), saturate hydraulic conductivity (TKSat), soil organic carbon concetration (TSOC), pH (TPH), cation exchange capacity (TCEC)

Other (3): year (Year), crop type (Crop_Type), gross primary productivity (GPP)



Output variables (3):



Autotrophic respiration (Ra), heterotrophic respiration (Rh), net ecosystem exchange (NEE).




 

2. N2O dataset:



Synthetic data of ecosys:



1980 simulations at 99 counties x 20 N-fertilizer rates in the 3I states (Illinois, Iowa, Indiana).

Daily sequences over 18 years (2000-2018).



Field observations:



6 chamber observations in a mesocosm environment facility at the University of Minnesota.

Daily sequences of 122 days x 3 years (2016-2018) x 1000 augmentations from hourly data at each chamber.



input variables (16):



Meterological (7): solar radiation (RADN), max air T (TMAX_AIR), min air T (TMIN_AIR), max air humidity (HMAX_AIR), min air humidity (HMIN_AIR), wind speed (WIND), precipitation (PRECN).

Soil properties (6): bulk density (TBKDS), sand content (TSAND), silt content (TSILT), pH (TPH), cation exchange capacity (TCEC), soil organic carbon concetration (TSOC)

Management (3): N-fertilizer rate (FERTZR_N), planting day of year (PDOY), crop type (PLANTT).



Output variables (3):



Soil N2O fluxes (N2O_FLUX), soil CO2 fluxes (CO2_FLUX), soil water content at 10 cm (WTR_3), soil ammonium concentration at 10 cm (NH4_3), soil nitrate concentration at 10 cm (NO3_3).





 





Each file is a serialized Python dictionary containing the following keys and values:


data={'X_train': X_train,

           'X_test': X_test,

           'Y_train': Y_train,

           'Y_test': Y_test,

           'x_scaler': x_scaler,

           'y_scaler': y_scaler,

           'input_features': input_features,

           'output_features': output_features}







X_train, X_test: Feature matrices for training and testing.




Y_train, Y_test: Target values for training and testing.


x_scaler: The scaler (mean, std) used for normalizing input features.



y_scaler: The scaler (mean, std) used for normalizing output features.




input_features: A list of input feature names.


output_features: A list of output feature names.


Please download and use the latest version of this dataset, as it contains important updates.

Contact: Dr. Licheng Liu (lichengl@umn.edu), Dr. Yufeng Yang (yang6956@umn.edu)