Machine Learning Meets Its Match in the Simplest Crop Price Forecast

A meticulous, five-year experiment in India has delivered one of the most refreshingly honest results in agricultural data science: sophisticated machine learning models, trained on nearly a quarter-century of market records, were unable to beat the humble forecast that next month’s price will simply equal this month’s price. The study, published in the journal Discover Informatics, examined nine major agricultural commodities in the western state of Maharashtra and found that short-run price persistence is such a powerful force in monthly market data that even the best ensemble algorithms could not outperform a one-month naive benchmark. Yet the research is far from a defeat for machine learning. Instead, it offers a rigorous, leakage-free template for how forecasting studies should be designed, and it pinpoints precisely where future gains must come from.

The research team, led by Payal Mahajan and Aniket A. Muley of Swami Ramanand Teerth Marathwada University in Nanded, together with Madhav R. Fegade of Digambarrao Bindu Arts, Commerce and Science College in Bhokar, built their framework on daily mandi-level price records from the AGMARKNET portal, the official agricultural marketing database of the Government of India. The commodities spanned the breadth of Indian farming: Arhar, Bajra, Cotton, Maize, Paddy, Sesamum, Soyabean, Sunflower and Wheat. Records dating from 2001 through October 2025 were cleaned, validated and aggregated into monthly average modal prices, the most commonly observed market price for each commodity, producing long monthly price series that capture decades of market behaviour.

One of the study’s central contributions is methodological rather than predictive. In many published forecasting papers, preprocessing steps such as outlier removal are performed on the entire dataset before the model is tested, which silently leaks information from the future into the training process and inflates apparent accuracy. The Maharashtra team avoided this trap entirely. Extreme prices were capped at commodity-specific percentiles, but the quantile limits were estimated only from training data available at each sequential forecasting step and then applied to the following test month. In other words, the pipeline was designed so that no future observation could ever influence a past forecast, a discipline that many machine learning benchmarks in economics and agriculture still lack.

The feature engineering pipeline was deliberately rich. Lag features captured prices from one, two, three, six, nine, twelve, eighteen and twenty-four months earlier, allowing the models to weigh both recent momentum and annual cycles. Rolling means over three, six, twelve and twenty-four month windows summarised short-, medium- and long-term trends, while rolling standard deviations of the same lengths encoded volatility, telling the models whether the market had been calm or turbulent in the preceding months. Seasonal calendar variables were encoded with sine and cosine transformations of the month number, a standard technique that preserves the cyclical nature of the year so that December and January are treated as neighbours rather than as numerically distant values. All prices were log-transformed to stabilise variance and dampen the influence of sudden spikes.

Four tree-based ensemble algorithms were put to the test: Random Forest, which aggregates decision trees trained on bootstrapped samples; Extra Trees, which injects additional randomisation into split selection for robustness; Histogram Gradient Boosting, a fast boosting method optimised for structured numerical data; and XGBoost, a regularised gradient boosting system that sequentially corrects the errors of weak learners. Models were trained with fixed hyperparameters and evaluated with Mean Absolute Error, Root Mean Squared Error, the coefficient of determination and Mean Absolute Percentage Error, using an expanding-window protocol in which each month from January 2021 to October 2025 was forecast using everything known before it, with the training set growing as actual prices became available.

The headline result is stark. The one-month naive forecast, which simply predicts that the coming month’s price equals the previous month’s, achieved the lowest MAPE for every single commodity, ranging from just 2.30 percent for Paddy to 4.91 percent for Sunflower. The best machine learning models, however, consistently outperformed the twelve-month seasonal naive benchmark, which predicts that this month’s price will match the same calendar month one year earlier. This distinction matters. It shows that the engineered lag, rolling and seasonal features do capture genuine nonlinear temporal structure beyond annual repetition, but not enough extra information to improve on the sheer stubbornness of short-run price continuation in aggregated monthly data.

Why is the naive benchmark so formidable? Monthly agricultural prices at the state level adjust gradually. Supply arrives in bulk through regulated markets, demand shifts slowly, and administrative factors such as minimum support prices dampen sudden swings. In such a regime, the previous month’s price already embeds most of the information needed for a one-step-ahead forecast, leaving little room for algorithms to extract additional signal from historical prices alone. The study’s authors note that abrupt movements driven by rainfall deficits, market arrivals, input costs, policy interventions or export-import shocks simply cannot be anticipated from the price series itself, which caps what any historical-price-only model can achieve.

The experiments also revealed meaningful differences among commodities and validation strategies. Switching from fixed-window training to expanding-window retraining, in which models were periodically refreshed with newly observed prices, reduced forecast errors for all nine commodities, confirming that regular updating is worthwhile even when it does not overturn the naive benchmark. Paddy and Wheat proved relatively easy to forecast, reflecting their lower relative price variability, while Arhar, Cotton, Sesamum, Soyabean and Sunflower, commodities with higher volatility and more erratic price behaviour, remained challenging. Sensitivity analyses with different training start years showed that no single configuration was uniformly best, underscoring that commodity-specific market dynamics, rather than any universal algorithmic choice, shape forecastability.

The researchers are transparent about the limitations of their design. Exogenous drivers such as rainfall, temperature, market arrivals, fuel and transport costs, inflation, festival demand and government policy were deliberately excluded, making the study a controlled assessment of what historical prices alone can deliver. Deep learning architectures such as LSTM and GRU networks were also left out, since a fair comparison would require a separate chronological tuning and architecture-selection study under the same leakage-safe principles. The authors frame both omissions as clear directions for future work, alongside probabilistic forecasting that would quantify uncertainty rather than produce single point estimates.

For farmers, traders and policymakers, the practical message is double-edged but valuable. First, for month-ahead planning, the cheapest forecast on the table, carrying last month’s price forward, is remarkably hard to beat, and any proposed machine learning service should be benchmarked against it before being trusted. Second, meaningful improvements in agricultural price forecasting will not come from more elaborate algorithms chewing on the same price history, but from richer information: weather data, crop arrivals, production estimates, cost indices and policy signals integrated into leakage-safe evaluation frameworks like the one this study demonstrates. In an era when artificial intelligence is often oversold, this Maharashtra experiment stands out as a model of scientific candour, showing exactly where machine learning helps, where it does not, and how the next generation of forecasting systems should be built.

Subject of Research: Machine learning models for forecasting monthly agricultural commodity prices in Maharashtra, India

Article Title: Forecasting agricultural commodity prices using machine learning models

Article References: Mahajan, P., Muley, A. A., & Fegade, M. R. (2026). Forecasting agricultural commodity prices using machine learning models. Discover Informatics, 1(1), Article 15. https://doi.org/10.1007/s44564-026-00015-0

Image Credits: AI Generated

DOI: 10.1007/s44564-026-00015-0

Keywords: agricultural commodity prices, machine learning, price forecasting, time series, Random Forest, XGBoost, AGMARKNET, Maharashtra, feature engineering, naive benchmark, ensemble learning, agricultural economics