When Machine Learning Models Fake a Trading Edge: How Data Leakage Manufactured a Perfect Bank Nifty Prediction

A machine learning model that appears to predict the direction of India’s Bank Nifty index with flawless accuracy in high-volatility markets has become the centerpiece of an unusual and unusually honest study. Rather than presenting a new trading algorithm, researchers Prakash Ukhalkar, Ravikant Zirmite, and Manasi Bhate have published what amounts to a forensic dissection of their own forecasting pipeline, showing precisely how two common methodological errors can manufacture an apparently strong positive result out of statistical noise. The work, published in Neural Computing and Applications, positions itself explicitly as a methodological case study rather than evidence of a validated trading edge.

The research team built a stacking ensemble combining XGBoost, LightGBM, Random Forest, CatBoost, and a bidirectional long short-term memory network to forecast whether Bank Nifty would rise or fall over a 21-day horizon. The models consumed sixteen carefully constructed indicators, all designed to be leakage-safe, meaning no information from the future could seep into the training data. The distinguishing feature of the study was its regime-aware framing: instead of treating all market days alike, the researchers partitioned the data by India VIX, the volatility index derived from Nifty 50 option prices that is often described as the market’s fear gauge.

The initial results looked spectacular. On the aligned evaluation sample, the model achieved 100 percent directional accuracy on the small subset of days when India VIX exceeded a high-volatility threshold, compared with 65.3 percent accuracy on the remaining low-volatility days. To a casual observer, this would suggest that machine learning models excel precisely when markets are most turbulent and hardest to read. But the authors dug deeper, and what they found undermines that seductive interpretation entirely.

The first problem was a look-ahead bias in how the regime threshold itself was defined. When the cutoff for classifying a day as high-VIX was derived from the test period rather than from training and validation data alone, the model was effectively peeking at the answer key. After correcting this leakage and fixing the threshold at a deployable value of 18.71, calculated from the 75th percentile of the combined training and validation data, the high-VIX subset shrank to just eight observations. And here lies the critical insight: the local majority baseline, the trivial strategy of always predicting the most common direction within that tiny high-VIX window, also achieved 100 percent accuracy. The model’s apparent perfection in stressed markets was indistinguishable from guessing the majority class.

The statistical picture was more nuanced than a simple null result. Dependence-aware inference, which accounts for the fact that overlapping financial observations are not independent, produced mixed evidence. A block-bootstrap confidence interval for the difference in accuracy between high-VIX and low-VIX regimes excluded zero, and a block-permutation test remained significant after Bonferroni correction for multiple comparisons. However, the lowest-power test, a non-overlapping Fisher exact test with only twelve aligned blocks, failed to reach significance. The evidence was genuinely mixed rather than uniformly absent, which makes the next finding all the more important.

When the researchers conducted a year-by-year walk-forward analysis across six independently evaluated years, the high-VIX advantage appeared in only one year, 2021. In the other five years, the advantage reversed, with low-VIX performance exceeding high-VIX performance by margins ranging from 9 to 44 percentage points. This is direct evidence that the headline result was concentrated in a single stress episode rather than reflecting a general property of volatile markets. A finding that holds in one crisis year but reverses in five others is not a regime effect; it is a historical accident dressed up as a pattern.

The second methodological trap the authors exposed concerns how trading simulations are constructed. Under a deployable, non-overlapping simulation, where a signal generated at the close of day t leads to entry at the open of day t plus one and exit at the close of day t plus 21, the regime-conditioned strategy reduced maximum drawdown from 6.62 percent to 3.69 percent but never exceeded the buy-and-hold Sharpe ratio at any tested transaction cost level. At zero basis points, the strategy achieved a Sharpe of 0.455 against buy-and-hold’s 1.204; at 50 basis points, the strategy’s Sharpe fell to 0.375 while buy-and-hold remained at 1.204.

But when the identical rule was evaluated under an overlapping-position simulation, where multiple positions could be open simultaneously, the reported Sharpe ratio jumped to 2.216, apparently beating buy-and-hold’s 1.963. The trading protocol itself, not any genuine predictive signal, determined the sign of the result. This is perhaps the study’s most consequential finding: the way a backtest is structured can manufacture or destroy an entire positive finding without any change to the underlying model or data.

The authors are explicit that their contribution is not a validated trading edge but a transparent, fully corrected reliability-assessment framework. They demonstrate that leakage and look-ahead bias can manufacture an entire positive finding in regime-conditional financial machine learning, and they provide the complete analysis pipeline as a reproducible GitHub repository covering data splitting, feature engineering, model training, statistical testing, and figure generation. The underlying data, Bank Nifty OHLCV prices and India VIX daily values, are publicly available from the National Stock Exchange of India without registration.

For the broader machine learning and quantitative finance community, the study arrives at a moment when marginal aggregate accuracy improvements are routinely reported without clarifying whether predictive signal concentrates in specific market states or how outputs should gate real deployment. By showing that a 100 percent accuracy figure can coexist with a trivial majority baseline, that a single stress year can dominate a multi-year evaluation, and that the choice of trading simulation protocol can flip a result from underperforming to outperforming, the researchers offer a cautionary template that extends well beyond Indian markets. The message is uncomfortable but necessary: in financial machine learning, the methodology is not a footnote to the result. It is the result.

Subject of Research: Regime-conditional machine learning prediction of Bank Nifty direction using India VIX and a stacking ensemble

Article Title: India VIX regime-conditional directional prediction of bank nifty: a stacking ensemble approach

Article References: Ukhalkar, P., Zirmite, R., & Bhate, M. (2026). India VIX regime-conditional directional prediction of bank nifty: a stacking ensemble approach. Neural Computing and Applications, 38(20), Article 809. https://doi.org/10.1007/s00521-026-12588-w

Image Credits: AI Generated

DOI: 10.1007/s00521-026-12588-w

Keywords: Bank Nifty, India VIX, stacking ensemble, machine learning, data leakage, look-ahead bias, volatility regime, BiLSTM, XGBoost, trading simulation, quantitative finance, walk-forward analysis