Explainable AI Pinpoints Urban Crime Hotspots and Forecasts Daily Trends Across Three Major US Cities

Crime in big cities is not spread evenly across the map. It clusters in predictable places, rises and falls with the rhythm of the week, and leaves behind a data trail that, in the right hands, can be turned into actionable forecasts. A new study published in Discover Artificial Intelligence by Shristi Bose, Jahnavi Raja, and Shaleen Bhatnagar of Manipal Academy of Higher Education has built one of the most complete crime analytics pipelines to date, testing where crime is likely to concentrate and how many incidents a city can expect each day. The researchers applied a single, unified framework to three of the largest open crime datasets in the United States: more than 8.4 million records from Chicago, over 2.1 million from Los Angeles, and nearly 9.5 million complaints from New York City.

The framework answers two distinct questions with two independent modelling tracks. The first track divides each city into grid cells of roughly one square kilometre and asks, for every cell and every day, whether that cell will become a crime hotspot. The second track forecasts the total number of crimes a city will record each day. Crucially, both tracks use a strict chronological train/test split, meaning models are always trained on the past and evaluated on the future. This design choice matters: many earlier studies used random splits that accidentally let models peek at future information, inflating their apparent accuracy. The authors also documented explicit leakage safeguards, including a correction to how the hotspot label threshold was computed, ensuring that no transformation fitted on the full dataset could leak test-period information into training.

For hotspot detection, the team benchmarked eight machine learning classifiers, from logistic regression and k-nearest neighbours to random forests and neural networks, plus a stacked ensemble that combines the strongest base models. The clear winner in all three cities was XGBoost, a gradient-boosted tree algorithm that excels at capturing nonlinear interactions in tabular data. It achieved a ROC-AUC of approximately 0.825 in Chicago, 0.804 in Los Angeles, and 0.887 in New York City. New York City’s advantage is instructive: with the largest dataset and the most spatially stable crime patterns, its grid cells produce lag and rolling features that reliably encode local trends. Los Angeles, by contrast, proved the hardest case, with hotspots that are more dispersed and less persistent, leading to elevated false negatives in the confusion matrices.

Perhaps the most striking technical finding concerns the humble stacked ensemble. Although ensembles are often assumed to outperform single models, XGBoost maintained a small but consistent edge over the stacked version in every city. The authors retrained both models with three different random seeds and found the seed-to-seed variation was an order of magnitude smaller than the gap between them, confirming the ranking is genuine rather than a fluke of initialization. A simple persistence baseline, which predicts each cell’s hotspot status from its own status the previous day, was also beaten by XGBoost everywhere, showing the trained models extract real predictive signal beyond day-to-day continuity.

What elevates this study above a standard benchmark is its use of SHAP, or SHapley Additive exPlanations, a model-agnostic interpretability technique rooted in cooperative game theory. SHAP attributes each prediction to individual input features while guaranteeing mathematical properties such as local accuracy and consistency. Applied to the best XGBoost model in each city, the analysis revealed a remarkably coherent picture across all three metropolises: the 1-day lag and the 7-day rolling mean of local crime counts dominate hotspot predictions. In plain terms, whether a grid cell becomes a hotspot tomorrow depends overwhelmingly on how much crime occurred there yesterday and how active it has been over the past week. Calendar features like day of week and month matter, but only as secondary signals, and the rolling standard deviation, a measure of recent volatility, was consistently the least important feature.

The SHAP dependence plots also uncovered nonlinear behaviour with practical implications. In Chicago, the relationship between the previous day’s crime count and its SHAP contribution is strongly monotone but plateaus at higher counts, meaning that once a cell has already recorded substantial crime, further increases add diminishing predictive value. The colour-coded interaction with the rolling mean showed that cells combining a high short-term count with a high recent trend are especially predictive of hotspot status. In New York City, these effects were steepest and most pronounced, while in Los Angeles they were noisier and weaker, mirroring that city’s irregular crime geography. The authors are careful to note that SHAP explains how the model weighs its inputs, not why crime occurs; these are associational attributions, not causal claims.

On the forecasting side, four deep learning architectures, Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), a one-dimensional Convolutional Neural Network (CNN), and a Transformer encoder, were compared against an automated SARIMA/ARIMA search and two naive baselines. Each deep model received a 30-day rolling window of eight engineered features per day, including the raw count, calendar variables, and lag and rolling statistics. The results were decisive: all four deep models beat every classical and naive baseline in every city. LSTM achieved the best RMSE in Chicago at 61.08, a 35.4 percent improvement over the fitted SARIMA model, while GRU led in Los Angeles (RMSE 56.45, an 17.9 percent gain) and New York City (RMSE 102.19, a 28.7 percent gain). Tellingly, the ARIMA models produced negative R-squared values in all three cities, meaning they performed worse than simply predicting the historical average, a stark indictment of linear statistical models on nonlinear daily crime series.

The study also drilled down to the category level, building separate forecasting models for the five most common crime types in each city. GRU emerged as the most reliable architecture overall, winning ten of the fifteen category-city combinations, with LSTM taking the remaining five. In New York City, GRU was best for every category, from petit larceny to grand larceny. An ablation study of hybrid architectures, combining CNNs with recurrent units and Transformers, delivered a sobering message about complexity: the three-component CNN+GRU+Transformer hybrid was the weakest model in two of three cities, and no hybrid reliably outperformed well-tuned standalone recurrent models. The practical lesson is that careful feature engineering and recurrent baselines beat architectural exotica on datasets of this size.

The authors are refreshingly candid about the limits of their work. Administrative crime records reflect policing intensity and reporting practices as much as underlying criminal activity, so a model trained on them risks reproducing existing enforcement patterns if used to guide patrol allocation, the well-known feedback-loop concern in predictive policing. None of the three datasets contain demographic covariates, making a formal fairness audit impossible. The team recommends treating hotspot probabilities as decision-support signals rather than deployment formulas, cross-checking flagged areas against victimisation surveys or emergency call data, and incorporating bias-mitigation techniques in future versions. They also acknowledge that their grid cells are treated as spatially independent, ignoring spillover between neighbouring areas, and that the framework has not yet been validated outside the United States.

Even so, the study offers a template for how urban analytics should be done in the era of explainable AI. It demonstrates that a single reproducible pipeline, applied consistently across cities with strict temporal validation, can deliver both competitive predictions and transparent explanations. For police departments and city governments weighing investments in crime analytics, the message is clear: the biggest gains come not from ever-larger models but from well-chosen features, honest evaluation, and interpretability tools that show exactly why a model flagged a particular block on a particular day. As cities worldwide grapple with resource-constrained public safety budgets, frameworks like this one, which pair predictive power with accountability, may define the next generation of evidence-based urban policy.

Subject of Research: Explainable machine learning and deep learning for spatial crime hotspot detection and daily crime forecasting in major US cities

Article Title: An explainable AI framework for spatial hotspot detection and temporal forecasting of urban crime

Article References: Bose, S., Raja, J., & Bhatnagar, S. (2026). An explainable AI framework for spatial hotspot detection and temporal forecasting of urban crime. Discover Artificial Intelligence, 6(1), Article 1457. https://doi.org/10.1007/s44163-026-02388-5

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02388-5

Keywords: crime hotspot prediction, XGBoost, SHAP, LSTM, GRU, Transformer, ARIMA, deep learning forecasting, urban crime analytics, explainable AI, predictive policing, time series forecasting