Lightweight AI Spots Violence in Surveillance Video at 130 Frames Per Second

Security cameras watch over train stations, schools, parking garages, and city streets around the clock, yet the humans paid to watch the feeds are falling further behind. Studies of closed-circuit television operations have long documented that a single operator juggling dozens of screens misses most of what happens, and the sheer flood of live video now vastly exceeds what any person can attend to. A research team in Algeria has tackled this bottleneck head-on, building a lightweight artificial intelligence system that scans surveillance footage for violent activity fast enough to keep up with live streams. The work, published in the journal Multimedia Tools and Applications, reports detection accuracy of 90 percent at processing speeds of up to 130 frames per second, a combination of precision and pace that few published systems have achieved on genuine surveillance data.

The team, led by Maya Houacine of the Laboratory of Research in Artificial Intelligence at the University of Science and Technology Houari Boumediene in Algiers, together with Khadidja Belattar and Naila Aziza Houacine, set out to correct what they see as persistent blind spots in the violence-detection literature. Many existing approaches lean on computationally heavy models that cannot plausibly run on the hardware guarding a real camera network. Others sidestep the timing question entirely, reporting accuracy without demonstrating that their systems can process video as it arrives. And a surprising number evaluate their methods on staged footage or cinematic fight scenes rather than the grainy, awkwardly angled, often distant video that real cameras actually produce. The Algerian group built its pipeline around real surveillance recordings and made real-time throughput a first-class design requirement rather than an afterthought.

The first stage of the system addresses a deceptively simple problem: video contains enormous redundancy. Consecutive frames in a surveillance feed are nearly identical, and training a neural network on every single frame wastes computation without adding information. The researchers compared two keyframe extraction techniques, methods that select the most informative frames from a clip while discarding duplicates, to determine which one best stripped redundancy while preserving the visual evidence of violent motion. Keyframe selection has a long history in video indexing, stretching back to early interfaces for browsing video archives in the 1990s, and modern variants rely on cues such as color histograms and adaptive clustering. Choosing the right extraction strategy matters because the quality of the frames fed into a detector directly shapes what the network can learn about fast, chaotic events like fights.

With preprocessing settled, the team adapted and evaluated three distinct deep learning architectures for the detection task. The first was an enhanced version of MobileNet, a convolutional neural network family originally engineered by Google researchers for mobile and embedded vision applications, where every parameter and every multiplication must be justified. The second combined MobileNetV2, which introduces inverted residual blocks and linear bottlenecks to squeeze more accuracy from fewer computations, with a long short-term memory network, a recurrent architecture designed to capture how visual features evolve across time, which is essential because violence is fundamentally a temporal phenomenon rather than a single frozen pose. The third contender was a three-dimensional convolutional neural network, or 3D CNN, which applies convolutions across both space and time simultaneously and is a popular choice for action recognition, though typically at a steep computational price.

Evaluation took place on two of the most challenging public benchmarks in the field. The first, RWF-2000, is a large-scale video database built specifically for violence detection using footage from real surveillance cameras, and it is openly available through the Zenodo repository. The second, UCF-Crime, comes from the University of Central Florida’s Center for Research in Computer Vision and contains real-world anomaly detection videos captured in uncontrolled settings, a subset of which the team used. The researchers supplemented these with material drawn from the Open Video Project archive. Testing on such data is deliberately unforgiving: lighting shifts, camera shake, occlusion, and the sheer variety of human behavior in public spaces all conspire to confuse models that were tuned on cleaner inputs.

A rigorous validation scheme separated this work from many predecessors. Rather than splitting the data once and reporting a single number, the team applied k-fold cross-validation to all three architectures, rotating through multiple partitions of the data so that performance estimates reflect the model’s behavior across different subsets rather than one lucky or unlucky split. This process exposed an unexpected complication in the enhanced MobileNet model: the folds were imbalanced, meaning some partitions contained uneven distributions of the classes the network needed to distinguish, which distorts both training and evaluation. Imbalanced folds are a subtle but consequential problem, because a model can appear to perform well simply because the data it sees is skewed.

The solution the researchers devised is one of the more inventive elements of the study. They turned to a genetic algorithm, a metaheuristic optimization method inspired by biological evolution, in which candidate solutions compete, mutate, and recombine over successive generations until a strong solution emerges. Their initial genetic algorithm reduced the fold imbalance cost, measured in misallocated images, from nearly 100 images down to 15. They then refined the approach into a dynamic genetic algorithm that adapted its behavior during the search, cutting the imbalance cost further to just 4 images while reaching the improved result in less time. The improvement demonstrates how classical optimization techniques can still play a decisive supporting role in modern deep learning pipelines, quietly fixing data plumbing problems that the headline models cannot solve on their own.

When the numbers settled, the MobileNet-based architecture emerged as the clear winner. It reached 90 percent accuracy, 91 percent precision, and 90 percent recall on the benchmark tasks, meaning it correctly identified violent incidents most of the time while keeping both false alarms and missed detections in check. Precision and recall matter in different ways for security applications: a system with poor precision floods operators with false alerts and quickly earns their distrust, while a system with poor recall lets genuine incidents slip through unnoticed. The MobileNet model balanced both while sustaining a processing speed of up to 130 frames per second, comfortably above the 25 to 30 frames per second that live video typically demands, leaving headroom for the other computational tasks a surveillance platform must perform.

The speed figure is the detail most likely to resonate with practitioners, because it addresses the gap between laboratory results and deployable systems. A detector that processes video slower than the cameras produce it accumulates an ever-growing backlog, and its alerts arrive after the moment to respond has passed. By building the system around efficient architectures and disciplined preprocessing, the Algerian team showed that state-of-the-art detection does not require data-center hardware. The choice of MobileNet as the backbone reflects a broader trend in computer vision toward models designed for edge devices, cameras, and embedded processors, where power budgets and memory constraints rule out the giant networks that dominate headline benchmarks.

The researchers were explicit about the ethical dimensions of their work, noting that surveillance data raises genuine privacy concerns. They mitigated these risks by relying exclusively on publicly available datasets, ensuring that no attempt was made to identify individuals, and confirming that no personally identifiable information was accessed or processed. All data were used solely for research purposes and handled in accordance with relevant privacy and data protection regulations, in line with principles of responsible data usage, data minimization, and respect for individual privacy. The code itself is not publicly available, but the datasets underpinning the study remain open, allowing other groups to reproduce the evaluation. As cities continue to multiply their camera networks and human attention stays fixed in supply, systems of this kind, fast enough to watch in real time and accurate enough to be trusted, are likely to move from research papers into the operational core of public safety infrastructure.

Subject of Research: Real-time violence detection in surveillance videos using lightweight deep learning models

Article Title: An intelligent system for real-time violence detection in surveillance videos

Article References: Houacine, M., Belattar, K., & Houacine, N. A. (2026). An intelligent system for real-time violence detection in surveillance videos. Multimedia Tools and Applications, 85(11), Article 815. https://doi.org/10.1007/s11042-026-21958-4

Image Credits: AI Generated

DOI: 10.1007/s11042-026-21958-4

Keywords: violence detection, surveillance video, deep learning, MobileNet, LSTM, 3D CNN, keyframe extraction, genetic algorithm, cross-validation, computer vision, real-time systems, RWF-2000