Research report: KLF: a high-recall learned filter for kNN search

A neural filtering framework called KLF achieved high recall while retrieving nearest neighbors from two million-scale vector datasets, according to a research article published in Knowledge and Information Systems. On GloVe−200D, the system reached 96.6% recall at 1.10 milliseconds; on SIFT1M, it achieved 96.2% recall at 0.90 milliseconds. These results describe measured performance on two experimental datasets rather than universal superiority over existing search methods.

The study presents a benchmark of a neural filtering system for k-nearest-neighbor, or kNN, search, a method that identifies data points closest to a query vector. KLF treats candidate selection as a dynamic probability-estimation task. Instead of calculating a distance from the query to every indexed point during each search, a pretrained multilayer perceptron performs neural inference and assigns each point a probability that it is a true nearest neighbor.

The probability scores are then processed by a density-aware adaptive threshold, which selects a compact candidate set for subsequent search stages. Across the reported evaluations, KLF produced a full containment rate of 95.5%, with a median candidate-set size of 1.2 times the requested number of neighbors, k. The median set therefore contained only modestly more candidates than the target neighborhood size, limiting the amount of work required after neural filtering.

KLF’s architecture shifts the nature of online computation rather than simply replacing conventional search with a universally faster method. Neural inference produces a probability score for every indexed point, creating a ranking signal that can guide candidate selection before downstream processing. The framework was designed for GPU-friendly inference, and its pretraining cost is paid offline, before it serves queries.

The authors present this setup cost as something that can be amortized in workloads with many queries. The authors position KLF as a distinct trade-off with established graph-based and approximate search techniques. Heuristic methods such as Hierarchical Navigable Small World graphs rely solely on distance metrics for navigation, whereas KLF adds model-generated probabilities for indexed points.

The article does not claim that this approach outperforms every competing method across all workloads, hardware configurations or data distributions; instead, it reports the combination of recall, latency and candidate-set compactness observed in the experiments. The evaluation used static, million-scale datasets, including GloVe−200D and SIFT1M. This scope supports the reported performance for those collections but does not establish how KLF behaves with rapidly changing indexes, substantially different embedding distributions or larger collections beyond those tested.

The framework’s dependence on an offline-trained model also means that the reported results concern a pretrained filtering setup rather than an untrained or continuously updated index. A further limitation emerged in sparsely populated parts of the data. The authors identified a long-tail performance gap in low-density regions, indicating that filtering quality was less consistent in some areas with fewer neighboring points.

They describe this issue as a direction for future work rather than a resolved problem. The experiments therefore show strong aggregate results while also identifying a region of the data where the neural filter’s output is less reliable. KLF’s central contribution is a reformulation of nearest-neighbor retrieval in which a neural model estimates which indexed points merit closer examination and an adaptive threshold creates a small candidate pool.

Subject of Research: Neural filtering for k-nearest-neighbor search in million-scale vector datasets

Article Title: KLF: a high-recall learned filter for kNN search

Article References: Peng, Y. (2026). KLF: a high-recall learned filter for kNN search. Knowledge and Information Systems, 68(1), Article 291. https://doi.org/10.1007/s10115-026-02913-z

Image Credits: AI Generated

DOI: 10.1007/s10115-026-02913-z

Keywords: k-nearest-neighbor search, neural filtering, KLF, vector datasets, multilayer perceptron, approximate search, GPU inference, candidate selection, recall, GloVe-200D, SIFT1M, high-recall