New Fuzzy Machine Learning Model Tackles Imbalanced Data With Striking Accuracy

Imbalanced data is one of the most stubborn problems in modern machine learning. Whenever a dataset contains far more examples of one class than another, standard classifiers tend to favor the majority class, quietly ignoring the rare but often critical cases. In medical diagnosis, fraud detection and fault monitoring, those rare cases are frequently the ones that matter most. A new study published in Knowledge and Information Systems by researchers at the Indian Institute of Technology Roorkee proposes a fresh attack on this problem: a class probability and polycentric fuzzy least squares twin support vector machine, abbreviated CPLTSVM, that consistently outperforms existing state-of-the-art methods across a broad suite of benchmark tests.

The work, led by Nikita Grewal and Yash Arora together with S. K. Gupta and Sanjeev Kumar, builds on the twin support vector machine, a widely recognized classification model first introduced as a faster, leaner cousin of the classical support vector machine. Rather than searching for a single separating hyperplane, the twin version constructs two nonparallel hyperplanes, one for each class, and assigns each point to whichever hyperplane it sits closer to. This structural difference typically makes training faster than the classical formulation, since each optimization problem involves the samples of only one class at a time. But the twin model has well-documented weaknesses: it is sensitive to noise and outliers, and when class sizes are unequal it can produce systematically biased decision boundaries that favor the dominant class.

The Roorkee team’s central insight is that not all samples deserve equal trust. In real datasets, some points sit comfortably in the heart of their class while others linger near the boundary or belong to scattered secondary clusters, and a few are outright errors. To capture this heterogeneity, CPLTSVM assigns each training sample a fuzzy membership weight derived from its proximity to the nearest class centers. Instead of assuming every class forms a single compact blob, the model adopts a polycentric view: each class may have several centers, reflecting the multi-cluster structure that naturally arises in high-dimensional data. Samples close to any center of their own class receive high membership values, meaning they exert strong influence on the learned hyperplane, while distant or structurally isolated points receive lower weights and therefore contribute less to the final decision rule. This mechanism embeds global structural information about the dataset directly into the training objective, something conventional support vector formulations ignore entirely.

The fuzzy weighting scheme draws on a long intellectual lineage. Fuzzy sets, introduced by Lotfi Zadeh in 1965, allow data points to belong to categories to intermediate degrees rather than in a binary fashion, and researchers have spent decades folding such gradations into kernel-based classifiers. Earlier fuzzy twin support vector machines have used information entropy, affinity measures and intuitionistic fuzzy memberships to dampen the effect of noisy points. What distinguishes the new approach is the combination of two complementary signals. The polycentric membership captures how representative a point is of its class structure, while a separate class probability estimate captures how confidently a point belongs to its assigned class at all.

That probability estimate comes from the k-nearest-neighbor technique, one of the oldest and most intuitive tools in pattern recognition. For each training sample, the model examines its closest neighbors and computes the fraction that share its label, yielding a local estimate of class membership probability. Points surrounded by neighbors of the same class earn high probability scores; points in mixed neighborhoods earn low ones. When these probabilities are folded into the fuzzy membership function, noisy samples and borderline outliers are automatically down-weighted, reducing their power to drag the decision boundary away from the true underlying structure. The result is a classifier that is robust by construction rather than by post-hoc correction.

Computational efficiency was a second design priority. Standard twin support vector machines solve two quadratic programming problems, which can be expensive on large datasets. By integrating the fuzzy membership weights into the least squares twin support vector machine formulation, which replaces the inequality constraints of the original with equality constraints and a squared loss, the authors convert training into the solution of systems of linear equations. This dramatically lowers the computational cost while preserving the benefits of the fuzzy weighting scheme, making the approach practical for the kinds of large, messy datasets where imbalance problems are most acute.

To evaluate the framework, the team ran experiments on twenty benchmark imbalanced datasets, testing both linear and nonlinear kernel versions of CPLTSVM against several state-of-the-art competitors. Performance was measured with three metrics suited to imbalanced settings: the area under the receiver operating characteristic curve, known as AUC, the geometric mean of class sensitivities, known as G-mean, and the F-measure, which balances precision and recall. The numbers are striking. The model achieved an average AUC of 89.71 percent with the linear kernel and 94.87 percent with the nonlinear kernel, and it consistently surpassed the existing techniques across the benchmark suite. The authors supplemented raw scores with comprehensive statistical analyses to confirm that the observed gains were significant rather than artifacts of dataset selection.

The researchers also demonstrated the model’s practical value on a task with real clinical stakes: breast cancer diagnosis from histopathological images using the BreakHis dataset. On this medical imaging benchmark, CPLTSVM delivered superior performance compared with baseline methods, suggesting the technique could support real-world classification pipelines where false negatives carry severe consequences. Because histopathological datasets are naturally imbalanced and noisy, with subtle visual differences between benign and malignant tissue, this application exercises exactly the weaknesses the new membership scheme was designed to address. The authors have made the source code publicly available on GitHub, allowing other researchers to reproduce the results and extend the framework.

The significance of the work extends beyond a single benchmark victory. Machine learning systems are increasingly deployed in settings where rare events dominate the consequences: detecting defective components in manufacturing lines, flagging fraudulent transactions, spotting early signals of disease, and identifying anomalies in wind turbine gearboxes, a domain where twin support vector machines have previously found application. Every one of these settings shares the same structural pathology that the Roorkee team targeted, and a classifier that resists both noise and imbalance without requiring delicate resampling or costly retraining could simplify deployment considerably. Compared with popular alternatives such as the SMOTE synthetic oversampling technique or cost-sensitive learning frameworks, which modify the data or the loss rather than the classifier’s view of structure, the fuzzy membership approach works within the learning algorithm itself, adjusting how much each sample matters based on where it sits in the geometry of the data.

There are, as with any method, avenues for future work. The polycentric membership depends on identifying class centers, and the k-nearest-neighbor probability estimation introduces a hyperparameter in the choice of k, questions of sensitivity that practitioners will want to probe. The evaluation here focuses on binary classification, the native territory of twin support vector machines, and extending the framework to multicategory problems, as earlier fuzzy proximal approaches have done, would broaden its reach. Still, the combination of strong empirical results, computational efficiency and demonstrated medical utility marks CPLTSVM as a notable advance in the ongoing effort to make classifiers trustworthy when the world refuses to hand us balanced data. As algorithms increasingly inform decisions about health, security and safety, techniques that give quiet, underrepresented samples their due weight are not merely academic refinements; they are prerequisites for reliable artificial intelligence.

Subject of Research: A fuzzy least squares twin support vector machine using class probability and polycentric memberships to improve classification of imbalanced datasets

Article Title: Class probability and polycentric fuzzy least squares twin support vector machine for imbalanced data

Article References: Grewal, N., Arora, Y., Gupta, S. K., & Kumar, S. (2026). Class probability and polycentric fuzzy least squares twin support vector machine for imbalanced data. Knowledge and Information Systems, 68(1), Article 259. https://doi.org/10.1007/s10115-026-02862-7

Image Credits: AI Generated

DOI: 10.1007/s10115-026-02862-7

Keywords: imbalanced datasets, support vector machine, twin support vector machine, fuzzy membership, polycentric membership, class probability, least squares, machine learning, medical diagnosis, breast cancer, BreakHis dataset, classification