Fair backward compatibility: theory, definitions, and empirical evidence

Every time a company updates an artificial intelligence model, an uncomfortable question arises in the machine learning community: what happens to the users who were being served correctly before the update? A new study published in Complex & Intelligent Systems by a team of Italian researchers addresses this question head-on, and its answer may reshape how the industry thinks about deploying new versions of learned systems. The work, led by Anna Pallarès López, Irene Buselli, Davide Anguita, Fabio Roli and Luca Oneto from the University of Genoa, together with collaborators at the University of Cagliari, introduces a generalized and mathematically rigorous notion of Fair Backward Compatibility, a concept that extends previous research on fairness and backward compatibility into a single unified framework.

The core problem is deceptively simple to state. Machine learning systems are updated for many reasons: new training data becomes available, better architectures are developed, or the systems must satisfy new or revised technical and ethical requirements. Conventionally, engineers evaluate whether an update is worthwhile by looking at aggregate performance measures such as accuracy. If average accuracy goes up, the update is deemed a success. But averages conceal what happens to individual samples. The researchers focus on a phenomenon known as negative flips: cases in which the updated model produces an error that the previous model handled correctly. A user whose loan application was approved under the old model may be rejected by the new one, even though the new model scores better overall. Each such instance constitutes a backward incompatibility between versions of the system.

The authors push this analysis one step further, into the domain of algorithmic fairness. If the negative flips introduced by an update are not distributed evenly across the population but are biased with respect to sensitive attributes such as sex or race, then the updated model is not merely backward incompatible; it is also unfair in a very specific and previously under-studied sense. A new model might, for example, improve overall accuracy while systematically breaking predictions for a particular demographic group, effectively shifting the burden of progress onto those least able to bear it. The new paper formalizes this situation, defining Fair Backward Compatibility as a property that simultaneously constrains both the number and the demographic distribution of negative flips.

Formally, the framework treats the previous model as a reference point against which the updated model is measured sample by sample. For any instance on which the old model was correct, the new model should ideally remain correct; deviations are negative flips. Fair Backward Compatibility then requires that these deviations, whether measured in aggregate or within groups defined by sensitive attributes, remain within tolerable bounds. By unifying the previously separate literatures on backward compatibility and fairness-aware learning, the definition allows researchers and practitioners to reason about both concerns with a single set of tools, rather than trading one against the other in an ad hoc fashion.

Building on this conceptual foundation, the team proposes Fair Backward-Compatible Empirical Risk Minimization, or FBC-ERM, a learning framework that embeds fairness-aware backward compatibility directly into the training objective of essentially any modern machine learning algorithm. In classical empirical risk minimization, a model is trained by minimizing the average loss over the training data. FBC-ERM augments this objective with additional terms that penalize negative flips relative to a reference model, as well as disparities in how those flips are distributed across sensitive groups. The practical beauty of the approach, the authors emphasize, is that it requires only simple modifications of the cost function in standard models, using relaxations of the underlying constraints that are convex or at least differentiable. This means the framework can be plugged into familiar training pipelines, from shallow classifiers to deep neural networks, without redesigning the learning architecture from scratch.

A crucial theoretical contribution of the paper is a proof of statistical consistency. In machine learning, a learning procedure is statistically consistent if, as the amount of training data grows, the model learned from the sample converges to the best possible model for the underlying population. The authors show that both the empirical risk and the empirical Fair Backward Compatibility of the model learned by their framework converge to their population-level counterparts at the same rate as in classical empirical risk minimization. In other words, adding fairness-aware backward-compatibility constraints does not slow down or destabilize the fundamental statistical behavior of learning. This is a nontrivial result, because constrained objectives often complicate generalization guarantees, and it provides the mathematical assurance needed to trust the framework beyond toy problems.

The theoretical guarantees, however, would be of limited use without a practical way to tune and evaluate models that must balance two competing demands: minimizing risk and maintaining fair backward compatibility. To address this, the researchers introduce a new procedure for tuning and evaluating the performance of models with respect to both criteria simultaneously. Because a model that is perfectly backward compatible may sacrifice accuracy, and a maximally accurate model may generate many unfair flips, practitioners need a principled way to navigate this trade-off. The proposed evaluation procedure allows system designers to characterize this trade-off explicitly and to select the operating point that best fits their deployment context, whether that is a high-stakes domain where stability of predictions is paramount or a fast-moving application where accuracy gains justify some churn.

To validate the framework empirically, the team conducted experiments on real-world datasets using both shallow and deep architectures. The results confirm that Fair Backward-Compatible Empirical Risk Minimization can substantially reduce negative flips and their demographic disparities while retaining competitive predictive performance relative to conventional training. The experiments span different model families and different relaxations of the fairness and compatibility constraints, demonstrating the flexibility of the approach across convex and nonconvex settings. While the authors note that reducing negative flips typically involves some cost in aggregate accuracy, the framework makes that cost explicit and controllable rather than leaving it hidden in the noise of a model update.

The significance of this work extends well beyond the technical details. Machine learning systems are now updated continuously in production environments, from recommendation engines and speech recognizers to credit scoring and medical decision support. Users develop expectations, sometimes implicit, about how a system will behave; negative flips violate those expectations in tangible ways. When those violations cluster along lines of sex, race or other sensitive attributes, they raise concerns of discrimination and erode trust in automated decision-making. Regulatory frameworks, including emerging AI governance rules that emphasize transparency and non-discrimination, increasingly demand that system providers understand and justify the effects of their updates. A framework that quantifies and constrains the demographic distribution of update-induced errors offers a concrete technical instrument for meeting such expectations.

The paper also reframes a debate that has largely treated fairness and backward compatibility as separate objectives. Prior research on backward compatibility concentrated on bounding the total number of negative flips between model versions, while the fairness literature focused on equalizing error rates across groups in a single model. The generalized definition introduced here shows that these are complementary facets of a single question: how the burden of model improvement is distributed, both across instances and across groups of people. By proving that a single risk-minimization-style framework can handle both facets with classical statistical guarantees, the authors provide a theoretical bridge that future work on model updating, fairness auditing and responsible deployment can build upon.

The article, published open access under a Creative Commons license, arrived as a peer-reviewed, accepted manuscript shared early to provide faster access to the research, and it carries a permanent digital object identifier ensuring citability ahead of the final version of record. The authors report no conflicts of interest. As machine learning models continue to be retrained and redeployed at an accelerating pace across industry and public services, the question of who bears the cost of each update is no longer a philosophical aside; it is a measurable, optimizable quantity. With this work, the Genoa and Cagliari researchers have given the field both the language to describe the problem precisely and the machinery to do something about it, suggesting that the next generation of AI updates may be judged not only by how much better they are on average, but by how fairly they treat the people who were already being served well.