AI Reads Live Cell Videos to Predict Cancer Cell Fates Before They Happen

One of the most stubborn puzzles in cancer biology is why two genetically identical cells, sitting side by side in the same dish and exposed to the same chemotherapy drug, can meet completely different ends. One may die by apoptosis, the cell’s built-in self-destruct program, while its twin survives, divides, or drifts into a senescent state. The genome alone cannot explain these divergences, and researchers have increasingly turned their attention to non-genetic determinants of cell fate: the shifting patterns of morphology, signaling activity, and timing that unfold over hours of a cell’s life. A new study published in PLOS Computational Biology by Florian Bürger, Martim Dias Gomes, Adrián E. Granada, Noémie Moreau, Katarzyna Bozek and colleagues tackles this problem with an unusual and powerful tool: a Transformer-based deep learning model that watches raw time-lapse videos of cancer cells and predicts what each cell will do, long before the outcome becomes visible.

The core idea behind the work is deceptively simple. Instead of asking a biologist to hand-craft measurements of cell shape, size, texture, or molecular markers, and then feeding those engineered features into a classifier, the team trained their model to learn directly from the pixels of long-term live-cell recordings. The cells were imaged continuously as they responded to chemotherapeutic treatment, generating video sequences that capture the full arc of each cell’s response, from the moment the drug takes effect to the final, unmistakable morphological signature of death or division. By treating each video as a sequence, in much the same way that language models treat sentences as sequences of words, the model could learn which visual patterns over time carry information about what the cell is about to do.

Transformers, the architecture that underlies modern large language models, are built around a mechanism called attention. Rather than processing a sequence strictly step by step, attention allows the model to weigh the relevance of every part of the sequence when making a decision about any given moment. For cell fate prediction, this means the model can, in principle, connect a subtle change in cell rounding at hour two with a dramatic membrane blebbing event at hour ten, learning which combinations of visual cues across the timeline are genuinely predictive. This flexibility is precisely what the authors wanted to exploit, because the timing of fate-relevant signals is not fixed. Some cells commit to death early in the treatment window, while others linger, and the informative moments differ from one trajectory to the next.

The performance figures reported in the study are striking. Trained purely on video, without any predefined morphological or molecular features, the model achieved a balanced accuracy of 0.94 and an F1-score of 0.93 in predicting cell outcomes. Balanced accuracy is a particularly meaningful metric here because cell populations under treatment are typically imbalanced, with dying cells often outnumbering survivors or vice versa, and a naive classifier can look good by simply always guessing the majority class. The F1-score, which harmonizes precision and recall, confirms that the model is not merely flagging the obvious cases but reliably identifying both outcomes. Taken together, these numbers demonstrate something that many in the field had suspected but not formally shown: the video of a cell’s life contains enough information, on its own, to forecast its fate.

Perhaps the most provocative finding concerns timing. If the model were simply reading the final frames of each video, where death or division is visually unmistakable, the prediction task would be trivial and biologically uninteresting. The authors therefore designed attention and masking experiments to probe where in the temporal sequence the predictive signal actually resides. By systematically masking out portions of the input video and observing how performance changed, they showed that reliable predictions are possible up to eight hours before the fate event occurs. In other words, the cell is broadcasting its intentions hours in advance, through visual cues that the human eye may register but not interpret, and the attention-based model can pick up that broadcast from the raw footage.

Equally important is what the masking analysis revealed about the structure of the predictive information. The distribution of fate-relevant signals over time turned out to be distinctly different in mitotic sequences compared with apoptotic ones. Cells heading toward division concentrate their predictive information in patterns tied to the mitotic process itself, while cells destined for apoptosis carry their signal in a different temporal profile, consistent with the gradual morphological deterioration that characterizes programmed cell death. This dissociation matters because it suggests the model is not relying on a single generic shortcut, such as overall cell health, but is instead learning genuinely different decision pathways for different fates, each with its own temporal signature.

The explainability framework developed by the team goes beyond timing. By interrogating which visual features the attention mechanism weighs most heavily, the authors connected the model’s predictions to cell morphology and, notably, to p53 signaling. p53, often called the guardian of the genome, is the master regulator that decides whether a stressed cell repairs its damage, arrests its cell cycle, or initiates apoptosis. The finding that the model’s attention aligns with p53-related cues provides a biological anchor for the machine’s decisions, suggesting that the network has converged on features that reflect real signaling states rather than arbitrary image artifacts. This kind of interpretability is essential if such models are to be trusted in biomedical research, where a black box that performs well but explains nothing offers little scientific value.

The implications for cancer therapy are considerable. Chemotherapy works by pushing cells toward lethal fates, yet resistance frequently emerges not through new mutations but through non-genetic mechanisms: cells rewire their signaling, alter their morphology, and adopt transient states that shield them from the drug. If a model can read the early visual signatures of these non-genetic decisions from live-cell video, it becomes possible to identify, at the population level, which cells are committing to death and which are quietly preparing to survive, and to do so hours before the outcome is legible by conventional means. That kind of early readout could accelerate the screening of drug combinations, allowing researchers to see not just whether a treatment eventually kills cells but when and how the decision is made, and whether a second agent can flip the trajectory of the survivors.

Methodologically, the study also marks a shift in how live-cell imaging data can be used. Historically, extracting insight from time-lapse microscopy required laborious pipelines of cell segmentation, feature engineering, and trajectory analysis, each step introducing assumptions and potential biases. By learning directly from raw sequences, the Transformer approach sidesteps much of that bottleneck and, crucially, can discover predictive features that no human would have thought to measure. The comprehensive explainability framework accompanying the model addresses the standard objection to such end-to-end approaches, showing that the learned representations can be traced back to interpretable temporal and morphological cues rather than remaining opaque.

None of this means the problem of cell fate is solved. The model was trained and evaluated on cancer cell populations under chemotherapeutic treatment, and extending it to other cell types, other drugs, and other fate outcomes will require further validation. Yet the central demonstration stands: an attention-based temporal model can predict cell fate from video alone with high accuracy, can do so hours ahead of the visible event, and can explain itself in terms of morphology and p53 signaling that biologists recognize as meaningful. In making the invisible decision points of individual cells visible, the work opens a window onto the non-genetic logic of cellular life-and-death choices, and offers a template for how deep learning can serve not just as a predictor but as an instrument of biological discovery.

Subject of Research: Deep learning prediction of non-genetic cell fate decisions in cancer cells from live-cell imaging

Article Title: Understanding cell fate decisions with temporal attention

Article References: Bürger, F., Dias Gomes, M., Granada, A. E., Moreau, N., & Bozek, K. (2026). Understanding cell fate decisions with temporal attention. PLOS Computational Biology, 22(10), e1014813. https://doi.org/10.1371/journal.pcbi.1014813

Image Credits: AI Generated

DOI: 10.1371/journal.pcbi.1014813

Keywords: cell fate, deep learning, Transformer, live-cell imaging, apoptosis, mitosis, p53, cancer therapy, chemotherapy, explainability, attention mechanism, computational biology