The economic stakes are considerable. Productivity losses attributable to porcine reproductive and respiratory syndrome virus alone have been estimated to exceed USD 1 billion annually in the United States, with substantial losses also reported on Chinese pig farms. Yet diagnosis of respiratory disease in commercial herds still relies largely on farm inspections, slaughter checks, serology and post-mortem examination of dead animals. These approaches are labour-intensive, expensive, slow, and often applied only after disease has progressed or an animal has died. Contact-based monitoring devices such as ear tags and respiratory belts add cost and stress, limiting large-scale deployment. Coughing, by contrast, is one of the most prevalent and easily observable clinical signs of porcine respiratory disease, making it an attractive target for non-invasive, continuous monitoring.

Earlier cough-sound studies focused mainly on detecting that a cough occurred somewhere in a pig house, without identifying which pen or animal produced it. Sound source localisation techniques mapped coughs to pen-level risk areas but could not distinguish individuals within the same pen. A later audio-visual approach used motion history images to link cough sounds to transient body movements, but relied on handcrafted motion features and threshold-based rules whose robustness in busy group-housed settings remained uncertain. The new work builds on a deep learning multimodal method for coughing pig identification and extends it in three directions: a task-specific architecture for hierarchical audiovisual temporal modelling, a design that decouples the recurrent temporal module from the classification layer, and a dataset featuring low-light nighttime scenes for evaluating performance under both day and night conditions.

The experimental foundation was a 42-day challenge study conducted from August to October 2024 within a Biosafety Level 2 laboratory at the Jiangsu Academy of Agricultural Sciences, approved by the institutional animal care committee. Ten 60-day-old crossbred finishing pigs were split equally between an infected group and a control group, housed in separate but identical pens under controlled conditions of 23 to 28 degrees Celsius and 40 to 70 percent relative humidity, with antibiotic-free feed. Pigs in the experimental group received an intratracheal dose of virulent Mhp suspended in phosphate-buffered saline; controls received saline only. Infection was confirmed serologically: serum Mhp-IgG sample-to-negative ratios in the infected group fell below the 50 percent ELISA threshold on days 28 and 42, and nasal swab Mhp-sIgA sample-to-positive ratios rose above the 0.2 cutoff on day 28, while control animals stayed within negative ranges throughout. Post-mortem examination at day 42 revealed characteristic shrimp-like lung lesions in the infected group and none in controls, and testing ruled out other common swine pathogens.

A high-definition camera mounted roughly two metres above each pen recorded the pigs’ dorsal regions continuously at 25 frames per second. From these recordings, 300 clips showing coughing events were manually segmented, 200 from daytime and 100 from nighttime footage. The pipeline consists of three modules. First, a coughing event detection module based on a sound event detection convolutional recurrent neural network processes log-Mel spectrograms of two-channel audio to locate the onset and offset of coughs and extract acoustic features. Second, a pig object detection module applies YOLO26-OBB, chosen for its oriented bounding boxes that fit pigs’ varied postures and reduce overlap between adjacent animals, to the single frame with the highest cough probability, then crops each pig’s region across the surrounding frames of the event window. Third, a coughing pig identification module fuses the audio features with each candidate pig’s video sequence and decides which animal is actually coughing.

The identification module is where the architectural novelty lies. Cropped pig sequences are converted to grayscale and resized to 112 by 112 pixels before a visual encoder, comprising 3D convolutional layers, a ResNet18 backbone and a video temporal convolutional network, extracts frame-level visual embeddings. Audio and visual features are then combined through channel attention, which concatenates the modalities and generates time-varying channel weights via a one-dimensional convolution, adaptively emphasising informative dimensions while suppressing redundancy. A bidirectional gated recurrent unit (BiGRU) models short-term temporal dynamics in both directions, and an eight-head self-attention mechanism then reweights the temporal features globally to capture dependencies across the whole event. Because the self-attention module receives BiGRU outputs that already encode temporal order, no positional encoding was added. Training used a weighted cross-entropy loss that upweights positive coughing samples, with a positive weight of 2.8 chosen in preliminary experiments, reflecting the fact that in health monitoring a missed diseased pig is costlier than a false alarm that can be checked manually.

The results were strong across the board. In four-fold cross-validation, the coughing event detection module achieved an average frame-level F1 score of 0.88 with an error rate of 0.28, and event-level averages of 0.68 F1, 0.62 precision and 0.75 recall; the best fold, retained for building the audiovisual dataset, reached a frame-level F1 of 0.95. The object detection module attained a mean average precision (mAP) of 0.94 at IoU thresholds of 0.50 to 0.95, detecting all pigs reliably in both daytime and nighttime scenes. Across five independent training runs, the full identification system achieved an average mAP of 0.96, precision of 0.86, recall of 0.92, F1 of 0.89, error rate of 0.23 and video-level accuracy of 0.80, meaning that in most videos the coughing or non-coughing status of every pig was correctly determined.

Notably, performance held up in the dark. Under nighttime low-light conditions the model recorded an mAP of 0.96, precision of 0.92, F1 of 0.90, error rate of 0.19 and video-level accuracy of 0.82, with recall of 0.89. In other words, the model produced fewer false detections at night while slightly missing more coughing instances, with overall performance essentially unchanged. The authors note that the nighttime evaluation involved fewer videos, 24 versus 56 during daytime, which made the metrics somewhat more variable, though the fluctuations remained small. This matters practically because environmental noise and animal activity are typically lower at night and in the early morning, potentially offering a more stable window for health assessment.

Ablation experiments confirmed that each component contributes. Removing the self-attention mechanism caused the error rate to balloon from 0.23 to 0.71, with precision collapsing to 0.64 while recall stayed high, showing that self-attention mainly suppresses false positives arising from non-cough movements and slight audio-visual misalignment. Removing the BiGRU degraded mAP, recall, F1 and video-level accuracy while increasing metric variability, underscoring the value of bidirectional local temporal modelling for coughs of variable duration and ambiguous boundaries. Comparisons against existing methods were also favourable: the proposed model outperformed the earlier coughing pig detection model, LR-ASD and TalkNet-ASD on mAP, recall, F1, error rate and video-level accuracy, while a rule-based motion-history method performed poorly, with precision of 0.17 and F1 of 0.22. Paired t-tests across five runs showed statistically significant advantages in several metrics, including F1, error rate and video-level accuracy against the earlier coughing pig detection model, and recall, F1, error rate and video-level accuracy against LR-ASD, though LR-ASD retained significantly higher precision. Inference takes about 0.0121 seconds per pig sequence on an RTX A6000 GPU, comparable to competing audiovisual models, though the full three-module pipeline needed roughly 14.85 seconds for an 8.68-second video of five pigs.

The authors are candid about the limitations. All data came from two controlled pens in a single BSL-2 laboratory with only ten pigs, so generalisation to commercial farms, different stocking densities and pen configurations remains untested. The random event-level data split, stratified only by day and night, means segments from the same pig or recording day could appear in both training and validation sets, potentially inflating estimates of generalisation; future work will adopt animal-level or temporally blocked splits. Cough labels were annotated by a single researcher without inter-annotator reliability checks, and the identification experiments ran on manually confirmed cough-event segments rather than unfiltered continuous recordings, so the reported metrics do not represent end-to-end performance. Overlapping coughs from multiple pigs, fixed bounding boxes without tracking, and latency dominated by the event detection module all remain open challenges. Even so, the study demonstrates that learned audiovisual temporal modelling can attribute a cough to a specific animal within a crowded pen, day or night, laying groundwork for continuous, non-invasive respiratory disease surveillance in intensive pig production.

Subject of Research: Audiovisual multimodal deep learning for identifying coughing pigs in group-housed environments

Article Title: Coughing pig identification method based on multimodal fusion and hierarchical temporal modelling in group-housed environments

Article References: He, J., Zhuang, Y., Gan, Y., Qiu, F., yang, G., Liu, K., Wu, Y., Zhao, Y., Li, H., Li, J., Li, Q., & Yu, L. (2026). Coughing pig identification method based on multimodal fusion and hierarchical temporal modelling in group-housed environments. Smart Agricultural Technology, 15, Article 102658. https://doi.org/10.1016/j.atech.2026.102658

Image Credits: AI Generated

DOI: 10.1016/j.atech.2026.102658

Keywords: precision livestock farming, swine respiratory disease, Mycoplasma hyopneumoniae, audiovisual fusion, deep learning, cough detection, active speaker detection, animal welfare, nighttime monitoring, BiGRU, self-attention, object detection

At its core, CoughNet is a distributed acoustic sensing system built around three Raspberry Pi single-board computers, each fitted with a built-in microphone and positioned at different points in a room. Raspberry Pis are small, general-purpose computers that typically cost less than fifty dollars per unit, which makes the hardware footprint of the system remarkably modest. When someone coughs, all three microphones pick up the sound, but the device closest to the source registers it at the highest amplitude. That nearest unit acts as what the researchers describe as a reference microphone, capturing a short recording of the cough and running the audio file through an artificial-intelligence model trained to determine whether the sound is an authentic cough rather than a door slam, a dropped object, or a burst of speech.

The clever part of the design lies in how the system decides whether a cough comes from someone it has already counted. Rather than attempting any form of speaker identification, CoughNet exploits basic physics: sound travels at a known speed through air, so a cough originating from a particular spot in the room will arrive at each of the three microphones with a characteristic combination of loudness and arrival delay. The system performs cross-correlation between the reference recording and the signals captured by the two more distant units, comparing how strong the cough was in each recording and how long the sound took to reach each device. If the acoustic fingerprint matches, the system concludes that the same individual produced the cough; if the timing and amplitude profile differ, it registers a new, unique cougher.

Over a series of coughs, this approach allows CoughNet to build a statistical picture of the room. Multiple coughs that share a similar loudness and time-of-arrival pattern are grouped together as likely coming from the same person, while divergent patterns are flagged as additional individuals. The end result is a running count of unique coughing people in a defined space, which is precisely the kind of aggregate signal that could alert medical staff to a brewing respiratory outbreak without revealing anything about who those individuals are. Ismail emphasized that the system determines only that a cough occurred, never that a specific person coughed.

The emphasis on lightweight, efficient computation is what sets CoughNet apart from much of the existing work in disease monitoring. As Ismail noted, most public health and disease monitoring research has been machine-learning-heavy and processing-intensive, typically demanding servers or cloud infrastructure to run. His team deliberately set out to treat cough detection and cougher counting as a lightweight application that could eventually run on practical, low-cost devices. That constraint shaped every layer of the system, from the choice of hardware to the wireless protocol used to move data between nodes.

That wireless protocol is long-range, low-power radio technology known as LoRa, and it is central to CoughNet’s energy story. LoRa covers far more indoor space than a single Wi-Fi access point while consuming so little power that sensors can run for years on batteries. Ismail estimated that a typical lower-tier sensor in the system can operate on AA batteries for roughly ten years. The trade-off is that LoRa can only carry small messages, so the units cannot simply stream raw audio to each other or to a central hub. Instead, the system is selective about what it transmits: if a cough recording is clean, the sensor processes and groups it locally on the device; if the recording is noisy or unclear, the unit offloads only a small clip to a nearby, more powerful computer for further analysis. In Ismail’s words, it is a combination of networking and computation, with both optimized to work efficiently on tiny devices.

Privacy considerations shaped the design just as much as engineering efficiency did. Many public health sensing systems deployed in shared spaces rely on thermal cameras or visual sensors, which can capture far more information about individuals than their operators need. CoughNet reacts only to short bursts of sound that resemble a cough. There is no voice recognition, no speech-to-text processing, and no attempt to link any acoustic event to a person’s identity. Moreover, the system processes only enough audio to run its detection algorithm and then immediately deletes the raw sound once the analysis is complete. Ismail argued that if the same level of accuracy can be achieved without a camera or additional sensors, the privacy-sensitive job is done, especially in indoor environments such as hospitals where surveillance concerns are acute.

The prototype is very much a proof of concept, but the research team has a clear roadmap for extending it. The current version listens to audio and classifies it as a cough; the next major goal is to analyze coughs for additional context by examining their specific acoustic signatures. Different respiratory conditions can produce subtly different cough sounds, and the researchers want to explore whether those features can be used to estimate the probability that a coughing individual has a particular illness, such as a flu-like infection, COVID-19, or bronchitis. If that line of research succeeds, CoughNet could evolve from a simple counting tool into an early-warning system capable of hinting at the nature of an outbreak, not merely its existence.

The most obvious application is in medical settings: installing the technology in hospital waiting rooms or clinical units so that staff receive an alert when the rate of coughing in a defined area spikes, allowing them to respond with better information and a more efficient allocation of resources such as isolation rooms, testing kits, and protective equipment. But Ismail also sees direct-to-consumer possibilities. He wants the technology to eventually run on active noise-cancelling headphones and other wearable devices, turning everyday gadgets into background health sentinels. In theory, such a device could quietly warn its wearer that they are entering an area where the risk of respiratory illness appears elevated, giving people a chance to take precautions before exposure occurs.

For the researchers, the breadth of possible directions is part of the appeal. Ismail acknowledged that this is his team’s first work in the health domain, but he expressed enthusiasm for the road ahead, noting that work of this kind has a tangible impact on society. If CoughNet and systems like it mature, the humble cough, long treated as background noise in public spaces, could become a measurable, privacy-respecting signal that helps health systems detect and contain the next respiratory outbreak before it spreads.

Subject of Research: A lightweight acoustic sensor network for privacy-preserving detection and counting of multiple coughers in indoor spaces

Article Title: New sensor system tracks coughs in a room — without knowing who's coughing

Article References: New sensor system tracks coughs in a room — without knowing who's coughing. (n.d.). Original publication

Image Credits: AI Generated

DOI: Not provided

Keywords: CoughNet, Binghamton University, cough detection, Raspberry Pi, LoRa, edge computing, privacy, respiratory illness, disease surveillance, acoustic sensing, machine learning, public health