The technique belongs to a family known as zero-watermarking. Instead of embedding a watermark into the image, the scheme extracts robust features from the picture and associates them with a binary message to form a reference signature, which is stored externally. During verification, features are extracted from a potentially marked image and used to confirm the watermark’s presence or recover its full content. The image itself never changes, so its visual integrity remains intact by design. What has historically limited zero-watermarking, however, is the fragility of the features it depends on. If a picture is rotated slightly or squeezed through JPEG compression, handcrafted descriptors and even pretrained deep features can shift enough to break the association with the stored signature, causing watermark recovery to fail.

Recent deep learning approaches have tried to sidestep this problem by borrowing feature extractors from self-supervised models such as SimCLR, BYOL, and DINO, assuming that representations trained on large-scale classification or contrastive tasks offer sufficient invariance to distortions. The InvZW team, led by Abdullah All Tanvir, Frank Y. Shih, and Xin Zhong, argues that this assumption is fundamentally flawed. Self-supervised models learn invariance only as a byproduct of their training objectives, typically through predefined augmentations, and are not explicitly optimized to suppress the distortion-specific variability that breaks watermark consistency. Their answer is to train a feature extractor specifically for the job, using a noise-adversarial scheme that forces the network to produce representations indistinguishable between clean and corrupted images.

The framework’s first module is a three-way adversarial game built on Vision Transformer architectures. A feature extractor divides an input image into patches, projects them into a latent space with learnable linear transformations and positional encodings, and processes them through stacked Transformer blocks containing multi-head self-attention and feed-forward layers. Both an original image and a distorted version pass through this extractor. A discriminator, itself a ViT-based classifier, is trained to determine whether a given feature representation came from a clean or corrupted image. The extractor is trained adversarially to fool the discriminator, a minimax interaction that pushes the two feature distributions toward alignment. In theory, this setup echoes the domain-adversarial learning paradigm, treating the distortion process as inducing a domain shift between related image populations that share semantic structure but differ in nuisance factors.

Adversarial alignment alone, however, invites a degenerate shortcut. The extractor could satisfy the discriminator by outputting a constant, trivial representation—say, all zeros—regardless of input. Such features are perfectly invariant and perfectly useless. To prevent this collapse, the team introduces a reconstructor module, an autoencoder-like network with convolutional encoder and decoder paths that must rebuild the original image from the extracted features. The reconstruction loss combines mean squared error with the Structural Similarity Index, applied to both clean and distorted inputs. This constraint can be read through the Information Bottleneck principle: the representation should retain information about the underlying image content while reducing sensitivity to distortion-specific detail. If features collapse, reconstruction fails with high error, and the model is penalized, effectively discouraging degenerate solutions.

The second module turns these invariant features into a working multibit watermarking scheme. For each image-watermark pair, a reference signature matrix is optimized by gradient descent so that the inner products between the signature and the feature vector align with the target binary message, with a sigmoid activation and binary cross-entropy loss enforcing the soft margin between bits. An L2 penalty regularizes the signature to prevent overfitting. Crucially, this optimization happens in feature space, not image space, and involves no updating of the image or the feature extractor. The team notes that the approach enables a natural one-to-many mapping: a single image can be linked to multiple watermark identities, each defined by a distinct reference signature, with storage scaling linearly with the number of assigned watermarks. During verification, only the correct signature produces a successful match, supporting user-specific ownership or multi-level authorization.

The experimental results are striking. The feature extractor was trained on 40,000 MSCOCO images using only geometric distortions—rotation, translation, shear, zoom—yet at test time it demonstrated strong invariance to a much broader spectrum of unseen attacks, including Gaussian blur, JPEG compression, salt-and-pepper noise, and solarization. Cosine similarity between features of original and distorted images remained consistently high, reaching 0.93 or above under blur and compression across all evaluated datasets, with Flickr30k and ImageNet showing resilience up to 0.96 under pixel-level attacks. Reconstruction quality stayed high as well, with PSNR values frequently exceeding 30 dB under most geometric transformations. When compared against five self-supervised baselines—SimCLR, BYOL, Barlow Twins, VICReg, and VIbCReg—the proposed method consistently achieved the highest feature invariance, with cosine similarities up to 0.98 under Gaussian blur and JPEG compression.

The watermarking benchmarks are equally compelling. Evaluated with 30-bit binary messages across 1,000 test images per distortion setting, the framework achieved bit error rates ranging from 0.05 percent to a maximum of 8 percent across six common distortions. Against embedded watermarking schemes such as HIDDEN and an adversarial variant, standardized so that marked images maintained approximately 40 dB PSNR for fair comparison, the proposed method reached an average bit accuracy of 96.5 percent, compared with 76.5 and 86.8 percent for the baselines. The gaps were widest under color-related distortions: at a hue adjustment of 0.6, the baselines collapsed to 18.1 and 42.4 percent accuracy while the proposed method held 99.1 percent. Under severe Gaussian noise at 0.10 intensity, it achieved 95.3 percent accuracy versus 63.2 and 89.5 percent for the alternatives. Even under non-differentiable transformations like screenshots, the method preserved 98 percent bit accuracy.

Ablation studies confirm that both core components are essential. Removing the reconstructor dropped linear classification accuracy from 81.67 to 63.31 percent and watermark bit accuracy from 96.7 to 68.1 percent, with feature heatmaps showing uniformly high pairwise similarity—clear evidence of collapse. Removing adversarial training similarly degraded both metrics, from 81.67 to 69.45 percent linear accuracy and from 96.7 to 74.3 percent bit accuracy. The full framework, comprising a roughly 9-million-parameter feature extractor, a 14-million-parameter discriminator, and a 7-million-parameter reconstructor, was trained on a single Nvidia RTX 4090 GPU in approximately 46 hours, operating on relatively small inputs. At inference time, only the feature extractor is required, keeping deployment costs comparable to standard feature extraction pipelines.

The team acknowledges that their study focused on simulated digital distortions, and future work will evaluate the framework under real-world perturbations such as camera-captured compression artifacts, sensor noise, and degradations from mobile or embedded devices. They also plan to extend the approach to video watermarking and real-time applications, and to test robustness under more extreme and semantic distortions such as style transfer and image enhancement. For now, InvZW demonstrates that the path to protecting images without altering them runs not through better handcrafted descriptors or borrowed pretrained models, but through training networks explicitly to learn invariance—an adversarial pursuit in which a discriminator and a reconstructor, working at cross purposes, together produce features stable enough to carry a secret message through almost anything an image might endure.

Subject of Research: InvZW: invariant feature learning via noise-adversarial training for robust image zero-watermarking

Article Title: InvZW: invariant feature learning via noise-adversarial training for robust image zero-watermarking

Article References: Tanvir, A. A., Shih, F. Y., & Zhong, X. (2026). InvZW: invariant feature learning via noise-adversarial training for robust image zero-watermarking. Frontiers in Signal Processing, 6, Article 1812987. https://doi.org/10.3389/frsip.2026.1812987

Image Credits: AI Generated

DOI: 10.3389/frsip.2026.1812987

Keywords: zero-watermarking, adversarial training, invariant feature learning, image protection, deep learning, Vision Transformer, copyright protection, InvZW, invariant, feature, learning, noise-adversarial