Optimal transport based adversarial patch to leverage large scale attack transferability - IRT SystemX Access content directly
Conference Papers Year : 2024

Optimal transport based adversarial patch to leverage large scale attack transferability

Abstract

Adversarial patch attacks, where a small patch is placed in the scene to fool neural networks, have been studied for numerous applications. Focusing on image classification, we consider the setting of a black-box transfer attack where an attacker does not know the target model. Instead of forcing corrupted image representations to cross the nearest decision boundaries or converge to a particular point, we propose a distribution-oriented approach. We rely on optimal transport to push the feature distribution of attacked images towards an already modeled distribution. We show that this new distribution-oriented approach leads to better transferable patches. Through digital experiments conducted on ImageNet-1K, we provide evidence that our new patches are the only ones that can simultaneously influence multiple Transformer models and Convolutional Neural Networks. Physical world experiments demonstrate that our patch can affect systems in deployment without explicit knowledge.
Fichier principal
Vignette du fichier
OPTIMAL_TRANSPORT_BASED_ADVERSARIAL_PATCH_TO_LEVERAGE_LARGE_SCALE_ATTACK_TRANSFERABILITY.pdf (6.92 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04467796 , version 1 (20-02-2024)

Identifiers

  • HAL Id : hal-04467796 , version 1

Cite

Pol Labarbarie, Adrien Chan-Hon-Tong, Stéphane Herbin, Milad Leyli-Abadi. Optimal transport based adversarial patch to leverage large scale attack transferability. The International Conference on Learning Representations (ICLR 2024), May 2024, Vienna, Austria. ⟨hal-04467796⟩
77 View
24 Download

Share

Gmail Mastodon Facebook X LinkedIn More