Are adversarial examples inevitable? · HackerPapers discussions

Are adversarial examples inevitable? — mentioned by laura_g

Mon, 29 Nov 2021 16:04:39 GMT

The literature has pretty consistently shown that adversarial examples can be found with only black box access (even with truncated prediction vectors), robustness methods are primarily a cat-and-mouse game between attackers and defenders, and the existence of adversarial examples is likely inevitable (https://arxiv.org/pdf/1809.02104.pdf). The big question that remains is - so what? There's exceedingly few use cases where the existence of adversarial examples causes a security threat. There's a lot of research value in understanding adversarial examples and what that tells us about how…

Paper and discussion history. A mention is not an endorsement.

Are adversarial examples inevitable? — mentioned by rademacher

Wed, 07 Nov 2018 00:48:18 GMT

This latest craze of "AI" research seems to be fueled by a sudden glut of computational power (GPUs) that wasn't available previously. I think that most technical people would agree that the mid 2020s is extremely ambitious. I'd also argue that we're actually more likely to experience another AI winter. The frightening part of the current deep learning research is how susceptible they are to adversarial attacks. Adding small amounts of noise causes misclassification in images, and some papers even explore the inevitability of adversarial examples [1]. This is especially frightening given the…

Paper and discussion history. A mention is not an endorsement.