ALL INTELLIGENCE
OpenAI 官方博客T1·Models

OpenAI Introduces UAR Metric for Adversarial Robustness

Original title: Testing robustness against unforeseen adversaries
45AI Score

Researchers introduced the Unforeseen Attack Robustness (UAR) metric to evaluate how reliably neural network classifiers defend against adversarial attacks unseen during training. The method highlights the necessity of measuring performance across a diverse range of unforeseen attacks, addressing limitations in current single-benchmark evaluations.

Full Report

We’ve developed a method to assess whether a neural network classifier can reliably defend against adversarial attacks not seen during training. Our method yields a new metric, UAR (Unforeseen Attack Robustness), which evaluates the robustness of a single model against an unanticipated attack, and highlights the need to measure performance across a more diverse range of unforeseen attacks.