Termsslug: adversarial-misuse

Adversarial Misuse

对抗性滥用

Intentional use of AI systems for purposes that violate ethical, legal, or safety standards.

Curated Intelligence

6 items · Page 1/1
MIT Technology ReviewT2·Industry
68 pts
Open Model Safety Debate Intensifies: Anthropic Flags GLM-5.3 Cyber Risks While Nvidia Backs Openness

Anthropic released a report warning that the open-source model GLM-5.3 from Chinese firm Z.ai poses significant cyberattack risks due to its unrestricted availability, sparking intense debate on whether frontier AI should remain closed. Meanwhile, Nvidia CEO Jensen Huang advocates for US development of more open models driven by hardware sales interests, highlighting the deep conflict between commercial incentives and safety considerations in open-source strategy.

OpenAI 官方博客T1·Industry
42 pts
OpenAI Bans Accounts Using ChatGPT for Recovery Scams

OpenAI disclosed in a security report that it banned a cluster of accounts using ChatGPT to generate fake law firm content and impersonate authorities like the FBI's IC3. Originating likely from Cambodia, these operations targeted fraud victims with 'recovery scams.' The case highlights the risk of LLMs automating high-credibility phishing content and platform efforts to disrupt such adversarial uses.

OpenAI 官方博客T1·Industry
68 pts
OpenAI Bans Accounts Linked to Russian Malware

OpenAI banned accounts suspected of being linked to Russian-speaking criminal groups that used AI to build malware loaders, evasion layers, and credential-theft scripts. This incident highlights the real-world risk of generative AI being abused for automated cyberattack infrastructure, prompting stricter platform security reviews.

OpenAI 官方博客T1·Industry
42 pts
OpenAI Bans Accounts Linked to AI-Driven Job Fraud

OpenAI has banned accounts associated with suspected deceptive employment campaigns where users leveraged AI to generate materials for potentially fraudulent remote job applications. This action targets the misuse of large language models for creating fake resumes or automating illicit job submissions, reinforcing platform safety and compliance standards.

OpenAI 官方博客T1·Industry
42 pts
OpenAI Details 'Tort Report' Abuse: Vietnamese Accounts Used Models to Generate Malicious Reports Against Independent Media

OpenAI disclosed a 'Tort Report' abuse case in its threat intelligence report, where Vietnamese accounts used models to generate comments for filing malicious reports against independent media on Facebook and YouTube. Although the activity resulted in no takedowns (rated as Category 1 impact), it highlights an emerging risk of LLMs being weaponized to automate false reporting and suppress dissent.