Cisco Talos discovered VOLTA, a new Windows malware that leverages online AI models like Anthropic Claude to analyze victim data and assess its economic value. This 'collect-then-evaluate' approach marks a shift from indiscriminate mass attacks to high-precision target selection, significantly increasing tracking difficulties and personal data exposure risks.
Social Engineering
社会工程学
Attack method exploiting psychological manipulation to trick people into revealing secrets or acting
Curated Intelligence
Google DeepMind and Singapore's GovTech have launched a lightweight on-device AI model designed to detect complex social engineering scams in real-time. By running locally on user devices without uploading chat data, the solution protects citizen privacy while effectively blocking fraud. This collaboration demonstrates a new paradigm for building public safety technology, with potential future integration into operating systems and messaging platforms.
OpenAI announced the disruption of a criminal scam operation based in Cambodia. The group utilized ChatGPT to facilitate investment, romance, gambling, and impersonation frauds. This action highlights the ongoing challenges and response capabilities regarding the malicious misuse of large language models.
OpenAI has banned a set of accounts suspected to originate from China for using AI tools to gather intelligence on US persons, locations, and social engineering tactics. This action highlights the emerging risk of generative AI being abused for malicious reconnaissance and cyber espionage, alongside platforms' increasing compliance monitoring.
OpenAI has banned accounts that used its models to support romance scam workflows. The prohibited activities included automated outreach, translation, victim engagement, and investment fraud lures, signaling a stricter enforcement against the misuse of generative AI for social engineering attacks.
OpenAI disclosed in a security report that it banned a cluster of accounts using ChatGPT to generate fake law firm content and impersonate authorities like the FBI's IC3. Originating likely from Cambodia, these operations targeted fraud victims with 'recovery scams.' The case highlights the risk of LLMs automating high-credibility phishing content and platform efforts to disrupt such adversarial uses.
OpenAI has banned accounts linked to online fraud networks that utilized AI for generating scam scripts, impersonation, translation, and victim engagement. This action aims to curb the trend of AI being weaponized for automated social engineering attacks.
OpenAI banned accounts likely originating from Cambodia that used AI to support 'wrong number' task scams targeting UK users. This action highlights the growing misuse of generative AI in automating social engineering attacks, with platforms increasingly deploying risk controls to curb such illicit workflows.
OpenAI banned a network of accounts using ChatGPT to generate social media posts, analyze datasets, and translate emails for a covert operation dubbed 'VAGue Focus.' These accounts impersonated employees of geopolitical entities to conduct social engineering attempts. While evidence suggests limited reach, the case highlights the risks of LLMs facilitating cross-border information manipulation.
OpenAI recently banned accounts suspected of originating in Cambodia that used AI to translate and generate romance and investment scam conversations. This action highlights the trend of generative AI being abused for automated social engineering attacks and demonstrates platform compliance interventions against specific regional fraud patterns.