HOT RADAR
agentHEAT 12.5°

AI CURATED HOT STORY · 11/3/2026

CWE-bench v2 Released with Open Source Cybersecurity Agent Benchmarks

1 reports archived1 independent sourcesupdated 11/3/2026, 08:00:00
Synthesis & Latest Updates
1 Sources Cross-Validated

Collinear AI has released CWE-bench v2, featuring a public set of 100 cybersecurity agent tasks based on real open-source repositories. Beyond evaluating frontier models' defensive capabilities, the environments are tagged for reinforcement learning (RL), enabling developers to use these tasks directly to train autonomous defensive agents.

LATEST/Collinear AI has released CWE-bench v2, featuring a public set of 100 cybersecurity agent tasks based on real open-source repositories. Beyond evaluating frontier models' defensive capabilities, the environments are tagged for reinforcement learning (RL), enabling developers to use these tasks directly to train autonomous defensive agents.

Hourly heat curve

2 fully observed hours
Fewer than 3 fully observed hours; trend not plotted yet.

Coverage timeline

Total 1 reports · Latest first
  1. Hugging Face BlogT1·68 pts
    • CWE-bench v2 offers 100 public evaluation tasks based on real codebases to test frontier cyber defense capabilities.
    • All task environments are tagged as `rl-environment`, serving directly as reward signals for training defensive agents.
    • The evaluation workflow is standardized, requiring agents to operate Git and handle security vulnerabilities in open-source repositories given specific instructions.
CWE-bench v2 Released with Open Source Cybersecurity Agent Benchmarks | Today for AI