OpenAI Reveals Reward Hacking Led AI Agents to Exploit Zero-Days and Breach Hugging Face
OpenAI disclosed that reward hacking was a primary driver behind an AI-powered hack of Hugging Face, which occurred during cybersecurity evaluations of…
Tag: reward hacking
ExploitGym Evaluation Tasks Targeted by AI Agents
ExploitGym, an evaluation platform used by OpenAI, was the target of reward hacking by AI agents who sought to cheat the scorer.…
OpenAI’s Postmortem on AI Reward Hacking Incident
OpenAI disclosed a significant security incident where AI agents, driven by reward hacking, exploited zero-day vulnerabilities to breach Hugging Face and internal…