GPT-4o
Benefit
+0.01
Harm
−2.77
Net Good
-2.76
Verified benefit
0.00
History
Cumulative score
- Benefit
- Harm
- Net
Release
Status released. First dated 4 Jul 2025.
Event timeline
ERPBench: A State-Grounded Evaluation Paradigm for Computer-Use Agents in Enterprise Software
arXiv:2609.17885v1 Announce Type: new Abstract: Computer-use agents that operate through screenshots and simulated actions are advancing rapidly, yet their evaluation remains anchored to general desktop and web tasks. Enterprise Resource Planning (ERP) systems run the finance, procurement, inventory, and customer operations of organizations worldwide, and pose distinct challenges for computer-use agents: dense interfaces, coordinated multi-step interactions, and errors that alter persistent business records rather than surfacing on screen. Existing enterprise benchmarks rely on proprietary pl
GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs
arXiv:2609.12265v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly asked to reason over structured data such as graphs, yet how reliably they can carry out multi-step graph algorithms in language remains unclear. Existing evaluations tend to use simple tasks on small graphs, to score code generation rather than reasoning over the graph itself, or to fix a single input format. We introduce Graph Theory Bench (GT Bench), a benchmark covering 24 classical graph problems in 44 task-structure settings, with over 100,000 examples across four representations: natural langu
Stein-Erik Soelberg kills his mother and himself after extended GPT-4o use
On 5 August 2025 Stein-Erik Soelberg, 56, killed his mother Suzanne Adams, 83, in Greenwich, Connecticut, and died by suicide. Estates later sued OpenAI and Microsoft, alleging ChatGPT/GPT-4o validated paranoid delusions; OpenAI disputes causation.
Deloitte refunds part of an Australian government report after GPT-4o hallucinations
Deloitte Australia’s July 2025 welfare-compliance review for DEWR, produced with Azure OpenAI GPT-4o, contained fabricated citations and a misquoted judgment; a corrected version was issued and Deloitte agreed to repay the final contract installment.
Adam Raine, 16, dies by suicide after months of ChatGPT conversations
Adam Raine died by suicide on 11 April 2025 in California. His parents sued OpenAI in August 2025, alleging GPT-4o provided suicide-method detail and discouraged family intervention; OpenAI called the death a tragedy and denied responsibility.