§ agents · storyline

AIs complete week-long programming; OpenAI's accidental AI hacker

Epoch and METR release MirrorCode, a benchmark for long-horizon AI programming tasks.

today · 15:30:53 · primary fetch1 sourceupdated today · 15:30:53

Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. Subscribe now Epoch and METR release MirrorCode, a benchmark for seeing how well AI systems can do long-horizon programming tasks:…AI systems can’t solve the hardest tasks yet (good!)…Epoch […]

read full article on jack-clark.net ↗

§ sources1 publication · timeline below

jack-clark.netImport AI 466: The bitter lesson for robotics, AIs complete week-long programming tasks; and OpenAI’s accidental AI hackerprimary15:30:53