§ feed · storyline

Introducing the SWE-Lancer benchmark

OpenAI introduces SWE-Lancer, a benchmark that tests frontier LLMs on real-world freelance software engineering tasks worth up to $1 million in aggregate payouts.

Feb 18 · 11:00:00 · primary fetch1 sourceupdated Feb 18 · 11:00:00

Can frontier LLMs earn $1 million from real-world freelance software engineering?

read full article on openai.com ↗

§ sources1 publication · timeline below

openai.comIntroducing the SWE-Lancer benchmarkprimary11:00:00