SWE-bench verified was created in collaboration with OpenAI. It's also an open d... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

cbg0 72 days ago | parent | context | favorite | on: SWE-bench Verified no longer measures frontier cod...

SWE-bench verified was created in collaboration with OpenAI. It's also an open dataset so prone to contamination, meaning it can be gamed.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact