Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
kmdupree
71 days ago
|
parent
|
context
|
favorite
| on:
SWE-bench Verified no longer measures frontier cod...
i disagree:
https://www.philosophicalhacker.com/post/anthropic-error/
defmacr0
70 days ago
[–]
I don't understand that methodology in the first place. Does Anthropic even have some kind of somewhat objective definition to measure and judge "memorization"? Is there any evidence that other LLMs are viable tool to determine that?
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: