> If you feed it the entire dataset before 1905, LLMs aren't going to come up wi... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

acuozzo 7 months ago | parent | context | favorite | on: Dario Amodei – "We are near the end of the exponen...

> If you feed it the entire dataset before 1905, LLMs aren't going to come up with general relativity.

Link?

Jensson 7 months ago [–]

You don't need a source for that, an LLM with such little data is barely able to form proper sentences.

acuozzo 7 months ago | [–]

> an LLM with such little data

There is a mountain of data pre-1905. Certainly enough to train a decent 30B parameter model.

Now, digitizing & OCRing all of that data... THAT is a challenge.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact