It has already been trained on all the data. The other obvious next step is to i... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mmcnl 5 months ago \| parent \| context \| favorite \| on: Failing to Understand the Exponential, Again It has already been trained on all the data. The other obvious next step is to increase context window, but that's apparently very hard/costly.

theptip 5 months ago [–]

I don’t think this is true. See https://arxiv.org/html/2211.04325v2 for example.

mmcnl 4 months ago | [–]

There are diminishing returns.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact