Sounds a lot like: stop using laptops and SOCs, get a last-gen desktop. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		contingencies on Nov 27, 2023 \| parent \| context \| favorite \| on: Ask HN: Cheapest way to run local LLMs? Sounds a lot like: stop using laptops and SOCs, get a last-gen desktop.

Rastonbury on Nov 27, 2023 | [–]

Yeah getting it all up and running on my 1080 was exciting but immediately got deflated how painfully slow it was. Bit the bullet on a new card, night and day, not even a top end card

alok-g on Nov 27, 2023 | [–]

And I guess avoid Windows.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact