Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is important for "smaller" models, because you don't have to waste some of the potential "intelligence" (parameter space) on training it how to generate valid JSON or YAML or anything like that.


You still do... The model has to know JSON and YAML, its just more reliable when the generation is enforced by grammar


Right, but there is a big difference between ”generally knows what JSON looks like and gets it right most of the time" and "generates perfect JSON every time".




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: