Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Very nicely written guide!

If the authors or readers are interested in some of the more technical details of how we optimized guidance & llguidance, we wrote up a little paper about it here: https://guidance-ai.github.io/llguidance/llg-go-brrr



One of the authors here. I've read the paper. Brilliant work, especially the slicing implementation for denser token masks.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: