Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Leaner LLMs could enable efficient local use on phones and laptops (princeton.edu)
2 points by geox on Nov 19, 2024 | hide | past | favorite | 1 comment


Compressing Large Language Models using Low Rank and Low Precision Decomposition

https://arxiv.org/abs/2405.18886




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: