I tried using schnell, it won't fit in a 16gb GPU, and I couldn't get it to run ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		nubinetwork on Oct 3, 2024 \| parent \| context \| favorite \| on: FLUX1.1 [pro] – New SotA text-to-image model from ... I tried using schnell, it won't fit in a 16gb GPU, and I couldn't get it to run on CPU.

washadjeffmad on Oct 4, 2024 | [–]

Try an fp8: https://huggingface.co/Kijai/flux-fp8/

TobTobXX on Oct 4, 2024 | [–]

I've sucessfully run schnell and dev on a 12G GPU. They do take 40s/60s repectively, but it works. I used ComfyUI and didn't have to tweak anything.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact