> you will need 8 GPUs (each with > 40GB of memory). oh joy | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		bigyabai 4 months ago \| parent \| context \| favorite \| on: Grok 2.5 weights available on Hugging Face > you will need 8 GPUs (each with > 40GB of memory). oh joy

karmakaze 4 months ago | [–]

Hey a use for the a16z machine[0].

[0] https://news.ycombinator.com/item?id=44996892

thot_experiment 4 months ago | [–]

that's bf16, you'll be running it at q4, so you'll be fine with 3 5090s

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact