Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

RTX 5090 for running smaller models.

Then the RTX Pro 6000 for running a little bit larger models (96gb VRAM, but only ~15-20% more perf than 5090).

Some suggest Apple Silicon only for running larger models on a budget because of the unified memory, but the performance won't compare.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: