They mention the cost was ~80,000k USD so for 32,256 hours it comes to ~2.48$ an... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		anizan on April 4, 2024 \| parent \| context \| favorite \| on: JetMoE: Reaching LLaMA2 performance with 0.1M doll... They mention the cost was ~80,000k USD so for 32,256 hours it comes to ~2.48$ an hour. Amazing how cost effective the compute actually is.

p1esk on April 4, 2024 [–]

I was paying $1.1 for A100 hour more than a year ago. $2.48 is crazy expensive.

anizan on April 5, 2024 | [–]

It was for a 96 X H100 cluster. Their provider was exabits.ai which bills itself as a decentralised computing marketplace.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact