5 trits fit into 1 byte pretty well, since 3^5 = 243 is just under 2^8 = 256. Th... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		tromp on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... 5 trits fit into 1 byte pretty well, since 3^5 = 243 is just under 2^8 = 256. That should be called an 8/5 = 1.6 bit model though, while the paper names it 1.58 bit, closer to log_2(3) ~ 1.5849625

londons_explore on Feb 28, 2024 | [–]

But the decoder for that will be 25+ gates, which is huge compared to the handful of gates to use the resulting weights.

JKCalhoun on Feb 28, 2024 | [–]

Would be nice to have hardware instructions that work on 5 tris natively.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact