Considering how much faster additions are processed, and how a particular silico... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		flockonus on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... Considering how much faster additions are processed, and how a particular silicon chip could be optimized for this very specific case; all parts added together perhaps could show >100x speed up vs current systems. I must concur, "wow".

Nevermark on Feb 29, 2024 [–]

For hardware, 2-argument ternary additions and multiplications should be very close in terms of the tiny circuit required for either.

If you are doing ternary calculations on 32/16-bit hardware, then the additions would be simpler.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact