But the decoder for that will be 25+ gates, which is huge compared to the handfu...

		londons_explore on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... But the decoder for that will be 25+ gates, which is huge compared to the handful of gates to use the resulting weights.