it's pretty close to accurate, the lack of differentiability at 0 for relu doesn...

		whimsicalism on April 30, 2024 \| parent \| context \| favorite \| on: Alice's adventures in a differentiable wonderland it's pretty close to accurate, the lack of differentiability at 0 for relu doesn't really come into play in practice