I feel like this statement is both obvious after spending a few minutes working with neural networks and completely useless in helping you build better neural networks.
It's kind of like saying, "Stripped of anything else, works of literature are compositions of words"
Well, I’d argue that could also be a bit enlightening. It’s like taking a moment to appreciate that forests are composed of single trees. It takes a certain level of insight to appreciate systems at various depths.
It's kind of like saying, "Stripped of anything else, works of literature are compositions of words"