This doesn't make a lot of sense when you consider how backprop works. Layers aren't limited to working independently.

This also doesn't make a lot of sense when you consider models are autoregressive.