the intuition that matmuls rotate and scale the space but nonlinearities cut and fold it was really illuminating for me no amount of rotation gets you to anything but a different rotation. but once you can cut and fold, hyperdimensional origami becomes possible