It's a matrix of differentiable functions that, eventually, you ultimately approximate via linear algebra. Some of these operations are multiplications.
"it's just matrix multiplications" umm sweety no it's not? the nonlinearity is actually super important? r u stupid?
