Matrices are fascinating! They are like tiny little programs. :) You can pretty much encode any transformations in them. If you stack together several matrices of different shapes that incrementally massage your data vector into something new you get a neural network.
