Use the eigen matrix library to speed up CPU operations.

Since it looks like we're going to be on the CPU on the weight server
side, we should try to get it running as fast as we can.