Install missing libs in Travis config

Forgot to install numpy and matplotlib and the required 32bit libraries
for cross-compiling.