travis: optimisation with a matrix build

* add build mode (now also compile in debug)
* add some excludes to the matrix
* build host and plugins separatly
* host: build the python binding at the end without parallel jobs to
limit memory troubles
* use apt cache