Better use of travis matrix

Signed-off-by: Jonas Kalderstam <jonas@kalderstam.se>