Don't use env for Travis

This does more than set environment variables; it is meant to test
different configurations simultaneously.