Prune travis build combinations

This is pretty aggressive, but I'll put it out there anyway. Are there other combinations we think are important to test?