Remove checks for same default compiler

These fail on the travis CI server.