Avoid to overload travis, just build on gcc and clang