Remove gvm and install go by hand.
Remove gvm on travis.
Trailing build system cleanups.

The .gitignore files had problems, and the build steps could be
simplified.