Revert "Revert "Remove branch whitelist for Travis CI""

This reverts commit fabdcc6be5f241ef8a2327f1f982d7bc9ad9d431.