Fix Travis CI IRC behaviour

At the moment, the IRC bot joins the channel each time, which is noisy.

This patch fixes that.