Master and JRuby also needs to be allowed to fail