Try to get the right allow_failures for travis