Allow failures on 4.1 for now

So we can see a green CI on 4.0 till we fix on 4.1