Skip testing failure cases of test_regularizer_as_loss_layer