Remove state from transformers