enable activation checkpointing

#10
by smangrul - opened

This PR is meant to enable activation checkpointing

model = AutoModelForCausalLM.from_pretrained("microsoft/phi-2",  checkpointing=True)

It gives me an Error "TypeError: PhiForCausalLM.init() got an unexpected keyword argument 'checkpointing'"

Microsoft org

Hello @smangrul and @rungao2001 !

This will be updated once we integrate with the Phi implementation in HF.

Best regards,
Gustavo.

gugarosa changed pull request status to closed

Sign up or log in to comment