Change `wte` to use shared embedding

#54

by bcui19 - opened Jun 9, 2023

←

bcui19

Jun 9, 2023

As title, this will help if, when we need to wrap self.wte with FSDP

bcui19

Jun 14, 2023

bcui19 changed pull request status to closed Jun 14, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment