universeTBD
/

astrollama

Text Generation

text-generation-inference

Model card Files Files and versions Community

joshnguyen commited on Sep 16, 2023

Commit

45a37da

•

1 Parent(s): d41ff0e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -85,5 +85,5 @@ inputs.to(model.device)
 outputs = model(**inputs, output_hidden_states=True)
 # Last layer of the hidden states. Get average embedding of all tokens
-embeddings = outputs["hidden_states"][-1][:, :, ...].mean().detach().cpu().numpy()
 ```

 outputs = model(**inputs, output_hidden_states=True)
 # Last layer of the hidden states. Get average embedding of all tokens
+embeddings = outputs["hidden_states"][-1][:, 1:, ...].mean(1).detach().cpu().numpy()
 ```