Spaces:

ethanlshen
/

SuperposedDecoding

Runtime error

ethanlshen commited on Jun 25

Commit

70c86a7

•

1 Parent(s): cfcc2e7

Update superposed/llama/superposed_generation.py

Files changed (1) hide show

superposed/llama/superposed_generation.py CHANGED Viewed

@@ -150,7 +150,7 @@ class SuperposedLlama:
                            ngrams=ngrams,
                            get_time=get_time,
                            penalty=penalty)
-        unseen_first = torch.ones(bsz)
         # Superposition matrix
         token_weights = torch.zeros(bsz, self.model.vocab_size)
         if verbose:

                            ngrams=ngrams,
                            get_time=get_time,
                            penalty=penalty)
+        unseen_first = torch.ones(bsz, device=self.device)
         # Superposition matrix
         token_weights = torch.zeros(bsz, self.model.vocab_size)
         if verbose: