modified: src/flux/modules/conditioner.py

Files changed (10) hide show

src/flux/__pycache__/__init__.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/__init__.cpython-310.pyc and b/src/flux/__pycache__/__init__.cpython-310.pyc differ

src/flux/__pycache__/_version.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/_version.cpython-310.pyc and b/src/flux/__pycache__/_version.cpython-310.pyc differ

src/flux/__pycache__/math.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/math.cpython-310.pyc and b/src/flux/__pycache__/math.cpython-310.pyc differ

src/flux/__pycache__/model.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/model.cpython-310.pyc and b/src/flux/__pycache__/model.cpython-310.pyc differ

src/flux/__pycache__/sampling.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/sampling.cpython-310.pyc and b/src/flux/__pycache__/sampling.cpython-310.pyc differ

src/flux/__pycache__/util.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/util.cpython-310.pyc and b/src/flux/__pycache__/util.cpython-310.pyc differ

src/flux/modules/__pycache__/autoencoder.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/modules/__pycache__/autoencoder.cpython-310.pyc and b/src/flux/modules/__pycache__/autoencoder.cpython-310.pyc differ

src/flux/modules/__pycache__/conditioner.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/modules/__pycache__/conditioner.cpython-310.pyc and b/src/flux/modules/__pycache__/conditioner.cpython-310.pyc differ

src/flux/modules/__pycache__/layers.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/modules/__pycache__/layers.cpython-310.pyc and b/src/flux/modules/__pycache__/layers.cpython-310.pyc differ

src/flux/modules/conditioner.py CHANGED Viewed

@@ -41,6 +41,11 @@ class HFEmbedder(nn.Module):
         assert input_ids.shape[1] == self.max_length, f"Sequence length {input_ids.shape[1]} does not match max_length {self.max_length}"
         print(input_ids)
         outputs = self.hf_module(
             input_ids=input_ids.to(self.hf_module.device),
             attention_mask=batch_encoding["attention_mask"].to(self.hf_module.device),

         assert input_ids.shape[1] == self.max_length, f"Sequence length {input_ids.shape[1]} does not match max_length {self.max_length}"
         print(input_ids)
+        print(f"self.tokenizer.vocab_size: {self.tokenizer.vocab_size}")  # Debug
+        print(f"self.hf_module.config.vocab_size: {self.hf_module.config.vocab_size}")  # Debug
+        print(f"self.tokenizer.vocab_size: {self.tokenizer.vocab_size}")  # Debug
+        print(f"self.hf_module.config.vocab_size: {self.hf_module.config.vocab_size}")  # Debug
         outputs = self.hf_module(
             input_ids=input_ids.to(self.hf_module.device),
             attention_mask=batch_encoding["attention_mask"].to(self.hf_module.device),