joaoalvarenga

/

bloom-8bit

like 75

I try to run with a local cache_dir and get and error:

<ipython-input-11-a98d9b5ff3cc> in <module>
      1 transformers.models.bloom.modeling_bloom.BloomBlock = BloomBlock
----> 2 model = BloomForCausalLM.from_pretrained('joaoalvarenga/bloom-8bit', cache_dir='/path to shared drive', low_cpu_mem_usage=True)
      3 tokenizer = BloomTokenizerFast.from_pretrained('joaoalvarenga/bloom-8bit', cache_dir='/path to shared drive')

5 frames
<ipython-input-10-21a49de45658> in __init__(self, config, layer_number)
    126 class BloomBlock(transformers.models.bloom.modeling_bloom.BloomBlock):
    127     def __init__(self, config, layer_number=None):
--> 128         super().__init__(config, layer_number)
    129         convert_to_int8(self.self_attention)
    130         convert_to_int8(self.mlp)

TypeError: __init__() takes 2 positional arguments but 3 were given