pszemraj commited on
Commit
26347e8
1 Parent(s): 197d142

update commit to use for revision

Browse files

this commit 197d14245ad874da82194248cab1ce8cf87fa713 updates the config to `use_cache=True` by default, so it doesn't need to be set every time in generation config

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -45,7 +45,7 @@ model = AutoModelForCausalLM.from_pretrained(
45
  model_name,
46
  torch_dtype=torch.bfloat16,
47
  trust_remote_code=True,
48
- revision='b51ddaf1a256420debfb44fd7367ed7b291b7c19', # optional, but a good idea
49
  device_map='auto',
50
  load_in_8bit=False, # install bitsandbytes then set to true for 8-bit
51
  )
 
45
  model_name,
46
  torch_dtype=torch.bfloat16,
47
  trust_remote_code=True,
48
+ revision='197d14245ad874da82194248cab1ce8cf87fa713', # optional, but a good idea
49
  device_map='auto',
50
  load_in_8bit=False, # install bitsandbytes then set to true for 8-bit
51
  )