kcoopermiller
/

aya-101-GGUF

Text2Text Generation

text-generation-inference

Model card Files Files and versions Community

kcoopermiller commited on Feb 28

Commit

418a620

•

1 Parent(s): 0ecad5b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -138,7 +138,7 @@ cargo run --example quantized-t5 --release  -- \
   --temperature 0
 ```
-Note: this runs on CPU. To use GPU, replace `Device::Cpu` with `Device::new_cuda(0)?` in `candle/candle-examples/examples/quantized-t5/main.rs`
 Available weight files:
 - aya-101.Q2_K.gguf

   --temperature 0
 ```
+Note: this runs on CPU
 Available weight files:
 - aya-101.Q2_K.gguf