Update README.md

## Problem:

If we do not set the device in the pipeline we first get this warning:
```
UserWarning: You are calling .generate() with the `input_ids` being on a device type different than your model's device. `input_ids` is on cpu, whereas the model is on cuda. You may experience unexpected behaviors or slower generation. Please make sure that you have put `input_ids` to the correct device by calling for example input_ids = input_ids.to('cuda') before running `.generate()`.
```
After that we get the error:
```
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select)

```

## Solution:

Set devices for all models and in the pipeline method to avoid tensors being on different devices.

README.md

@@ -108,12 +108,15 @@ pip3 install git+https://github.com/casper-hansen/AutoAWQ.git@1c5ccc791fa2cb0697
 from awq import AutoAWQForCausalLM
 from transformers import AutoTokenizer
 
+device = torch.device("cuda") if torch.cuda.is_available() else torch.device("cpu")
+
+
 model_name_or_path = "TheBloke/Mistral-7B-v0.1-AWQ"
 
 # Load model
 model = AutoAWQForCausalLM.from_quantized(model_name_or_path, fuse_layers=True,
-                                          trust_remote_code=False, safetensors=True)
-tokenizer = AutoTokenizer.from_pretrained(model_name_or_path, trust_remote_code=False)
+                                          trust_remote_code=False, safetensors=True, device=device)
+tokenizer = AutoTokenizer.from_pretrained(model_name_or_path, trust_remote_code=False, device=device)
 
 prompt = "Tell me about AI"
 prompt_template=f'''{prompt}
@@ -154,7 +157,8 @@ pipe = pipeline(
     temperature=0.7,
     top_p=0.95,
     top_k=40,
-    repetition_penalty=1.1
+    repetition_penalty=1.1,
+    device=device,
 )
 
 print(pipe(prompt_template)[0]['generated_text'])