Writer
/

palmyra-small

Text Generation

text generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

kiranr commited on Feb 10, 2023

Commit

beaf795

•

1 Parent(s): 73a63c5

minor fix

Files changed (1) hide show

README.md +4 -5

README.md CHANGED Viewed

@@ -24,7 +24,7 @@ img {
 }
 </style>
-|[![Model architecture](https://img.shields.io/badge/Model%20Arch-Transformer%20Decoder-green)](#model-architecture)|[![Model size](https://img.shields.io/badge/Params-126M-green)](#model-architecture)|[![Language](https://img.shields.io/badge/Language-en--US-lightgrey#model-badge)](#datasets)
 ## Model Description
@@ -49,13 +49,12 @@ This model can be easily loaded using the `AutoModelForCausalLM` functionality:
 ```python
-from transformers import AutoModelForCausalLM, AutoTokenizer
 import torch
-model = AutoModelForCausalLM.from_pretrained("Writer/palmyra-small", torch_dtype=torch.float16).cuda()
-# the fast tokenizer currently does not work correctly
-tokenizer = AutoTokenizer.from_pretrained("Writer/palmyra-small", use_fast=False)
 ```

 }
 </style>
+|[![Model architecture](https://img.shields.io/badge/Model%20Arch-Transformer%20Decoder-green)](#model-architecture)|[![Model size](https://img.shields.io/badge/Params-128M-green)](#model-architecture)|[![Language](https://img.shields.io/badge/Language-en--US-lightgrey#model-badge)](#datasets)
 ## Model Description
 ```python
 import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+model = AutoModelForCausalLM.from_pretrained("Writer/palmyra-small")
+tokenizer = AutoTokenizer.from_pretrained("Writer/palmyra-small")
 ```