aiplanet
/

buddhi-128k-chat-7b

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Chaitanya890 commited on Apr 4

Commit

f535e3c

•

1 Parent(s): 151c18f

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -42,7 +42,6 @@ from vllm import LLM, SamplingParams
 llm = LLM(
     model='aiplanet/buddhi-128k-chat-7b',
     trust_remote_code=True,
-    download_dir='aiplanet/buddhi-128k-chat-7b',
     dtype = 'bfloat16',
     gpu_memory_utilization=1,
     max_model_len= 75000

 llm = LLM(
     model='aiplanet/buddhi-128k-chat-7b',
     trust_remote_code=True,
     dtype = 'bfloat16',
     gpu_memory_utilization=1,
     max_model_len= 75000