Hugging Face's logo

humane-intelligence
/
gemma2-9b-cpt-sealionv3-instruct-endpoint

Text Generation
Transformers
Safetensors
gemma2
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
binaryaaron commited on
Commit
f159189
·
unverified ·
1 Parent(s): d646830

update handler args

Browse files
Files changed (1) hide show
  1. handler.py +1 -1
handler.py CHANGED
@@ -5,7 +5,7 @@ import torch
5
  MAX_TOKENS=8192
6
 
7
  class EndpointHandler(object):
8
- def __init__(self):
9
  self.pipeline: transformers.Pipeline = transformers.pipeline(
10
  "text-generation",
11
  model="humane-intelligence/gemma2-9b-cpt-sealionv3-instruct-endpoint",
 
5
  MAX_TOKENS=8192
6
 
7
  class EndpointHandler(object):
8
+ def __init__(self, path=''):
9
  self.pipeline: transformers.Pipeline = transformers.pipeline(
10
  "text-generation",
11
  model="humane-intelligence/gemma2-9b-cpt-sealionv3-instruct-endpoint",