bigcode

/

santacoder

like 324

Hi, I'm trying to deploy stock santacoder from tar.gz file created from cloning this hub repo. After deploying the model via the following code

huggingface_model = HuggingFaceModel(
   model_data="s3://my_bucket/santacoder_stock/model.tar.gz", 
   role=role,
   transformers_version="4.26",
   pytorch_version="1.13",
   py_version="py39", 
)
huggingface_model.env['HF_TASK'] = 'GPT2LMHeadModel'

env = {
    'SM_NUM_GPUS': json.dumps(1),
}
predictor = huggingface_model.deploy(
    initial_instance_count=1,
    instance_type="ml.g5.4xlarge",
    container_startup_health_check_timeout=300,
    env=env,
  )

I get following error:

...santacoder requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code\u003dTrue to remove this error

What configuration file are they talking about? Or how can I set trust_remote_code when deploying via the sagemaker.huggingface sdk?