Activating the model on huggingface-vscode

#4
by yurqua - opened

Hi. Newbie here. Could you please help me to get around the ways of using the model in VS Code?

I'm trying to activate StableCode-Completion-Alpha-3B-4K on https://github.com/huggingface/huggingface-vscode
I have generated a HF token with a write permission and added it in VS Code extension settings. The bigcode/starcoder model works fine.
On the model page I pressed the 'πŸš€ Deploy' button, selected 'Inference API' item, copied the https://api-inference.huggingface.co/models/stabilityai/stablecode-completion-alpha-3b-4k API endpoint URL and pasted it into the 'Hugging Face Code: Model ID Or Endpoint' settings field.
Unlike with the default bigcode/starcoder model, the extension doesn't seem to work. I tried to restart extensions host and also tried stabilityai/stablecode-completion-alpha-3b-4k as value with no luck.

When I type in my editor, I see πŸ”„ Status bar icon next to Hugging Face Code spinning for a split of a second, and then nothing happens.

The OUTPUT panel shows something like:
INPUT to API: (with parameters {"max_new_tokens":60,"temperature":null,"do_sample":false,"top_p":0.95,"stop":["<|endoftext|>"]})
def main

What am I doing wrong?

Me too, trying to figure out the issue. It works perfectly fine with default model.

I am trying this as well

did anyone figure this out?

Sign up or log in to comment