Hugging Face's logo

bigcode
/
starcoder

Text Generation Transformers PyTorch
gpt_bigcode code Eval Results Inference Endpoints text-generation-inference 4 papers
Model card Files Community
114

Why isn’t the memory being released after inference?

#76
by CodeWave - opened
Discussion
CodeWave

The memory has not been released after the first inference.
image.png

averoo
 BigCode org

I guess it's the model weights on GPU.

Sign up or log in to comment