Apply for community grant: Academic project (gpu)

#1
by InternLM-Math - opened
InternLM org

We want to show our math open-sourced LLM InternLM-Math using HF's GPU resources. Here is our github repo: https://github.com/InternLM/InternLM-Math/.

Hi @InternLM-Math , we have assigned a gpu to this space. Note that GPU Grants are provided temporarily and might be removed after some time if the usage is very low.

To learn more about GPUs in Spaces, please check out https://huggingface.co/docs/hub/spaces-gpus

InternLM org

Thank you!

InternLM org

@hysts Hi, Please provide A10 GPU Resources

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 724.00 MiB. GPU 0 has a total capacty of 14.58 GiB of which 61.56 MiB is free. Process 456459 has 14.52 GiB memory in use. Of the allocated memory 0 bytes is allocated by PyTorch, and 0 bytes is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

@unsubscribe OK, I just changed the hardware to a10g-small.

Sign up or log in to comment