view post Post 1456 ๐ข For those who wish to launch distilled DeepSeek R1 for reasoning with schema, sharing the Google Colab notebook:๐ https://github.com/nicolay-r/nlp-thirdgate/blob/master/tutorials/llm_deep_seek_7b_distill_colab.ipynbThis is a wrapper of the Qwen2 transformers ๐ค provider via bulk-chain framework.Model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7BGPU: T4 (15GB) is nearly enough in float32 mode. ๐ To boost the performance you may set bf16 mode (use_bf16=True)๐ Powered by bulk-chain: https://github.com/nicolay-r/bulk-chain See translation ๐ 4 4 ๐ฅ 1 1 + Reply