Qiyu Zhong

allenzhong1214
ยท

AI & ML interests

Natural Language Processing Computer Vision Graph

Recent Activity

Organizations

Stanford AI's profile picture

allenzhong1214's activity

upvoted an article about 1 month ago
reacted to nicolay-r's post with ๐Ÿ‘ about 1 month ago
view post
Post
1456
๐Ÿ“ข For those who wish to launch distilled DeepSeek R1 for reasoning with schema, sharing the Google Colab notebook:
๐Ÿ“™ https://github.com/nicolay-r/nlp-thirdgate/blob/master/tutorials/llm_deep_seek_7b_distill_colab.ipynb
This is a wrapper of the Qwen2 transformers ๐Ÿค— provider via bulk-chain framework.
Model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
GPU: T4 (15GB) is nearly enough in float32 mode.
๐Ÿš€ To boost the performance you may set bf16 mode (use_bf16=True)
๐ŸŒŸ Powered by bulk-chain: https://github.com/nicolay-r/bulk-chain