intel/intel-extension-for-transformers: ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
Category: perf
Language: C++
Topics: 4-bits, attention-sink, chatbot, chatpdf, cpu, gaudi2, gpu, habana, intel-optimized-llamacpp, large-language-model, llm-cpu, llm-inference, neural-chat, neural-chat-7b, neurips2023, pc, speculative-decoding, streamingllm, xeon