RichardErkhov/p208p2002_-_llama-keyword-generator-zh2zh-120M-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

llama-keyword-generator-zh2zh-120M - GGUF

• Model creator: https://huggingface.co/p208p2002/
• Original model: https://huggingface.co/p208p2002/llama-keyword-generator-zh2zh-120M/

Name	Quant method	Size
llama-keyword-generator-zh2zh-120M.Q2_K.gguf	Q2_K	0.05GB
llama-keyword-generator-zh2zh-120M.IQ3_XS.gguf	IQ3_XS	0.06GB
llama-keyword-generator-zh2zh-120M.IQ3_S.gguf	IQ3_S	0.06GB
llama-keyword-generator-zh2zh-120M.Q3_K_S.gguf	Q3_K_S	0.06GB
llama-keyword-generator-zh2zh-120M.IQ3_M.gguf	IQ3_M	0.06GB
llama-keyword-generator-zh2zh-120M.Q3_K.gguf	Q3_K	0.06GB
llama-keyword-generator-zh2zh-120M.Q3_K_M.gguf	Q3_K_M	0.06GB
llama-keyword-generator-zh2zh-120M.Q3_K_L.gguf	Q3_K_L	0.06GB
llama-keyword-generator-zh2zh-120M.IQ4_XS.gguf	IQ4_XS	0.07GB
llama-keyword-generator-zh2zh-120M.Q4_0.gguf	Q4_0	0.07GB
llama-keyword-generator-zh2zh-120M.IQ4_NL.gguf	IQ4_NL	0.07GB
llama-keyword-generator-zh2zh-120M.Q4_K_S.gguf	Q4_K_S	0.07GB
llama-keyword-generator-zh2zh-120M.Q4_K.gguf	Q4_K	0.07GB
llama-keyword-generator-zh2zh-120M.Q4_K_M.gguf	Q4_K_M	0.07GB
llama-keyword-generator-zh2zh-120M.Q4_1.gguf	Q4_1	0.08GB
llama-keyword-generator-zh2zh-120M.Q5_0.gguf	Q5_0	0.08GB
llama-keyword-generator-zh2zh-120M.Q5_K_S.gguf	Q5_K_S	0.08GB
llama-keyword-generator-zh2zh-120M.Q5_K.gguf	Q5_K	0.08GB
llama-keyword-generator-zh2zh-120M.Q5_K_M.gguf	Q5_K_M	0.08GB
llama-keyword-generator-zh2zh-120M.Q5_1.gguf	Q5_1	0.09GB
llama-keyword-generator-zh2zh-120M.Q6_K.gguf	Q6_K	0.09GB
llama-keyword-generator-zh2zh-120M.Q8_0.gguf	Q8_0	0.12GB

Original model description:

language: - zh inference: false pipeline_tag: text-generation tags: - llama - chinese - keyword-generator

LLaMA based chinese keyword generator

基於高品質中文資料訓練的中文關鍵字產生器。

Base Model: p208p2002/llama-traditional-chinese-120M

使用方式

範例

輸入

國內車市旺，10月單月掛 牌量衝上4萬台佳績，為40,540台，月增9%、年增11%；累計前十個月掛牌量逾39萬台，改寫近18年來新高紀錄，這樣的熱度將旺到年底。</s>

輸出

汽車行業、車市、熱度</s>

OpenLLM

支援OpenLLM部署使用。

$ openllm start opt --model-id p208p2002/llama-keyword-generator-zh2zh-120M

$ openllm query CONTEXT</s>