Instructions to use ruddls030/haru-e5-small-en-int8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use ruddls030/haru-e5-small-en-int8 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('feature-extraction', 'ruddls030/haru-e5-small-en-int8');
haru-e5-small-en-int8
HaruPet λ°μ€ν¬ν± ν«μ μμ΄ 'CPU μ μ© λν'(λ΄μ₯ λν λͺ¨λΈμ λͺ» μ°λ μ¬μ©μμ© λ΅ κ³ λ₯΄κΈ°)μ μ°λ λ¬Έμ₯ μλ² λ© λͺ¨λΈμ΄μμ. μΈμ΄λ§λ€ λͺ¨λΈμ΄ λ°λ‘ μμ΄μ(νκ΅μ΄: haru-e5-small-int8). νκ΅μ΄ ν루 λͺ¨λΈμμ μΆλ°ν΄ μμ΄ μ§λ¬Έβλ΅ μμΌλ‘ μ΄μ΄μ νμ΅νμ΄μ(MultipleNegativesRanking, 3μν). νμ΅ λ°μ΄ν°λ 곡κ°νμ§ μμμ.
onnx/model_quantized.onnx: int8 λμ μμν(μ±λλ³ uint8), 118MB. μ±μ΄ μ°λ νμΌμ΄μμ.onnx/model.onnx: fp32, 470MB- 384μ°¨μ, mean pooling ν μ κ·ν. μ
λ ₯ μμ
query:λ₯Ό λΆμ¬μ.
CPU μ μ© λν λ¬Άμ (cpu-chat/)
cpu-chat/questions.f16: κ³΅μ© μ§λ¬Έ 3,575κ°(μμ΄)μ 벑ν°. 3,575Γ384 float16, little-endian, μ κ·νλ¨. 2.7MBcpu-chat/answers.json:answers.{haru,luna,mori,minako}[i],fallback.<μΊλ¦ν°>3κ°,threshold0.5
μ΅κ³ μ μ >= threshold λ©΄ κ·Έ μ§λ¬Έμ λ΅, μλλ©΄ λ묻λ λ§. CPU(WASM, 1μ€λ λ)μμ ν λ² κ³ λ₯΄λ λ° μ½ 15ms, ν¨μ¨ μ½μ΄λ§ μ°λ©΄ μ½ 96ms.
- Downloads last month
- 17
Model tree for ruddls030/haru-e5-small-en-int8
Base model
intfloat/multilingual-e5-small