Hugging Face's logo

c01zaut
/
Phi-3-mini-4k-instruct-rk3588-1.1.4

Text Generation
Safetensors
English
French
phi3
nlp
code
conversational
custom_code
Model card Files Community
c01zaut commited on
Commit
5c6445a
•
1 Parent(s): fe08c79

Upload folder using huggingface_hub

Browse files
Files changed (26) hide show
  1. .gitattributes +18 -0
  2. Phi-3-mini-4k-instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm +1 -1
  3. Phi-3-mini-4k-instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm +1 -1
  4. Phi-3-mini-4k-instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm +1 -1
  5. Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm +1 -1
  6. Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm +1 -1
  7. Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm +1 -1
  8. Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  9. Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  10. Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  11. Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  12. Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  13. Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  14. Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  15. Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  16. Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  17. Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  18. Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  19. Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  20. Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  21. Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  22. Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  23. Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  24. Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  25. Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  26. README.md +1 -1
.gitattributes CHANGED
@@ -39,3 +39,21 @@ Phi-3-mini-4k-instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=
39
  Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
40
  Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
41
  Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
40
  Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
41
  Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
42
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
43
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
44
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
45
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
46
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
47
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
48
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
49
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
50
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
51
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
52
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
53
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
54
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
55
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
56
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
57
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
58
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
59
+ Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
Phi-3-mini-4k-instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:79473f5dcd3d942a5051335bcf998abab2912f01dfce848c995b34f6a5860bbb
3
  size 3940113076
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79904a38bf009ba6f9895e4126e21b0ccd792438310e12ecd4d71bdd60363f22
3
  size 3940113076
Phi-3-mini-4k-instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:79473f5dcd3d942a5051335bcf998abab2912f01dfce848c995b34f6a5860bbb
3
  size 3940113076
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79904a38bf009ba6f9895e4126e21b0ccd792438310e12ecd4d71bdd60363f22
3
  size 3940113076
Phi-3-mini-4k-instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:79473f5dcd3d942a5051335bcf998abab2912f01dfce848c995b34f6a5860bbb
3
  size 3940113076
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79904a38bf009ba6f9895e4126e21b0ccd792438310e12ecd4d71bdd60363f22
3
  size 3940113076
Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9498d4204b4721e607cfa138905e1d01786358d6a541cf9b3e333e929736680
3
  size 3940113076
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48863ddedb6221067ebad46969641c82d672fe0f08c04bae41f614b23ef65fb6
3
  size 3940113076
Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9498d4204b4721e607cfa138905e1d01786358d6a541cf9b3e333e929736680
3
  size 3940113076
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48863ddedb6221067ebad46969641c82d672fe0f08c04bae41f614b23ef65fb6
3
  size 3940113076
Phi-3-mini-4k-instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9498d4204b4721e607cfa138905e1d01786358d6a541cf9b3e333e929736680
3
  size 3940113076
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48863ddedb6221067ebad46969641c82d672fe0f08c04bae41f614b23ef65fb6
3
  size 3940113076
Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d56d2a0f226d4827570998f299edaaa0193aca4a75d81865037fd54bd512a8b8
3
+ size 4195231076
Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d56d2a0f226d4827570998f299edaaa0193aca4a75d81865037fd54bd512a8b8
3
+ size 4195231076
Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d56d2a0f226d4827570998f299edaaa0193aca4a75d81865037fd54bd512a8b8
3
+ size 4195231076
Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f1cab5a7f15b7655eb7d3d0400469fe7be37747e36200eba20739f5501a4c7c
3
+ size 4188829692
Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f1cab5a7f15b7655eb7d3d0400469fe7be37747e36200eba20739f5501a4c7c
3
+ size 4188829692
Phi-3-mini-4k-instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f1cab5a7f15b7655eb7d3d0400469fe7be37747e36200eba20739f5501a4c7c
3
+ size 4188829692
Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1837b67c301a2ecffef2a48a3161b338fc68aaabe62070ace8a5640a4018d481
3
+ size 4063502564
Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1837b67c301a2ecffef2a48a3161b338fc68aaabe62070ace8a5640a4018d481
3
+ size 4063502564
Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1837b67c301a2ecffef2a48a3161b338fc68aaabe62070ace8a5640a4018d481
3
+ size 4063502564
Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b0f60faca3b4804f63b6c2802e8a0377e16aef397c1debc1e8407598b4e930d
3
+ size 4060438524
Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b0f60faca3b4804f63b6c2802e8a0377e16aef397c1debc1e8407598b4e930d
3
+ size 4060438524
Phi-3-mini-4k-instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b0f60faca3b4804f63b6c2802e8a0377e16aef397c1debc1e8407598b4e930d
3
+ size 4060438524
Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07887ee6c7af0381750666025d73b00181bc07be21a257c70c29107a3b4b5506
3
+ size 3997638308
Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07887ee6c7af0381750666025d73b00181bc07be21a257c70c29107a3b4b5506
3
+ size 3997638308
Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07887ee6c7af0381750666025d73b00181bc07be21a257c70c29107a3b4b5506
3
+ size 3997638308
Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:508397e04aa69d5e03cc33894a674c49043ad8292ce363a66b29858885af2ff0
3
+ size 3996242940
Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:508397e04aa69d5e03cc33894a674c49043ad8292ce363a66b29858885af2ff0
3
+ size 3996242940
Phi-3-mini-4k-instruct-rk3588-w8a8_g512-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:508397e04aa69d5e03cc33894a674c49043ad8292ce363a66b29858885af2ff0
3
+ size 3996242940
README.md CHANGED
@@ -18,7 +18,7 @@ widget:
18
  ---
19
  # Phi-3-mini-4k-instruct-RK3588-1.1.2
20
 
21
- This version of Phi-3-mini-4k-instruct has been converted to run on the RK3588 NPU using ['w8a8'] quantization.
22
  This model has been optimized with the following LoRA:
23
 
24
  Compatible with RKLLM version: 1.1.2
 
18
  ---
19
  # Phi-3-mini-4k-instruct-RK3588-1.1.2
20
 
21
+ This version of Phi-3-mini-4k-instruct has been converted to run on the RK3588 NPU using ['w8a8', 'w8a8_g128', 'w8a8_g256', 'w8a8_g512'] quantization.
22
  This model has been optimized with the following LoRA:
23
 
24
  Compatible with RKLLM version: 1.1.2