fix:remove local info
d9d74ae
lausannel
commited on
Commit History
fix:add resource cleanup in `__del__`
d3ab5ad
lausannel
commited on
fix: change position of remove offload path and fix params in __init__()
e50cd48
lausannel
commited on
add choice for device, and verify in backend. Add debug mode (#18)
5ead910
verified
add debug info
5f34a5c
add gpu info
84f0fa3
add gpu info
034968f
solve submission issue (#11)
a549d9d
verified
change Repo names (#10)
0dec706
verified
improve local debug
d936aea
future-xy
commited on
fix display
88d1c0e
future-xy
commited on
fix tps
1ae96c8
future-xy
commited on
add system performance metrics
b9f0099
future-xy
commited on
fix dbrx
9ceb74b
fix generation bugs
85e30d4
future-xy
commited on
add base class code
f0ad559
future-xy
commited on
add base class
3020792
future-xy
commited on
fix bug
5fd4d0a
future-xy
commited on
add moe-infinity back
33e1c9d
future-xy
commited on
support selecting inference framework
1c22d8d
future-xy
commited on
fix bugs
b3946ef
Yao Fu
commited on
add task back
aa83719
future-xy
commited on
fix result display bug
82a6ed1
future-xy
commited on
set log level to warning
a4a186c
future-xy
commited on
formatting code
d6d7ec6
future-xy
commited on
connect front and backend
2d754ab
future-xy
commited on
keep gsm8k and XSum/ROUGE
a89d71b
future-xy
commited on
fix cuda mismatch bugs
794e78c
future-xy
commited on