Zhihao Zhang's picture

10 1

Zhihao Zhang

JackFram

·

AI & ML interests

None yet

Recent Activity

commented a paper about 2 months ago

TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention

authored a paper about 2 months ago

SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification

View all activity

Organizations

Papers 1

arxiv:2305.09781

models 7

JackFram/llama-68m

Text Generation • Updated May 23 • 628k • 24

JackFram/llama-160m

Text Generation • Updated Jan 4 • 244k • 32

JackFram/llama-160m-base

Text Generation • Updated Nov 5, 2023 • 6

JackFram/llama-160m-cbt-4

Text Generation • Updated Jul 7, 2023 • 7

JackFram/llama-160m-cbt-3

Text Generation • Updated Jul 7, 2023 • 7

JackFram/llama-160m-cbt-2

Text Generation • Updated Jul 7, 2023 • 9

JackFram/llama-160m-cbt-1

Text Generation • Updated Jul 7, 2023 • 8

datasets

None public yet