Pingrui Liu

pruiliu

8 4

·

AI & ML interests

Efficient LLM inference, KV cache optimization, quantization, speculative decoding, model pruning

Recent Activity

liked a model about 20 hours ago

anthonymikinka/gpt2_coreml_kv_cache_try1

upvoted a paper about 20 hours ago

StudentSim: Training LLM-based Student Simulators

upvoted a paper about 20 hours ago

LatentPort: Beyond KV Cache - Cross-Model Transfer of Recurrent Memory in Hybrid Language Models: A 4B-to-9B Hybrid-State Handoff Without Target Prefix Replay

View all activity

Organizations

None yet

pruiliu 's datasets

None public yet