Space: Ringokun/condensate-theorem
title: 157x Faster Attention - Zero Retraining
sdk: gradio
license: mit
tags: attention, sparse-attention, efficient-inference, transformers, llm, optimization, research
models: openai-community/gpt2, openai-community/gpt2-medium, openai-community/gpt2-large, EleutherAI/pythia-70m, EleutherAI/pythia-160m, EleutherAI/pythia-410m, EleutherAI/pythia-1b, EleutherAI/pythia-2.8b, Qwen/Qwen2-0.5B, TinyLlama/TinyLlama-1.1B-Chat-v1.0, mistralai/Mistral-7B-v0.1
short_description: 157x faster attention, 100% accuracy, zero retraining
Tags: gradio, attention, sparse-attention, efficient-inference, transformers, llm, optimization, research, region:us