4.7x Faster Long-Context LLM Inference: AsyncTLS Explained
Long-context LLM inference collapses past 96k tokens. AsyncTLS pairs two-level sparse attention with async KV offloading for 1.3-4.7x more throughput.
Long-Context
Recursive Language Models: How RLMs Beat Long Context
Recursive language models treat a huge prompt as a Python variable the model can grep and recurse over. MIT's paper shows it beats GPT-5 on long context.
TriAttention Compresses KV Cache 10.7x — How Trigonometry Fixed Long-Context Reasoning
TriAttention uses pre-RoPE vector concentration and trigonometric scoring to compress KV cache 10.7x while matching full attention accuracy on reasoning tasks.