All tags
Topic: "sparse-attention"
not much happened today
gpt-5-pro gemini-2.5 vllm deepseek-v3.1 openai google-deepmind microsoft epoch-ai-research togethercompute nvidia mila reasoning reinforcement-learning inference speculative-decoding sparse-attention kv-cache-management throughput-optimization compute-efficiency tokenization epochairesearch yitayml _philschmid jiqizhixin cvenhoff00 neelnanda5 lateinteraction mgoin_ blackhc teortaxestex
FrontierMath Tier 4 results show GPT-5 Pro narrowly outperforming Gemini 2.5 Deep Think in reasoning accuracy, with concerns about problem leakage clarified by Epoch AI Research. Mila and Microsoft propose Markovian Thinking to improve reasoning efficiency, enabling models to reason over 24K tokens with less compute. New research suggests base models inherently contain reasoning mechanisms, with "thinking models" learning to invoke them effectively. In systems, NVIDIA Blackwell combined with vLLM wins InferenceMAX with significant throughput gains, while Together AI's ATLAS adaptive speculative decoding achieves 4× speed improvements and reduces RL training time by over 60%. SparseServe introduces dynamic sparse attention with KV tiering, drastically improving throughput and latency in GPU memory management.
Anthropic Claude Sonnet 4.5, Claude Code 2.0, new VS Code Extensions
claude-sonnet-4.5 claude-code-v2 deepseek-v3.2-exp anthropic deepseek openai stripe swe-bench finance law stem code-execution context-editing memory-management api chrome-extension generative-ui sparse-attention long-context cost-efficiency john_schulman mike_krieger
Anthropic launched a major update with Claude Sonnet 4.5, achieving 77.2% SWE-Bench verified performance and improvements in finance, law, and STEM. They also released Claude Code v2 featuring checkpoints, a refreshed terminal, and a native VS Code extension, plus a new mascot Clawd. The Claude API gained context editing and memory tools, and the Claude Agent SDK was introduced. The Claude.ai apps now support code execution and file creation, with a Chrome extension available for Max users. Additionally, Imagine with Claude offers a generative UI research preview. Reception has been positive from developers and third-party evaluators. Meanwhile, DeepSeek released V3.2-Exp with a new Sparse Attention algorithm, significantly reducing long-context costs and cutting API prices by over 50%, while maintaining quality.