All tags
Person: "gneubig"
not much happened today
gpt-5.6-luna gpt-5.6-terra gpt-5.6-sol arc-agi-3 inkling-small inkling gemini-robotics-2 openai thinking-machines lmsys modal unsloth artificial-analysis google price-optimization agent-systems memory-retention context-compaction multimodality mixture-of-experts model-compression benchmarking open-weights multimodal-models model-efficiency model-deployment embodied-ai robotics long-context sama fchollet kimmonismus gneubig scaling01 mervenoyann
OpenAI aggressively cut prices for GPT-5.6 Luna by 80% and Terra by 20%, introducing a faster Sol Fast tier with up to 2.5× lower latency at double the price, improving agent workflow costs by roughly 10×. The ARC-AGI-3 debate highlighted that the complete agent system, including memory retention and tool orchestration, is critical beyond just the base model. Thinking Machines released Inkling-Small, an open-weights, multimodal MoE model with 276B parameters (12B active), delivering performance comparable to the original Inkling at a quarter of the size, supporting audio, images, and Python-based image inspection. Benchmarks show Inkling-Small excels in coding and multimodality tasks, with 1M-context support and broad open inference stack adoption. The news also mentions Google's Gemini Robotics 2 advancing embodied AI from tabletop to full-body control.
not much happened today
glm-5.2 opus-4.8 gpt-5.5 laguna-m.1 north-mini-code codex zhipu hugging-face llama-cpp unsloth poolsideai cohere ollama openai cursor_ai claude cognition sparse-attention 1m-token-inference open-weight-models model-architecture long-context mixture-of-experts quantization local-deployment workflow-automation code-agents software-configuration-management automation-primitives security model-harness agentic-coding rasbt jeremyphoward matvelloso artificialanlys zixuanli_ _xjdr gneubig _catwu
GLM-5.2 from Zhipu emerged as a leading open-weight model with innovative IndexShare sparse-attention enabling efficient 1M-token inference, praised as comparable to GPT-5.5 and Opus 4.8 but lacking vision support. Other notable open models include Laguna M.1 by Poolside AI, a 70-layer sparse MoE optimized for long-horizon coding, and North Mini Code by Cohere with 4-bit quantization and local deployment support via Ollama. The focus is shifting from standalone models to integrated systems combining model + harness + memory + SCM, exemplified by Noumena Code / ncode addressing challenges in concurrent code agent workflows. Automation tools like Codex Record & Replay, Cursor's /automate, and Artifacts in Claude Code enhance teachability, reusability, and security in AI-assisted coding workflows.
not much happened today
opus-4.8 gemma-4 cognition frontiercode moonshot google claudedevs magicpath langsmith modal coding-evaluation agent-control verification agent-ergonomics sandbox-environments local-inference workflow-optimization cli-tools plugin-integration persistent-memory swyx dzhng claudecode bcherny reach_vb omarsar0 gneubig hamelhusain angaisb_
FrontierCode benchmark by Cognition highlights the challenge of coding tasks with the best model, Opus 4.8, scoring only about 13% on the hardest subset, indicating coding is less solved than benchmarks suggest. The trend toward using loops as a control metaphor for coding agents is prominent, with emphasis on clear goals, verification, and iteration, though some experts caution about overreliance on loops. Agent ergonomics are improving with observability dashboards, sandbox environments, and workflow tools from ClaudeDevs, MagicPath, LangSmith, and Modal. Kimi by Moonshot released major updates including a stronger coding agent and a desktop agent product supporting up to 300 local sub-agents. Google advanced efficient local deployment with upgrades to Gemma 4 checkpoints.
not much happened today
mythos anthropic openai langchain nous-research cybersecurity sandboxing reinforcement-learning agent-architecture memory-management model-deployment software-security evaluation-methods kimmonismus paul_cal gneubig kentonvarda boazbaraktcs ylecun deanwball hwchase17 vtrivedy10 sarahcat21 aijoey
Anthropic's Mythos and OpenAI's upcoming restricted cyber-capable models are central to recent discussions, with debates on their security realism and evaluation methods. LangChain's Deep Agents deploy introduces an open memory, model-agnostic agent harness architecture emphasizing open protocols and memory ownership. Sandboxes are gaining prominence as a core infrastructure for reinforcement learning, with labs running up to 100K concurrent sandboxes aiming for 1M. The Hermes Agent by Nous continues to gain traction with new integrations and features like a web-based HUD and token cost tracking.
not much happened today
claude-max anthropic openai ai21-labs github cline model-agnostic model-context-protocol tooling skills concurrency transactional-workspaces context-engineering file-centric-workspaces rate-limiting agent-workspaces yuchenj_uw andersonbcdefg gneubig matan_sf scaling01 reach_vb _philschmid claude_code code jamesmontemagno cline danstripper omarsar0
Anthropic tightens usage policies for Claude Max in third-party apps, prompting builders to adopt model-agnostic orchestration and BYO-key defaults to mitigate platform risks. The Model Context Protocol (MCP) is evolving into a key tooling plane with OpenAI MCP Server and mcp-cli enhancing tool discovery and token efficiency. The concept of skills as modular, versioned behaviors gains traction, with implementations in Claude Code, GitHub Copilot, and Cline adding websearch tooling. AI21 Labs addresses concurrency challenges in agent workspaces using git worktrees for transactional parallel writes, while long-horizon agents focus on context engineering and persistent file-centric workspaces.
not much happened today
claude-code gemini qwen3-coder gemini-2.5-flash exa openpipe coreweave statsig openai zed claude gemini langchain anthropic fair alibaba hud-evals agent-protocols interoperability standardization agent-evaluation coding-agents software-optimization web-browsing reinforcement-learning multi-turn-reasoning optimizer-design data-efficient-rlvr leaderboards benchmarking zeddotdev mathemagic1an hwchase17 giffmana gneubig crystalsssup sayashk _philschmid _akhaliq jaseweston
Exa raised a $700m Series B, OpenPipe was acquired by Coreweave, and Statsig and Alex were acquired by OpenAI. The Agent/Client Protocol (ACP) was introduced by the Zed team to standardize IDE-agent interoperability, supporting Claude Code and Gemini CLIs. LangChain 1.0 alpha unifies content blocks for reasoning and multimodal data. The OSWorld Verified leaderboard promotes reproducible evaluation of computer-use agents including OpenAI and Anthropic models. FAIR revealed coding agent cheating on SWE-Bench Verified. PR Arena hosts live coding agent competitions. Benchmarks like GSO and Holistic Agent Leaderboard test software optimization and web browsing tasks, with Qwen3-Coder and Gemini 2.5 Flash showing strong performance. Advances in reinforcement learning for tool use include SimpleTIR improving multi-turn tool use success rates and UI-TARS-2 advancing GUI agents. The DARLING optimizer improves quality and diversity in reasoning and instruction following, while DEPO achieves data-efficient RLVR with significant speedups.
not much happened today
gpt-oss-120b gpt-oss-20b kimi-k2 deepseek-r1 qwen-3-32b openai huggingface microsoft llamaindex ollama baseten fireworksai cerebras groq together anthropic google uk-aisi sliding-window-attention mixture-of-experts rope context-length mxfp4-format synthetic-data reasoning-core-hypothesis red-teaming benchmarking coding-benchmarks model-performance fine-tuning woj_zaremba sama huybery drjimfan jxmnop scaling01 arunv30 kevinweil xikun_zhang_ jerryjliu0 ollama basetenco reach_vb gneubig shxf0072 _lewtun
OpenAI released its first open models since GPT-2, gpt-oss-120b and gpt-oss-20b, which quickly trended on Hugging Face. Microsoft supports these models via Azure AI Foundry and Windows Foundry Local. Key architectural innovations include sliding window attention, mixture of experts (MoE), a RoPE variant, and a 256k context length. The models use a new MXFP4 format supported by llama.cpp. Hypotheses suggest gpt-oss was trained on synthetic data to enhance safety and performance, supporting the Reasoning Core Hypothesis. OpenAI announced a $500K bounty for red teaming with partners including Anthropic, Google, and the UK AISI. Performance critiques highlight inconsistent benchmarking results, with GPT-OSS-120B scoring 41.8% on the Aider Polyglot coding benchmark, trailing competitors like Kimi-K2 and DeepSeek-R1. Some users note the model excels in math and reasoning but lacks common sense and practical utility.
Gemini 2.5 Pro/Flash GA, 2.5 Flash-Lite in Preview
gemini-2.5 gemini-2.5-flash-lite gemini-2.5-flash gemini-2.5-pro gemini-2.5-ultra kimi-dev-72b nanonets-ocr-s ii-medical-8b-1706 jan-nano deepseek-r1 minimax-m1 google moonshot-ai deepseek cognitivecompai kling-ai mixture-of-experts multimodality long-horizon-planning benchmarking coding-performance long-context ocr video-generation model-releases tulsee_doshi oriolvinyalsml demishassabis officiallogank _philschmid swyx sainingxie scaling01 gneubig clementdelangue mervenoyann
Gemini 2.5 models are now generally available, including the new Gemini 2.5 Flash-Lite, Flash, Pro, and Ultra variants, featuring sparse Mixture-of-Experts (MoE) transformers with native multimodal support. A detailed 30-page tech report highlights impressive long-horizon planning demonstrated by Gemini Plays Pokemon. The LiveCodeBench-Pro benchmark reveals frontier LLMs struggle with hard coding problems, while Moonshot AI open-sourced Kimi-Dev-72B, achieving state-of-the-art results on SWE-bench Verified. Smaller specialized models like Nanonets-OCR-s, II-Medical-8B-1706, and Jan-nano show competitive performance, emphasizing that bigger models are not always better. DeepSeek-r1 ties for #1 in WebDev Arena, and MiniMax-M1 sets new standards in long-context reasoning. Kling AI demonstrated video generation capabilities.
not much happened today
claude-4 claude-4-opus claude-4-sonnet gemini-2.5-pro gemma-3n imagen-4-ultra anthropic google-deepmind openai codebase-understanding coding agentic-performance multimodality text-to-speech video-generation model-integration benchmarking memory-optimization cline amanrsanger ryanpgreenblatt johnschulman2 alexalbert__ nearcyan mickeyxfriedman jeremyphoward gneubig teortaxesTex scaling01 artificialanlys philschmid
Anthropic's Claude 4 models (Opus 4, Sonnet 4) demonstrate strong coding abilities, with Sonnet 4 achieving 72.7% on SWE-bench and Opus 4 at 72.5%. Claude Sonnet 4 excels in codebase understanding and is considered SOTA on large codebases. Criticism arose over Anthropic's handling of ASL-3 security requirements. Demand for Claude 4 is high, with integration into IDEs and support from Cherry Studio and FastHTML. Google DeepMind introduced Gemini 2.5 Pro Deep Think and Gemma 3n, a mobile multimodal model reducing RAM usage by nearly 3x. Google's Imagen 4 Ultra ranks third in the Artificial Analysis Image Arena, available on Vertex AI Studio. Google also promoted Google Beam, an AI video model for immersive 3D experiences, and new text-to-speech models with multi-speaker support. The GAIA benchmark shows Claude 4 Opus and Sonnet leading in agentic performance.
not much happened today
grok-3 grok-3-mini gpt-4.5 claude-3.7-sonnet quasar-alpha optimus-alpha gpt-4.1 kaleidoscope internvl3 internvit qwen2.5vl transmamba fantasytalking openai alibaba cmu reinforcement-learning reasoning benchmarks vision multilinguality multimodality transformers attention-mechanisms agents code-generation model-performance rasbt sarahookr mervenoyann gneubig svpino mathemagic1an
The AI news recap highlights independent evaluations showing Grok-3 outperforming models like GPT-4.5 and Claude 3.7 Sonnet on reasoning benchmarks, while Grok-3 mini excels in reasoning tasks. Research on reinforcement learning (RL) fine-tuning reveals potential improvements for small reasoning models but also notes instability in reported gains. Benchmark results suggest Quasar Alpha and Optimus Alpha may be versions of GPT-4.1. Vision and multimodal models like Kaleidoscope, supporting 18 languages, and InternVL3, built on InternViT and Qwen2.5VL, demonstrate advances in multilingual vision and reasoning. The fusion model TransMamba combines transformer precision with speed via SSM mechanisms. Alibaba's FantasyTalking generates realistic talking portraits. Agent-focused events at CMU and tools like FilmAgent AI for virtual film production and BrowseComp benchmark for browsing agents were announced. The coding assistant Augment supports multiple IDEs with code analysis and suggestions. Discussions also covered Google’s new agent-to-agent protocol concept.