All tags
Topic: "computer-use"
not much happened today
claude-opus-4.7 gemini-3.1-pro gpt-5.4 claude-code codex anthropic openai agentic-ai model-benchmarking adaptive-reasoning cost-efficiency computer-use prototyping-tools code-generation model-performance software-integration claudeai yuchenj_uw kimmonismus skirano therundownai arena artificialanlys victortaelin emollick alexalbert__ theo scaling01 reach_vb kr0der hamelhusain mattrickard matvelloso gdb
Anthropic launched Claude Design, a prototyping tool powered by Claude Opus 4.7, targeting design workflows and competing with Figma and others. Benchmarks show Opus 4.7 leading in coding and text tasks, with improved efficiency and adaptive reasoning, though early user feedback noted some regressions and stability issues. Discussions highlighted its cost-efficiency and agentic capabilities compared to Gemini 3.1 Pro and GPT-5.4. Meanwhile, OpenAI's Codex updates introduced advanced computer-use features enabling fast, agentic control of desktop apps and enterprise software, signaling progress toward practical AGI-like agents.
Anthropic's Claude Opus 4.7
claude-opus-4.7 codex gpt-rosalind anthropic openai cursor replit perplexity-ai microsoft coding agentic-ai tokenization long-context benchmarking image-processing software-engineering computer-use plugin-integration multi-terminal-support ssh-access model-expansion bcherny kimmonismus scaling01 valsai artificialanlys natolambert nrehiew_
Anthropic launched Claude Opus 4.7, its most capable Opus model yet, featuring stronger coding and agentic performance, a new tokenizer, and improved long-context handling with a new xhigh reasoning tier. Benchmarks show substantial gains, including SWE-bench Pro 64.3%, SWE-bench Verified 87.6%, and TerminalBench 69.4%, with top rankings on Vals Index and GDPval-AA. Technical changes include a new tokenizer and increased image input resolution to 3.75MP. Some long-context benchmarks showed mixed results, with a shift in focus from MRCR to Graphwalks. Adoption was rapid across tools like Cursor, VS Code, Replit Agent, and Perplexity. Meanwhile, OpenAI expanded Codex into a broader computer agent with Mac computer use, in-app browser, image generation/editing, 90+ plugins, multi-terminal support, SSH remote devbox access, and richer file previews. A new vertical life-sciences model, GPT-Rosalind, was also introduced.
not much happened today
molmo-2-4b molmo-2-8b hermes-agent-v0.4.0 anthropic figma github cursor_ai langchain nous-research ai2 genreasoning zhipu-ai huggingface agent-infrastructure multi-agent-systems orchestration computer-use tool-calling design-canvases open-agent-platforms reinforcement-learning-environments benchmarking rl-environments self-improvement api memory-optimization
Anthropic advances agent infrastructure with a multi-agent harness emphasizing orchestration and "computer use" for complex software environments. Figma, GitHub, and Cursor launch design canvases with direct AI editing, showcasing tool-calling becoming product-native. Nous Research releases Hermes Agent v0.4.0 with 300+ PRs, adding OpenAI-compatible APIs and self-improving memory agents. Open agent ecosystems mature with AI2's MolmoWeb (4B and 8B models), GenReasoning's OpenReward platform offering 330+ RL environments and 4.5M+ tasks, and Zhipu's ZClawBench benchmark with 116 real-world agent tasks, highlighting progress toward standardized environment serving and benchmarkable agent tasks.
not much happened today
claude-3.5-sonnet claude-3.5-haiku o1-preview mochi-1 stable-diffusion-3.5 embed-3 kerashub differential-transformer anthropic openai cohere microsoft computer-use coding-performance video-generation fine-tuning multimodality transformers attention-mechanisms model-optimization alexalbert fchollet rasbt
Anthropic released upgraded Claude 3.5 Sonnet and Claude 3.5 Haiku models featuring a new computer use capability that allows interaction with computer interfaces via screenshots and actions like mouse movement and typing. The Claude 3.5 Sonnet achieved state-of-the-art coding performance on SWE-bench Verified with a 49% score, surpassing OpenAI's o1-preview. Anthropic focuses on teaching general computer skills rather than task-specific tools, with expected rapid improvements. Other releases include Mochi 1, an open-source video generation model, Stable Diffusion 3.5 with Large and Medium variants, and Embed 3 by Cohere, a multimodal embedding model for text and image search. KerasHub was launched by François Chollet, unifying KerasNLP and KerasCV with 37 pretrained models. Microsoft introduced the Differential Transformer to reduce attention noise via differential attention maps, and research on transformer attention layers was shared by Rasbt.
Claude 3.5 Sonnet (New) gets Computer Use
claude-3.5-sonnet claude-3.5-haiku llama-3.1 nemotron anthropic zep nvidia coding benchmarks computer-use vision multimodal-memory model-updates ai-integration philschmid swyx
Anthropic announced new Claude 3.5 models: 3.5 Sonnet and 3.5 Haiku, improving coding performance significantly, with Sonnet topping several coding benchmarks like Aider and Vectara. The new Computer Use API enables controlling computers via vision, scoring notably higher than other AI systems, showcasing progress in AI-driven computer interaction. Zep launched a cloud edition for AI agents memory management, highlighting challenges in multimodal memory. The update also mentions Llama 3.1 and Nemotron models from NVIDIA.