AINews

not much happened today

Thu, 16 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/15/2026-7/16/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

Moonshot AI launched Kimi K3 as a frontier-class open-weights model, with official claims that place it near top closed models and above prior open competitors.

Moonshot officially introduced Kimi K3 as “Open Frontier Intelligence” with 2.8T total parameters, 1M-token context, native multimodal input, Kimi Delta Attention (KDA), and Attention Residuals, and said the model is live on Kimi.com, Kimi Work, Kimi Code, and API, with open weights promised by July 27, 2026 @Kimi_Moonshot
Moonshot also highlighted product positioning around long-horizon agentic coding and self-evolving workflows, plus “vision in the loop” coding/game-building workflows that iterate between code and screenshots @Kimi_Moonshot
Before the formal announcement, multiple accounts circulated leaked or app-sourced details that K3 was 2.8T params, calling it the largest open-weight model ever if weights ship as promised @scaling01, @scaling01, @eliebakouch
The official Kimi blog went live later and was widely shared as the primary technical source @Jianlin_S, @scaling01, @Yulun_Du
Moonshot’s own phrasing acknowledged a limitation: despite being highly competitive overall, K3 still has a “noticeable gap in user experience” versus Claude Fable 5 and GPT-5.6 Sol @scaling01
Arena announced that Kimi K3 entered Agent Arena, plus Text, Vision, Document, and Frontend Code Arena, with community evaluations to follow @arena
Arena then reported a major early result: Kimi K3 became #1 in Frontend Code Arena with 1679 points, surpassing Claude Fable 5 and jumping from #18 (K2.6) to #1, ranking #1 in 6 of 7 frontend domains and #2 in Gaming @arena
Arena later added that K3 has a 76% pairwise win rate in Frontend Code Arena, versus 63% for Fable 5 and 58% for GPT-5.6 Sol @arena
In Text Arena, K3 landed at #9 with 1486 points, a jump from #38, with top-10 placements in creative writing, coding, and instruction following, and #1 in several occupation slices @arena
Artificial Analysis published an independent evaluation placing K3 at 57 on the AA Intelligence Index, calling it comparable to Opus 4.8 and GPT-5.5, but still behind Fable 5 and GPT-5.6 Sol overall @ArtificialAnlys
AA also reported K3 at 1668 Elo on GDPval v2, 53% / #1 on AutomationBench-AA, and 1547 Elo on AA-Briefcase, with cost per task of $0.94, about 21% fewer output tokens than K2.6 across the full Intelligence Index run @ArtificialAnlys
The launch immediately triggered strong reaction from engineers and model-watchers who framed K3 as an open-model milestone comparable to earlier DeepSeek moments @kimmonismus, @nrehiew_, @eliebakouch

Technical details

Architecture and systems details

Official specs: 2.8T total parameters, 1M context, native multimodal input (text + images), text output, open weights by July 27 @Kimi_Moonshot, @ArtificialAnlys
K3 uses Kimi Delta Attention (KDA), which Moonshot says enables up to 6.3x faster decoding in million-token contexts @Kimi_Moonshot
It also uses Attention Residuals (AttnRes), claimed to deliver ~25% higher training efficiency at <2% additional cost @Kimi_Moonshot
Community readers of the blog highlighted additional architecture details: LatentMoE / Stable LatentMoE, 16 activated experts out of 896, implying an activation ratio under 2% @nrehiew_, @eliebakouch
More community-extracted details from the blog/report discussion: per-head Muon, QB load balancing / quantile load balancing, and a new activation function called SiTU (Sigmoid Tanh Unit) @eliebakouch
One engineer noted the architecture as notable for combining KDA + LatentMoE + AttnRes while scaling more than 2x over prior Kimi models @teortaxesTex
KDA had a long incubation cycle: design reportedly started in Jan 2025 and took ~1.5 years to reach frontier scale @zxytim

Inference and serving

K3 pricing was reported as $3 / 1M input tokens and $15 / 1M output tokens, with cached input discounted 90% to $0.30 / 1M @scaling01, @ArtificialAnlys
Several posters compared that pricing to Sonnet 5, with some noting Sonnet was temporarily cheaper until end of August, after which prices align more closely @kimmonismus
A blended estimate at 80% input / 20% output came out to $5.40 / 1M tokens, vs $9 for Opus 4.8 and $10 for GPT-5.5 @jaminball
Artificial Analysis estimated $0.94 average cost per Intelligence Index task, versus $1.04 for GPT-5.6 Sol and $1.80 for Opus 4.8 @ArtificialAnlys
Early live serving observations: ~28 tok/s via Moonshot API on OpenRouter @scaling01, and another observer saw 26 tok/s, calling it slower than Opus and speculating that speculative decoding wasn’t yet enabled @nrehiew_, @nrehiew_
Moonshot’s blog reportedly recommends deployment on supernode configurations with 64+ accelerators for best inference efficiency @teortaxesTex
vLLM said Moonshot contributed a KDA prefix caching implementation directly to vLLM, with support available day 0 for official release @vllm_project
Moonshot’s KDA contribution was cited as important because KDA breaks assumptions behind conventional prefix caching, so upstream runtime changes were required @vllm_project

Benchmarks and evals

Moonshot’s official benchmarking message, as summarized by others, positioned K3 behind only Claude Fable 5 and GPT-5.6 Sol among tested models, and ahead of Claude Opus 4.8 @scaling01, @Yuchenj_UW
One cited number: 1687 on GDPval-AA v2, above Opus 4.8 and behind GPT-5.6 Sol at 1747.8 in that comparison @scaling01
Artificial Analysis’ independent numbers:
- AA Intelligence Index: 57
- GDPval v2 Elo: 1668
- AutomationBench-AA: 53%, #1
- AA-Briefcase Elo: 1547
- AA-Omniscience: +18, with accuracy 46% vs 33% on K2.6, but hallucination rate worsening to 51% from 39% @ArtificialAnlys, @ArtificialAnlys
AA also reported 132M output tokens consumed for K3 across the Intelligence Index, versus 166M for K2.6, i.e. 21% reduction while gaining 13 index points @ArtificialAnlys
Arena’s frontend result was especially prominent because it is a pairwise human-preference arena, not just a static benchmark, and K3’s #1 frontend rank became one of the main launch headlines @arena
Community posts also highlighted strong results on kernel optimization tasks, with some saying K3 was matching or beating Fable in certain kernel/codegen settings @nrehiew_, @scaling01
One benchmark caveat came from ProgramBench author Ofir Press, who said Kimi used a metric they do not recommend: averaging implementation percentage rather than counting fully working programs, which can overstate usefulness @OfirPress, @OfirPress

Facts vs opinions

Facts / directly sourced claims

Kimi K3 is officially announced by Moonshot @Kimi_Moonshot
Officially disclosed specs include 2.8T params, 1M context, native multimodal input, KDA, AttnRes, open weights by July 27 @Kimi_Moonshot
Artificial Analysis independently scored K3 at 57 Intelligence Index, with detailed task, cost, token, and benchmark data @ArtificialAnlys
Arena independently ranked K3 #1 in Frontend Code Arena and later reported its 76% pairwise win rate @arena, @arena
vLLM confirmed Moonshot contributed runtime support for KDA prefix caching @vllm_project

Opinions / interpretations

“DeepSeek moment,” “beginning of the US-China AI race,” and “everything changed” are editorial interpretations from observers, not established facts @kimmonismus, @scaling01, @kimmonismus
Claims that K3 “beats GPT-5.6 Sol on 11 of 14 benchmarks” and “Fable on 6 of 14” are aggregated community summaries and should be treated as contingent on the benchmark set and exact methodology @scaling01
Assertions that this implies Dario/Anthropic margin pressure, a geopolitical turning point, or near-term superintelligence are speculative commentary @teortaxesTex, @Jason
Several “distillation” insinuations were explicitly framed as jokes or conjecture rather than evidence @yacinelearning, @dejavucoder

Different opinions

Strongly supportive

Many engineers called K3 a genuine frontier open model, especially because it appears to be better than Opus 4.8 while being priced near Sonnet and planned for open-weight release @kimmonismus, @cline, @nrehiew_
Supporters emphasized that this is no longer “good for open source,” but simply competitive with top public closed models @tokenbender, @TheAhmadOsman
Some framed the release as evidence that open models are now within weeks or a couple months of the frontier @nrehiew_
Others argued this materially raises the odds that future AGI-level systems are open @MaorShlomo

Supportive but technically cautious

Artificial Analysis gave a more restrained view: K3 is comparable to Opus 4.8 and GPT-5.5, but still behind Fable 5 and GPT-5.6 Sol on overall intelligence @ArtificialAnlys
Simon Willison described K3 as significant, but also pointed readers toward nuanced notes and benchmark caveats rather than simple leaderboard hype @simonw
Ethan Mollick’s hands-on impression: very good open-weights model, but not Sol Max or Fable @emollick
One user said K3’s intelligence is strong, but it is slow, sometimes over-checks, and still trails Claude on taste/aesthetics @nrehiew_

Critical / skeptical

Bindu Reddy warned that K3’s benchmark story might be overstated unless validated on hidden / uncontaminated evals like LiveBench, and argued that if the model “thinks forever,” real cost could be less favorable @bindureddy
ProgramBench maintainers objected to Moonshot’s metric choice, saying it can inflate partial-credit performance relative to fully working programs @OfirPress
Artificial Analysis also flagged a real weakness: hallucination rate regressed on AA-Omniscience despite accuracy gains @ArtificialAnlys
Multiple users noted that K3 currently appears to think a lot, preserve long reasoning history, and may require more careful harness support than simpler chat-first APIs @scaling01, @Xianbao_QIAN
Some skepticism focused on economics and deployability: 2.8T open weights is impressive, but practical self-hosting may still be limited to well-funded teams @mbusigin

Political / strategic interpretations

A broad cluster of tweets framed K3 as proof that Chinese labs are no longer far behind and that the US lead is shrinking @tszzl, @kimmonismus, @scaling01
Others counterweighted that K3 still appears to lag the very best Western models in usability / productization, even if raw capability is close @RyanGreenblatt, @scaling01
Some argued that open Chinese models function as economic pressure on US labs by compressing margins and commoditizing capability @francoisfleuret
Others viewed the inevitable next step as more competition on harnesses, products, and deployment systems, not just raw model weights @AravSrinivas, @theo

Context

Why this matters technically

K3 is notable not just for raw size but for scaling a non-standard attention stack into a frontier-class model: KDA + AttnRes + sparse MoE drew repeated attention from technically literate observers @scaling01, @eliebakouch
The launch is also a systems story: long-context serving, prefix caching, KDA runtime support, and deployment on large accelerator supernodes all matter if the weights are to be practically usable @vllm_project, @teortaxesTex
The emphasis on kernel optimization, chip design, agentic coding, and environment simulation suggests Moonshot is optimizing for AI-improving-AI workflows, not just chatbot benchmarks @18jeffreyma, @yong_zhengxin

Why this matters economically

The strongest repeated theme: frontier-ish performance at materially lower price than top closed models, though not at bargain-basement open-model prices @kimmonismus, @cline, @jaminball
Artificial Analysis’ task-cost framing is especially relevant for practitioners: if K3 is near GPT-5.6 Sol cost-per-task and below Opus 4.8, the real question becomes where it slots into agent stacks, coding platforms, and self-hosted infra @ArtificialAnlys
Some noted the paradox that “open weights” does not automatically mean “cheap to run”: a 2.8T model with 64+ accelerator deployment guidance is frontier infrastructure territory @teortaxesTex, @mbusigin

Why this matters geopolitically

Many reactions explicitly tied K3 to export controls, US-China competition, and the narrowing gap between Chinese open labs and US closed labs @scaling01, @tszzl, @kimmonismus
Several commentators argued that K3 weakens the common narrative that Chinese models trail by 6–8 months, because it appears to outperform a closed US model from late May only weeks later @kimmonismus
Others stressed that “capability parity” is not the same as full-stack parity: product reliability, inference scale, deployment margins, and proprietary post-training may still favor US incumbents @RyanGreenblatt

Early hands-on signals

Users reported K3 building impressive web experiences, games, and shader/code artifacts, reinforcing the Frontend Arena result @johnlindquist, @ChrissGPT, @intheworldofai
One user said K3 generated a CS:GO × Portal clone in 3 shots using ~600k tokens, costing $3.24 by API pricing, compared with claimed higher costs on Fable and GPT-5.6 Sol @ChrissGPT
Another reported K3 continuously working for hours over near-1M context to build a web DOS emulator with low human intervention @bigeagle_xd
At the same time, several users noted it can be verbose, slow, and heavily reliant on thinking-history preservation, implying that serving/harness defaults will matter a lot @nrehiew_, @Xianbao_QIAN, @bigeagle_xd

Open-source/open-weights debate

The surrounding discourse included the usual complaint that “open weight” is not “fully open,” but several commenters pushed back that this distinction is often impractical at frontier scale and that inspectable, fine-tunable weights still matter @Dan_Jeffries1, @ClementDelangue
Yulun Du said the delay before weight release was to ensure a smooth rollout with inference partners, signaling that ecosystem readiness mattered as much as the checkpoint itself @Yulun_Du
vLLM maintainers and others treated Moonshot’s upstream contributions as evidence that the launch is not just “marketing open,” but also includes meaningful OSS infra work @vllm_project, @woosuk_k

Benchmarks, contamination, and what to watch next

Several people cautioned that current public benchmark ecosystems saturate quickly, and that hidden evals or stack-level evals will be more informative @bindureddy, @gdb, @WolfBenchAI
Observers specifically asked for follow-up on METR time horizons, cyber ranges, FrontierMath T4, ARC-AGI-2/3, CritPt, token usage, and broader long-horizon agent evals @scaling01
The most credible near-term follow-up points are:
- whether the weights ship on time
- what third-party serving stacks achieve for throughput/cost
- how K3 performs on hidden evals and real production agent tasks
- whether Moonshot closes the UX/post-training gap they themselves acknowledged @Kimi_Moonshot, @scaling01, @ArtificialAnlys

Open Models, Inference Stacks, and Retrieval Infrastructure

vLLM and serving ecosystem support landed quickly: vLLM said Moonshot contributed a KDA prefix-caching implementation directly to vLLM, enabling day-0 support once weights drop. This matters because KDA breaks some conventional prefix-caching assumptions. The post underscores that long-context architectural innovation increasingly requires coordinated systems work, not just model release.
NVIDIA shipped a notable open retrieval release: NVIDIA launched Nemotron 3 Embed 8B, claiming #1 overall on RTEB, and partners quickly made it deployable, including Baseten and Turbopuffer. A more detailed community summary by @kimmonismus reports 78.46 NDCG@10 on RTEB and 75.45 on MMTEB Retrieval, with NVIDIA arguing stronger retrieval reduces downstream agent token usage. The release also includes 1B BF16 and 1B NVFP4 variants, with the NVFP4 version reportedly offering up to 2× BF16 throughput on Blackwell while retaining >99% retrieval quality.
LiteParse added a gRPC interface for backend document pipelines: LlamaIndex introduced liteparse-grpc, exposing PDF/Office/image parsing, rendering, and OCR-complexity estimation over gRPC with protobuf definitions and generated clients. This is a practical infra improvement for polyglot microservice stacks where REST isn’t ideal.
Managed vector/search infra also expanded: Weaviate announced Managed Weaviate on DigitalOcean in public preview, running the unmodified open-source engine (v1.37.1 at launch) with HA, autoscaling, backups, forks, and control-plane observability.

Agents, Harnesses, and System Design Becoming the Real Product Layer

Harnesses were a recurring theme across builders: Harrison Chase’s conversation with Factory AI’s Eno Reyes was repeatedly shared as a case for why “the harness matters more than the model” (Harrison, LangChain). Chase later argued teams should “own the harness,” “own the context and memory layer,” and “own model optionality” rather than rent intelligence from a single provider (thread).
There’s growing interest in open standards for memory and knowledge representation: Harrison Chase promoted OKF (Open Knowledge Format) as an “open standard for memory,” while Brace Sproul detailed OpenWiki’s adoption and the benefits for search, retrieval, and codebase memory.
Agent self-improvement and scheduled multi-agent workflows are becoming mainstream topics: @omarsar0 highlighted a survey on self-improving agentic systems, and elsewhere described using an “LLM Council” with recurring scheduled research updates (thread). On the product side, Google AI Studio added a free tier for Managed Agents, plus max_total_tokens for pausing/resuming long runs and native cron triggers.
Perplexity’s infra direction was also notable: NVIDIA AI Infra highlighted Perplexity’s new SPACE secure sandbox platform, with early tests on NVIDIA Vera CPU showing up to 1.9× faster sandbox starts—a reminder that sandbox startup latency is now part of agent throughput engineering.

OpenAI and Anthropic: Safety, Productization, and Developer Workflow Updates

OpenAI acknowledged a dangerous Codex/GPT-5.6 failure mode around file deletion: Thomas Sottiaux said OpenAI investigated rare reports where GPT-5.6 unexpectedly deleted files, most commonly when full access mode was enabled without sandboxing or auto review, and when the model attempted to override $HOME for temp directories but mistakenly deleted $HOME itself. OpenAI says it is updating developer messaging, nudging users toward safer permission modes, and adding harness safeguards, with a detailed postmortem forthcoming.
OpenAI continued to ship workflow features around Codex and PR review: OpenAI Devs added PR Chat and inline code editing in Codex for reviewing and editing pull requests in context. OpenAI also announced Office Hours around GPT-5.6, ChatGPT, and Codex (source).
Anthropic upgraded Claude Code review depth: ClaudeDevs introduced effort levels for /code-review, from low cost/low effort to ultra, where a fleet of reviewer agents reproduces findings independently. Anthropic says low effort beats other code-review tools on findings per token, while high/ultra improve severe-issue recall and reduce false positives.
Voice remains a major adoption vector: Sam Altman said he now talks to ChatGPT more than he types, calling the new voice model a threshold-crossing UX shift. Separately, OpenAI published GPT-Live usage limits in its help center, summarized by @athyuttamre: Pro users get unlimited daily usage, while Plus/Go and free tiers have bounded live minutes.

Multimodal Video, Real-Time Media, and Creative Tooling

Google pushed Gemini Omni into Vids: Google and Google Workspace launched Gemini Omni for video generation/editing in Google Vids, plus personal avatars built from a selfie and voice recording. Google says generated clips include SynthID watermarking and that avatars are restricted to a user’s own account/likeness (details).
NotebookLM’s rebrand signals tighter Google product integration: Gemini Notebook announced that NotebookLM is now Gemini Notebook, with existing standalone behavior intact but deeper integration coming via the Gemini app and eventually Search. This looks like a packaging/integration move more than a model change.
Real-time and agentic media tooling kept advancing: DecartAI introduced Lucy 2.5, a more capable realtime live AI video editor; fal made Lucy 2.5 Realtime available over WebRTC for live video-to-video editing. fal also launched LTX-2.3 Reframe for aspect-ratio conversion with generated scene completion.
Meta expanded media model distribution: Meta, AI at Meta, and Alexandr Wang all announced Muse Spark 1.1 on OpenRouter, reflecting continued demand for frontier-ish generative media models via neutral routing layers.

Robotics, World Models, and Embodied AI

A high-reliability robotics model stood out: Tony Zhao introduced ACT-2 Preview, described as the first robotics model to unify broad generalization with high reliability. The headline claim is striking: a single fine-tuning example can teach Memo a new behavior that generalizes, with zero-shot, real unseen homes, 99% success rate.
Reka discussed world-model data operations at production scale: Reka pointed to an episode on how a sub-100-person team prepares petabytes of video data for world model training, emphasizing that the bottleneck is often data platform engineering, not just model architecture.
There’s continuing work on embodied world-model architectures: @lixin4ever highlighted a DAMO effort using tri-branch DiT, joint cross-modal attention, and 250M+ RGB frames with dense depth and optical flow annotations to turn a video generation model into a 4D embodied world model.

Top Tweets (by engagement)

Kimi K3 official release: Moonshot’s launch post was the day’s dominant technical tweet, combining model specs, architecture, and release timeline.
Kimi K3 Arena breakthrough: Arena’s Frontend Code Arena #1 post drew exceptional engagement because it framed K3 as not just strong “for open weights,” but directly ahead of a top closed competitor in a visible product task.
OpenAI safety incident disclosure: OpenAI’s explanation of GPT-5.6 file deletions was one of the most consequential engineering/safety updates, because it tied model behavior to permission modes, sandboxing, and harness safeguards.
Anthropic’s multi-effort code review: Claude Code’s /code-review effort levels is a meaningful productization signal for agentic software engineering: not just “AI review,” but tunable cost/recall tradeoffs and subagent-based verification.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Kimi K3 Launch and Frontier Benchmarks

Kimi K3 weights to be released on the 27th. (Activity: 399): The announcement image states that Kimi K3 is now available through kimi.com, the Kimi app, Kimi Work desktop client, Kimi Code, and the Kimi API, with the current default “thinking intensity” set to max / extreme. Per the linked official posts (WeChat, English blog), full model weights and additional technical details are scheduled for release by July 27, 2026, which is the main technical significance of the image. Commenters are excited about the open-weight release but expect local inference to be impractical due to the model’s apparent scale, joking that even if someone runs the rumored 2.8T-parameter model on a 24 GB VRAM laptop, it would be at unusably low throughput.
- Commenters highlight that Kimi K3’s apparent 2.8T-parameter scale makes local inference impractical for nearly all consumer setups; one linked screenshot of the announcement/spec context is here. The discussion frames the weights release as valuable for openness and research even if typical local hardware would be limited to extremely slow or unrealistic runs, e.g. “24 Gb VRAM laptop… 0.01 token per sec.”
- A technically substantive workflow suggestion was to use Kimi’s largest models for planning/strategy while pairing them with a smaller implementation model, similar to DeepSeek’s large/small model split. One commenter specifically asked for a sub-300B MoE or smaller MoonshotAI model for lighter coding workloads, noting that K2.7 Code appeared to improve over K2.6 and K2.5 for agentic coding use cases.
Kimi K3 released on web and app (Activity: 1057): Kimi K3 was announced as available on web/app, with claimed specs of 2.8T parameters and 1M context, and claims of leading performance in coding, agentic tasks, long-horizon reasoning, visual understanding, and agent-swarm workflows (screenshot). No benchmark data, architecture details, license, or Hugging Face/open-weight release link were provided in the post. Commenters focused on deployment practicality: a 2.8T model would be extremely difficult to run locally, with one noting even a 1.58-bit quant likely would not fit in 512 GB RAM. Others questioned whether it would become the largest open-weight model if uploaded to HF and said they were waiting for benchmarks.
- Discussion focused on the hardware infeasibility of running Kimi K3 locally: commenters cite the reported 2.8T parameter size and note that even a 1.58-bit quantized version would likely exceed 512 GB RAM, putting it far beyond typical consumer or even workstation setups.
- Several users framed Kimi K3 as potentially one of the largest open-weight models if released on Hugging Face, with interest centered on forthcoming benchmarks. One commenter compared an RTX 6000 Pro 96 GB card against the model’s memory requirements, estimating it is still more than 12x short, underscoring that even high-end single-GPU hardware is not sufficient.
Kimi K3 Benchmarks (Activity: 1487): The image is a coding benchmark chart for Kimi K3 (image), comparing it with models such as GPT-5.6 Sol, Fable 5, Opus-4.8, GPT-5.5, and GLM-5.2 across six coding evaluations. Kimi K3 is highlighted in blue and is shown leading Program Bench and SWE Marathon, while placing second on Terminal Bench 2.1, FrontierSWE, and Kimi Code Bench 2.0, suggesting very strong benchmark-level coding performance. Commenters cautioned that the chart only reflects benchmark performance, not real-world usage, but one argued Chinese models appear “not even 6 months behind US models,” perhaps “6 days behind.” Another comment, “2TB VRAM Is All You Need,” appears to be a joke or jab about likely heavy inference hardware requirements.
- A commenter interprets the shared Kimi K3 benchmark image as evidence that Chinese frontier models are nearly at parity with U.S. models, saying that based on benchmarks alone they appear “not even 6 months behind US models” and possibly closer to “6 days behind”. They explicitly caveat that this is benchmark-only and may not reflect real-world usage quality or reliability.
KIMI K3 Beats Claude Fable and GPT 5.6 sol in arena.ai!!! (Activity: 854): The image is a Code Arena WebDev overall leaderboard screenshot (image) dated Jul 16, 2026, showing Moonshot’s kimi-k3 ranked #1 with a score of 1679, ahead of claude-fable-5 and gpt-5.6-sol-xhigh on front-end web development tasks. The post frames this as surprising because Kimi is beating “frontier” models described as “too dangerous” for public release; a commenter notes that on the broader arena.ai text leaderboard, it is not #1 but still appears competitive with gemini-3-pro and gpt-5.6-sol-xhigh. Comments focus on whether this implies China is only “6 days behind the west” and whether kimi-k3 will actually be released as open weights, which would affect its practical significance beyond leaderboard placement.
- A commenter links the arena.ai text leaderboard (https://arena.ai/leaderboard/text) and notes that Kimi K3 is not leading the main text arena, but is reportedly scoring in the same range as Gemini 3 Pro and GPT 5.6 sol (xhigh), which they consider technically notable for a Chinese model release.
- There is uncertainty over whether Kimi K3 will be released as open weights, which is a key technical distinction for local deployment, fine-tuning, and reproducibility compared with API-only leaderboard performance.
- One commenter raises a benchmark-validity concern: if Arena users disproportionately judge models on generated Three.js / 3D browser games, Kimi may have been optimized for that task distribution. They argue this could inflate perceived capability because visually impressive generated games may score well with casual evaluators even if they are not a robust measure of general coding or reasoning ability.
Kimi K3 achieves 3rd Place on ArtificalAnalysis, beating out Claude Opus 4.8 (Activity: 656): The image is a technical benchmark chart from Artificial Analysis showing Kimi K3 in 3rd place on the Intelligence Index with a score of 57, narrowly ahead of Claude Opus 4.8 at 56 and behind Claude Fable 5 (60) and GPT-5.6 (59). Commenters add that follow-up charts for cost per task and output tokens per task look “super promising,” but the main technical caveat is whether the model sustains quality in long sessions at roughly Sonnet-like costs and around 30 t/s. The main skepticism is benchmark fatigue: one commenter says they’ve “seen enough bar-charts” and wants real long-session usage reports before accepting the ranking as meaningful.
- Commenters focused less on the headline rank and more on operational efficiency: one noted that at roughly Claude Sonnet-level pricing and around 30 tokens/s, Kimi K3 would need to show strong long-session reasoning efficiency rather than just benchmark-bar performance. This frames the model’s ArtificialAnalysis placement as needing validation through sustained interactive workloads, not only leaderboard scores.
- A linked follow-up claimed Kimi K3 looks promising on cost per task and output tokens per task, sharing ArtificialAnalysis-style charts: https://preview.redd.it/ayxi7od6bndh1.png?width=1753&format=png&auto=webp&s=14190215c0ae612463e1d7e9a7587b2d5e0c5b48. The discussion implies Kimi K3’s competitiveness may come from a favorable efficiency/price profile in addition to raw benchmark rank, especially if it is outperforming or approaching models like Claude Opus 4.8.

2. New Open-Weight Model Releases

Thinking Machines releases first open-weight model “Inkling” (Activity: 1775): Thinking Machines announced its first open-weight model, Inkling, and the image shows it on a model leaderboard at 1257, roughly mid-pack and tied with Claude Opus 4.6, just below GPT-5.6 Sol. Per the linked announcement, Inkling is a MoE transformer with 975B total / 41B active parameters, 1M token context, and pretraining over 45T tokens spanning text, images, audio, and video; commenters also note a preview Inkling-Small variant with 12B active parameters for lower cost/latency. Commenters were interested because Thinking Machines is led by the former OpenAI CTO and is entering open weights, but there was skepticism about adoption because Inkling appears not to outperform competing open models like GLM-5.2 on the shown leaderboard.
- Commenters highlighted Inkling’s core architecture/specs: a mixture-of-experts transformer with 975B total parameters, 41B active parameters, 1M token context, and pretraining on 45T tokens spanning text, images, audio, and video. One technical concern was that while it is multimodal and similarly sparse to competing open-weight MoE models, it reportedly does not outperform GLM-5.2, which may limit adoption among users prioritizing benchmark leadership.
- The most technically interesting discussion centered on Inkling-Small: a 276B total-parameter MoE with only 12B active parameters, positioned as a lower-latency/lower-cost sibling to the 41B-active Inkling. Commenters noted that Thinking Machines claims Inkling-Small matches or exceeds the larger model on many benchmarks, attributed to improvements in the pretraining data mix and recipe, making it potentially attractive for high-end local/home inference despite the large total parameter count.
Inkling by Thinking Machines is the #1 US open weight model now (Activity: 460): The image is a BenchmarkList page for Thinking Machines Lab’s Inkling, described as an open-weights reasoning multimodal model released 2026-07-15, with an Experimental ECI of 132.71, global SOTA rank #30/867, and global open-weight rank #5/169. In the post’s framing, Inkling is claimed to be the #1 U.S. open-weight model, outperforming U.S. peers such as NVIDIA Nemotron Ultra, though a commenter notes Inkling is reportedly nearly 1T parameters versus Nemotron Ultra’s 550B, making raw comparisons parameter-scale-sensitive. Comments were skeptical of the benchmark framing: one points out that OP appears affiliated with the benchmark site shown in the screenshot, and another mocks the claim as potentially weak relative to non-U.S. open-weight leaders.
- Commenters noted that Inkling is reportedly close to 1T parameters, making comparisons against Nemotron Ultra (550B) potentially parameter-count-skewed rather than purely architecture/training-efficiency based. The main technical criticism was that while the benchmark lead may be notable, the model is “too big” for many practical open-weight users due to likely inference cost, VRAM requirements, and deployment complexity.
- One commenter flagged that the original poster appears affiliated with the benchmark site shown in the screenshot, linking a Reddit search for the author’s posts: https://arctic-shift.photon-reddit.com/search?fun=posts_search&author=davidthesong&before=2026-07-15T20%3A40%3A39&limit=10&sort=desc. This raises a benchmark-interpretation concern: the ranking may need scrutiny around methodology, benchmark selection, and whether the post is promotional rather than independent evaluation.
German AI consortium releases Soofi S, an open 30B model that tops benchmarks in both English and German (Activity: 445): Soofi S is presented as an open German-led 30B-A3B MoE LLM (31.6B total, ~3.2B active/token) based on Nvidia Nemotron 3 Nano’s hybrid Mamba-2/Transformer architecture, with claimed near-flat long-context serving throughput from 4K–256K via reduced KV-cache attention layers; the team says it underwent full pretraining rather than being a finetune, with a paper, W&B training logs, and pretraining scripts available. It was reportedly trained on ~27T tokens with a German-heavy mix including machine-translated/synthetic German, and claims leading aggregate English/German benchmark results among fully open models, though commenters note missing comparisons to newer baselines and that Qwen3.5 35B-A3B appears to beat it on some German results; gated GGUF and reasoning GGUF builds exist. Commenters were skeptical of the benchmark framing, arguing the model is compared against older systems rather than newer Qwen/Gemma variants, and that math/coding-heavy benchmark aggregates may not measure German generation quality. There was also concern over licensing ambiguity: the project advertises “Sovereign, Open Source Long-term, license-free availability for industry” while the model card reportedly uses a custom Other license with the full license text not yet filled in.
- Soofi S is described as a newly pretrained model rather than a finetune: commenters note it is based on Nemotron 3 Nano, underwent full pretraining plus additional phases, and has public artifacts including the paper, training logs, and training scripts. One technical concern raised is that the architecture may have weaker long-context behavior; the release includes a RULER test but apparently lacks newer long-context evaluations.
- Several commenters question the benchmark framing: the release reportedly compares against older models while omitting newer baselines like Qwen 3.6 or Gemma 4. Another noted that, according to Soofi’s own benchmarks, Qwen3.5 35B-A3B beats Soofi S on German despite not being especially German-focused, suggesting the benchmark may emphasize general understanding, math, or coding rather than native-quality German generation.
- The data and release details drew scrutiny: the training mix reportedly includes “machine-translated and synthetically generated German texts,” which commenters warned can produce unnatural German due to translation artifacts. There was also concern about licensing ambiguity: the project claims “Sovereign, Open Source Long-term, license-free availability for industry,” but the model card is marked as a custom “Other” license with the actual license text apparently missing; GGUF builds exist on Hugging Face, including Instruct Preview GGUF and Rhine reasoning GGUF, but are gated.

3. Local Inference Runtime Upgrades

ExLlamaV3 v1.0.0 - Major Performance Upgrades (Activity: 467): The image is a technical benchmark table, not a meme, for the post titled “ExLlamaV3 v1.0.0 - Major Performance Upgrades” (image). It shows RTX 3090 decode throughput comparisons between v0.0.43, v1.0.0 mcg, and v1.0.0 mul1, with large speedups across EXL3-quantized models—e.g. Qwen 3.5 0.8B rising from about 268 to 444 tok/s and Qwen 3.6 27B from about 29 to 50 tok/s. The benchmarks contextualize the release notes: ExLlamaV3 removes FlashAttention-2/xFormers dependencies, adds new attention/GEMM/GEMV/MoE kernels, broader tensor parallelism, and KV-cache quantization improvements that reportedly avoid prior slowdown. Comments are mostly positive, praising turboderp’s solo development effort; one commenter clarifies that ExLlamaV3 is an Nvidia-GPU-focused LLM inference engine using the EXL3 format rather than GGUF/llama.cpp.
- A commenter summarized the core technical scope: ExLlamaV3/ExLlama3 is an LLM inference engine targeting a dedicated EXL3 model format rather than common GGUF used by llama.cpp-style runtimes, and it is currently NVIDIA GPU-only.
- One user highlighted ecosystem integration concerns, specifically hoping TabbyAPI improves tool-calling compatibility with Claude Code so ExLlamaV3 can be used locally. They also noted they are currently using GGUF with MTP and are interested in comparing the quality of EXL3 quantization.
Google is updating Gemma 4's chat templates, bringing major fixes to tool calling and reducing "laziness", and enabling Flash Attention 4 on Hopper GPUs, plus an interactive guide on how to work with and improve its vision! (Activity: 956): Google Gemma announced updated Gemma 4 artifacts/templates for testing, with claimed speedups, Flash Attention 4 on Hopper GPUs, improved tool-calling behavior, reduced “laziness,” and a vision token-budget/optimization demo on Hugging Face Spaces: google/gemma4_vision_token_budget. A commenter enumerated the relevant google/gemma-4-31B-it chat-template commits, including fixes for null handling, turn-tag balance, input validation, restoration of model-turn/thinking cues after tool responses, prevention of extra <turn|> emission, tool-call-only turn closure, and—most emphasized—restoring add_generation_prompt behavior plus the preserve_thinking default (commit list). The practical impact is mostly prompt-serialization correctness for multi-turn/tool-call traces: preserving or scoping the thinking channel appropriately, avoiding malformed continuation turns/newlines, and making historical assistant/tool-call turns render consistently. Commenters framed the fixes as resolving confusing user-side failures rather than requiring new prompting tricks, with particular enthusiasm for preserve_thinking. One commenter also noted the original X links appeared incorrect and supplied what they believed was the correct Gemma post: https://x.com/googlegemma/status/2077449152062247219.
- A commenter enumerated the Hugging Face commits for google/gemma-4-31B-it, showing the chat-template update is largely about tool-calling and reasoning/thinking-channel correctness: null handling, reasoning preservation, balanced turn tags, input validation, restored model turn/thinking cues after tool responses, and fixes for extra <turn|> emission. The list also highlights changes around preserve_thinking, APC primers, continuation turns, and tool-call-only turn closure, with the aggregate commit referenced at https://huggingface.co/google/gemma-4-31B-it/commit/68abe48010cbe15293462fa11e901a60639a44e5.
- One user reported that the advertised reduction in Gemma 4 “laziness” was not resolved by the latest chat template, arguing it appears to be a model behavior issue rather than a template-formatting issue. This is an anecdotal but technically relevant distinction: prompt/chat-template fixes may improve tool-call formatting and reasoning preservation without materially changing completion effort or refusal/under-answering tendencies.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Kimi K3 Launch and Coding Benchmarks

Chinese fable 5 is here !! Aka kimi k3 (Activity: 1106): The image is a screenshot of a verified Chetaslua post announcing Kimi K3 on the web, claiming a 1 million token/context window and showing a dark-themed Kimi UI with modes/options like K3 Max, swarm, slides, and deep research. In the Reddit context, the title frames it as “Chinese fable 5,” implying a high-end Chinese LLM competitor, but the post provides no benchmark table or reproducible evaluation—only launch/UX claims and anecdotal praise of a demo. Commenters’ early impressions are mixed but competitive: one says it feels faster than Claude, but less accurate, roughly “on par with GPT 5.5” but below “5.6 or Fable,” while others mainly express excitement that AI model competition is increasing.
- Early impressions characterize Kimi K3 / “Chinese Fable 5” as faster than Claude but with lower accuracy, roughly comparable to GPT-5.5 and behind GPT-5.6 or Fable in perceived quality. One commenter also notes its chain-of-thought allegedly references Anthropic content policies, suggesting possible policy-style contamination or imitation in reasoning traces.
- A technically detailed comparison highlights MiniMax M3 as under-discussed, with the commenter claiming it consistently outperforms DeepSeek v4 Pro and Mimo 2.5 Pro for their workloads. They cite MiniMax’s paid plan as 1.7B tokens / $20 per month with API access, and mention anticipation for a 2.7T-parameter MiniMax model.
- For tooling, the MiniMax agent environment is described as providing a Debian 12 sandbox with 2GB RAM, 1 Xeon vCore, and apparently unlimited storage. The commenter reports using cloudflared tunnels to expose/test APIs from the sandbox, implying it is usable for lightweight agent/API prototyping despite limited compute.
Kimi K3 tops Frontend Code Arena (Activity: 1037): The image is an Arena.ai Frontend Code Arena leaderboard showing Kimi-K3 ranked #1 with an arena score of 1,679, ahead of Claude Fable 5 (1,631) and GPT-5.6 Sol xHigh (1,618). The technical significance is that Kimi-K3 is being presented as a leading frontend-code-generation model in this benchmark, with commenters emphasizing that it is allegedly open weights and cheaper than Claude Fable, which would make the result notable beyond raw leaderboard placement. Commenters framed the result as a win for open-weight/low-cost models and contrasted it with perceived underperformance from Google/Gemini, which is absent from the chart. Some comments also speculated politically about possible U.S. pressure or restrictions around releasing or using Kimi-K3 weights, but those claims are speculative rather than technical.
- Commenters highlighted Kimi K3’s Frontend Code Arena lead as notable because it is reportedly open-weight while costing around 1/3 of Fable, suggesting a strong price/performance result rather than just a benchmark win. Several users framed the result as evidence that Chinese labs may be closing or surpassing benchmark gaps despite restricted access to high-end US chips, though the thread did not provide detailed benchmark methodology or score breakdowns.

2. AI Coding Agents: Codex Micro and WebGPU Builds

OpenAI reveals Codex Micro (Activity: 1440): The post claims OpenAI revealed “Codex Micro”, apparently a ~$230 keyboard-like hardware product with an integrated microphone, but the linked Reddit-hosted media (v.redd.it/3u8b331hdfdh1) was inaccessible due to HTTP 403 Forbidden, so the underlying announcement/video could not be verified. No concrete technical specs, model details, APIs, benchmarks, or implementation information were available from the post/comments beyond the implied keyboard + microphone form factor. Comments were overwhelmingly skeptical and confused, with users questioning whether it was an April Fools-style joke and mocking the idea of a "keyboard with a microphone" at "$230".
I built a true-scale atlas of the universe (8.4M real stars) in about a week with Fable (Activity: 1078): A developer reports building a WebGPU-based, dependency-free “true-scale” universe atlas in ~1 week using Claude Code + Fable 5, producing ~14.5k lines of TypeScript/WGSL across 92 merged PRs and 237 commits; the app renders 8.4M Gaia DR3 stars, 2.6M SDSS galaxies, real orbital/satellite dynamics, eclipses, Sgr A lensing, and scale-continuous navigation (site, MIT source). The workflow emphasized automated verification: JPL Horizons CI checks with a 0.2° tolerance, physics-gated data generation, deterministic URL repros, and headless WebGPU rendering via software Vulkan with pixel-diff baselines.* Commenters mostly framed it as an impressive scientific/visualization use case for new coding models, while one asked how the author bridged the gap between intended visuals and Fable’s typical graphics output, suggesting asset quality may be the limiting factor. Another technical suggestion was to extend it toward an N-body simulation.
- A commenter asked about the practical workflow gap between the intended atlas design and Fable5’s generated output, noting recurring dissatisfaction with Fable’s graphics quality. They suggested the limitation may be asset-related, requiring use of existing assets or custom asset creation in tools like Blender to achieve the desired visual fidelity.
- Another technically relevant suggestion was extending the atlas into an N-body simulation, implying a next step from static star visualization toward gravitational dynamics and large-scale physical simulation.

3. AI Governance and Open-Source Adoption

‘Anthropic doesn’t care about Europe’ — EU officials peeved after AI giant sends junior staffer to testify about safety (Activity: 1311): POLITICO reports that Anthropic sent Donny Greenberg, a newly hired technical employee, to testify remotely before the European Parliament on advanced AI safety risks, despite lawmakers reportedly requesting public-policy lead Sarah Heck. EU officials interpreted the staffing choice, prepared/possibly AI-generated answers, and abrupt exit as a failure to seriously engage with EU AI governance, leaving questions on safety policy and regulatory accountability unanswered. Commenters framed the incident as consistent with Anthropic’s perceived US-first commercial and policy posture, citing early-access programs, services, credits, and discounts focused on American companies. Others viewed it as operationally bizarre and unfair to the junior employee, while also reputationally damaging given the EU’s regulatory leverage over AI deployment.
- A technically relevant concern raised was that Anthropic’s Europe strategy appears underdeveloped, specifically around data residency: one commenter said it “seems like an afterthought.” For EU enterprise and public-sector adoption, this matters because model providers often need regional data processing/storage guarantees, compliance controls, and clear GDPR-aligned deployment options.
Linus Torvalds Reaffirms That Linux Is Not "Anti-AI" And Not A "Social Warrior" Project (Activity: 1157): Linus Torvalds stated that the Linux kernel will not ban AI/LLM-assisted development or review tooling, arguing that “AI is a tool” and that kernel policy should remain based on technical merit, not ideological opposition (Phoronix). The context is ongoing debate around Software Freedom Conservancy AI guidance and tools such as Sashiko for AI-assisted kernel review; Torvalds’ position is that such tools must reduce maintainer burden rather than generate low-quality submissions, but usage should not be prohibited. Top technical comments broadly agreed, noting that LLM code-generation quality has improved substantially over the last year and is now practically useful, while also arguing that the Linux kernel’s review culture is unlikely to tolerate “reckless slop” because of its high scrutiny and maintainer gatekeeping.
- Commenters highlighted Torvalds' position as a pragmatic one: Linux kernel development is unlikely to accept "AI slop" unchecked because its patch-review process has unusually high scrutiny and many expert maintainers reviewing submissions. The technical argument is that AI-assisted code can be tolerated as long as the resulting patches meet the same quality, correctness, and maintainability standards as human-written code.
- One commenter argued that AI-generated code quality has materially improved over the last year, contrasting it with experiences from ~2 years ago when tools frequently hallucinated nonexistent APIs and produced poor structure. The implication was that modern AI coding assistants are now "seriously useful" for software engineering workflows, though still dependent on human verification.
Anthropic warns that AI will soon be able to improve itself without human intervention (Activity: 939): Anthropic is warning policymakers that frontier models may soon materially accelerate AI R&D workflows—potentially enabling recursive improvement with little human intervention—and is advocating an AI “brake pedal”: stronger evals, monitoring, and possible deployment pauses for systems that can substantially improve model development pipelines (CNN). The technical risk being highlighted is not autonomous self-modification in isolation, but models improving the surrounding research/engineering loop enough to cause rapid capability jumps and weaker human oversight. Top comments were skeptical of Anthropic’s motives, arguing the company repeatedly issues alarmist safety warnings while continuing to build frontier systems, framing this as regulatory/market positioning rather than purely public-interest risk disclosure. Others dismissed the warning as repetitive or unserious.

not much happened today

Wed, 15 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/14/2026-7/15/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

What happened

Thinking Machines Lab launched Inkling, its first fully released open-weights foundation model family entry, positioning it as a customizable multimodal base model rather than a benchmark-maxed flagship.

Thinking Machines announced Inkling as an open-weights model that “reasons efficiently across text, image, and audio modalities,” with full weights available and immediate support on its Tinker platform and Playground @thinkymachines.
Mira Murati described Inkling as the company’s “first model,” “trained from scratch,” with open weights and same-day fine-tuning on Tinker @miramurati.
Soumith Chintala framed it as Thinking Machines’ “first general model,” stressing open weights, 975B parameters, native multimodality, and availability on Tinker, Hugging Face, and partners @soumithchintala.
John Schulman added timeline context: pretraining began last winter, and from mid-January a small team built coding, reasoning, and agentic training on top @johnschulman2.
Lilian Weng characterized Inkling as a foundation model aimed at “solid performance across a broad categories of capabilities” and intended for practical use plus customization @lilianweng.
TML staff repeatedly emphasized that this is a day-1 release and a foundation for future iterations rather than their final frontier push @soumithchintala, @cHHillee, @keirp1.
The release landed with unusually broad day-0 ecosystem support across vLLM, SGLang, Modal, Baseten, Databricks, Hugging Face, and quantization/community tooling @vllm_project, @lmsysorg, @modal, @baseten, @Yuchenj_UW, @huggingface, @danielhanchen.
Independent commentators immediately tagged it as the strongest U.S.-based open-weight release so far, though generally still behind the top Chinese open-weight and best closed models on some benchmarks @natolambert, @ArtificialAnlys, @scaling01.

Core facts and specs

Model size, modality, licensing, context

Inkling is reported as 975B total parameters / 41B active parameters in most posts @soumithchintala, @vllm_project, @ArtificialAnlys, @kimmonismus.
- One tweet says 974B @Yuchenj_UW, and another says 952B @multimodalart; the overwhelming consensus in the tweet set is ~975B.
It is a Mixture-of-Experts model with 41B active parameters per token @VictoriaLinML.
It is Apache 2.0 licensed according to multiple reactions and summaries @natolambert, @Yuchenj_UW, @multimodalart.
It supports text, image, and audio inputs, with text output @soumithchintala, @TheRundownAI, @ArtificialAnlys.
Open-weights checkpoints support up to 1M context @vllm_project, @lmsysorg, @ArtificialAnlys.
Tinker/API context is described as 256K, with pricing differentiated for 64K and 256K contexts @ArtificialAnlys.

Training and release details

TML says Inkling was trained from scratch @miramurati, @LiorOnAI.
Community readers extracted 45T training tokens from the release materials @eliebakouch, @ArtificialAnlys, while one post says 48T @mervenoyann. The more repeated figure in this dataset is 45T.
Inkling includes controllable reasoning effort / numerical effort levels @LiorOnAI, @TheRundownAI, @danielhanchen.
Tinker customers highlighted concise reasoning and strong tool calling rather than maximal raw benchmark chasing @tinkerapi, @MichaelElabd.

Architecture details surfaced in reactions

Several technically literate reactions extracted architectural choices from the release:

Hybrid/sliding-window attention with a 5:1 local-to-global layer ratio and window size 512 @eliebakouch, @ariG23498.
Relative positional encoding / relative attention bias instead of RoPE; multiple posters called this one of the most novel large-scale choices @stochasticchasm, @eliebakouch, @rasbt, @arohan, @ChangJonathanC.
Short convolution layers added around attention/FFN streams; commenters flagged this as unusually scaled-up usage of short convs @eliebakouch, @stochasticchasm, @rasbt, @SonglinYang4.
MoE with shared expert sinks / 2 shared experts, noted as atypical since many recent MoEs use 1 shared expert @eliebakouch, @ariG23498.
DeepSeek-style auxiliary-loss-free load balancing was cited in community readings of the architecture @eliebakouch.
muP and Muon/weight decay variants were inferred from the writeup and confirmed by optimizer expert reaction: Aaron Defazio said they are using his corrected weight decay approach, “MuonC/AdamC” @aaron_defazio, while community readers also pointed out muP @stochasticchasm, @Laz4rz.
8 MTP heads for speculative decoding were highlighted by vLLM @vllm_project.

Variants

Inkling-Small is repeatedly referenced as an upcoming or separately discussed smaller model @LiorOnAI, @teortaxesTex.
Community summaries describe Inkling-Small as 276B total / 12B active and unexpectedly competitive versus the larger model on several evaluations @eliebakouch, @nrehiew_.

Performance and benchmarks

Independent benchmark framing

Artificial Analysis said Inkling debuts at 41 on the Intelligence Index, making it the leading U.S. open-weights release and ahead of Nemotron 3 Ultra (38), Gemma 4 31B (29), and gpt-oss-120b (24) @ArtificialAnlys.
Artificial Analysis also said Inkling averages 25K output tokens per Intelligence Index task, vs 43K for GLM-5.2 max, 38K for Kimi K2.6, and 37K for DeepSeek v4 Pro max, framing it as relatively token-efficient @ArtificialAnlys.
Natolambert called it a “clear step up from Nemotron Ultra” and “new best American model,” but still “a bit behind GLM 5.2 on agentic benchies, and Kimi K 2.6 on multi modal” @natolambert.
Design Arena said Inkling entered Agentic Web App Arena at #9 overall, Elo 1257, in the same band as Claude Opus 4.6 and Gemini 3.5 Flash, and called it the highest-ranking U.S.-based open-weight model for agentic workloads @DesignArena.
Arena added Inkling to Agent Arena / Text / Vision / Code Arena on launch day @arena.

Specific benchmark numbers cited

From Artificial Analysis:

GDPval-AA v2 Elo 1238, higher than Kimi K2.6 (1190) and DeepSeek v4 Flash max (1189) @ArtificialAnlys.
τ³-Banking 24%, above Kimi K2.6 (21%) and slightly above DeepSeek v4 Flash max (23%) @ArtificialAnlys.

Qualitative performance takes

Positive:

“Sharp and concise” reasoning, not rambly @MichaelElabd.
Strong tool calling and good long-horizon error recovery on agentic tasks @MichaelElabd.
Good “quality of mind” / unsycophantic flavor @skirano, @tinkerapi.
Alex Kirillov claimed Inkling avoids the common “audio in = intelligence penalty” seen in many omni models, though another user asked for stronger supporting evidence and benchmarks @alex_kirillov, @giffmana, @alex_kirillov.

More mixed / critical:

Scaling01 argued the benchmarks are “not that great,” describing it as roughly “another Kimi-K2.6” and behind all closed models and GLM-5.2, speculating the release may have been timed ahead of Kimi-K3 and DeepSeek-V4-GA @scaling01.
Stochasticchasm said it seems “very strong for multimodal” but “not super strong for terminal bench etc.” @stochasticchasm.
JJitsev pushed back on hype around “only open-weight model trained without distilling,” saying Inkling uses distillation from open weights and underperforms GLM 5.2 on TerminalBench-style evals @JJitsev.
TeortaxesTex offered a contrarian positive spin: mediocre benchmark-maxing may actually suggest less corner-cutting/distillation contamination and a more independent data pipeline @teortaxesTex.

Inference, systems, and launch ecosystem

Official and partner infrastructure facts

NVIDIA said Inkling was trained on GB300 NVL72 and that an NVFP4 checkpoint was available on Hugging Face on day 0 @NVIDIAAI.
vLLM said day-0 support includes NVFP4 and BF16, optimized for Blackwell and Hopper, reaching up to 380 tok/s/user on 4× GB200 with MTP @vllm_project.
Inferact detailed system work: sconv-aware tensor-parallel sharding, low-latency fused collectives (5× faster at bs=1), and direct integration of TML’s FA4 sheared-bias kernel @inferact.
LMSYS/SGLang said Inkling architecture support was implemented natively, including ShortConv, relative positional attention, shared expert sink MoE, prefill full CUDA graph, MXFP8 KV cache, full parameter and LoRA RL in customized Megatron backend, routing replay, cross-runtime parameter sync, and DFlash speculative decoding from Modal @lmsysorg.
Modal said Inkling on Modal uses a custom DFlash speculator for 67% higher throughput and interactivity @modal.
Soumith Chintala separately amplified that Modal’s DFlash speculator is “much faster than MTP” @soumithchintala.

Community optimization observations

Lysandre reported replacing TML’s causal Conv1D with causal-conv1d yielded +4% tok/s, and replacing attention with FlashAttention-4 yielded another +11%, for ~15% total throughput gain without retraining @LysandreJik.
Unsloth released 1-bit GGUF quants said to be 86% smaller (270GB vs 1.9TB) while retaining 74.2% of top-1% accuracy, with vision and audio support @danielhanchen.

Pricing and availability

Artificial Analysis listed Tinker pricing as:
- 64K context: $1.87 / 1M input, $0.374 cached, $4.68 output
- 256K context: $3.74 / 1M input, $0.748 cached, $9.36 output
  @ArtificialAnlys
Available on Tinker, Hugging Face, and via launch partners including Databricks, Baseten, Modal, vLLM/SGLang stacks @soumithchintala, @Yuchenj_UW, @baseten, @modal.

Facts vs opinions

Factual claims directly supported by launch and partners

Open weights/full weights released @thinkymachines.
Trained from scratch @miramurati.
975B total / 41B active MoE, multimodal text-image-audio input, 1M context on weights, 256K on Tinker/API @soumithchintala, @ArtificialAnlys.
Apache 2.0 license @natolambert, @Yuchenj_UW.
Pretraining began last winter; agentic/coding/reasoning work started mid-January @johnschulman2.
Day-0 support on major serving stacks, with concrete performance claims from vLLM/Inferact/Modal/NVIDIA @vllm_project, @inferact, @modal, @NVIDIAAI.

Interpretations and opinions

“Best American open model” / “saved American open-source frontier” are judgments, albeit repeated by several respected observers @natolambert, @karinanguyen, @saranormous.
Claims that Inkling is especially important because it is not distilled from OpenAI/Anthropic are disputed. Jxmnop called it “the ONLY open-weight model” without such distillation @jxmnop, then partially walked it back: “apparently they did distill lol. but only a tiny bit” @jxmnop. Andrew Carr also contested the purity framing, noting use of Kimi 2.5 for SFT traces @andrew_n_carr.
Claims that Inkling was “rushed” ahead of Chinese releases are speculation from critics, not evidenced by the launch materials @scaling01.
Claims that relative attention gives TML a finetuning moat because backward is hard are speculative @typedfemale.
Claims that Inkling avoids multimodal intelligence loss are promising but not yet benchmark-complete in the tweet set @alex_kirillov.

Different perspectives

Supportive / bullish

Open-weight and permissive license as strategic win: Many saw the Apache-2.0 release as a major boost to the U.S./Western open ecosystem @latkins, @saranormous, @brexton, @hyperindexed.
Customization over leaderboard chasing: Researchers and builders praised the explicit framing that Inkling is a broad, tunable foundation rather than a benchmark-maxed point solution @gneubig, @ben_burtenshaw, @thealexker.
Strong release quality: Several users praised the transparency, grounded tone, and comprehensive technical documentation @lvwerra, @saranormous, @rasbt.
Architecture interest: The non-RoPE positional choice and scaled short-conv usage drew positive attention as evidence TML is willing to make meaningful architecture bets @stochasticchasm, @rasbt, @ChangJonathanC.

Neutral / analytical

Strong but not top overall: The most balanced reads place Inkling as the new U.S. open-weight leader, but behind GLM/Kimi/DeepSeek or top closed models on some fronts @natolambert, @ArtificialAnlys, @stochasticchasm.
Good base model thesis: Multiple analysts read the release as a systems/business move: ship a solid, efficient, post-trainable base and let Tinker plus downstream RL/fine-tuning create differentiation @ben_burtenshaw, @kimmonismus, @tinkerapi.

Critical / skeptical

Not frontier overall: Critics argued it is still clearly behind top Chinese open-weight models and the strongest closed models @scaling01, @JJitsev.
Purity claims overstated: Some pushback focused on exaggerated claims that it is uniquely “pure” or non-distilled; the thread set includes both hype and corrections @jxmnop, @jxmnop, @andrew_n_carr, @JJitsev.
Benchmark middlingness as concern: Some readers saw the moderate benchmark profile as evidence it may simply lag current Chinese open frontier rather than inaugurate a new frontier @scaling01.

Context: why this matters

First major TML public model: This is the first true external model release from Thinking Machines after months of anticipation around a lab staffed by ex-OpenAI leaders and researchers. That made the choice of open weights itself notable @Hesamation, @TechCrunch.
A U.S. open-weight answer to Chinese momentum: Many reactions explicitly compare Inkling to GLM, Kimi, DeepSeek, and Qwen. The release lands amid concern that Western open-weight models have trailed Chinese ones on capability and release cadence @scaling01, @teortaxesTex, @sriramk.
Open base + post-training stack thesis: TML’s messaging strongly suggests a strategy similar to “ship a competent open substrate, then differentiate via customization/fine-tuning/RL infrastructure.” That aligns with Tinker distribution and with user reactions centering controllable reasoning, concise outputs, and adaptation rather than raw leaderboard supremacy @thinkymachines, @MichaelElabd, @ben_burtenshaw.
Inference ecosystem maturity: The release also showcases how far open inference stacks have come. Day-0 support for a 1T-class multimodal MoE with new architectural components and multiple kernel-level optimizations would have been far less plausible a year earlier @vllm_project, @inferact, @LysandreJik.
Architectural experimentation at scale: Relative positional bias instead of RoPE and large-scale short-conv usage are the kind of choices researchers watch closely because they may indicate future architecture trends if they prove robust under scaling and post-training @stochasticchasm, @rasbt, @ChangJonathanC.
Release style as signal: Several commentators praised the unusually restrained release language, explicit admission that it is not the strongest overall model, and detailed technical notes. For expert audiences, that improved credibility relative to more benchmark-maxed launches @eliebakouch, @lvwerra, @thealexker.

Agents, Sandboxes, and Harness Engineering

Perplexity’s SPACE sandbox platform: @perplexity_ai introduced SPACE, its in-house sandbox platform now serving 100% of Computer production traffic. The interesting systems design choice is the decoupling of session state from disposable Firecracker microVM sandboxes, with rolling snapshots allowing pause/resume/branch semantics. @perplexity_ai reported median sandbox creation latency dropping from 185 ms to 60 ms and P90 from 447 ms to 89 ms, while @zbraniecki explained the use of disk snapshots plus full VM checkpoints, object storage for resumability, and Btrfs COW to make sandbox creation a metadata operation instead of full image copy. This is one of the more concrete production infrastructure disclosures in the set.
Agent workspaces, Slack-native agents, and harness cost: On the product side, @istdrc launched Raft 1.0, positioning it as a shared workspace where agents behave more like a team in a messaging app than isolated terminal sessions. @LangChain upgraded Fleet in Slack, enabling one-click deployment of agents into channels/threads with custom identity and file handoffs, echoed by @hwchase17. On the engineering side, @AI21Labs argued that harness design, not just model choice, materially affects cost: it cited Writer’s “Harness Effect” as showing 41% lower cost per task at quality parity when only orchestration changed, and linked to its own early-stopping work claiming up to 44% compute reduction for SWE agents. Related toolchain notes came from @nutlope, who launched TogetherLink to run open-source models inside coding harnesses like Codex and Claude Code, and @Teknium, who added Blender MCP to the Hermes agent catalog.

Automated Red Teaming, Alignment, and Governance Friction

OpenAI’s GPT-Red and the safety flywheel: @OpenAI introduced GPT-Red, an internal automated red teamer for finding prompt injection vulnerabilities at scale. The most concrete claim was that adversarial training against GPT-Red made GPT-5.6 Sol substantially more robust, with OpenAI saying replayed strong attacks produced 6× fewer failures than its best production model from four months earlier. The broader framing—AI systems improving the safety of future AI systems—was made explicit in OpenAI’s follow-up. This sits alongside external commentary from @omarsar0, who called it a high-ROI self-improvement loop.
Anthropic’s misalignment scenarios and DeepMind governance debate: @AnthropicAI published “Agentic misalignment in Summer 2026”, adding four new simulated scenarios of bad autonomous-agent behavior a year after its blackmail case studies. Concurrently, governance discussion intensified around Google DeepMind: @Turn_Trout announced he resigned from DeepMind over military use without restrictions against killer robots or mass surveillance, while @jackclarkSF and @Yoshua_Bengio amplified Demis Hassabis’s call for third-party testing and standards feeding into policy. The juxtaposition—public support for standards versus internal dissatisfaction over governance practice—was succinctly noted by @BlackHC.

Benchmarks, Reproducibility, and Evaluation Integrity

Soofi S / Nemotron contamination dispute: The sharpest evaluation controversy concerned claims around Soofi S 30B-A3B. @kimmonismus presented it as a Europe-trained model based on NVIDIA’s open Nemotron 3 Nano architecture, trained on ~27T tokens with German upweighting and a fully released recipe. But multiple critics challenged both novelty and eval integrity. @JJitsev argued the comparison lowered Nemotron reference scores versus the original report, while @eliebakouch alleged the training mix included light rephrasings of the GPQA Diamond eval set, potentially contaminating the benchmark and overstating the gap. He later summarized the concern as “10 epochs of a very light rephrasing of every GPQA Diamond eval item” in a follow-up. Even skeptics suggested a straightforward remedy: rerun the original Nemotron recipe and then compare under identical evaluation conditions, as @JJitsev proposed.
Broader movement toward better evals and reproducibility: Several posts pushed on eval methodology more generally. @arena launched a factuality-weighted ranking combining human preference with claim verification, based on 2M+ labeled claims across text and search arenas; GPT-5.5 reportedly gained the most under the factuality weighting while some preference-optimized models dropped. @askalphaxiv and @abidlabs kicked off a Hugging Face-backed reproducibility challenge around ICML 2026 papers, with early community progress already reproducing dozens of papers. And @sayashk announced a PhD talk explicitly titled “The Missing Science of AI Evaluation.”

Top tweets (by engagement)

Inkling launch: @thinkymachines announcing Inkling was the clear technical story of the day, combining an open-weight ~1T multimodal MoE release with a broad open inference rollout.
OpenAI’s GPT-Red: @OpenAI’s GPT-Red announcement stood out for substance: automated prompt-injection red teaming plus a concrete 6× robustness improvement claim on GPT-5.6 Sol.
Claude Code artifacts + MCP: @ClaudeDevs launched artifacts that can call MCP connectors, effectively making artifacts per-viewer live apps/dashboards with permission-scoped data access.
Perplexity SPACE: @perplexity_ai and @AravSrinivas provided unusually detailed production numbers for agent sandboxes, including 5× faster tail latency claims.
DeepMind governance resignation: @Turn_Trout’s resignation thread was one of the most engaged policy-adjacent AI posts, centered on military-use restrictions and lab governance credibility.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Bonsai 27B and Local Inference Speedups

Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels (Activity: 731): PrismML released Bonsai 27B, a 1-bit dense LLM intended to run locally in-browser via custom WebGPU kernels, with model artifacts on Hugging Face and a WebGPU demo Space. The claimed compression is from roughly 54GB to 3.8GB (-93%) while retaining about 90% of baseline capability; commenters note a ~5.7GB footprint for a Qwen/Qwen3-derived 27B variant and interest in testing on consumer GPUs such as an 8GB RTX 3070 laptop GPU. Commenters are broadly positive but focus on scaling questions: whether 1-bit quantization can make 80–100B parameter models practical, and what parameter/context-length tradeoff would fit 256k+ context on a single 24GB GPU. There is also a recurring view that recent 1-bit releases suggest a broader shift toward ultra-low-bit LLM deployment.
- Commenters highlighted the headline compression claim: Bonsai 27B / Qwen 3.6 27B-class model reportedly fits in about 5.7GB at 1-bit density with only ~5% capability loss. One user specifically planned to test it on an 8GB laptop RTX 3070, implying the main practical interest is whether custom WebGPU kernels can make a 27B dense model usable on consumer VRAM budgets.
- A technically focused thread discussed scaling: users want an 80B–100B 1-bit dense model, but noted the real constraint is fitting both weights and a 256k+ context KV/cache footprint on a single 24GB GPU. This frames 1-bit weights as only part of the memory story; long-context inference may dominate usable deployment limits even if model weights are highly compressed.
- One commenter distinguished 1-bit models trained from scratch from extreme post-training quantization, arguing the former should retain much more capability than simply quantizing a larger model down to 1 bit. They suggested a future 1-bit 70B trained natively at that precision could be both consumer-GPU runnable and practically useful, unlike many heavily quantized ultra-low-bit models.
PrismML’s new Ternary Qwen3.6 27B runs near fp16 precision on 10GB of memory!!! (Activity: 465): PrismML released Bonsai 27B, a ternary/BitNet-style variant of Qwen3.6 27B, with GGUF and MLX builds requiring PrismML forks of llama.cpp / mlx for now. The OP reports ~10GB memory use at 32K context on an M4 Pro and claims the model is much better than a conventional 2-bit quant, but later edits clarify it is better than Q2, worse than Q4_K_XL, with observed hallucinations and tool-calling loops; the main value is memory footprint rather than fp16-equivalent accuracy. Claimed capabilities include 256K context and multimodal input, with dFlash support mentioned as forthcoming; the whitepaper is here. Commenters pushed back on the wording “near fp16 precision” because ternary weights are {-1,0,1}, and criticized hype/AGI framing as technically misleading. One technical question raised was whether the same ternary approach could scale to larger models such as GLM 5.2 while preserving acceptable quality loss.
- A commenter challenged the claim that a ternary / 1-trit Qwen3.6 27B can run at “near fp16 precision”, noting that PrismML’s premise is extremely low-bit representation and asking what that phrase technically means in this context. They also objected to loose use of AGI, arguing that even stronger models like Mythos should not be labeled that way without evidence.
- One user reported a working local run of Ternary-Bonsai-27B-Q2_0.gguf via a PrismML fork of llama.cpp, using -ngl 99 and a very large -c 200000 context. On a simple TypeScript explanation prompt, they observed 243.5 t/s prompt processing and 89.1 t/s generation, suggesting the model is at least operational and fast under their setup, though the example does not validate quality claims.
- Another commenter asked for rigorous benchmarks such as SciCode or SWE-rebench to support the claims that the ternary model is close to BF16 and “far more intelligent” than comparable 2–3 bit Qwen3.6 27B quantizations. They also asked whether the method works for MoEs or larger dense models like Mistral Medium 3.5, noting that very large MoEs with >10B active parameters, such as Step 3.7 Flash and MiMo V2.5, often appear unusually resistant to quantization.
Apple in talks with startup PrismML that shrinks AI models to run on an iPhone (Activity: 362): CNBC reports Apple is in early talks with PrismML, a Caltech spinout, over extreme LLM compression for on-device iPhone inference. PrismML reportedly compresses Alibaba Qwen 27B from ~54 GB to <4 GB via ternary/binary-style quantization, claiming 10–15× lower memory, 6–8× faster responses, and 3–6× lower energy use, with some degradation in factual recall. Technical commenters noted missing details around conversion cost, convergence guarantees when moving to ternary/binary weights, whether distillation is used, saturation of post-training, and comparisons to prior low-bit work such as BitCPM-CANN and bitnet-b1.58-2B-4T. Commenters were skeptical that small size alone proves usefulness, with one asking whether the compressed model is “actually capable of anything useful.” Another user expressed disappointment because they had just been testing PrismML’s q1 bonsai model, implying concern about Apple potentially acquiring or restricting the technology.
- Commenters noted that PrismML’s public materials appear to lack key technical details needed to evaluate its compression/quantization claims: conversion cost, whether ternary/binary conversion reliably reaches a convergence point, whether distillation is used, and whether post-training has fully saturated the model. One comparison raised was the BitCPM-CANN tech report, with commenters arguing that there is little precedent for a properly trained-from-scratch ternary model beyond bitnet-b1.58-2B-4T.
- Several comments questioned whether PrismML’s advertised small model size translates into practical capability. One user said they had been testing the company’s q1 bonsai model, while another noted they had seen repeated claims about compactness but little evidence that the model is “actually capable of anything useful.”
ExLlamaV3 v1.0.0 - Major Performance Upgrades (Activity: 422): The image is a technical benchmark table (PNG) for ExLlamaV3 v1.0.0, showing RTX 3090 decode throughput gains versus v0.0.43 across multiple quantized LLMs/bitrates. It supports the release claims of major inference-kernel upgrades: v1.0.0 mul1 shows large speedups such as Qwen 3.6 27B rising from 29 to 50 tok/s (+72%) and Qwen 3.5 0.8B from 268 to 444 tok/s (+66%), consistent with the post’s notes about new attention, GEMM/GEMV, INT8 GEMV, Conv1D, and MoE scheduler kernels. Comments are mostly appreciative rather than deeply technical, highlighting that ExLlamaV3 is an NVIDIA-GPU-focused LLM engine using the EXL3 format rather than GGUF/llama.cpp, and praising the scale of the work by Turboderp/Fable.
- A commenter clarified that ExLlamaV3/ExLlama3 is an LLM inference engine targeting the specialized EXL3 model format rather than common GGUF files used by llama.cpp, and that it is currently NVIDIA GPU-only. This distinction matters for deployment compatibility: users with existing GGUF workflows may need separate quantized weights and CUDA-capable hardware to use it.
- One technical request focused on TabbyAPI integration, specifically improving tool-calling compatibility with Claude Code so ExLlamaV3 could be used locally in that workflow. The same commenter noted they are currently using GGUF with MTP and are interested in evaluating the quality tradeoffs of EXL3 quantization versus their current setup.

2. Open-Weight Model Launches and Updates

Thinking Machines releases first open-weight model “Inkling” (Activity: 1082): The image is an AI model leaderboard highlighting Thinking Machines’ first open-weight model, Inkling, scoring 1257, roughly mid-table and tied with Claude Opus 4.6, below GPT-5.6 Sol and well below top entries like Claude Sonnet 5 at 1333. From the announcement/comments, Inkling is described as a MoE transformer with 975B total parameters, 41B active parameters, up to a 1M token context window, and pretraining on 45T multimodal tokens spanning text, images, audio, and video; a preview Inkling-Small has 12B active parameters for lower cost/latency. Commenters were interested because Thinking Machines is associated with a former OpenAI CTO and is releasing open weights, but some were skeptical that Inkling will see broad adoption if it does not outperform competing open models such as GLM-5.2.
- Inkling is described as a sparse MoE transformer with 975B total parameters, 41B active parameters, a 1M token context window, and pretraining on 45T tokens spanning text, images, audio, and video. One commenter compared it unfavorably to GLM-5.2, arguing that despite being multimodal and long-context, it may see limited adoption if it does not outperform that open-weight competitor.
- The most technically interesting discussion centered on Inkling-Small: a 276B parameter MoE with only 12B active parameters, positioned as a lower-latency/lower-cost variant. Commenters highlighted that it reportedly “matches or exceeds its larger sibling on many benchmarks” due to improvements in the pretraining data mix and recipe, making it potentially practical for local inference compared with the 41B active main model: https://thinkingmachines.ai/news/introducing-inkling/#inkling-small
- A few commenters noted gaps in the model-size lineup: there is no model around the 30B dense/active-parameter class, which some local-inference users consider a useful middle ground. The release instead jumps from Inkling-Small at 12B active MoE to the main Inkling at 41B active MoE.
German AI consortium releases Soofi S, an open 30B model that tops benchmarks in both English and German (Activity: 321): Soofi S is presented as a German-led fully pretrained MoE LLM, 31.6B total / ~3.2B active parameters, based on NVIDIA Nemotron 3 Nano’s hybrid Mamba-2/Transformer architecture, trained on ~27T tokens with German upweighting and claimed near-flat throughput from 4K to 256K context (article, paper). Commenters note it is described as a new full pretraining run, not a finetune, with unusually transparent artifacts including W&B training logs, training scripts, and gated GGUF / reasoning GGUF releases. Technical caveats raised include limited modern long-context evaluation beyond RULER, possible German naturalness issues from “machine-translated and synthetically generated German texts”, and benchmark ambiguity because coding/math tasks and German understanding may inflate language-quality claims; one commenter also claims Qwen3.5 35B-A3B beats Soofi S on German benchmarks despite not being German-specialized. The main debate is whether the benchmark comparison is credible: commenters criticized omission of newer baselines such as Qwen 3.6/Gemma 4 and comparison against older models. Another concern is licensing: marketing claims “sovereign, open source… license-free availability” conflict with a Hugging Face card using a custom “Other” license whose full text was reportedly missing.
- A commenter notes Soofi S is described as a newly pretrained model rather than a finetune, with architecture based on Nemotron 3 Nano and full pretraining/additional phases documented in the paper, W&B training logs, and training scripts. They caution that the Nemotron-derived architecture may limit long-context accuracy: the release includes a RULER test, but apparently lacks more modern long-context evaluations.
- Several commenters question the benchmark framing, arguing Soofi S was compared against older baselines and not newer models like Qwen 3.6 or Gemma 4. One commenter highlights that the authors’ own results show Qwen3.5 35B-A3B outperforming Soofi S on German, suggesting the benchmark may measure broad understanding, math, and coding more than native-quality German generation.
- The data mix is flagged as potentially problematic because the paper mentions “machine-translated and synthetically generated German texts”, which can produce unnatural German and may affect generation quality despite benchmark gains. Release artifacts also appear incomplete or inconsistent: GGUF builds exist for Soofi-S-Instruct-Preview and reasoning variants like Soofi-S-Rhine-Preview, but they are gated, and the license is described as custom/“Other” with the full text apparently missing.
KAT-Coder-Air V2.5 - Open model soon (Activity: 262): The image is a screenshot of a KwaiAI/KAT-Coder social post announcing KAT-Coder-Pro V2.5 and, more importantly for r/LocalLLaMA, a reply stating that KAT-Coder-Air V2.5 will be open-sourced “very soon.” The post links to availability on OpenRouter and a technical report on arXiv (abstract, PDF), with claims around long-horizon and agentic coding performance; a commenter who tested it via OpenRouter speculates it is below 100B parameters. Comments are mostly curiosity-driven: users are waiting for actual open weights and asking about the model size, with one tester noting it is already usable through OpenRouter but not yet confirming architecture or parameter count.
- A commenter who says they asked about the weights reports that KAT-Coder-Air V2.5 is already available on OpenRouter and, based on their usage/metadata, “should be below 100B parameters.” The main technical uncertainty raised in the thread is the model’s exact parameter count/size, which users are waiting to verify once weights are released.
Google is updating Gemma 4's chat templates, bringing major fixes to tool calling and reducing "laziness", and enabling Flash Attention 4 on Hopper GPUs, plus an interactive guide on how to work with and improve its vision! (Activity: 513): Google Gemma announced updates to Gemma 4 chat templates via X, targeting tool-calling correctness and reduced “laziness,” while also enabling Flash Attention 4 on Hopper GPUs and publishing an interactive Gemma vision token-budget guide on Hugging Face Spaces. A commenter linked the relevant google/gemma-4-31B-it commit, which includes fixes for null handling, reasoning/thinking preservation, turn-tag balancing, tool-response continuation, add_generation_prompt regression, extra <turn|> emission, and tool-call-only turn closure; notably, preserve_thinking is restored/defaulted and scoped around tool-call turns. Commenters framed the update as addressing confusing prior behavior in Gemma 4 prompting/tool use, with one saying they had assumed the failures were user error. The most emphasized reaction was enthusiasm that preserve_thinking support was included.
- A commenter enumerated the Hugging Face commit-level fixes for Gemma 4 31B IT chat templates, including null handling, reasoning preservation, turn-tag balance, input validation, restoration of model turns/thinking cues after tool responses, and fixes for extra <turn|> emission in assistant content + tool-call continuation paths. The linked commit list starts from 68abe480, with notable fixes around preserve_thinking, rendering the thinking channel independent of tool_calls, and correcting tool-call-only turn closure.
- One technical takeaway from the thread is that tool-calling behavior appears to have been strongly affected by template-level serialization bugs, especially around preserving reasoning/thinking channels and correctly reopening assistant generation after tool responses. However, another commenter reports that the perceived "laziness" remains present with the latest template, arguing it is likely a model behavior issue rather than a chat-template issue.

3. Open-Model Policy and Self-Hosting Risk

Source: the Trump administration and industry groups discussed streamlining US open model releases of equal or lesser capability to leading Chinese open models (Activity: 573): A reported Trump administration/industry discussion would streamline U.S. releases of open models whose capabilities are equal to or below leading Chinese open models, motivated by concern over U.S. developers adopting Chinese local/open-weight models. The linked source could not be verified from the provided archive page because it returned a CAPTCHA/HTTP 429 interstitial rather than article content. Commenters argued that U.S. AI firms have weak incentives to release Chinese-competitive open models because strong local models could cannibalize paid API/SaaS revenue. Others were skeptical of claims about Chinese open models containing CCP-exploitable backdoors, noting that if such model-level backdoors were practical or detectable, U.S. labs would likely already dominate open-weight alternatives.
- Several commenters argued that banning capable open-weight models is technically unenforceable once weights are mirrored globally: a single torrent tracker, private file share, or USB transfer can bypass restrictions. One commenter noted enforcement would likely require extreme downstream controls such as confiscating or restricting GPUs/workstations above certain VRAM thresholds, because inference can run locally once weights are obtained.
- A recurring technical policy argument was that if the US wants companies to avoid local Chinese models, the practical alternative is to release US open-weight models of equal or better capability rather than restrict access. Commenters suggested this would need to match the quality trajectory of Chinese open models closely enough that local deployment users do not need to rely on foreign weights.
- One commenter specifically cited NVIDIA Nemotron as a better model-release pattern because of its relatively transparent training data/process, while noting that Nemotron 3 Ultra is “very good” but appears undertrained and therefore underperforms for its parameter size. Multiple commenters were skeptical of claims about intentional Chinese “backdoors” in open-weight models, arguing that if such hidden model-level backdoors were straightforward to weaponize, US labs would already be exploiting the same technique in open models.
Some of y'all wonder why anyone would self host AI. Would you accept the opinion of the CEO of Microsoft? (Activity: 559): The post argues for self-hosting AI/LLMs as a data-protection strategy, citing a TechCrunch article quoting Microsoft CEO Satya Nadella that enterprises may “pay for intelligence twice”: once in fees and again by exposing proprietary business knowledge needed to make hosted AI useful. The technical concern is that API/SaaS model providers such as OpenAI or Anthropic could ingest sensitive prompts, documents, workflows, or RAG corpora and potentially derive competitive intelligence, making local inference or private deployment attractive for inventors, researchers, and enterprises handling IP-sensitive data. Top comments were skeptical of Nadella’s framing, arguing it may be a sales pitch for Azure-hosted AI rather than a neutral privacy warning. Others pointed to Microsoft’s own products—Copilot, the OpenAI partnership, and screen-indexing features like Recall—as evidence that Microsoft has similar incentives and privacy risks.
- Commenters interpreted Satya Nadella’s self-hosting argument as less about pure decentralization and more about enterprise workloads moving onto Microsoft Azure, i.e. companies “hosting” private models inside Microsoft’s cloud rather than running them fully on-prem.
- Several commenters tied the self-hosting/privacy discussion to Microsoft’s own AI products, especially Copilot and the controversial Windows Recall feature, which was criticized for continuously snapshotting user activity for later AI-powered indexing. The technical concern raised was that cloud-connected assistants create a large attack surface for sensitive business data, even when marketed as productivity tooling.
- A recurring technical concern was that enterprise AI vendors may use customer interactions or documents as training/evaluation data, with one commenter asking how labs continue acquiring 50–100T new tokens per year for model training. The point was framed as a reason businesses might prefer self-hosted or tightly controlled deployments to reduce IP leakage and data reuse risk.
This is why we need local models and opensource harnesses (Activity: 379): The image (screenshot) shows a claim by International Cyber Digest that xAI’s Grok Build CLI uploaded entire Git repositories—including private code and unredacted secrets—to a Google Cloud bucket, allegedly disabled later via a hidden server-side flag. The post uses this alleged leak to argue for local-first/open-weight models, deterministic open-source agent harnesses, private VPC execution, and governance layers that can inspect/redact secrets before any third-party network egress. Commenters were overwhelmingly skeptical of cloud-tethered coding agents, framing this as potential spyware/malware behavior and suggesting legal accountability if the exfiltration was intentional. One recurring sentiment was that users should expect poor data-handling practices from opaque vendor-controlled AI tooling.
- A commenter describes mitigating LLM-driven code/data exfiltration by using a self-hosted Git server blocked from the Internet. They note this does not fully prevent leakage, but it changes the threat model: instead of a tool silently issuing direct upload/download jobs, any exfiltration would need to pass through the LLM interaction path, making it more visible and slower.
- Another technically relevant takeaway is the preference for open-source agents plus open-weight models on self-controlled infrastructure. The argument is that local execution and inspectable harnesses reduce reliance on opaque hosted services where telemetry, tool calls, or data-retention behavior may be difficult to audit.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Frontier AI Distillation and Safety Standards

Anthropic just told the US Senate that Alibaba ran 25,000 fake accounts and had 28.8 million conversations with Claude — not to use it, but to copy it (Activity: 3524): The post claims Anthropic told the U.S. Senate that Alibaba used 25,000 API accounts to run 28.8M Claude conversations over ~six weeks (Apr–Jun) to perform large-scale model distillation—extracting agentic reasoning/coding behavior via normal API access rather than hacking—and then use it to improve Qwen. Anthropic is described as framing this as its largest “distillation attack” and arguing current law is ambiguous enough that it sought congressional action rather than litigation; the OP links a longer breakdown tying this to the Fable 5 export ban: YouTube. Top comments debate whether this is meaningfully different from conventional reverse engineering—e.g., automakers or Samsung buying competitors’ products to study them—versus prohibited model extraction. Several commenters argue Anthropic’s complaint is hypocritical because frontier labs trained on large amounts of public/creative human output under fair-use theories, but object when their own model outputs are used as training data.
- Several commenters framed model distillation via API outputs as analogous to competitive reverse engineering: an automaker or Samsung buying a rival product, studying behavior, and using the findings to improve its own system. The technical distinction raised is that AI distillation can automate this process at scale—here alleged as 25,000 accounts and 28.8M Claude conversations—rather than relying on human engineers manually extracting design lessons.
- One technically relevant objection was attribution: because Alibaba operates major cloud infrastructure, traffic originating from Alibaba-associated networks or accounts does not necessarily prove Alibaba corporate teams performed the alleged distillation. Commenters compared this to seeing suspicious requests from AWS or Azure IP ranges, which may indicate customer activity rather than action by Amazon or Microsoft themselves.
- A recurring implementation/security point was that if the interactions occurred through paid Claude access and within apparent API mechanics, Anthropic’s complaint may expose weaknesses in abuse detection, account-linking, rate limits, ToS enforcement, or anti-distillation controls. One commenter summarized this as: “they got paid and the API was used according to the TOS?”—suggesting the issue may be more about platform controls than unauthorized access.
Demis Hassabis shared a rare essay on X: AGI is few years away, we're in the singularity foothills, proposes US-led Frontier AI Standards Body with eventual mandatory safety testing (Activity: 899): Demis Hassabis’ essay argues AGI is plausibly “a few years away” and frames the current period as the “foothills of the singularity,” with potential impact on the order of 10× the Industrial Revolution at 10× the speed. He proposes a US-led Frontier AI Standards Body—analogous to FINRA—to evaluate frontier models, initially via voluntary pre-release safety testing that could become mandatory for major “Frontier Labs,” applying to both open and closed models and focusing on risks such as cybersecurity, biology, and autonomous agents (essay on X). Commenters were more trusting of Hassabis’ timelines than those from Altman/Dario/Musk, but skeptical that model/code regulation is enforceable—especially against open-source or Chinese frontier models. Others noted real-world cyber impacts already appear dual-use, improving defense while raising attacker sophistication, and questioned whether a US-led standards body is geopolitically credible given current US posture toward international institutions.
- Commenters questioned the feasibility of regulating frontier AI models or code, comparing it to the difficulty of regulating Bitcoin. One technical concern was that even if U.S. or Western labs submit to mandatory testing, China could continue releasing increasingly capable open-source models that are cheaper and close enough to frontier performance to attract global users.
- A cybersecurity-related comment noted that AI is producing a dual-use effect in banking security: it has materially improved defensive capabilities while also increasing attacker sophistication. The commenter described a shift from mostly basic attacks toward more complex AI-assisted intrusion attempts, suggesting that frontier AI governance may need to account for rapidly improving cyber-offense capabilities.
- Several commenters challenged the proposed U.S.-led Frontier AI Standards Body, arguing that international coordination failure is a major unresolved technical-policy risk. They highlighted problems such as China refusing to participate, labs secretly accelerating despite agreed slowdowns, and the essay’s limited treatment of power concentration, inequality, and job displacement as consequences of AGI deployment.

2. AI Hardware Companions and Ambient Robots

NEW LEAK: OpenAI’s First Device Will Be Moveable, Screenless Speaker Built as AI Companion (Activity: 764): A reported leak claims OpenAI’s first hardware product is a moveable, screenless smart-speaker-like AI companion with onboard camera/sensors for environmental context, designed around personality, humanlike interaction, and productivity rather than a traditional display UI. The Bloomberg source itself was not accessible in the provided scrape due to a bot-detection page, so the details remain unverified from the linked article content. Top comments were skeptical, framing the device as essentially “reinvented Alexa” with added surveillance concerns due to the camera/sensor stack. Several commenters joked about uncomfortable camera placement/use cases, reflecting distrust of an always-present AI companion in private spaces.
- One commenter highlighted a concrete assistive-tech use case: a moveable AI speaker with a camera-enabled variant could materially help visually impaired users by providing environmental description, object recognition, and navigation-style assistance. They noted surprise that more consumer AI hardware is not explicitly targeting disability/accessibility markets, suggesting current product strategy may be limited by perceived market size rather than technical feasibility.
Keio University made these soft, helium-filled flying robots; they can follow you, wake you up, remind you of stuff, and even be your study buddy (Activity: 1975): The post highlights Keio University soft, helium-filled indoor flying robots—apparently blimp-like “airwhales”—intended for lightweight human-assistance/HRI tasks such as following a user, alarms/wake-up prompts, reminders, and acting as a study companion. The linked Reddit video could not be accessed because Reddit returned 403 Forbidden (v.redd.it); only the preview image is available (preview). Top comments were mostly nontechnical: users joked that the robots might be amusing but not broadly useful, attractive to cats, and potentially problematic around hazards like automatic revolving doors.

3. AI Cost Controls in Real Deployments

Well it finally happened: we’re not using models because of cost (Activity: 1537): A Fortune 500 “AI-first” org that had broadly deployed GitHub Copilot and Claude, with year-long internal training/demos, is now reducing access—Claude removed, usage limited, demos/training stopped—primarily due to cost controls, with architects recommending older/cheaper models. The flagship pilot—using agents to reverse-engineer a legacy application into an “as-written” business-rule specification for a rewrite—failed because agents repeatedly missed subtle code-path details, and day-to-day use showed reliability issues such as generated SQL attempting to DROP constraints around insert/delete logic. A top technical comment attributes the budget shock partly to Copilot’s shift toward metered “premium request” / usage-based pricing (GitHub Docs). Commenters debate whether this is a structural blocker or a transient phase: one view is that AI is currently in a “sour spot” where capability is near-useful but not dependable enough for complex enterprise workflows while inference/subagent costs remain high; another asks whether the company would resume “AI-first” prioritization if costs fell.
- Several commenters framed the issue as a pricing-model shift rather than a capability failure: GitHub Copilot moving to usage-based pricing reportedly made large organizations re-evaluate AI spend because previously hidden or fixed costs became variable and attributable to heavy usage.
- A technical cost-performance theme was that current models are in a “sour spot”: capabilities are close to being broadly useful, but workflows with intense subagent use can multiply inference calls and make deployments expensive. One commenter argued this may be temporary as model capability per dollar improves, eventually making AI use a financial “no-brainer” for many tasks.
- Another commenter argued that expensive frontier models do not imply AI is overhyped: organizations can stay on older, cheaper models, and high prices for new models suggest buyers perceive meaningful performance gains rather than “flat performance.” They compared this to historical compute trends where “one year’s cutting edge is the next year’s bargain bin,” implying today’s premium models may quickly become commodity-priced as newer models arrive.
Claude spent +15 EUR of a 2 EUR limit. (Activity: 1861): The image shows a Claude “Usage credits” billing/limit screen where a configured €2.00 monthly spend limit was exceeded to €13.79, displayed as 690% used, with auto-reload off and current balance €0.00 (image). In context, the post alleges a single summarization request was allowed to complete and bill far beyond the user’s remaining credits/limit, implying the spend cap may function as a soft limit rather than a hard real-time cutoff. Commenters report similar behavior, suggesting Claude may finish an in-progress turn and charge the full amount even after limits are exceeded. Some frame this as potentially unlawful or deceptive if refunds are denied, while others call it “scummy behavior.”
- Multiple users report Anthropic API spend limits/credit controls not acting as hard caps: one user says a £15 balance was consumed despite usage credits being turned off, while another reports a $1 limit resulting in $42 of charges before detection. A commenter hypothesizes the system may “always finish the turn” and bill the full in-flight request even after the configured limit is exceeded, implying spend limits may be enforced only after request completion rather than pre-authorizing against remaining budget.
- Users describe refund/support failures after limit overruns, with one commenter claiming support refused to refund the $41 overage beyond a $1 limit. The discussion frames this as a risk for API-only workflows with fixed monthly allocations, e.g. budgeting $200 for “fable” usage but potentially receiving much larger actual charges if limits are soft rather than hard.

not much happened today

Tue, 14 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/13/2026-7/14/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

Coding Agents, Harnesses, and the Shift From Chat to Execution

OpenAI’s agent products are seeing unusually strong pull: @sama said usage of Codex + ChatGPT Work grew 2.5x in a week, later adding that GPT-5.6 Sol demand is “insane” and may cause scaling hiccups while infra catches up (1, 2). The ecosystem response was immediate: JetBrains made Codex its recommended agent, @theo highlighted Codex’s underexposed “question tool”, and OpenAI’s own team showed command-line eval tooling built start-to-finish with GPT-5.6. Product-side, OpenAI also ran multiple usage resets, amplified by @reach_vb and users like @kimmonismus.
Harness quality and observability are becoming a first-class differentiator: several tweets converged on the idea that model quality alone is no longer enough. @swyx warned that stale agents.md instructions can act like self-inflicted prompt injection, causing multi-hour stalls in long-running tasks. LangChain added tracing for Codex and later expanded to Cursor, Copilot, Pi, and OpenCode in LangSmith, exposing tool calls, subagents, and token usage. @Teknium shipped Hermes updates to parallelize any subset of tool calls and previously exposed banked resets directly in Hermes Agent. The meta-point was stated crisply by @andykonwinski: companies that can encode their value into evals and environments may gain a more durable edge than those relying on capital or raw scale alone.

Open Models, Quantization, and Local Inference Compression

Aggressive compression is bringing frontier-adjacent models onto consumer devices: PrismML released Bonsai 27B, based on Qwen 3.6 27B, in two compact variants: Ternary Bonsai 27B at 5.9 GB / 1.71 effective bits and 1-bit Bonsai 27B at 3.9 GB / 1.125 effective bits, both under Apache 2.0. The claim is notable not just for size, but for preserving multimodal, tool-using, long-context agentic workflows locally; a demo shows Hermes running it on an RTX 5090, while Locally AI highlighted phone deployment. In parallel, Tencent Hunyuan released 1-bit and 4-bit Hy3, describing a 295B flagship-scale model that can be served on a single GPU via llama.cpp with MTP enabled.
Quantization and edge deployment continue to broaden the open-model operating envelope: @danielhanchen announced NVFP4 dynamic quants across the Gemma-4 family and additional large models including Qwen3.5-122B-A10B and GLM-4.7-Flash. @MiaAI_lab’s DGX Spark thread sketched practical multi-node local deployments, including 1M-context DeepSeek v4 Flash and MiMo-V2.5 on 2× DGX Sparks, and GLM 5.2 NVFP4 across four. The common theme across these posts is that local inference is no longer just a toy path: it is becoming viable for serious agentic workflows, especially when paired with low-bit weight formats and optimized harnesses.

Multimodal and World-Model Systems: Video, Realtime VLMs, and Motion

Realtime multimodal interaction is moving from “watch then answer” to continuous perception: OpenMOSS released MOSS-VL-Realtime, an 11B vision-language family under Apache 2.0 with 256K context, designed for continuous video streams. Its key systems property is that it can keep watching while generating, revise or interrupt answers as scenes change, and remain silent when evidence is insufficient. A companion technical thread from @Open_MOSS emphasizes a cross-attention architecture, XRoPE for unified temporal-spatial positioning, and unified templates across offline/streaming/realtime settings.
Long-video understanding is increasingly framed as active evidence search, not passive frame ingestion: a dense summary from @ZhihuFrontier described OmniAgent, built on Qwen2.5-Omni-7B, which uses an Observation–Thought–Action loop to request only the frames/audio it needs. On LVBench, OmniAgent-7B reportedly scored 50.5, beating Qwen2.5-VL-72B at 47.3, while consuming only ~203 frames vs 768. The training recipe is also notable: passive SFT hurt performance, while 58K agentic trajectories and entropy-weighted RL via TAURA improved it. The larger research pattern here aligns with Andrew Carr’s note that motion is a fundamentally novel data type requiring dedicated collection, infra, and model treatment rather than being reduced to images-with-time.
Open world models are inching toward interactive, longer-horizon simulation: @RekaAILabs outlined the data stack behind omni world models, stressing petabytes of video, 6 pipeline stages, and the doubled payoff from data-quality improvements when models both generate and understand video. @omarsar0 summarized LingBot-World 2.0 as one of the first open releases claiming hour-scale, 720p/60fps interactive generation, though still without long-term memory. On the application side, PixVerse Game was highlighted as pursuing the harder problem of real-time interactive video response rather than canned game-like clips.

Research Infrastructure, Benchmarks, and Evaluation Methodology

Perplexity open-sourced WANDR, a benchmark for wide-and-deep agentic research: @perplexity_ai described WANDR as a 500-task benchmark built from de-identified production research tasks, requiring 170,495 source-backed records across multiple difficulty tiers. Rather than grading against a static gold set, WANDR re-fetches cited pages and checks claims against underlying evidence, which better matches dynamic web research. @AravSrinivas framed this as the internal benchmark behind Perplexity Computer’s deep-and-wide research harness, while @denisyarats emphasized its additional role as an RL environment synthesized from production traces.
Eval design is getting more adversarial and more realistic: Agent Arena highlighted work cutting system costs by 89% while matching the best static config’s accuracy, arguing that full system config > LLM routing alone. Relatedly, Google DeepMind work on model routing argued that routers should be judged not just by accuracy/cost but by behavioral differentiation among experts and stability under paraphrase; otherwise routing may be functionally meaningless. @HamelHusain’s automated evals post landed in a similar place: these systems can spot issues humans miss, but still lack enough domain taste and feedback loops to replace experts.
Benchmarks are expanding beyond one-shot SWE tasks toward degradation and search realism: mini-swe-agent marked one year while now powering multiple software benchmarks; SlopCodeBench was cited as measuring how agents erode codebases over sequential tasks rather than just solving one isolated issue. This broadens the benchmark surface from “can it solve a task?” to “can it avoid making the repository worse over time?”

Physical AI, Collective Intelligence, and Robotics

Sakana AI pushed collective intelligence from software into physical self-repairing systems: across multiple posts, Sakana introduced “Smart Cellular Bricks”, published in Nature Communications. The system consists of many identical cubes, each running a small neural network and communicating only with physical neighbors, yet able to infer global shape and detect damage without centralized control. A follow-up detail is especially notable: the cells can detect missing neighbors across six spatial directions with 95% accuracy and regrow target structures; in simulation, the method scaled to 18,000+ cubes (detail thread).
Physical autonomy is also showing up in much smaller form factors: @alextoussss posted a striking demo of an autonomous micro-drone achieving an air-to-air kill of a flying moth, framed as a step toward mosquito eradication. Separately, @fchollet highlighted Airtap, which turns SMS into a headless agentic execution layer for mobile apps, using text as the control plane and intervening only for authentication. These are different ends of the autonomy spectrum, but both point to interfaces where humans specify goals while systems handle embodied or semi-embodied execution.

Top tweets (by engagement)

OpenAI demand spike and product pull: @sama on GPT-5.6 Sol pricing/efficiency, 2.5x growth in Codex/Work usage, and “5.6 sol growth is insane” were the most consequential operator signals in the set.
Governance and lab politics: @BlackHC’s thread on DeepMind’s Pentagon contract and abandoned safeguards and Carole Cadwalladr amplifying it drew very high engagement. In parallel, Demis Hassabis’ AGI governance proposal, endorsed by @mustafasuleyman and @sama, was a major policy discussion node.
Notable open-model release: Bonsai 27B stood out as the strongest technically substantive open-model launch in the timeline, due to its combination of 27B scale, phone-class footprint, and Apache 2.0 licensing.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Chinese Open-Weight Models Gain Market Share

Chinese AI Models Seize OpenRouter’s Top Five as OpenAI and Google Vanish From the Top 10 (Activity: 637): The image is an OpenRouter “AI Model Rankings” dashboard showing monthly token-usage share, where Chinese models reportedly take the top five spots—DeepSeek V4 Flash, MiMo-V2.5, MiniMax M3, Hy3 preview, and DeepSeek V4 Pro—and seven of the top ten, while OpenAI and Google are absent from the top 10; the source ranking is OpenRouter’s own platform traffic, not global LLM usage. Technically, the significance is less about benchmark superiority and more about cost/performance and deployment economics: commenters frame OpenRouter as a practical routing/prototyping layer for testing cheaper open or semi-open models before deciding whether to self-host or keep paying API rates. Image Commenters emphasized that “it’s hard to compare benchmarks, but easy to compare bills,” arguing that models like DeepSeek V4 Flash and MiMo-V2.5 are attractive because they are “cheap and good enough,” sometimes cheaper via API than the electricity and hardware costs of self-hosting. There is also distrust of closed Western providers such as OpenAI and Anthropic due to pricing, model churn, and the possibility that preferred models may disappear or change unexpectedly.
- Several commenters framed OpenRouter as a practical model-evaluation layer: test multiple open-source models through the API, then either self-host the best fit or continue using OpenRouter if the unit economics are better. The main technical concern raised was vendor instability from OpenAI/Anthropic—models changing, becoming more expensive, or disappearing—making reproducibility and long-term deployment planning harder.
- A cost-focused thread argued that models like deepseek-v4-flash and mimo-v2.5 are cheap enough via hosted inference that self-hosting may cost more once electricity and hardware requirements are included. One commenter summarized the benchmarking-vs-cost tradeoff as: “It’s hard to compare benchmarks, but easy to compare bills.”
- Infrastructure economics were highlighted as a factor in Chinese model/API competitiveness: commenters noted that electricity costs in China are less than half of US costs, which can materially affect inference pricing at scale. The discussion contrasted this with expensive US regions such as California, where high power prices and constraints on new generation could make domestic data-center inference less competitive.
FT: Companies Turn to Chinese Open Weight Models to Cut Costs (Activity: 407): The post links to an FT story titled “Companies Turn to Chinese Open Weight Models to Cut Costs,” implying enterprise adoption of Chinese open-weight LLMs as a cost-reduction strategy versus proprietary/API-hosted Western models. However, the archived link (archive.ph/QzSyV) only returned a CAPTCHA/429 Too Many Requests, so no article-level specifics—model names, pricing deltas, benchmarks, deployment patterns, or licensing terms—are verifiable from the provided source. Commenters frame the trend as predictable after perceived restrictions/bans on other models, arguing that policy and IP pressure may push companies toward Chinese open-weight alternatives. There is also optimism that open models will improve rapidly over the next few years, with one commenter citing phone-scale capability as evidence of accelerating local inference potential.
- Several commenters framed the trend as a cost-structure problem for closed US frontier APIs, not an “AI bubble” broadly: companies that pushed heavy Anthropic/OpenAI-style token consumption are now reportedly asking employees to reduce usage after months of encouraging maximum adoption. One anecdote described internal incentives to use AI heavily despite unclear revenue impact, with the implication that token bills can become material operational spend before product-market fit is proven.
- A technical theme was optimism around open-weight model efficiency, especially for local or edge deployment. One commenter cited Gemma 4 as an example of models becoming strong enough to run on phones, arguing that open models could increasingly replace paid frontier API calls where latency, privacy, or cost constraints matter.
Source: the Trump administration and industry groups discussed streamlining US open model releases of equal or lesser capability to leading Chinese open models (Activity: 451): The post claims the Trump administration and AI industry groups discussed a policy/process to streamline U.S. releases of open-weight/open models whose capability is equal to or below leading Chinese open models, as a response to China’s increasingly competitive local LLM ecosystem. The linked source is not technically verifiable from the provided archive because archive.is/sANZ5 resolves to a CAPTCHA/security interstitial rather than the article content. Commenters debated whether U.S. labs would actually release open models competitive with Chinese systems, arguing that strong local models could cannibalize paid API/SaaS revenue. Others questioned claims about Chinese models as “Trojan horses” or containing CCP-exploitable backdoors, noting that if such backdoors were straightforward to implant and exploit, U.S. actors would likely already dominate open-weight model deployment.
- Several commenters argued that restrictions or bans on capable open-weight models would be technically unenforceable once weights are available globally: model files can be redistributed via torrents, physical drives, or mirrors, and enforcement would require controlling access to high-memory GPUs/workstations capable of running them. The discussion frames open weights as closer to general data distribution than a controllable service endpoint.
- A technical skepticism emerged around claims that Chinese open models could contain CCP-accessible “backdoors.” One commenter noted that if reliable model-weight backdoors were practical and exploitable in this way, U.S. labs would likely already be using similar techniques to dominate open-weight releases; another called such backdoors “unlikely at this point.”
- Commenters supported releasing U.S. open-weight models of equal or better quality as a competitive alternative to Chinese local models, especially for organizations that need on-prem deployment. One technical point highlighted Nvidia Nemotron as a positive example due to relatively transparent training data/process, while noting Nemotron 3 Ultra is strong but “not trained enough,” causing it to underperform relative to its parameter scale.
Zhipu founder backs open-source AI as global security debate intensifies (Activity: 298): Zhipu founder Tang Jie defended open-sourcing frontier AI in an internal memo, arguing that model security is better served by “transparency, broad participation, sharing, and oversight” than by restricting access, according to Business Standard. Zhipu has released GLM-5.2 under an open-source license for download and commercial use, while positioning future work around long-horizon tasks, autonomous agents, and self-training AI, amid broader policy debates involving OpenAI, Anthropic, cyber-risk, and national security controls. Comments were largely geopolitical and anti-monopoly in tone: users framed Chinese open-weight releases as a counterweight to closed US labs, while speculating that services like z.ai could face bans on security grounds.
- A commenter notes that Zhipu/Z.ai’s open-source stance may be market-driven rather than ideological, pointing out that the company was previously more closed before DeepSeek R1 shifted competitive pressure toward open flagship releases. They argue the strategy could reverse if investor incentives begin favoring closed models again, despite recent investor acceptance of dilution.
- One technically relevant user references prior experience with the GLM series, saying they have been a fan but that its coding-plan quality has historically been questionable. This suggests continued skepticism around Zhipu’s practical coding-agent performance even as its open-source positioning improves.

2. Local AI Inference: Compression, GPUs, and Game Engines

Compressed Version of Qwen-3.6-27B coming from PrismML - Khosla-Backed Startup Claims Breakthrough With Largest-Ever AI Model on an iPhone (Activity: 476): PrismML claims it compressed Alibaba’s open-weight Qwen 3.6 27B from roughly 54 GB to < 4 GB and can run it on an iPhone 17 Pro with all 27B parameters active, unlike sparse/on-device architectures such as Apple’s cited 20B-parameter model with only 1B–4B active. The company says the Caltech-derived, patent-licensed compression method preserves performance and enables on-device chat, reasoning, agents, and coding, with a downloadable release promised “next Tuesday,” though no benchmark numbers, tokens/sec, quantization details, accuracy deltas, or demo evidence are provided in the post. Top commenters are highly skeptical, calling the brain-synapse analogy technically meaningless and questioning the plausibility of <4 GB compression with no performance loss while computing all 27B parameters on an iPhone at usable speed. Several argue that credible claims should be accompanied by a live demo, benchmarks, or a technical blog rather than a hype article.
- Several commenters challenged the claim that a 27B model can be compressed to roughly 4GB and run all parameters on an iPhone at acceptable speed without major quality loss. One technical guess was that this would require something like 1-bit / ternary quantization or BitNet-style quantization; a Q1-level 27B model can land near the 4GB range, but commenters noted it is typically “very damaged compared to fp16.”
- A more detailed comment identified PrismML’s likely approach as its existing “1 bit” / ternary quantization, previously released for smaller Qwen models such as Bonsai-8B on Hugging Face. The commenter emphasized that prior PrismML benchmarks did not show near-original performance: their 8B quant reportedly performed worse than a BF16 4B, though better than 1.7B, implying the 27B version should not be expected to preserve full Qwen quality.
- The technically relevant benchmark framing suggested by commenters is not whether the compressed 27B matches the original model, but whether a 4GB ternary 27B outperforms a conventional 4GB 8B Q4 model. One commenter also noted that PrismML appears to be comparing against Qwen3, not newer Qwen 3.5 / 3.6, which affects how claims about relative model quality should be interpreted.
I benchmarked 15 "E-Waste" GPUs with Modern Workloads (Activity: 628): The author benchmarked decommissioned NVIDIA Tesla-class GPUs—K80/M10/M40/M60/P40/P100/V100/T40—using a custom Dockerized suite (gpu_box_benchmark) and custom cooling hardware, targeting LLMs, CV, Blender, Whisper, and related workloads; full graphs are in the blog post. Key findings: V100 16GB is the best overall value near <$200 and approaches T40 performance, P40 beats P100 for LLM inference, M60 is unusually strong for Whisper despite ~$50 pricing, and multi-GPU scaling was described as mostly linear within a 4U chassis, with mixed-generation LLM setups bottlenecking on slower cards. The author argues EOL/CUDA-era friction can often be worked around by compiling older software such as llama.cpp from source, and that cheap X99 Xeon platforms provide enough PCIe lanes/CPU throughput for these GPUs in homelab workloads. Top technical pushback focused on whether the benchmark set is sufficiently “modern”: commenters asked for larger contemporary LLMs such as Qwen 3.x 27B/35B MoE, pooled-VRAM tests across multiple V100/P40-class cards, and prompt-processing/token-generation numbers at long context lengths like 150k. Others questioned practical power efficiency and acoustics, noting these systems may only make sense if powered on for batch AI jobs—or if waste heat offsets winter heating.
- Several commenters argued the benchmark missed the key value proposition of old datacenter/mining cards: cheap pooled VRAM for larger contemporary LLMs. They requested tests with models like Qwen 3.6 27B/31B MoE/35B A3B at deep context lengths such as 150k ctx, reporting both prompt processing (PP) and token generation (TG) across multi-GPU configurations, especially on V100-class setups.
- There was technical pushback on workload selection: ResNet and very small models were called unrepresentative of “modern” GPU use, because they do not stress the VRAM-capacity advantage of e-waste GPUs. The suggested practical benchmark was whether larger Qwen-class models can run with pooled VRAM at usable speeds, rather than showing good performance on legacy or undersized workloads.
- One commenter noted the Tesla P100 should outperform the P40 unless a relevant fp32 optimization/patch changed the results, because the P100’s HBM bandwidth is roughly 3× higher than the P40’s memory bandwidth. Another added a data point for the P102-100 mining GPU: about $50, around 10 W idle, easy cooling, and roughly 40 tokens/s generation on Qwen 3.6 35B, but with very slow prompt processing at about 100.
I got Gemma 4 running directly inside Godot using only GDScript and Vulkan compute shaders (Activity: 428): The post demonstrates Gemma 4 (gemma-4-E2B-it-Q4_K_M.gguf) running fully inside Godot 4.7 using only GDScript + Vulkan compute shaders, with GDScript handling GGUF loading, tokenization, sampling, KV cache, and UI—no llama.cpp, Python, server, C bindings, or GDExtension. The image shows a Godot editor/debug chat UI generating at about 46.99 tok/s, notably answering that such an implementation would be “not realistic,” despite the project proving a constrained version works. The author notes it is experimental, supports only one model, and is roughly 10× slower than llama.cpp with CUDA; code is available on GitHub. Comments were mostly impressed, with one technical takeaway that the speed penalty is less important than the deployment model: a single Godot export with local inference avoids native-extension ABI issues and sidecar servers, making it plausible for portable local NPC demos.
- A technically substantive point is that even at ~10x slower performance, the implementation is valuable because it packages GGUF loading, KV cache management, and sampling entirely inside a single Godot export using GDScript/Vulkan compute, avoiding native-extension ABI issues or a separate llama.cpp/sidecar inference server. This could make local LLM-powered NPC demos much easier for end users to run.
- One commenter framed the main use case as embedded local generation for games, e.g. roguelike/roguelite systems that use an on-device LLM for more emergent randomness. The key technical appeal is removing the deployment burden of bundling or orchestrating an external inference runtime such as llama.cpp.

3. Kimi, DeepSeek, and GLM Release Watch

Kimi K3 in the next few hours. Deepseek V4 GA later in the week. New Liquid models. New Mistral models sometime this month. And some rumours suggest GLM 5.5 is coming in August. Openweight AI is eating good. (Activity: 573): The image is a screenshot amplifying rumors that Moonshot/Kimi K3 may launch imminently, following Kimi K2.6’s reported strengths in coding agents, long tool-using sessions, 256K context, vision, and low-cost large-scale sub-agent coordination. In context with the title/selftext, the post frames Kimi K3, DeepSeek V4 GA, new Liquid non-transformer models, upcoming Mistral releases, and possible GLM 5.5 as evidence that open-weight model capability and cost-performance are rapidly improving, while enterprise concerns shift toward governance/control layers rather than raw model intelligence. Commenters are enthusiastic but pragmatic: one user reports running local GLM 5.2 Q4 at only ~0.5 tok/s for multi-day codebase audits that still find useful bugs, while others argue the ecosystem especially needs strong models at 100B parameters and below—ideally not below 35B.
- A user reports running GLM 5.2 Q4 locally continuously on a workstation for whole-repository static-analysis style prompting: “Read all code in this project and analyze it for bugs.” Throughput is only about 0.5 tokens/sec, with a full run taking roughly 3.5 days, but each run reportedly returns 10–15 bug findings with only 1–2 hallucinations and at least one practically useful issue fixed per run.
- Several comments emphasize that current frontier open-weight releases are often impractical for enthusiasts because many are 0.5T+ parameter-class models requiring extreme hardware, e.g. multiple RTX PRO 6000-class GPUs or around 1TB ECC DDR5 for CPU/offload setups. Users specifically call for stronger models in the ≤100B range, with one commenter narrowing the useful local target to above 35B but under 100B rather than giant MoE/foundation-scale checkpoints.
👀A new GLM model incoming (Activity: 1043): The image is a non-technical teaser screenshot from X, not a benchmark or release note: Ivan Fioravanti says “GLM 5.3 is cooking” while quoting Z.ai / GLM founder Jie Tang’s hint that “5.2 could be better with more RL,” implying an upcoming GLM update likely focused on additional reinforcement learning/post-training. The Reddit post frames this as a possible successor to GLM 5.2, with speculation in comments about variants like GLM 5.3 Flash 20B and broader open-weight model releases; image: i.redd.it/6xkuthwho7dh1.jpeg. Commenters are broadly excited about a crowded open-weight release window, mentioning rumored or expected models such as Kimi K3, DeepSeek V4 GA, Liquid, Mistral, and possibly GLM 5.5. There is no substantive technical debate yet, mostly hype and speculation.
- Commenters expect a crowded open-weight release window: Kimi K3 reportedly “in the next few hours,” DeepSeek V4 GA later in the week, new Liquid models, new Mistral models this month, and rumors of GLM 5.5 in August. Another commenter speculates the incoming GLM could be GLM 5.3 Flash 20B, implying interest in a smaller/fast variant rather than another very large checkpoint.
- A technical concern is usability of frontier-scale open models on attainable hardware: one user asks for models that run at reasonable speed on <$100k hardware, rejecting 30 tok/s prompt processing and 5 tok/s token generation as insufficient. They propose roughly 1000 tok/s prompt processing and 40 tok/s generation as a practical target for real-world tasks, while others complain that 700GB models are unusable locally and ask for smaller models like a hypothetical Qwen 3.7 35B.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Frontier Models Solving Open Math & Physics Problems

Yuji Tachikawa, one of the world’s leading theoretical physicists, reports Claude Fable solved a problem that he and his collaborators had gotten stuck on for the past 6 months (Activity: 3554): Yuji Tachikawa, a leading mathematical/theoretical physicist, reportedly posted that Claude Fable helped solve a technical problem his group had been stuck on for ~6 months (original tweet). He later deleted the tweet not as a retraction, but because he disliked the attention it attracted (follow-up); no reproducible derivation, benchmark, or problem statement is included in the Reddit post, so the technical claim cannot be independently assessed from the linked discussion alone. Top comments debated evaluation standards for AI-assisted research: one commenter argued that dismissing the result because it was not solved “one shot” applies a stricter standard to LLMs than to humans, while another highlighted the significance of an LLM proposing speculative directions such as “I wonder if…” as potentially relevant to frontier reasoning beyond known results.
- One commenter frames Claude Fable’s contribution as notable because it appears to involve exploratory hypothesis generation rather than just executing a known procedure: they highlight the model saying “I wonder if…” as evidence of asking questions beyond the current solution path. The technical implication raised is that frontier LLMs may be moving toward a capability often cited as missing in AI-assisted research: proposing useful hypotheticals in domains where even experts are stuck.
Another 50+ year-old Erdős problem falls to GPT-5.6 (Activity: 1144): The post links to X threads by J. D. Lichtman, Przemysław Chojecki, and Sébastien Bubeck claiming GPT-5.6 solved another 50+ year-old Erdős problem. The Reddit body does not include the theorem statement, proof, benchmark setup, or verification details, so from the provided content the technically relevant takeaway is the claim of an LLM-assisted/LLM-generated proof rather than independently assessable mathematical evidence. Top comments mostly frame the result as a rebuttal to common LLM-skeptic claims like “just fancy autocorrect” or “just predicting the next word.” One substantive suggestion was to benchmark models on already-solved problems with long proofs to see whether they can discover shorter or simpler proofs, which would be useful even when the theorem is not new.
- A commenter raised a methodological question about AI-assisted theorem proving: how much of the result comes from the LLM versus expert human guidance. They specifically asked whether a non-expert prompter, e.g. a high school student unable to verify correctness, could still get the model to solve the problem reliably.
- Another technically relevant thread suggested benchmarking models on already-solved problems with long proofs to see whether systems like GPT-5.6 can produce materially shorter or simpler proofs. The commenter noted that this could be a useful way to evaluate mathematical creativity or proof compression, even if the practical significance is unclear.
- One commenter noted that Przemek Chojecki appears to be producing solutions to Erdős-style problems faster than they can be fully peer-checked, while Lichtman, described as a Stanford mathematician, reportedly thinks the approach is working. The key technical issue implied is verification throughput: AI-generated proofs may outpace expert validation, making independent checking and formalization important.

2. AI Data Extraction, Distillation & Privacy Incidents

Anthropic just told the US Senate that Alibaba ran 25,000 fake accounts and had 28.8 million conversations with Claude — not to use it, but to copy it (Activity: 2021): The post claims Anthropic told the U.S. Senate that Alibaba allegedly used 25,000 fake accounts to conduct 28.8M Claude API conversations over ~six weeks (April–June), not via hacking but by normal API access at industrial scale, to distill Claude’s agentic reasoning and coding capabilities into Qwen. Anthropic reportedly frames this as its largest “distillation attack,” larger than alleged activity by DeepSeek, Moonshot, and MiniMax combined, and the author argues the legal ambiguity explains why Anthropic sent a congressional letter rather than filing suit; they link a longer breakdown on YouTube: youtu.be/g1d3yTR6E2Y. Top comments largely reject Anthropic’s framing as hypocritical, arguing AI labs trained on public/creative output under fair-use theories and now object when their own model outputs are used similarly. One commenter frames mass distillation as analogous to competitive reverse engineering—e.g., automakers or Samsung buying a rival product to study it—while acknowledging the analogy is imperfect.
- Commenters drew a technical/legal analogy between model distillation via API outputs and conventional competitive reverse engineering, e.g. buying a competitor’s car or phone and studying it to improve an internal product. The implied technical question is whether using Claude-generated outputs as supervised training data is materially different from engineers learning from a competitor’s product behavior.
- One technically relevant caveat raised was attribution: because Alibaba operates cloud infrastructure, suspicious traffic originating from Alibaba-owned IP ranges or accounts may not prove that Alibaba itself performed the alleged distillation. The commenter compared it to seeing abusive or unusual requests from AWS or Azure, which often implicates customers using the platform rather than Amazon or Microsoft directly.
- Another thread framed the incident as an API governance failure: if the 25,000 accounts and 28.8 million Claude conversations were paid API usage and not blocked earlier, commenters questioned whether Anthropic’s enforcement, anomaly detection, rate limits, or ToS controls were sufficient to prevent large-scale extraction-like usage.
grok build was uploading whole directories to google bucket (Activity: 1074): The image is a screenshot of a claim by International Cyber Digest alleging that xAI’s Grok Build CLI uploaded whole Git repositories—including private code and unredacted secrets—to a Google Cloud Storage bucket. The post claims a 12 GB test repository caused 5.1 GB of uploads, that the behavior was later disabled via a hidden server-side flag, and that the “Improve the model” opt-out allegedly did not prevent the upload; no independent technical evidence is provided in the Reddit excerpt. The comments shown are non-technical and mostly express broad hostility or distrust toward Grok/xAI/Musk rather than debating the implementation or evidence.

3. AI Coding Agents: Workflows, Costs & Reliability Limits

Fable + 5.6 is absolute peak (Activity: 1306): The post describes a shell-scripted agent workflow (TRIP-workflow) where Fable acts as a high-level orchestrator rather than primary code generator: it plans, has 5.6 Sol review plans in an approval loop, delegates implementation to 5.6 Luna via Codex/Claude-code-style CLI background workers with persistent threads, then reads diffs, patches issues, runs tests, and handles release tasks such as changelog/tag/merge. The author emphasizes the stack is “just bash around codex cli” with no MCP/framework/agent swarm, and recommends users clone the repo and have an agent explain/review it before trusting it. Top comments discuss using adversarial multi-model workflows: giving both Fable and Sol 5.6 xhigh the same problem statement, letting one design/execute while the other critiques at checkpoints, sometimes with a scorekeeping loop. Others ask for concrete cost/quality comparisons versus Fable alone, thinking-setting choices, and suggest evaluating an omp harness for this kind of orchestration.
- Several commenters describe a multi-model adversarial workflow: give both Fable and Sol 5.6 xhigh the same problem statement and goal, let each produce a design, then allow the winning design to execute while the losing model performs checkpoint reviews and teardown. One user reports a similar validation pattern where Codex reviews Fable-generated plans and often finds “something crucial missing,” suggesting Fable may need external critique for planning reliability.
- A commenter recommends using the omp harness for this kind of model-vs-model orchestration, implying there are existing harnesses better suited than ad hoc scripts for evaluating or coordinating multi-agent/model workflows.
- One user open-sourced a lightweight orchestration daemon, jinn, intended to replace brittle bash glue for Claude Code + Codex workflows. It provides persistent sessions, cross-engine messages, a shared facts file, cron, and YAML personas, but deliberately avoids implementing its own agent loop: *“A bus not a brain, the CLIs still do all the thinking.”
[WARNING] Avoid using 5.6 Sol. It can get you banned for even the most harmless task. Used it once for a legitimate Excel task, got flagged for a “cybersecurity threat,” appeal was rejected within 2h. (Activity: 952): A user reports that a single benign Sol 5.6 task—generating an Excel workbook for rental-property accounting—triggered a “cybersecurity threat” flag and warning despite the prompt containing only spreadsheet requirements: monthly utility/rent accounting, printable statements, cash-flow tracking, room-level over/underpayment carry-forward, and capital vs. utility fund separation. During Sol’s Excel workflow it apparently generated/reran code, hit an exception resembling “Could not get source, probably due to dynamically evaluated source code”, then still produced the workbook after review; the user’s appeal was rejected within ~2h. Commenters largely treat this as a likely false positive in OpenAI’s automated safety/appeals pipeline; one notes OpenAI staff monitor the subreddit and may be able to manually investigate, while the OP argues the appeal process appears AI-mediated and ineffective.
- A commenter shared the full prompt that allegedly triggered the ban: a benign request to generate a multi-sheet Excel workbook for rental-property accounting, including monthly utility allocation, tenant over/underpayment carry-forward, printable statements, and separate capital/utilities cash-flow tracking. The technically relevant detail is that the task likely required workbook generation and formulas/tables, which may have caused the model to invoke a code-execution or file-generation path despite no explicit cybersecurity content.
- One user hypothesized that GPT-5.6 Sol may have executed code in a cloud sandbox from the ChatGPT client, and that this sandbox activity—not the natural-language prompt itself—could have tripped automated cybersecurity classifiers. They contrasted this with the Codex client, suggesting the same task might not cause the same enforcement issue there because the execution environment or policy pipeline may differ.
Well it finally happened: we’re not using models because of cost (Activity: 849): A Fortune 500 “AI First” org reportedly pulled back from broad Claude/Copilot usage after a failed agentic pilot to reverse-engineer a legacy application into a formal specification: agents repeatedly missed subtle business rules and produced unreliable specs, while day-to-day codegen showed correctness/safety issues such as generated SQL that dropped constraints around DML paths. The company has stopped AI training/demos, removed Claude access, and is asking teams to limit usage or use older/cheaper models, with commenters noting Copilot’s move to usage-based pricing as a likely trigger for cost visibility in large enterprises. Commenters split between seeing this as evidence that current LLM ROI is poor for complex software modernization, versus a temporary “sour spot” where capability is almost useful but still too expensive—especially for agent/subagent-heavy workflows. One commenter asked whether the company would resume an AI-first posture if inference costs drop substantially.
- Several commenters identify usage-based pricing for GitHub Copilot as the trigger that made large organizations re-evaluate AI tooling costs. The implication is that predictable per-seat licensing masked consumption risk, while metered billing exposes high-volume inference and agent workflows as a material operating expense.
- One technical cost concern is that AI workflows with intense subagent use can multiply inference calls, making otherwise useful models financially unattractive before capability-per-dollar improves. A commenter argues this may be temporary as models improve and become cheaper “per unit of intelligence,” but that current systems sit in a “sour spot” where they are close to useful yet still expensive at scale.
- A commenter from a very large company claims every AI project failed or was abandoned, not necessarily due to model access limits but because teams did not want to maintain the generated “slop.” The technical takeaway is that AI adoption cost includes downstream maintenance, code quality review, and operational ownership—not just token or subscription spend.

AI Discords

Unfortunately, Discord shut down our access today. We will not bring it back in this form but we will be shipping the new AINews soon. Thanks for reading to here, it was a good run.

not much happened today

Mon, 13 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/11/2026-7/13/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

Agent RL Infrastructure: Prime Intellect’s Verifiers v1 and Long-Horizon Rollouts

Prime Intellect’s verifiers v1: Prime Intellect released verifiers v1, a substantial redesign of its environment stack for agentic RL and evals. The key abstraction splits environments into a taskset, harness, and runtime, explicitly supporting “bring your own harness” workflows for coding and computer-use agents across heterogeneous execution setups, as highlighted by Johannes Hage and in a follow-up deep dive. The release was framed by team members as months of infra modernization work with major efficiency gains, including richer commentary from willccbb, mikasenghaas, and xeophon.
Why it matters technically: one of the most important underlying changes is that rollout traces are now stored as message DAGs, so each message is stored once instead of repeatedly copied into full histories; that shifts trace growth from O(n²) to O(n) in turn count, making long-horizon multimodal rollouts and router replay much more practical, per Prime Intellect. The team also claimed a concrete training configuration: a 100B reasoning model, on 40-turn SWE agent tasks, in a user-supplied coding harness, for 1000 RL steps, using 6 H200 nodes in under 2 days (willccbb). That claim was reinforced by ecosystem support from vLLM, which noted verifiers’ rollout path runs on vLLM with exact token IDs/logprobs to avoid tokenization drift between serving and training.

Coding Agents, Harness Design, and Cost-Per-Task Competition

Harnesses are becoming the product surface: several posts converged on the idea that model quality is no longer the only differentiator; the harness/orchestrator increasingly determines outcomes. threepointone’s talk was summarized as “the harness is the app,” while LangChain argued that winning agent products will come from task-specialized harnesses, not generic wrappers. Factory pushed a related UI angle with “design mode,” where users point at UI elements/files instead of verbally re-specifying edits. On the orchestration side, omarsar0 emphasized provider-switching across models as a hedge against pricing/policy churn.
Benchmarks are moving from token price to cost per task: skirano built a coding-agent index explorer and found notable cost/perf tradeoffs such as Terra Max slightly ahead of Fable 5 Max on score for materially lower cost, while Cognition reported that Devin Fusion now uses Fable 5 and that, surprisingly, it can be lower cost per task than Opus 4.8 because stronger delegation and judgment reduce unnecessary work. imjaredz highlighted the key stat from those experiments: in 81% of Fable-led runs, the lead model never makes a code edit, implying expensive models can be cheaper when they avoid wasted actions.
Real-world agent benchmarks are getting denser: Arena placed GPT-5.6 Sol at #2 on its agent leaderboard based on 7.8K real-world agentic sessions, with strong steerability and task success; later, Arena put Grok-4.5 at #13, a significant jump over Grok 4.3. Artificial Analysis also emphasized cost per task as an increasingly important metric for long-horizon knowledge work, arguing token pricing alone misses effects from turns, verbosity, and cache hit rates. Separate evaluation work from Parlance Labs compared automated eval platforms and foundation models on failure analysis over production voice-agent traces, while dair.ai highlighted a paper on the anatomy of CLI coding-agent failures, focusing on where runs become unrecoverable rather than only final pass/fail.

OpenAI GPT-5.6 Sol, Codex Usage Fixes, and Product Surface Expansion

OpenAI addressed Codex/Sol usage burn transparently: the biggest operational thread came from thsottiaux, who explained several fixes for GPT-5.6 Sol in ChatGPT Work/Codex: inference optimizations yielding roughly 10% more usage, a rollback of context limit from 372k to 272k after billing/usage side effects, reversion of some experimental reasoning-effort (“juice”) changes, and fixes for overactive multi-agent behavior at high/xhigh settings. Community reverse-engineering from theo proposed that compounding factors around long context, subagent spawning, and fast mode were behind the severe burn, though he later corrected one billing detail in a follow-up. Reactions split between criticism of a perceived “nerf” narrative (ns123abc) and praise for unusual transparency (theo, sama).
Users are reporting strong coding/computer-use capability: multiple practitioners argued that OpenAI has taken the lead on coding models, including schrockn, while gdb repeatedly showcased ChatGPT Work and Codex workflows for startup prospecting, web design, mobile work, and site generation. Particularly illustrative user demos included Star_Knight12 using Sol in Cursor to set up Blender MCP and render a floating MacBook without prior Blender experience, and petergostev showing GPT-5.6 Sol Ultra building a Doom-like game in SQL.
Product-level expansion continues: ChatGPTapp announced ChatGPT’s return to WhatsApp in the EEA, plus Kakao/Viber support in additional markets. OpenAIDevs opened submissions for OpenAI Build Week. Across the OpenAI ecosystem, gdb summarized the moment succinctly: “you can just create things.”

Open Models, Inference Systems, and Quantization

Transformers↔vLLM integration removes duplicated model implementation work: Clement Delangue highlighted a major open-inference usability improvement: Hugging Face Transformers models can now run in vLLM at native speed, often matching or exceeding hand-written implementations. If this generalizes broadly, it reduces the long-standing burden of implementing each new architecture twice—once for research/training and once for high-performance serving—and could materially accelerate adoption of new open model architectures.
Quantization remains a major lever: waterloo_intern previewed a new quantization method claimed to beat existing approaches, including NVIDIA’s ModelOpt, by finding better layerwise precision assignments faster, with more aggressive quantization and higher benchmark scores. Complementing that, Unsloth published an AWS guide to LLM quantization and deployment spanning GGUF, NVFP4, and FP8. There was also practitioner commentary around fp4 RL / fp4 serving from nrehiew_, arguing low-bit post-training may enable cheap serving with limited quality loss.
GLM-5.2 and local/open coding stacks continue to gain traction: several users described moving real workflows onto open or semi-open setups. juanjucm wrote up using GLM-5.2 for coding-agent workflows, while TheZachMueller reported migrating one actual work pipeline from Claude to a stack built around GLM 5.2 NVFP4 plus Kimi K2.7 Code NVFP4 on an 8xB200 node, getting denser reports for pennies albeit at slower wall-clock latency. nutlope also released LlamaCoder v4, rebuilt around GLM 5.2.

Security, Privacy, and Data Control in Agent Tooling

Grok Build code upload controversy: the most consequential security story came from IntCyberDigest and hrkrshnn, who alleged that xAI’s Grok Build CLI was uploading entire repositories—including private code and secrets—to a Google Cloud bucket, far beyond what was needed for the coding task. The criticism centered on scope, silent server-side mitigation, and unclear retention/deletion guarantees. This triggered broader discussion about what agent tools actually transmit and why opt-out UX can diverge from wire-level behavior.
xAI’s response emphasized ZDR and privacy controls: SpaceXAI replied that for teams using zero data retention, trace and code data is not retained, API key use respects ZDR, and the /privacy command can disable retention and delete previously synced data. That answered some operational questions but did not fully resolve community concern around default behavior, prior uploads, and disclosure norms.
Trust boundaries are becoming a central open-vs-closed argument: several posts extended the conversation beyond this incident. mchiang0610 and jmorgan argued that open models are not just about cost but about control over the human-AI learning loop and keeping institutional knowledge in-house. Arav Srinivas said ZDR availability was one reason Perplexity integrated Grok 4.5 quickly into its Computer harness.

Continual Learning, Multimodal Systems, and Research Directions

Continual learning is re-emerging as a first-class systems problem: ysu_nlp argued that a world where every organization owns its own human-AI learning loop depends on solving continual learning, and that current approaches—memory/RAG, domain post-training, task RL—are not yet sufficient. That theme recurred in new work from skyfallai, which introduced Morpheus, described as a persistent enterprise simulation for real-world RL where the world does not reset; fchollet endorsed it as a benchmark better aligned with real deployment than stationary episodic RL.
“Sleep and dreaming” for LLMs: behrouz_ali and coauthors proposed that LLMs may need a sleep phase to consolidate short-term into long-term memory plus a dreaming phase for recursive self-improvement, introducing Knowledge Seeding and reporting benefits on continual learning/reasoning tasks. This dovetails with broader dissatisfaction around current continual-learning recipes and with Oak Lab, the new venture from Rich Sutton and collaborators pursuing animal-like intelligence that learns from experience rather than today’s standard LLM pipeline.
A broad spread of non-LLM-agent research shipped: notable items included Sakana AI’s Smart Cellular Bricks for decentralized physical self-recognition and repair in modular systems; ByteDance’s UniVR-34B, described as learning reasoning/dynamics/planning directly from visual demonstrations; Google DeepMind’s Predicting the Past skill for historical inference workflows; and Anthropic’s research on how Claude’s expressed values vary across models and languages based on analysis of 300K+ anonymized conversations.

Top tweets (by engagement)

OpenAI Codex/Sol usage fixes: thsottiaux on GPT-5.6 Sol usage, context, “juice,” and multi-agent fixes
Grok Build privacy incident: IntCyberDigest on full-repo uploads to xAI cloud buckets
OpenAI response tone and user treatment: sama: “come for the best model, stay because we don’t treat you with contempt”
Prime Intellect rollout efficiency: willccbb on training a 100B reasoning model for 40-turn SWE RL on 6 H200s in under 2 days
Anthropic values research: Anthropic on model/language-dependent value expression across 300K+ conversations
Transformers + vLLM interoperability: Clement Delangue on running Transformers models in vLLM at native speed

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. E-Waste GPU Inference Benchmarks and Fixes

I benchmarked 15 "E-Waste" GPUs with Modern Workloads (Activity: 462): A year-long homelab benchmark tested decommissioned NVIDIA Tesla GPUs (K80/M10/M40/M60/P40/P100/V100/T40) using a custom Dockerized suite (gpu_box_benchmark) across LLMs, CV, Blender, Whisper, and related workloads, with full graphs on the author’s blog. Key findings: V100 16GB was the best overall value and approached T40 performance, P40 outperformed P100 for LLMs, M60 was unexpectedly strong for Whisper, multi-GPU scaling was roughly linear in a 4U chassis, and cheap X99 + Xeon platforms generally fed the cards adequately despite EOL software/power-efficiency caveats. Commenters questioned whether the benchmark really targets “modern” workloads, arguing that small models and ResNet-style tests do not exercise the main value proposition: cheap pooled VRAM for larger models. Requested follow-ups included power/noise measurements and LLM serving metrics such as prompt processing/token generation at long context lengths for models like Qwen 3.x 27B/35B MoE across multiple V100/P40-class cards.
- Several commenters argued the benchmark suite did not represent current high-VRAM use cases: ResNet and small models were described as insufficient for evaluating “cheap VRAM” GPUs. They requested tests with larger modern LLMs such as Qwen 3.6 27B/31B MoE/35B A3B, including whether pooled VRAM configurations can run them, and asked for prompt-processing (PP) and token-generation (TG) throughput at long context lengths such as 150k ctx.
- A technical correction noted that the Tesla P100 should normally outperform the Tesla P40 unless a relevant fp32 patch has changed behavior, because the P100’s HBM bandwidth is roughly 3× higher than the P40’s memory bandwidth. This implies memory-bound workloads may be misrepresented if the benchmark shows the P40 ahead without explaining software/kernel differences.
- One commenter suggested adding the P102-100 mining GPU, which is currently available around $50, has relatively low idle power around 10 W, and is reportedly easy to cool. They claimed it reaches about 40 tokens/s generation on Qwen 3.6 35B, but with very slow prompt processing at around 100 tokens/s, making it an interesting but bottlenecked e-waste inference option.
Your $80 Tesla P100 has been doing silently noisy math in llama.cpp for years. Three lines fix it, for free. (Activity: 426): A 3-line CUDA arch-gating patch for llama.cpp/turboquant changes sm_60 Tesla P100 handling to match the existing sm_61 Pascal exemption, avoiding a "fast fp16" path that reportedly increased logit noise without improving throughput; released in llama-cpp-turboquant v0.3.0, merged in TheTom/llama-cpp-turboquant#212 and spiritbuun/buun-llama-cpp#80, with upstream tracking in ggml-org/llama.cpp#25593. The author reports, vs fp32-reference logits on Qwen3.6-27B / WikiText-2, median KLD improving from 0.0023 to 0.000001 (~2300×) and top-token agreement from 96.5% to 99.9%, with prefill unchanged and decode ~1.4% faster at 8k context; a commenter independently patched a P100 and saw mean KLD 0.0122 → 0.000000 and top-token match 95.09% → 99.997%. The claimed scope is specifically Pascal sm_60 P100: GTX 10-series/P40 sm_61 were already exempt, while Volta+ use different kernels and are claimed unaffected, with a Blackwell control reportedly showing bit-identical perplexity/decode behavior. Comments were mostly supportive, framing this as a small but meaningful correctness fix; one commenter used an LLM to decode the technical claim and concluded it was plausibly a real accuracy improvement with no practical speed cost.
- A commenter tested the patch and reported a large numerical-accuracy improvement on Tesla P100: stock llama.cpp CUDA produced mean KLD = 0.0122 with 95.09% same top-token, while the patched/control path produced mean KLD = 0.000000 with 99.997% same top-token. This supports the claim that disabling the fp16 fast-math path for sm_60 removes distribution-level noise without changing model behavior unpredictably.
- Another commenter summarized the technical mechanism: llama.cpp’s CUDA backend enables a fast fp16 math mode for GPUs classified as having strong fp16 throughput; sm_61 cards like GTX 10-series/P40 were already excluded, but sm_60 P100 was not. The claim is that P100’s real-world inference is memory/GEMM-bound rather than fp16-vector-unit-bound, so the fp16 path adds quantization-like numerical error without measurable speedup; the proposed 3-line patch reportedly cuts KL divergence vs fp32 by about 2300x with no speed loss.
- One P100 user with a 3x P100 setup planned to test the patch in their llama.cpp build and mentioned prior experimentation with Qwen 3 27B, quantization behavior, and MTP. This suggests interest in validating whether the fix generalizes across multi-GPU P100 inference and different quantization/model configurations.

2. Chinese AI Stack: Usage, Weights, Chips

China's DeepSeek developing its own AI chip, sources say (Activity: 576): Sources reportedly say DeepSeek is developing an in-house AI accelerator, likely as a response to restricted access to Nvidia GPUs in China and the need for domestic training/inference hardware. The key technical constraint raised in comments is not just chip design but access to leading-edge semiconductor manufacturing; one quoted view argues “Nvidia is at zero in China” while DeepSeek has little chance outside China without advanced fabs. Commenters were broadly pro-competition, but one technical take argued that a high-memory consumer accelerator—e.g. >32GB VRAM and >1TB/s bandwidth under $5k—would sell even if inefficient or built from awkward memory configurations.
- One commenter highlighted the manufacturing and market-access constraint: without access to leading-edge fabs, DeepSeek would likely struggle to sell competitive AI silicon outside China, while Nvidia’s position in China is described as effectively constrained by export controls. Another technical angle was consumer demand for high-memory-bandwidth accelerators: a hypothetical card with >32GB memory and >1TB/s bandwidth under $5k was argued to be attractive even if implemented inefficiently, e.g. with many DDR channels and ~800W power draw.
Chinese AI Models Seize OpenRouter’s Top Five as OpenAI and Google Vanish From the Top 10 (Activity: 561): The image is a technical dashboard screenshot of OpenRouter’s AI Model Rankings, showing monthly token-usage share where Chinese-affiliated models occupy the top five positions and 7/10 of the displayed top 10. The chart shows OpenRouter usage rising sharply toward late June, reaching roughly 60T weekly tokens, with DeepSeek, MiMo, MiniMax, and Hy3 models ahead of Western frontier models; Anthropic Claude appears in positions 6 and 8, while OpenAI and Google are absent. The significance is platform-specific: OpenRouter says this reflects real usage by its users, but it measures OpenRouter traffic, not global LLM adoption. Commenters framed the ranking less as a pure capability benchmark and more as evidence of cost/practicality: “It’s hard to compare benchmarks, but easy to compare bills.” Others argued open/source-available models are attractive because users can test via OpenRouter and later self-host, while lower electricity costs in China may contribute to pricing competitiveness.
- Several commenters framed OpenRouter as a practical model-selection layer: test multiple open/source-available models behind a common API, then either continue routing through OpenRouter or self-host the winning model if unit economics justify it. The key technical concern raised was operational stability: users distrust OpenAI/Anthropic because pricing, model behavior, and model availability can change abruptly, making reproducibility and long-term deployment planning harder.
- Cost was treated as a more actionable metric than benchmarks: one commenter noted that “it’s hard to compare benchmarks, but easy to compare bills,” while another claimed deepseek-v4-flash and mimo-v2.5 are cheap enough on OpenRouter that inference costs are lower than the electricity cost of self-hosting, before even accounting for hardware capex. Another commenter argued China’s lower electricity prices materially affect inference economics, especially compared with proposed US datacenter locations such as California.
- A commenter suggested OpenRouter rankings may underrepresent OpenAI and Google Gemini usage because many customers access those models directly from the providers rather than through an aggregator. This implies OpenRouter’s top-model distribution is more reflective of aggregator-native demand and price/performance experimentation than total market share across all access channels.
Xiaomi quietly uploaded MiMo-V2.5-DFlash — official DFlash weights are now on Hugging Face (Activity: 389): Xiaomi has uploaded official MiMo-V2.5-DFlash weights to Hugging Face at XiaomiMiMo/MiMo-V2.5-DFlash, including a dedicated dflash/ directory and a separate MTP model. The poster reports the non-DFlash MiMo-V2.5-class model as 300B+ params running around 8–10 tok/s on 2×24GB GPUs with RAM/VRAM offload, and speculates DFlash could roughly double throughput; they also note llama.cpp currently struggles to identify/use the MTP layers, while the separate DFlash/MTP artifacts may be easier to support. Commenters characterize MiMo 2.5 as “incredible and underrated,” but one benchmark-related claim was corrected: a comparison placing it between DeepSeek V4 Flash and Pro on SWE-rebench was actually referring to MiMo Pro (1T, A42B), not this roughly 284B Flash/DFlash-sized model.
- One commenter initially compared MiMo-V2.5-DFlash to DeepSeek V4 Flash/Pro on swe-rebench, claiming it fell between them in price/performance despite being 284B rather than 1.6T, but later corrected this as a confusion with MiMo Pro, described as 1T A42B. The useful takeaway is that benchmark/performance claims around MiMo variants may be easy to misattribute because DFlash, Flash-sized, and Pro model naming overlap.
- There is interest in measuring real-world tok/s gains once DFlash support lands in llama.cpp, especially under GGUF/local inference conditions. A commenter cautioned that speculative-decoding-style speedups may degrade when VRAM offload is insufficient and inference spills into system RAM, so practical benchmarks will need to separate ideal accelerator throughput from mixed VRAM/RAM execution.
- A commenter asked whether DFlash is closer to an MTP/speculative decoding mechanism that preserves the base model’s output distribution while accelerating generation, rather than a separate “Flash” model in the sense of a smaller/lighter distilled variant. This distinction matters for interpreting the released weights: DFlash may be an inference-speed augmentation rather than a reduced-capacity model family member.

3. Local AI Runtime and Visualization Experiments

Local Image to 3D (<2gb RAM, <20s, Apple Silicon, iPhone) (Activity: 990): The linked GIF (image) appears to be a technical demo of Modelr, an open-source Swift/MLX app that ports Hunyuan3D-Shape and Hunyuan3D-Paint for local image-to-3D generation on Apple Silicon and limited iOS. The author reports FP16 benchmarks on an M4 Max: hy3d shape in ~21–22s using 5.6–7.3GB peak memory, while hy3d paint is much heavier at 231–344s and ~38–39GB; quantized Q4/Q8 runs are positioned as enabling lower-memory Mac/iPhone usage via MLX rather than PyTorch/CPU overhead. The main technical caveat raised in comments is licensing: generated assets may be heavily restricted under the current Hunyuan3D license, limiting commercial/practical use despite the open-source tooling. Other commenters were impressed that the heavier Paint stage runs locally at all, with one noting “I didn't even think Paint would be possible.”
- A commenter flagged that outputs may be heavily constrained by the Hunyuan3D license, linking directly to Tencent’s Hunyuan3D-2.1 license. They noted that despite strong local image/text-to-3D tooling, the field is still limited by non-permissive “community” licenses, though they speculated Hunyuan3D-3 may move toward more permissive terms.
Interactive Jacobian-Lens visualizer and live steerer for GGUF models on llama.cpp (Activity: 374): The image is a technical UI screenshot, not a meme: it shows the J-Lens web interface for an interactive Jacobian-Lens visualizer/steerer for GGUF models on llama.cpp, demonstrated on qwen2.5-1.5b-instruct. The project, igorbarshteyn/jlens-gguf, adds a native GGUF server for observing models and performing j-space swapping / abliteration / steering, with support for dense and MoE GGUFs; lens memory overhead is reported to scale at roughly 1/8 of model size, e.g. ~20 GB extra RAM for a 160 GB GGUF such as a large quantized Qwen model. Commenters focused on possible extensions: merging original GGUF and lens tensors, using the tool to diagnose or repair heavily quantized models, and the implication that this could enable “targeted live adapters” or real-time steering workflows.
- One technical request was for the tool to support merging the original GGUF with the Jacobian-lens tensors, implying a desire for a self-contained GGUF artifact rather than a separate visualization/steering sidecar. This would likely require defining how lens tensors are serialized, named, and loaded within the existing llama.cpp GGUF tensor/metadata conventions.
- A commenter suggested the Jacobian-lens approach might be useful for repairing heavily quantized models, i.e. using live steering/adapters to compensate for behavior or representation damage introduced by aggressive GGUF quantization. Another raised a data requirement concern, asking whether a larger dataset is needed to map the lens properly, which is relevant because learned or estimated Jacobian mappings may be brittle if calibrated on too little activation data.
I got Gemma 4 running directly inside Godot using only GDScript and Vulkan compute shaders (Activity: 364): The image shows a Godot 4.7 debug chat UI running a local GGUF LLM inside the engine, reporting about 46.99 tok/s, and is contextually ironic because the in-app model response says implementing GGUF loading/inference in GDScript + Vulkan compute shaders would be “extremely complex” while the project demonstrates exactly that. Per the post, the experiment runs gemma-4-E2B-it-Q4_K_M.gguf with Vulkan compute for model math and GDScript for GGUF loading, tokenization, sampling, KV cache, and UI, with code available at github.com/asallay/godot-llm; it is limited to one model and reportedly ~10× slower than llama.cpp with CUDA. Image Comments are mostly impressed by the proof-of-concept rather than its speed, with one noting that avoiding native extensions, ABI issues, or a sidecar server could make local NPC/LLM demos easier to distribute as a single Godot export.
- A technically substantive point is that the demo appears to implement GGUF loading, KV-cache management, and sampling entirely in Godot via GDScript + Vulkan compute shaders, avoiding native-extension ABI issues or a separate inference server. One commenter argues that even at roughly 10x slower performance, the deployment simplicity is significant because a single Godot export could make local LLM-driven NPC demos practically runnable by others.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Claude Fable 5 Access and Business-Model Backlash

Is Anthropic shooting themselves in the foot by pulling Fab 5 from subscriptions tonight? (Activity: 1656): The image is a dark-themed benchmark bar chart for DeepSWE 1.0, showing claimed coding-agent performance where “Fable/Fab 5 max” leads at 66.1%, ahead of GPT 5.5 xhigh 64.31%, Grok 4.5 62.0%, Opus 4.8 max 55.75%, and Opus 4.7 max 40.12%. In context, the post argues that if Anthropic removes Fab 5 from subscriptions and makes it metered token billing only, it risks losing developer mindshare despite strong benchmark positioning, especially if competitors provide comparable coding performance under flat-rate plans. Comments frame the move as a “classic footgun,” arguing that unpredictable API billing discourages individual developers who often become internal enterprise champions. Several users say they plan to migrate or cancel paid Claude tiers in favor of flat-rate alternatives like Codex/GPT subscriptions unless Anthropic reverses or clarifies the pricing change.
- Several commenters framed Anthropic’s subscription/API split as a technical adoption-risk issue: if Fab/Fable 5 is removed from predictable subscriptions, power users may migrate to Codex’s $200 plan, GPT-5, or cheaper alternatives rather than accept unpredictable API spend. The core concern is not just pricing but loss of internal champions who prototype on subscriptions and later drive enterprise budget approval.
- One commenter disputed a cited performance comparison, arguing that the graph was misleading because it omitted Sol 5.6 xhigh, which they claimed is “way above 5.5 xhigh.” Another said their current workflow is split between Opus calls and GPT-5, and suggested the Fable 5 hype may be overstated relative to Sol 5.6.
Anthropic, I think you really need to react. You're slowly losing ground. (Activity: 1731): The image is a screenshot of an X post highlighting OpenAI subscription/product changes: temporary removal of a 5-hour usage limit for Plus/Business/Pro, efficiency improvements to “GPT 5.6 Sol,” 6M active users, and an incoming usage reset. In the context of the post, it is used as evidence that Anthropic/Claude is falling behind on consumer experience after the troubled “Fable” rollout, unclear quota handling, higher token consumption with “Sonnet 5,” and last-minute communication around model availability and limits. Commenters largely agree with the competitive-pressure framing, arguing that OpenAI is currently winning on cost, resets, communication, and model quality. Several express concern that Anthropic is prioritizing enterprise/government customers over subscribers, with one $200/month user calling recent handling “unprofessional.”
- Commenters framed OpenAI’s recent advantage as a combination of lower cost, more frequent usage-limit resets, better communication, and improving model quality, with one user claiming OpenAI had provided “like 20 resets” since they subscribed. Several users argued Anthropic’s current consumer offering is weakening relative to OpenAI’s, particularly for high-paying users on the $200/month tier.
- A recurring technical/product concern was Anthropic’s perceived prioritization of enterprise, government, and corporate accounts over consumer/prosumer capacity. Users specifically referenced Anthropic’s model/tier lineup—Mythos, Fable, Opus, and Sonnet—suggesting pricing realignments such as making Fable cost the same as Opus and Opus cost the same as Sonnet to remain competitive.
- Users criticized Anthropic’s handling of last-minute Fable 5 extensions and lack of clearer reset policy changes, arguing that a “weekly reset” or more predictable capacity management would be a more credible response to OpenAI’s recent moves. The frustration is less about raw model capability and more about quota reliability, pricing transparency, and service predictability for paying subscribers.
Subscriptions is less than 5% of revenue, they might not care enough to keep Fable around (Activity: 1162): The image is a financial projection table, “Anthropic: the P&L behind the IPO”, estimating quarterly revenue mix from 1Q24 to 4Q26; it shows API revenue dominating Anthropic’s projected revenue, while consumer/business/enterprise subscriptions remain a small minority—supporting the post’s claim that subscriptions are <5% of revenue. The table also projects Anthropic moving from heavy operating losses in 2024–2025 toward profitability in 2026, implying that subscription products like “Fable” may be strategically less important than API/enterprise growth if the estimates are accurate. Commenters debated whether subscriptions are still strategically valuable despite low revenue share: they may influence developer preference, seed workplace adoption, and convert personal usage into API/business demand. Others questioned the credibility of the table because Anthropic is private and the image appears to be an external estimate rather than leaked financials.
- Several commenters argued that subscription products can function as a loss leader and market-signal channel rather than a direct revenue center: individual developer usage can convert into enterprise/API adoption when those developers advocate for the same tooling at work. The key technical/business dynamic raised is that consumer coding tools like Codex/Fable may influence enterprise procurement through developer preference and workflow familiarity.
- A commenter questioned the reliability of the reported “<5% of revenue” figure, noting that for a private company such numbers are likely estimates rather than audited public financials. The implication is that strategic conclusions about whether OpenAI would maintain a product like Fable should be treated cautiously unless the revenue breakdown source and methodology are clear.
I'm paying $200/month, and after tomorrow, I can't access Anthropic's best model with my sub? (Activity: 1447): A $200/month Anthropic subscriber argues that if the new/best model “Fable” is more expensive to serve than Opus, Anthropic should keep it available in the subscription and apply a higher usage/token multiplier rather than removing access. The post frames this as a unit-economics/control problem: Anthropic can cap cost exposure through faster quota burn while preserving access to its frontier model. Commenters expect Anthropic may reverse the decision, with some saying they will cancel if access is removed. One notable take is that frontier models may increasingly become API-only rather than bundled into fixed-price consumer subscriptions.
- A commenter frames Anthropic’s change as evidence that frontier models may increasingly become API-only, separating top-tier model access from fixed-price consumer subscriptions. The technical implication is that providers may prefer metered API pricing for their most expensive models rather than exposing them through capped monthly plans like $200/month subscriptions.
Yuji Tachikawa, one of the world’s leading theoretical physicists, reports Claude Fable solved a problem that he and his collaborators had gotten stuck on for the past 6 months (Activity: 2989): Yuji Tachikawa, a leading theoretical physicist, reportedly posted on X that Claude Fable helped solve a theoretical-physics problem that he and collaborators had been stuck on for ~6 months (original tweet, now deleted). He later said he deleted the post due to the type of attention it attracted, not because he was retracting the claim (follow-up). The Reddit thread does not provide enough technical detail to evaluate the problem, solution, prompt process, or verification beyond the reported claim and a linked screenshot. Commenters debated evaluation standards for AI-assisted research: one argued that dismissing the result because it was not solved “one shot” applies an unfairly stricter standard than for human collaborators. Another highlighted the model’s apparent use of speculative reasoning — e.g. “I wonder if…” — as potentially relevant to frontier LLMs’ ability to explore hypotheses beyond established understanding.
- One commenter framed the notable technical claim as not merely solving a known exercise, but showing a form of hypothesis generation: Claude Fable reportedly used language like “I wonder if…”, which they connect to a commonly cited frontier-LLM limitation—models’ ability to ask productive questions or explore hypotheticals beyond established understanding. The thread itself does not provide details of the physics problem, verification process, or benchmark-style evidence, so the technical substance is limited to this interpretation of model behavior.

2. AI Coding: Prototype Hype vs Production Reality

Why the majority of vibe coded projects fail (Activity: 1785): The image (jpeg) is a dark-mode social post arguing that “vibe coded” AI prototypes fail because a localhost demo is often mistaken for a production system: mature Slack/Discord-like apps require distributed systems, scaling, reliability, message ordering, storage, search, observability, and years of iteration. In the context of the title, it frames the core technical gap as not code generation itself, but underestimating the engineering needed beyond an MVP. Commenters pushed back that most projects fail for normal startup reasons—insufficient product value, marketing, and sales—not because they cannot scale to Slack. Others argued AI-generated tools can still be valuable for SMB/internal workflows, where a custom CRM or HubSpot-like replacement may save $10k–$100k+ without needing hyperscale architecture.
- Several commenters argued that “vibe-coded” projects usually fail for product/value and go-to-market reasons, not because they cannot scale to “Slack-level” infrastructure. The technical implication is that many AI-generated MVPs may soon clear the basic implementation bar, making differentiation depend more on domain fit, workflow integration, and whether the software solves a high-value problem.
- A recurring theme was that the best use case is small, domain-specific internal software, not billion-user SaaS platforms. Commenters cited SMB tools that replace expensive vendors—e.g. a custom HubSpot-like CRM built quickly with a capable model—where saving $15k+ annually can justify software that only needs to serve a small team.
- One commenter emphasized that many successful projects do not require public-scale testing because they are hyper-niche operational tools used by only a handful of people. The claimed opportunity is software that may only serve 3–10 users but saves a company up to $100k annually when replacing manual work, EUC processes, or governance overhead.
Honest question: What are you building that you need fable 5 so badly? (Activity: 1030): The poster asks what workloads justify upgrading to Fable 5 given that Claude Pro with mostly Opus 4.8, and workplace use of Opus 4.6 / Sonnet 5, already handles homelab automation and large-scale data-engineering work including dbt, long SQL/query parsing, near-real-time joins, thousands of schemas/integrations, and pipelines processing roughly 150B events/day. Top technical use cases cited for newer models were multi-agent VFX/AAA game pipeline automation—where less prompt specificity and less hand-holding reduce cognitive load across obscure, duct-taped artist tooling—and adversarial language/rhetorical analysis, where Fable is valued for holding multiple interpretive frames while critiquing. Commenters framed Fable/Sol less as unlocking categorically new programming capability and more as reducing supervision cost, context switching, and prompt-engineering overhead. One dissenting view characterized much usage as wasteful “slop,” while another noted GPT 5.6 Sol may now be competitive for multi-frame critique tasks.
- A VFX/AAA games software engineer with 17 years experience described using Fable and Sol to manage ad hoc production pipelines and obscure tooling issues where code is often a means to unblock artists rather than the product itself. They emphasized running “five agents” concurrently on artist-facing tasks, valuing models that need less prompt-detailing and hand-holding to reduce cognitive load in engineering-hostile production environments.
- One commenter uses Fable primarily for adversarial testing, language analysis, rhetorical critique, and paper-writing rather than coding. They characterized Fable as better at maintaining and critiquing “multiple frames at once,” while noting that GPT 5.6 Sol is becoming “very, very good” at the same class of multi-perspective critique tasks.
- A senior big-tech engineer argued that Fable’s value is less about generating better code than Opus or Sonnet, and more about acting like a “staff engineer”: clarifying ambiguous requirements, producing high-level architecture, and orchestrating implementation. In their framing, Opus maps well to “senior engineer” coding under moderate ambiguity, Sonnet to “junior engineer” execution with clearer tasks, while frontier models become useful when the user delegates more systems-level and cross-functional problem solving.
Did not expext Fable 5 to be this good!✨ (Activity: 1273): The post claims Fable 5 was used to generate a browser-based Three.js FPS in roughly 3 afternoons from a low-poly city asset folder, with Fable handling map creation. The demo, hosted on Heroku, is described as supporting single/multiplayer FFA/TDM, desktop/VR play, flying cars, and Quake-style weapons like rocket launchers and rail guns; the referenced Reddit video could not be accessed due to a 403 Forbidden block. Top comments were mostly non-technical: one says the praise is “justified,” another jokes it resembles “last week’s Fable,” and one compares the gameplay/aesthetic to Forsaken.

not much happened today

Fri, 10 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/09/2026-7/10/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

OpenAI’s GPT-5.6 rollout: model stratification, agent UX, and early benchmark signals

GPT-5.6 introduced a more explicit model/compute ladder: users are now navigating Luna / Terra / Sol plus multiple effort levels, with community guidance converging around “start lower than you did on 5.5.” OpenAI staff explained that Max means one model spending longer on a hard problem, while Ultra parallelizes work across subagents; they also noted that 5.5→5.6 effort settings are not directly comparable (guidance from @reach_vb, follow-up, practical default suggestion). The community reaction was mixed: many praised the added control, while others criticized the 30+ configuration combinatorics and missing “Auto” routing (@rasbt, @Yuchenj_UW).
The product launch landed with real UX regressions, and OpenAI publicly course-corrected fast: users complained that the new ChatGPT Work / Codex split was confusing, chats/projects became harder to find, and usage burned down faster than expected (@scaling01, @simonw, @kimmonismus). OpenAI responded unusually directly: multiple usage-limit resets, acknowledgements that defaults nudged users toward overly expensive settings, and a commitment to restore familiar sidebar/navigation patterns and clarify positioning between Work and Codex (@thsottiaux reset announcement, second reset, full corrective roadmap).
Initial eval picture: GPT-5.6 appears strongest in agentic coding / presentation / some science tasks, but not unambiguously dominant everywhere. Examples: #1 tie in Code Arena: Frontend with Claude Fable 5 while being ~2× cheaper on listed IO pricing (Arena); best recorded Presentation Elo on AA-Briefcase with a ~500-point jump over GPT-5.5 (Artificial Analysis); CritPt gains over GPT-5.5 and beats Fable 5 by ~4 points (Artificial Analysis); and strong results on WeirdML at lower cost (@htihle). At the same time, users reported instruction-following issues, uneven token efficiency in practice, and some concern about jailbreakability / reward hacking (@teortaxesTex, @Mononofu, @kimmonismus).

Parallel-agent workflows, computer use, and the “harness is the product” theme

GPT-5.6’s biggest perceived leap may be orchestration and computer use rather than pure chat quality. Multiple users highlighted that Sol is unusually strong as a planner / verifier / orchestrator, often using subagents automatically and reacting more quickly to steering (@omarsar0, @Hangsiin). OpenAI also showcased computer use with Sol Ultra and promoted ChatGPT Work as bringing agents to consumer/mobile scale (OpenAI demo via @gdb, Work positioning). Community reports described very high-throughput GUI automation and Blender workflows (@mckbrando, @kimmonismus).
A recurring operational issue is hidden subagent cost explosion: users found that spawned agents may inherit premium settings, draining quotas much faster than expected. One concrete claim was that spawn_agent doesn’t let users choose model/effort, so Sol Ultra spawns more Sol Ultra by default (@evi77ain). This fits the broader pattern of people liking the capability jump but finding the cost model opaque.
The broader systems trend is toward harness-centric competition. This came through in product commentary from Perplexity’s Arav Srinivas (“the real product is now the harness around it”), in LangChain’s launch framing around Deep Agents + Nemotron + OpenShell, and in a growing set of memory / orchestration tools like OpenWiki and OpenSWE (@dee_bosa quoting Arav, @hwchase17, OpenWiki proactive memory, OpenSWE adoption). The meta-point: frontier model parity is tightening, so value is increasingly shifting to routing, memory, tool use, safety rails, and enterprise context.

Meta’s Muse Spark 1.1 and the widening frontier of “good enough, fast, cheap” models

Muse Spark 1.1 was the other major model story of the day, with many practitioners calling it the most surprising release of the week. Reports consistently emphasized strong UI/frontend generation, fast responses, and unusually aggressive pricing, often framing it as near-frontier quality for a large subset of coding/product tasks (@alexandr_wang, @rowancheung, @kimmonismus).
Benchmarking suggests a real step up, but not outright frontier leadership. Artificial Analysis scored Muse Spark 1.1 at 51 on its Intelligence Index, up 8 points from 1.0, roughly tied with GLM-5.2 / GPT-5.4 / GPT-5.6 Luna and behind Grok 4.5 / GPT-5.6 Sol / Claude Fable 5. Notable details: 1M context, median speed ~114 tok/s, pricing $1.25 / $4.25 per 1M input/output tokens, and strong token efficiency (Artificial Analysis). Arena also placed it #9 on Code Arena: Frontend with strong gains in instruction-following and longer-query categories (Arena).
The strategic implication many drew: Meta’s compute-heavy bet is starting to show up as cost-effective inference products, not just talent headlines. Several commentators argued this materially raises competitive pressure on OpenAI/Anthropic, especially if Meta improves distribution and API ergonomics (@scaling01 asking for OpenRouter, @alexandr_wang, @mweinbach).

Open models, infra, and efficiency work

Open-model tooling kept shipping despite the closed-model attention vacuum. Unsloth released Qwen3.6 NVFP4 quants with claims of 2.5× faster inference, including 27B on 24GB VRAM and a 35B-A3B variant hitting 17,561 tok/s on B200 (Unsloth, technical details from @danielhanchen). QuixiAI reported Qwen3.6-35B-A3B-NVFP4 on dual B60 at 65 tok/s and 128k context (QuixiAI).
Inference optimization remains a major live research area. Cohere open-sourced Hardware-aware Dynamic Speculative Decoding in vLLM, addressing the familiar issue where speculative decoding helps at low batch sizes but hurts at high ones (Cohere/vLLM, vLLM commentary). Google/Hugging Face’s Gemma challenge reported up to 5× faster single-A10G inference, with 315 TPS lossless and 491.8 TPS fastest overall (Gemma).
Agent evaluation / self-improvement work is getting more concrete: “LLM-as-a-Verifier” reported SOTA on Terminal-Bench V2, SWE-Bench Verified, RoboRewardBench, and MedAgentBench using repeated sampling plus score-logprob ranking (paper thread); Meta researchers proposed an explicit memory agent to combat behavioral state decay in long-horizon agents (summary).

Science, math, health, and modality-specific systems

Math/science capability claims escalated sharply. OpenAI staff and community members circulated examples of GPT-5.6 Sol Ultra producing a claimed proof of the Cycle Double Cover Conjecture using 64 subagents in under an hour (claim from @eknight, amplified by @gdb). Separately, Bubeck noted a single-person 1M-line Lean formalization effort with GPT-5.6 (@SebastienBubeck). These are still claims pending external scrutiny, but they indicate where labs want the narrative to go: parallelized research agents as a scientific compute primitive.
Health is becoming a first-class benchmark and product vertical. OpenAI said GPT-5.6 is a major step forward for health intelligence, highlighting that Luna at lowest effort beats GPT-5.5 at highest effort while costing 25× less (OpenAI). Karan Singhal added that, in blinded physician comparisons over 20,000 axis ratings, physicians found fewer flaws in GPT-5.6 responses than physician-written responses across a hard task set (details).
Audio/music and creative tooling also moved: Kyutai + Mirelo released MuScriptor, an open model for multi-instrument audio-to-MIDI transcription from full mixes, not stems (MireloAI, Kyutai). Sakana’s new Picbreeder-style work explored open-ended creativity with VLM agents, concluding that diverse agent populations help but still fall short of human open-ended exploration (Sakana).

Security, safety, and policy frictions

Security concerns rose alongside capability gains. OpenAI moved its Bio Bug Bounty into a private ongoing program and doubled rewards to $50K, specifically seeking universal jailbreaks against predefined biosafety challenges (OpenAI). Separately, OpenAI tightened access requirements for its most cyber-capable models, requiring hardware security keys for Trusted Access for Cyber members starting Sept. 1 (@cryps1s).
Evidence of misuse remains salient: a new study reported Boko Haram members using frontier chatbots for bomb-making and related tactical queries (@AntoniaJuelich). That thread sat uncomfortably next to ongoing online discussion that GPT-5.6 may be relatively easy to jailbreak or reward-hack in some settings (@Mononofu).
Policy discourse remains polarized and speculative. The “AI 2040 / Plan A” transparency-and-governance scenario drew both support and ridicule, with Ajeya Cotra emphasizing the centrality of total research transparency while critics questioned feasibility and assumptions about superintelligence/governance capacity (@ajeya_cotra, @binarybits, @banteg satire).

Top tweets (by engagement)

OpenAI launch and rollback management: OpenAI’s product lead acknowledged launch confusion, promised UI fixes, and reset usage twice while clarifying that Codex is here to stay (full thread).
Claude Code desktop browser: Anthropic shipped an in-app browser for Claude Code desktop so Claude can browse docs/sites inside the app (@ClaudeDevs).
OpenAI org update: Fidji Simo announced she is leaving her full-time role at OpenAI and becoming a part-time advisor, citing the need to focus on recovery from chronic illness while continuing work related to AI and health (@fidjissimo).
Perplexity harness expansion: Perplexity added Grok 4.5 as an orchestrator in Computer after internal evals showed strong WANDR performance at roughly half the cost of Opus 4.8 (Perplexity).

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. GLM-5.2 Local Inference and Security Scrutiny

GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine (Activity: 1249): A demo reportedly runs GLM-5.2, a 744B-parameter MoE model, on a consumer machine with only 25 GB of RAM by streaming expert weights from disk rather than keeping the full model resident in memory. Commenters emphasize the technical interest is not throughput—likely unusably slow for practical inference—but proving that disk-backed expert paging is possible; “if someone figures out expert routing prediction well enough to prefetch, the whole picture changes.” Top comments pushed back against criticism of speed and implementation quality, arguing the noteworthy result is enabling a 744B MoE to execute at all on low-RAM consumer hardware. There was some meta-debate over whether the project was “vibe coded,” but technical commenters largely viewed the prototype as impressive.
- Several commenters framed the experiment as technically interesting because it demonstrates streaming a 744B MoE model’s experts from disk on a consumer machine with only 25 GB RAM, rather than as a practical inference setup. One pointed out that if expert-routing prediction could reliably prefetch the next required experts, disk-backed MoE inference latency could change substantially.
- A commenter noted that llama.cpp may already provide related behavior via --mmap, implying the model weights can be memory-mapped instead of fully resident in RAM, though this does not by itself solve MoE expert prefetch/routing latency.
- One user shared an extreme low-resource baseline: running Qwen2.5-0.5B with a 1-bit quantization on an x86 Atom N270 netbook with 1 GB RAM, achieving roughly 240 s/token, illustrating how feasibility and usability diverge sharply on constrained hardware.
GLM-5.2 fearmongering in the press (Activity: 907): The post criticizes a Futurism article claiming GLM-5.2 is broadly downloadable, usable “on virtually any hardware,” and potentially raises cybersecurity risk because there is no hosted-vendor mediation layer. The article cites Semgrep and Graphistry findings that GLM-5.2 performs well on bug-finding/cybersecurity tasks, including Semgrep’s “We Have Mythos at Home” benchmark framing, but commenters dispute the hardware claim as technically misleading given frontier-scale inference requirements and degradation in extreme low-bit quantization. Commenters view the article as fearmongering and technically uninformed, especially around inference hardware feasibility. A notable counterargument is that if strong models improve exploit discovery, the appropriate response is to use similarly strong models for remediation and defense rather than restrict or censor open models.
- Commenters challenged the press claim that GLM-5.2 can run on “virtually any hardware”, arguing that a large frontier/open-weight model would require substantial GPU investment rather than consumer-era CPUs; one user sarcastically asks how many seconds per token an old 4th gen i3 laptop would achieve, while another frames realistic deployment as hardware costing on the order of $250k.
- A technical objection was raised against citing extreme 1-bit or 2-bit quantization as evidence of broad deployability: commenters argue such quants are often severely degraded—described as “lobotomised”—and therefore not comparable to running the full-capability model.
- One commenter reframed the security-risk argument as a dual-use mitigation problem: if advanced models can help exploit vulnerabilities, the appropriate response is to use similarly capable models for defensive discovery and patching rather than banning or restricting the models outright.

2. Local LLM Performance and Hardware ROI

2.5x faster Qwen3.6 NVFP4 Unsloth quants (Activity: 934): The image is a promotional benchmark graphic for Unsloth’s dynamic NVFP4 quantizations of Qwen3.6, supporting the post’s claim of up to 2.5× faster inference than NVIDIA NVFP4 quants. It reports B200 throughput gains such as Qwen3.6-27B: 5,637 vs 2,259 and Qwen3.6-35B-A3B: up to 11,628 vs 6,481, attributed to W4A4 4-bit tensor-core matmuls versus NVIDIA’s W4A16 path, while tables in the post show broadly comparable MMLU-Pro, GPQA, and AIME 2025 scores across BF16/FP8/NVFP4 variants. The post also links released Hugging Face models for 35B-A3B-NVFP4, 35B-A3B-NVFP4-Fast, and 27B-NVFP4, plus FP8 KV-cache calibration for roughly 2× longer contexts. Commenters mainly frame this as a Blackwell-specific win, with jokes that Pascal/RTX 3090-era users likely won’t benefit because the speedups depend on newer GPU tensor-core support.
- Commenters questioned how Qwen3.6 NVFP4 Unsloth quants compare against standard non-NVFP4 4-bit quantizations, specifically whether the claimed 2.5x speedup is unique to Blackwell hardware or holds against existing 4-bit formats in common inference stacks.
- There was technical uncertainty around llama.cpp / llama-server NVFP4 support: one user noted that llama-server can run NVFP4 but that prior performance looked “lackluster,” while another asked why no GGUF builds were provided if llama.cpp now supports NVFP4 reasonably well.
- Several comments implied the optimization is primarily relevant to NVIDIA Blackwell GPUs, with older architectures such as Pascal and consumer cards like the RTX 3090 unlikely to benefit from NVFP4 acceleration.
If you spent $4–5K on a local AI rig, would you do it again? (Activity: 359): The post argues that a $4–5K local AI rig is hard to justify purely for running frontier-quality local LLMs, especially when APIs such as DeepSeek V4 Flash are priced around $0.14/M uncached input tokens and $0.28/M output tokens. The author reports that even on a 128GB MacBook, running a 2-bit quantized DeepSeek V4 Flash is still not compelling versus hosted models, though the setup was useful for learning about quantization, KV cache, context windows, memory limits, and model serving. The author’s view is that expensive local hardware may make sense for privacy, always-on workloads, or when the machine is needed anyway, but not primarily as a cost-saving substitute for Claude/ChatGPT-quality APIs. No top comments were provided to summarize.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. GPT-5.6 Coding Benchmarks

DeepSWE just added the gpt-5.6 models to their benchmark. I hope you guys don't get too used to Claude Code as your only coding agent. Chart is marked NSFW due to the grotesque violence. (Activity: 1718): The image is a DeepSWE benchmark cost/performance chart comparing coding-agent models by “DeepSWE score” vs average cost per task, with the post highlighting newly added GPT-5.6 variants as strong low-cost competitors to Claude Code/Claude models. In the chart, GPT-5.6/5.5-family points appear to cluster around roughly 60–70% DeepSWE score at comparatively low task cost, while Claude models remain competitive—e.g. Claude-fable-5 near the top around 70%—but often at higher cost. The comments do not engage much with the benchmark itself; they overwhelmingly criticize the visualization quality, calling it “psychopath” charting and pointing to r/dataisugly. The post’s “grotesque violence” framing is hyperbolic/meme-like, referring to the chart’s implied GPT-vs-Claude disruption rather than literal content.
GPT 5.6 Beats Fable 5 by 3% more on DeepSWE at a cheaper price. (Activity: 1310): The image shows a DeepSWE leaderboard where gpt-5.6-sol scores 73% ±3% at an average cost of $8.39, outperforming claude-fable-5 at 70% ±4% while costing much less than Fable’s $21.63. It also highlights gpt-5.6-terra matching Fable’s 70% score at roughly 4.4× lower cost, making the post’s main technical claim about cost-adjusted coding-agent performance, not just raw benchmark score. Commenters focused less on the 3-point lead and more on the pricing efficiency, calling $8.39 vs $21.63 the real headline. They also noted the apparent jump from GPT 5.4 and Terra’s Fable-level score at about one-quarter the cost.
- The main technical takeaway was cost-normalized DeepSWE performance: commenters highlighted GPT 5.6 at 73% and framed the result as $8.39 vs $21.63 compared with Fable 5, i.e. a small reported accuracy lead but much larger price advantage. Another commenter noted Terra tying Fable at roughly 1/4 the cost, suggesting the benchmark may favor cheaper planner/executor configurations over premium frontier models.
- One user reported real-world MCP-heavy workload costs across model families: Opus 4.8 runs reportedly cost $1–$2, while GPT 5.5 cost around $0.20–$0.50 for similar work, implying substantially lower token consumption or pricing for GPT models. They added that Opus output quality was still “on a different level,” so the tradeoff is not purely benchmark score or raw cost.
- A commenter suggested that if the DeepSWE numbers hold, a workflow using Opus 4.8 high + Sonnet 5 medium could potentially be replaced by Sol high + Terra high as planner/executor, with better aggregate results at lower cost. This reflects interest in multi-model routing where cheaper high-reasoning tiers handle decomposition/execution instead of relying on a single premium model.
Superhuman competitive programming AI is here (Activity: 1068): The image shows an AtCoder World Tour Finals exhibition leaderboard with OpenAI ranked 1st at 8300, nearly doubling the next competitor tour1st at 4300, supporting the post’s claim of “superhuman” competitive-programming performance. In the linked Algorithm contest, the poster claims OpenAI solved all 5/5 problems while no human solved more than 3, with related AtCoder links for heuristic standings, heuristic tasks, algorithm standings, and algorithm tasks. Commenters emphasized the size of the gap — “look at that margin” — while one technical distinction noted this is less general software engineering and more algorithm design / contest problem solving. Another practical caveat is that the AtCoder leaderboards are reportedly behind login.
- One commenter draws a technical distinction between competitive programming and broader software engineering: the system appears superhuman at algorithm writing—a constrained subset of programming focused on solving formal problems under contest conditions—rather than necessarily being superhuman at end-to-end production software development.
- Multiple commenters note that the supporting leaderboard links are behind a login, limiting independent verification of the claimed margin/performance without authenticated access to the benchmark results.

2. Claude Code Large-Scale Builds

Jarred, creator of Bun rewrote it from Zig to Rust in 11 days using Claude Fable 5 which costed 165k of Fable usage, at API prices. They said by hand, this would've taken 3 engineers with full context on the codebase about a year with no other work possible (Activity: 1159): According to the Bun rewrite post, Jarred Sumner used a pre-release Claude Fable 5 via Claude Code dynamic workflows to port Bun’s 535,496 lines of Zig to Rust in 11 days, running ~50 workflows with up to 64 Claude instances; estimated API-equivalent usage was ~$165k, versus an estimated 3 engineers/year for a manual rewrite. The process used an upfront PORTING.md, continuous human monitoring, and “adversarial review” with separate Claude contexts acting as reviewers; reported outcomes for Bun v1.4.0 include 128 fixed bugs vs v1.3.14, eliminated instrumentable memory leaks, ~20% smaller Linux/Windows binaries, and ~10% faster Linux startup for Claude Code v2.1.181+. Top commenters were skeptical that this demonstrates broad accessibility: they argued the key input was not merely $165k of model usage but Jarred’s exceptional codebase context and engineering skill, with one framing it as “a million dollar Thiel Fellow engineer who used 165K of Claude Credits.” Another suggested the API-price framing inflates the perceived cost/scale for effect.
- Commenters pushed back on attributing the rewrite primarily to the model spend: the substantive claim was that Jarred Sumner’s deep Bun/Zig/runtime expertise and full codebase context were likely the enabling factor, with the LLM acting as an accelerator rather than an autonomous replacement. One commenter framed it as “Bun was rewritten by a million dollar Thiel Fellow engineer who used $165K of Claude Credits,” implying replication cost for a less expert engineer could be far higher.
- Several comments questioned the cost framing, noting that quoting API pricing may inflate the perceived spend versus internal/contracted/discounted usage, and that raw token budget is not equivalent to engineering capability. The technical skepticism was that this result may not generalize: large-scale language/runtime rewrites require architecture judgment, verification, and codebase-specific knowledge that “typical vibe coding” workflows would not supply.
I just made $25K USD with my capybara game built entirely with Claude Code (Activity: 1463): An iOS engineer built A Game About Capybaras Delivering Food in 15 days for VibeJam 2026, winning the $25,000 first prize; the project used Claude Code Opus 4.7, Three.js, GPT Images-2/Grok for textures, Tripo3d for models, and Suno/ElevenLabs for audio, with claimed 100% AI-written code across 188 commits and ~27k LOC. The workflow centered on parallel Claude Code sessions, /plan, and AI-generated tooling: an in-game map/terrain/road editor, cutscene editor, iOS-like phone UI, PS1-style texture pipeline, mission loop, stacked-item pseudo-physics, vehicle drifting/collision, localization, and a Cloudflare WebSocket multiplayer lobby relaying player state at ~10 Hz with O(n²) fanout scaling. Top comments were mostly non-technical: one joked that Claude often suggests “capybara” as a mascot, while another questioned the title’s phrasing, noting the money came from a competition prize rather than game revenue.

3. Frontier Model Usage Limits

GPT-5.6 Sol Ultra is impressive — for the 12 minutes you’re allowed to use it as a Plus subscriber (Activity: 914): A ChatGPT Plus user reports that using GPT-5.6 Sol Ultra for two large batch/agentic workloads—merging/analyzing ~10 PDFs into a ~700-page output and reorganizing ~700 Markdown files in an Obsidian vault—exhausted their Plus usage allowance despite a reset. The main technical rebuttal argues the workload likely involved millions of processed tokens: ~280k–560k output tokens for the 700-page document alone, plus ~210k–1.05M tokens for a single pass over 700 Markdown files, before planning, rereads, rewrites, retries, or multi-agent overhead. Commenters largely push back on measuring cost by prompt count, arguing that “two tasks” can represent very large compute/token consumption; the clearest shared criticism is that OpenAI’s quota meter is too vague, even if the throttling itself is economically expected for a $20/mo plan.
- Several commenters argued the reported limit burn is better explained by token/compute consumption rather than prompt count: a 700-page generated report could represent roughly 280k–560k output tokens, and processing 700 Markdown files at 300–1,500 tokens/file adds another 210k–1.05M input tokens per pass. With planning, rereads, rewrites, retries, and multi-agent handoffs in Sol Ultra, commenters estimated the workload could plausibly reach several million processed tokens.
- A technical criticism was that Plus quota UX is opaque: users see a vague usage meter rather than a compute/token-based accounting model. Commenters suggested the complaint is valid insofar as OpenAI exposes limits as “messages” or time windows, while high-context batch jobs on an expensive multi-agent mode can consume quota disproportionately quickly.
- One practical recommendation was to avoid using Ultra for large context-heavy batch workflows unless the goal is benchmarking; commenters noted that tasks involving hundreds of documents and long-form synthesis are likely inefficient under capped consumer subscriptions, even if the apparent number of prompts is small.
5 hour and weekly limits have been reset. Thanks Anthropic! (Activity: 2865): The image is a dark-mode X/Twitter screenshot from ClaudeDevs announcing: “We’ve reset 5-hour and weekly rate limits for all users” (image). Technically, this means Claude/Anthropic users’ short-window and weekly quota counters were cleared, allowing renewed usage immediately; the post asks whether this was goodwill, competitive timing, or related to a possible 5.6 update. Comments were mostly speculative: some joked the timing suggested pressure from OpenAI, while others regretted not exhausting their usage before the reset but appreciated the free quota refresh.

OpenAI launches GPT 5.6 Sol/Terra/Luna

Thu, 09 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/08/2026-7/09/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

OpenAI launched a new three-model GPT‑5.6 family and simultaneously expanded the product stack around it.

OpenAI announced GPT‑5.6 Sol, Terra, and Luna rolling out across ChatGPT, Codex, and the API via @OpenAI and @OpenAIDevs
In ChatGPT, Plus, Pro, Business, and Enterprise users get access to GPT‑5.6 Sol through medium+ effort settings, while Pro and Enterprise can select GPT‑5.6 Pro for highest-quality results on complex tasks, per @OpenAI
API pricing introduced a tiered lineup: Sol $5 / $30 per million input/output tokens, Terra $2.5 / $15, Luna $1 / $6, with cache-write pricing added for the first time and 90% cache-read discount retained, according to @ArtificialAnlys
OpenAI framed the family around a price-performance ladder: Sol = flagship/highest ceiling, Terra = GPT‑5.5-like capability at lower cost, Luna = fastest/cheapest high-volume option, via @OpenAIDevs
The launch bundled major app-layer changes: ChatGPT Work, a new desktop app merging Codex + ChatGPT, Sites beta, programmatic tool calling, and multi-agent beta in the Responses API, via @OpenAI, @OpenAIDevs, and @OpenAIDevs

Official claims and benchmark results

OpenAI’s official message emphasized strong agentic/coding performance, better artifact quality, and improved economics.

Sam Altman called it “obviously the best model we have ever produced” in the launch post, linking the release blog, via @sama
Altman also highlighted enterprise economics: “5.6 sol is a huge step forward for dollars-per-task,” via @sama
Greg Brockman said the goal is “the best price for any level of target performance” and the highest possible ceiling, via @gdb
OpenAI claimed GPT‑5.6 Sol sets a new high of 53.6 on Agents’ Last Exam, beating Claude Fable 5 adaptive by 13.1 points; at medium reasoning it beats Fable by 11.4 points at roughly one-quarter the estimated cost, while Terra and Luna also outperform Fable at around one-sixteenth the cost, via @OpenAI
OpenAI said GPT‑5.6 improves artifact quality across presentations, documents, and spreadsheets, with outputs exportable into existing enterprise tools, via @OpenAI
OpenAI positioned GPT‑5.6 as state of the art for reasoning through complex tasks and for producing materials matched to templates, reference files, and preferred style inside ChatGPT Work, via @OpenAI
OpenAI also said GPT‑5.6 is its most capable model yet on cyber and bio-related tasks, with some API calls potentially blocked or paused for extra safety review in dual-use areas, via @OpenAIDevs
OpenAI highlighted better Computer Use performance: faster, more token-efficient, support for batching and parallel operations across multi-step tasks, plus picture-in-picture supervision, via @OpenAIDevs

Independent evaluations and third-party measurements

Independent evals broadly placed Sol near or at the frontier, especially on coding-agent workloads, while also surfacing caveats.

@ArtificialAnlys reported GPT‑5.6 Sol (max) scores 59 on its Intelligence Index, 1 point below Claude Fable 5 (max), at about one-third of Fable’s cost per task
On the same analysis, Terra and Luna score 55 and 51 on the Intelligence Index, with ~50% and ~80% lower cost per task than Sol, respectively, via @ArtificialAnlys
Artificial Analysis said Sol leads the Coding Agent Index at 80, ahead of Fable 5 and Opus 4.8, and is also cheaper per task than both on their harnesses, via @ArtificialAnlys
It also noted Sol defines a new Pareto frontier of intelligence vs output tokens, while Terra and Luna are not on that frontier, via @ArtificialAnlys
Artificial Analysis found minor improvement over GPT‑5.5 in AA‑Omniscience but with a higher hallucination rate than GPT‑5.5 max, via @ArtificialAnlys
It reported similar GDPval-AA v2 performance to Claude Fable 5, suggesting comparable ability on economically valuable tasks, via @ArtificialAnlys
@ValsAI ranked GPT‑5.6 #2 on Vals Index and Vals Multimodal Index, saying Fable 5 remains ahead on several benchmarks but GPT‑5.6 is “clearly in the same class”
Vals also said Sol is #1 on CyberBench and Excel Modeling Benchmark, and #1 on Legal Research Bench, ProofBench, SWE-bench, and Terminal-Bench 2.1, adding that Fable had a nearly 100% refusal rate on CyberBench, via @ValsAI
@arcprize said GPT‑5.6 Sol scores 7.8% on ARC‑AGI‑3 and is the first verified frontier model to ever beat an ARC‑AGI‑3 game
@GregKamradt noted 92.5% on ARC‑AGI‑2, calling it SOTA while costing an order of magnitude less than GPT‑5.5 Pro three months earlier
@ArtificialAnlys later reported GPT‑5.6 Sol (max) leads CritPt, a benchmark of unpublished research-level physics problems, by roughly 4 points over Claude Fable 5
@llama_index said day-0 ParseBench results show GPT‑5.6 continues to do well on text and tables but still struggles on charts and layout, and that Luna is ~6× cheaper than Sol with only minor degradations
@jerryjliu0 similarly said ParseBench shows no high-level change versus GPT‑5.5 on tables/text/charts/layout, stressing persistent weakness on complex text layouts, chart transcription, and source-element bounding boxes

Technical details

The technical story of GPT‑5.6 is as much about inference orchestration and token efficiency as raw capability.

OpenAI shipped three model tiers with multiple reasoning effort levels; users discussed Light, Medium, High, Extra High, Ultra, leading to a large configuration matrix, via @rasbt
OpenAI added Programmatic Tool Calling in the Responses API and Multi-agent beta, indicating more explicit support for orchestrated tool use and agent decomposition, via @OpenAIDevs
OpenAI’s app layer now uses Codex as the core of the new Work product, per @sama and @gdb
Several posts stress parallel agents/subagents as a major capability lever; @aidan_mclau explicitly mentions users can increase the number of 5.6 subagents
@LiorOnAI summarized likely drivers as adaptive reasoning, parallel agents, programmatic tool use, and higher token efficiency
Artificial Analysis reported Sol max uses ~15k output tokens per Intelligence Index task vs 16k for GPT‑5.5, and fewer than Opus 4.8, GLM‑5.2, and Gemini 3.5 Flash at comparable intelligence, via @ArtificialAnlys
@OpenRouter said early testing found the 5.6 models more token efficient, lowering both cost and time-to-task completion
The desktop/app layer brought a Chrome extension, revamped in-app browser, authenticated sites, persistent multi-tab sessions, file downloads, and tighter cross-device handoffs, via @OpenAIDevs, @OpenAIDevs, and @OpenAIDevs
Sites entered beta for paid users, offering hosting, storage, and optional auth for GPT-built apps, via @OpenAIDevs and @OpenAIDevs

The “Sol autonomously post-trained Luna” claim

This was the most provocative technical claim around the launch, but its interpretation became contested almost immediately.

Multiple accounts amplified the statement that OpenAI says GPT‑5.6 Sol autonomously post-trained GPT‑5.6 Luna, via @scaling01, @tejalpatwardhan, and @dejavucoder
The claim fueled RSI/autoresearch speculation; @tenobrus said if true as stated, it would be a “pretty large update” for automated researcher timelines
@eliebakouch framed it as OpenAI asking Sol to post-train Luna “with 100k GPUs” for an experiment
@gdb said the implication is easy to overlook for accelerating engineering workflows, reinforcing that OpenAI wants this read as more than a marketing flourish
But skeptical clarifications emerged quickly: @nikolaj2030 asked whether this actually meant Sol completed a small controlled post-training task—modifying a config, editing a scheduler file, and launching a run—rather than end-to-end real-world post-training of Luna
@nrehiew_ interpreted the screenshot similarly: Sol could go from high-level ideas to editing configs and launching experiments, not fully owning Luna’s end-to-end post-training
@scaling01 argued that what’s probably happening is a model implementing LLM-as-a-judge graders, reward-shaping logic, or small training configs on top of existing OpenAI RL infrastructure—not autonomous end-to-end research or training systems
@scaling01 explicitly said we should distance these statements from literal autonomous end-to-end post-training or research, which models still cannot do
Counterbalancing that skepticism, @aidan_mclau said it is routine for him to have 5.6 e2e do an entire RL run, suggesting meaningful internal workflow automation even if not self-sufficient research
The consensus across technical observers was not that Sol independently invented and trained Luna, but that GPT‑5.6 may now be capable of executing meaningful chunks of model-improvement workflows inside mature internal infrastructure

Internal productivity and recursive improvement signals

OpenAI also used internal-usage data to argue that GPT‑5.6 materially changes researcher throughput.

@scaling01 highlighted an OpenAI claim that it doubled experiment throughput per researcher since the start of the year
@eliebakouch quoted OpenAI saying average daily output tokens per active researcher were more than twice the highest level observed for GPT‑5.5 during internal testing
Another OpenAI stat, relayed by @eliebakouch, said over six months the share of research compute devoted to internal coding inference grew 100-fold, while internal agentic token usage increased ~22-fold
@FakePsyho linked these developments to OpenAI’s performance in top programming contests, describing systems close to GPT‑5.6 plus custom harnesses as decisively beating elite human competitors
This fed broader RSI/autoresearch discussion, especially from people who see long-horizon coding and heuristic optimization as proxies for model-improvement capability

Product implications: ChatGPT Work, Codex merge, desktop, and Sites

The model launch doubled as a product strategy reset: OpenAI is pushing from “chatbot” to “work OS.”

OpenAI launched ChatGPT Work, an agent powered by Codex + GPT‑5.6 that can act across apps and files, stay on tasks for hours, and turn a goal into finished work, via @OpenAI
Work can ingest context from docs, Slack, Notion, Microsoft 365, and Google Drive and produce decks, docs, spreadsheets, dashboards, visualizations, and interactive explanations, summarized by @kimmonismus
The Codex app merged into the new ChatGPT desktop app, confirmed by @avstorm and @OpenAIDevs
Developers now get inline diff editing, PR review side panel, better SSH video rendering, and stronger computer use, via @romainhuet and @reach_vb
Sites lets users turn work into shareable hosted apps/websites from ChatGPT, via @OpenAIDevs and @simpsoka
@OpenAI, @OpenAI, and @OpenAI marketed GPT‑5.6 through case studies: a broccoli farmer, a mathematician, and a family cereal business
This product reframing was read by some as OpenAI’s answer to Anthropic’s Cowork / Claude Code stack, via @jerryjliu0 and @kimmonismus

Facts vs opinions

Facts / directly sourced claims

GPT‑5.6 family names, rollout channels, and access tiers: @OpenAI, @OpenAI, @OpenAIDevs
API prices and cache-write policy: @ArtificialAnlys
OpenAI’s benchmark claims on Agents’ Last Exam: @OpenAI
Artificial Analysis and Vals leaderboard placements: @ArtificialAnlys, @ValsAI
ARC‑AGI‑3 7.8% claim: @arcprize
ParseBench caveats: @llama_index, @jerryjliu0
Safety testing finding jailbreaks on GPT‑5.6 Sol: @alxndrdavies

Opinions / interpretation / hype

“Best model we have ever produced”: @sama
“First time I’ve felt comfortable delegating the hardest problem out there”: @reach_vb
“Not enough people are emotionally prepared for GPT‑6”: @scaling01
“OpenAI is competing on cost curves, not benchmarks”: @LiorOnAI
“The engineers were allowed to cook”: @TheHumanoidHub
“Generational fumble” regarding Codex becoming ChatGPT Desktop: @theo

Different perspectives

Supportive views

Many developers and evaluators saw GPT‑5.6 as a meaningful frontier advance, especially in coding and knowledge work: @gdb, @AravSrinivas, @OpenRouter, @Teknium
Several posts focused on cost efficiency as the real win, with Sol matching frontier peers while being materially cheaper: @ArtificialAnlys, @omarsar0, @cline
Others highlighted the agentic stack—Work, Codex, multi-agent, programmatic tools—as more strategically important than raw benchmark deltas: @TheRundownAI, @kimmonismus, @fidjissimo

Neutral / analytical views

Some analysts saw Sol as roughly same class as Fable, but not decisively ahead overall: @ArtificialAnlys, @ValsAI
@teortaxesTex argued the release may reflect OpenAI strong post-training recovering toward Anthropic despite a stronger Anthropic base model
@simonw pointed to notable API additions but also implied growing product complexity

Critical / skeptical views

@scaling01 asked whether GPT‑5.6 Sol is worse at math, pushing back on the “everything got better” narrative
@ArtificialAnlys found higher hallucination rate vs GPT‑5.5
@scaling01 criticized the ARC‑AGI‑3 scoring setup, saying Sol would score 0% under official scoring methodology capped at $10k and objecting to use of a $25k budget
@Hangsiin and @Hangsiin pointed to subscription/credit confusion, saying Sol costs more credits than GPT‑5.5 while usage limits differ less than API pricing suggests
@QuinnyPig said OpenAI’s pricing/subscription strategy is confusing, particularly around future pricing jumps or inclusion terms
@rasbt highlighted UX complexity: 2 modes × 3 models × 5 effort levels = 30 configurations
@MParakhin complained that GPT‑5.6 Pro no longer has extended thinking, preferring an option to pay for much longer reasoning
@theo and @simonw criticized the growing app/mode fragmentation around ChatGPT, Codex, and Work

Safety and security concerns

The launch also surfaced one of the strongest public cyber-safety debates around a recent frontier model release.

@alxndrdavies from the AI Safety Institute said they found universal jailbreaks in all rounds of testing that enabled long-form agentic task completion in vulnerability discovery and exploit development
@EthanJPerez called it “the highest stakes safety issue of any model release yet”
@yonashav praised OpenAI for allowing third-party unreleased-model safety assessments to be published even when inconvenient
@Mononofu said ease of jailbreaking plus reward-hacking reports make them worried OpenAI may have rushed the release to keep pace with Fable
At the same time, OpenAI explicitly warned some cyber/bio requests may be paused or blocked mid-stream for additional review, via @OpenAIDevs
This created a split narrative: strong cyber capability is treated as a product advantage by some evaluators, but as a serious deployment risk by safety researchers

Context

Why this matters goes beyond a single model benchmark win.

The launch happened amid a compressed week of frontier competition that also included new releases from Meta Muse Spark 1.1 and Grok 4.5, leading multiple observers to describe the frontier as newly crowded: @matanSF, @kimmonismus
OpenAI’s differentiation is increasingly framed less as “best raw benchmark score” and more as cost-efficient agentic work, consistent with posts from @sama, @ArtificialAnlys, and @LiorOnAI
The product bundling suggests OpenAI is moving from a model vendor to a full-stack work platform, with its own browser, connectors, orchestration primitives, hosted app deployment, and desktop runtime
The strongest forward-looking signal may be the internal claim that researchers already use these systems to materially increase output and automate chunks of RL/post-training workflows, even if public discussion often overstates that as “the model trained itself”
The launch also sharpens a recurring engineering question raised by many tweets: whether the frontier is now bottlenecked less by a single monolithic model and more by orchestration quality, tool APIs, subagents, evaluation harnesses, and economics

Frontier models and evaluations

Meta launched Muse Spark 1.1 and the Meta Model API in public preview, positioning it as a strong agentic, coding, multimodal, and computer-use model. Official posts came from @finkd, @alexandr_wang, @shengjia_zhao, @ren_hongyu, and @OpenAIDevs
Key technical details repeatedly cited: 1M-token context window, video understanding, multimodal reasoning, and API availability, with @altryne and @xinyun_chen_ among those emphasizing long-horizon agentic gains
Benchmark claims around Muse Spark 1.1 included competitiveness with GPT‑5.5 and Opus 4.8 on agentic evals, strong performance on Harvey’s Legal Bench, TaxEval, MedScribe, and some out-of-distribution evals over Opus 4.8 and Grok 4.5, via @alexandr_wang, @alexandr_wang, @_jasonwei, and @cline
External reaction ranged from surprise and enthusiasm—e.g. @kimmonismus, @preston_ojb, @0interestrates—to practical integration pushes from @cline
Grok 4.5 continued to draw benchmark discussion: @arena said it reached #3 in Code Arena: Frontend, while @alexgshaw discussed Terminal-Bench 2.1 reward-hacking caveats. Several posters argued Grok now belongs in the frontier set, including @teortaxesTex

Agents, orchestration, and developer tooling

Multiple posts reinforced that harness/orchestration quality is becoming as important as the base model. @dair_ai highlighted a study where changing only the orchestration layer cut blended cost per task 41%, tokens 38%, and median wall-clock 44% at quality parity
LangChain/LangSmith tooling updates focused on observability for coding agents: tracing Claude Code sessions into LangSmith via @LangChain, plus discussion of OpenWiki Brains for proactive memory agents from @BraceSproul, @hwchase17, and @colifran_
@ManusAI launched Branch, allowing parallel sessions that inherit full context
@antigravity described investment in dynamic agent teams, active sidecars, and generative UI
@CoreWeave introduced ARIA, an AI Research and Improvement Agent inside W&B that reads runs, forms hypotheses, launches experiments, and scores against baselines
@TheTuringPost highlighted SkillCenter, a package manager/index for agent skills, while @steveruizok shipped a “papercuts” CLI for agents to report broken tool paths and frustrations

Inference, efficiency, and open model infrastructure

Ollama announced fundraising and said it now has 9M+ active builders, framing the moment as scaling “open models into AI that you can own,” via @ollama
Hugging Face / Reachy Mini economics were striking: @andimarafioti said 9k Reachy Minis generate 15k hours of conversation/month; using GPT-realtime would cost $45k/month, so they built an open alternative at $0.25/hour and free on laptop
@dmitrshvets shared speculative decoding research claiming 4.37× speedup over autoregressive decoding and +24.7% over a strong DFlash baseline
@fal detailed a diffusion serving stack reaching 0.45s inference using kernel optimizations, quantization-aware distillation, and timestep distillation
@ostrisai added isolated reference-token attention for Krea2 edit training; example timings showed major gains from KV caching, such as 31.63s → 10.90s for 3 refs
@vllm_project announced the first vLLM Conference, underscoring how open inference stacks remain a central layer of the ecosystem
@QuixiAI reported Qwen3.6-35B-A3B-NVFP4 at 65 tok/s on dual B60 with custom SYCL kernels and 128k context

Robotics, multimodal systems, and AI-for-science

@perceptroninc launched Perceptron Egocentric, an embodied reasoning/annotation system said to beat pipelines built on Gemini 3.5 Flash and Gemini Robotics-ER 1.6
@DataChaz summarized the economics: 10–15× cheaper than human annotation, with +77% end-to-end F1 on WGO-Bench (0.280 vs 0.158)
@rohanpaul_ai emphasized the output structure: subtask boundaries, per-hand actions, left/right hand grounding, and dense labels from raw egocentric/robot video
Google Research released SensorFM, a sensor foundation model trained on 1 trillion minutes of unlabeled wearable data from 5 million consented participants, via @GoogleResearch
@SebastienBubeck said GPT‑5.6 helped formalize the unit distance solution in 1 million lines of LEAN, compressing what would previously require a team over years into a short single-person effort
@TheTuringPost highlighted a Stanford paper on the “Agentic Garden of Forking Paths”, where AI research personas reproduced human-like ideological variation; 86% of analyses passed independent AI review and 78% were judged methodologically sound by humans

Policy, safety, and ecosystem debate

A cluster of posts sharply criticized the EU’s Chat Control law/proposal from civil-liberties and anti-surveillance angles, including @perrymetzger, @IterIntellectus, and @dhh
Open-source advocacy remained loud: @AndrewYNg said protecting open source AI is critical to permissionless innovation, while @Dan_Jeffries1 argued restricting open source AI would be “civilizational suicide”
@cognition addressed trustworthiness concerns around open-source-derived coding agents, saying their SWE‑1.7 built on Kimi K2.7 was specifically trained for trustworthiness and refused surveillance-style scenarios where the base model complied
On evaluation methodology and behavior science, @TransluceAI argued for measuring how systems behave in the world, not just raw capabilities
Forecasting/futures discussion centered on AI 2040, with endorsements and critiques from @NeelNanda5, @RichardMCNgo, @scaling01, and others debating compute gaps, geopolitical assumptions, and takeoff dynamics

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Chinese Open Models: Releases and Scrutiny

China’s MiniMax Plans to Launch 2.7-Trillion Parameter Model (Activity: 1058): MiniMax reportedly plans to release and open-source a next-generation LLM codenamed M3 Pro as early as Q3, with 2.7T parameters—~6.3× larger than its current M3 (428B) model—according to The Information. The claimed target improvements are complex reasoning and multi-step instruction/task handling, though no architecture details, training data, evals, context length, MoE/dense breakdown, or inference cost numbers were provided. Commenters framed the release mainly as competitive pressure on U.S. closed-model providers: even if individuals cannot self-host a 2.7T model, open weights could let datacenters/API providers offer cheaper access than closed frontier APIs. One commenter specifically speculated that an uncensored open model competitive with existing creative-writing/roleplay models could shift users away from U.S. providers.
- Commenters focused on the deployment economics of a potential open-source 2.7T-parameter MiniMax model: while consumer hardware cannot run it locally, cloud/data-center providers could host it via APIs, potentially lowering access costs versus closed frontier models because providers would not need to pay proprietary model licensing fees.
- A technically relevant theme was that even if 99% of users cannot run a 2.7T model, open weights could still matter if many inference providers can serve it and it is competitive with proprietary systems. One commenter argued this creates an adoption-driven incentive to open source, especially if the model can outperform current closed providers in quality or censorship constraints.
- Several comments compared the possible release strategy to DeepSeek, hoping MiniMax would also provide smaller “mini” or “flash” variants derived from the large model. The concern was that the gap between increasingly large flagship models and locally runnable models keeps widening, so distilled or reduced-size releases would be important for broader experimentation and downstream model development.
GLM-5.2 fearmongering in the press (Activity: 799): The post criticizes a Futurism article framing GLM-5.2 as a cybersecurity risk because it is downloadable/open-source and allegedly can run on “virtually any hardware,” citing Semgrep and Graphistry findings that it performs well on bug-finding/security tasks, including Semgrep’s “We Have Mythos at Home” benchmark. Top technical pushback focuses on the hardware claim: commenters argue capable inference would require high-end/expensive GPU setups, while 1–2 bit quantizations are likely too degraded for serious use. Commenters largely view the article as fearmongering and technically sloppy. One recurring argument is that if advanced models improve exploitation capability, the correct response is to deploy similarly advanced models for vulnerability discovery and patching—not restrict or ban open models.
- Commenters challenged the claim that GLM-5.2 can run on “virtually any hardware”, noting that meaningful inference for frontier-scale models requires substantial compute rather than an old consumer CPU laptop. One commenter framed the realistic requirement as hardware costing on the order of $250k, while another questioned expected throughput in seconds per token on a 4th-gen i3 laptop.
- There was pushback against citing extreme low-bit quantization as making such models broadly usable: commenters argued that 1-bit or 2-bit quantized models are severely degraded, described as “lobotomised,” and should not be treated as equivalent to full-precision or practical high-quality deployments.
- A security-focused comment argued that if advanced models can help exploit vulnerabilities, the technical response should be to use similarly capable models for defensive vulnerability discovery, patching, and auditing, rather than restricting model availability. Another commenter noted that claims of easy local execution could undermine the investment case for closed-source model API providers, since commoditized local inference would weaken API lock-in.
Unsloth has uploaded several sizes of Deepseek-V4-Flash GGUF's (Activity: 611): Unsloth published multiple DeepSeek-V4-Flash GGUF quantizations; commenters note current inference requires a specific llama.cpp fork/branch with a DeepSeek V4 checkpointing fix: danielhanchen/llama.cpp@deepseek-v4-checkpointing-fix. Early llama-bench results for DeepSeek-V4-Flash-UD-Q4_K_XL show a 144.44 GiB, 284.33B model on 8× RTX 3090, CUDA NGL=99, reaching 258.77 ± 2.23 t/s prefill at pp512 but only 19.73 ± 0.24 t/s generation at tg128; another user reports a laptop-class Framework 16 setup with 96GB DDR5 + 8GB GDDR6 RX 7700S achieving ~70 TPS prefill and ~7 TPS generation by pinning dense layers to the 7700S and experts to the integrated 780M at ~100 W TDP. Commenters are optimistic about Unsloth Dynamic Quants and hosted V4-Flash quality, but several characterize local GGUF performance as immature: “very low speeds” on high-VRAM multi-GPU rigs and a hope that throughput improves as llama.cpp/backend support matures.
- Users noted that running these DeepSeek-V4-Flash GGUFs currently requires a specific llama.cpp fork/branch with a checkpointing fix: danielhanchen/llama.cpp deepseek-v4-checkpointing-fix. This suggests upstream support is still immature and performance/stability may depend heavily on using the patched backend.
- One benchmark on 8× RTX 3090 reported low generation throughput for DeepSeek-V4-Flash-UD-Q4_K_XL: model size 144.44 GiB, 284.33B params, CUDA backend, NGL=99, with pp512 prefill at 258.77 ± 2.23 t/s and tg128 generation at only 19.73 ± 0.24 t/s. The commenter expected better and contrasted it with being “spoiled” by 27B int8, implying the large MoE/quantized GGUF path is still bottlenecked despite multi-GPU capacity.
- A Framework 16 user reported custom inference performance around ~70 TPS prefill and ~7 TPS generation using 96GB DDR5 plus an 8GB Radeon 7700S, with dense layers pinned to the dGPU and experts placed on the integrated 780M. They estimated roughly ~100 W inference TDP, highlighting a heterogeneous CPU/iGPU/dGPU placement strategy for running the model on a relatively low-cost laptop setup.
What China Said at the UN’s First Global Dialogue on AI Governance (Activity: 571): At the UN’s first Global Dialogue on AI Governance in Geneva, China’s MIIT Minister Li Lecheng framed the UN as the primary venue for AI governance and emphasized Global South capacity-building, consensus-based standards, and balancing AI development with safety (article). China explicitly endorsed open-source AI as a global public good, citing DeepSeek and Qwen as reducing AI adoption costs, while opposing fragmented governance regimes, exclusive blocs, and supply-chain bifurcation; the article argues this stance weakens claims that Beijing is preparing export controls on open-source models. Top comments were mostly sarcastic or meme-driven, including jokes about competing with Sam Altman/OpenAI and “llama.ccp,” with no substantive technical debate.

2. Local LLM Coding and RAG Benchmarks

Qwen3.6-27b does not understand software architechure. (Activity: 789): The post reports that Qwen3.6-27B performs poorly on large-scale software engineering tasks in a 100k+ LOC commercial codebase: it tends to generate code that satisfies local requests while ignoring architectural constraints such as separation of concerns, test automation, SRP, interface granularity, and maintainability. The author asks for reusable SKILL.md files encoding software-architecture guidance to steer the model toward production-grade patterns. Top commenters argue this is not Qwen-specific: current LLMs generally do not “understand” architecture and should not be expected to infer unstated design requirements. Suggested workflows include explicitly providing architecture docs/context, asking the model to first produce an architectural report, then iterating via code review prompts such as “what would you have done differently?” before generating final implementation prompts.
- Several commenters argued that failures here are less about Qwen-specific coding ability and more about insufficient architectural context: one suggested first prompting the model to review the repository and generate a technical architecture report covering modules, responsibilities, and dependencies, then using that report as persistent context for subsequent implementation tasks. They also recommended iterative review loops—after code generation, ask the model to inspect the branch and answer “what would you have done differently”—claiming 5–6 iterations can materially improve design quality.
- A recurring technical workflow recommendation was to avoid giving code agents direct implementation commands without a plan. Commenters described using written design proposals before allowing an agent to modify code, explicitly instructing models to reuse existing library capabilities before adding new abstractions, and treating missing prompt/documentation detail as effectively outsourcing architecture to the LLM.
- One commenter emphasized model-scale expectations: Qwen 27B was described as strong for its size but unlikely to reliably infer software architecture compared with much larger frontier models. They contrasted it with Fable 5, claiming it can produce architecture but has a “brain” 150+ times larger than Qwen 27B, and suggested using larger remote models via OpenRouter to critique plans generated incrementally by the smaller local model.
Can you trust local models to answer accurately? (Activity: 584): The image is a benchmark table, “Accuracy & Memory Across Local Models,” evaluating local LLMs on 7,648 generated multiple-choice technical questions from docs for Node, LangChain.js, TypeScript, Transformers.js, and Vue. It shows that unsupported local-model accuracy is much weaker than grounded runs, while RAG sharply improves results—e.g. Apple Intelligence / AFM 2 3B on-device reportedly rises from 60.2% No RAG to 86.2% With RAG despite a ~4k context limit, and larger local models such as Qwen 3.6 27B reach about 96.9% with RAG. The image supports the post’s conclusion that local LLMs are much more trustworthy for developer Q&A when retrieval injects relevant documentation; see the chart here. Commenters generally agreed that small models like Apple Intelligence and Gemma E2B are surprisingly strong for their size, while larger Gemma/Qwen models achieving 82%+ without RAG was seen as a sign of rapid progress. There was also agreement that browser/search tooling or RAG is essential for accuracy-sensitive technical answers.
- Commenters noted that Gemma 31B and Qwen 27B reportedly reaching 82%+ accuracy without RAG is a major improvement over results from roughly six months prior, when comparable local-model accuracy was described as about half that. The thread frames this as evidence that current mid-sized local models are becoming more viable for factual QA, though still improved substantially by external tooling.
- One technical workflow mentioned was connecting local models to a browser MCP search tool via a Chrome extension with opencode, so the model can retrieve current web information when high accuracy is needed. This was presented as a practical alternative to trusting the base model’s parametric memory alone.
- There was interest in finding a reliable self-hosted RAG stack, with one commenter noting prior attempts involved a clunky Dockerized web-fetch component and agent-only harnesses. The implicit technical concern was that local-model accuracy depends heavily on the surrounding retrieval/fetching pipeline, not just the model checkpoint.
This is what Hy3 is capable of. Mother of god. (Activity: 459): A user reports that Hy3 (free) via OpenRouter, run in an empty opencode harness, generated a single-page HTML “relaxing flight simulator” from the prompt “create a beautiful, relaxing flight simulator in a single html page”; the resulting demo is hosted on CodePen. Technical feedback notes missing collision handling, horizontally inverted controls, and largely stock components: procedural terrain, basic camera/controller logic, and simple colored geometry. A commenter compares it to a one-shot Fable result (pilotwings.vercel.app), claiming Fable produced more correct flight physics and outperformed Minimax M2.7/M3 and local Qwen in their tests. Commenters are split: one argues the Hy3 output is mostly recombined tutorial-like code and should be tested with less common feature requests, while another says the result is strong for a single-sentence prompt and reflects major progress over the last ~6 months.
- One commenter argued the demo is mostly a composition of common training-set patterns rather than novel game logic: no collision, horizontally inverted controls, a tutorial-like terrain generator, basic camera/controller code, and simple colored shapes. They suggested testing Hy3 by asking for features that are not common in tutorials to better evaluate generalization.
- A comparison was made to Fable, which reportedly generated a similar Pilotwings-style demo from one prompt on release: https://pilotwings.vercel.app. The commenter said they tested it against MiniMax M2.7/M3 and local Qwen models, claiming none were close and that Fable’s physics were “almost correct.”
- Another commenter framed the result as notable given it came from a single-sentence prompt, emphasizing perceived progress in code/game generation over the last 6 months. A separate technical preference was expressed for a future Qwen3.7-56B model over the current Hy3-style demo.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Grok 4.5 Launch and Coding Benchmarks

Grok 4.5 is live (Activity: 1343): The post announces “Grok 4.5 is live” via a benchmark table image: image. The highlighted Grok 4.5 column reports 83.3% on Terminal-Bench 2.1, 78.0% on SWE-Bench Multilingual, 62.0% on DeepSWE 1.0, and 64.7% on SWE-Bench Pro, positioning it slightly behind some named frontier competitors but competitive on software-engineering benchmarks. Commenters focused less on raw benchmark rank and more on cost/performance, calling the reported $2/$6 pricing “the real surprise” and pointing to xAI’s claimed pricing/efficiency advantage of up to 2× versus current frontier models.
- Commenters focused on Grok 4.5’s pricing/performance: $2/$6 (presumably input/output token pricing) was described as the standout surprise if the published benchmark results hold up.
- A technical point highlighted the xAI pricing/efficiency claims: Grok 4.5 is reportedly near-frontier on benchmark scores while claiming up to 2x better efficiency than the current leading frontier model, with output-token throughput and latency framed as the key metrics.
- Several comments argued that if the benchmarks, speed, and pricing remain stable in production, Grok 4.5 could win enterprise adoption despite brand concerns, because buyers will primarily optimize for passing internal evals, lower latency, and reduced inference costs.
Introducing Grok 4.5 (Activity: 1160): ****xAI/SpaceXAI announced Grok 4.5, a large model positioned for coding, agentic workflows, and technical knowledge work, trained on curated technical data plus large-scale RL over multi-step engineering tasks using tens of thousands of NVIDIA GB300 GPUs. The announcement claims strong SWE/terminal benchmark performance, 80 TPS serving, and unusually high output-token efficiency—about 15.9k output tokens per SWE Bench Pro task versus ~67k for Opus 4.8—at pricing of $2/M input tokens and $6/M output tokens, with availability in Grok Build, Cursor, and the API console. The main technical discussion focused on token efficiency as a cost/performance differentiator, with one commenter arguing Anthropic models are expensive not only per token but also because they produce excessive “fluff.” Another commenter rejected Grok on trust grounds, saying they did not want an LLM “grounded in misinformation.”
- Commenters noted that the launch copy emphasizes token efficiency, contrasting Grok 4.5 with Anthropic models that some users characterize as producing excessive verbose output and therefore higher effective cost despite similar capability. The technical concern is not just price per token, but total generated-token burn from “fluff,” which can materially affect real-world inference cost.
- One commenter pointed out that the announcement includes the DeepSWE benchmark, which they describe as closer to realistic software-engineering tasks than many generic LLM evals. They argue that inclusion of DeepSWE suggests Grok 4.5 may be technically competitive despite the negative reception in the thread.
- A user reported a deployment/availability issue: grok-4.5 returns “The model grok-4.5 is not available in your region” in Europe. This suggests either regional rollout gating, compliance restrictions, or product availability limitations for EU users.
Grok-4.5 on par with gpt-5.5-xhigh in coding at half the cost (Activity: 1058): The image is a technical benchmark scatter plot, “Artificial Analysis Coding Agent Index vs. Cost per Task”, showing Grok Build – Grok 4.5 positioned in the “most attractive quadrant”: roughly comparable coding-agent index to Codex – GPT-5.5 xhigh while costing about half as much per task. The post’s claim is that Grok-4.5 offers near-frontier coding performance with substantially better cost efficiency versus OpenAI’s highest-tier coding agent, alongside comparison points for Anthropic, Google/Gemini, DeepSeek, Cursor, Moonshot AI, and Z.ai. Comments are mixed: one user reports hands-on coding tests where Grok-4.5 performs near Opus/GPT-5.5 quality at a much better price, while others are skeptical that Grok will remain competitive beyond “one day.” Gemini’s placement/performance in the chart is also criticized.
- A user reported several hours of hands-on coding tests where Grok-4.5 performed near their usual “hard task” models, specifically GPT-5.5 and Opus 4.8, while their normal workflow uses Sonnet 5 or GPT-5.4 for routine coding. They emphasized that combining the base Grok model with added Cursor data made it “GOOD,” and suggested Grok-4.5 may be viable as a lower-cost daily coding model if results hold up beyond the initial testing window.
- One commenter noted an evaluation transparency issue: other models apparently disclose the inference setting used, but Grok-4.5’s run configuration was unclear. They were testing it in Grok Build on medium to conserve tokens, implying that benchmark comparisons may be difficult to interpret without knowing whether Grok was run at medium, high, or another reasoning/compute setting.
Gemini is even worse than grok now🥀🥀🥀 (Activity: 1103): The post’s image is a benchmark screenshot from Artificial Analysis comparing model rankings on an “Intelligence Index” and “Coding Agent Index”; highlighted bars show Grok 4.5 at 54 on intelligence and Grok Build / Grok 4.5 at 76 on coding, while Gemini CLI / Gemini 3.1 Pro appears much lower on the coding chart at 43. The title frames this as “Gemini is even worse than Grok now,” but the chart is mainly a leaderboard comparison rather than a direct technical evaluation; see the image. Comments push back that Grok’s scores are “very respectable” and that comparing a newer Grok release against an older Gemini generation may be misleading, with one commenter claiming Gemini’s next contender is not out yet. Another commenter notes perceived benchmark double standards, arguing that people dismissed Artificial Analysis when Gemini led, and points to Gemini 3.1 Pro still allegedly doing better on accuracy/hallucination metrics in a separate Artificial Analysis view.
- Several commenters argued the comparison is generation-mismatched: Grok’s current benchmark scores are described as “very respectable,” while Gemini has not yet released its contender for the newest model wave, making comparisons against an older Gemini release potentially misleading. One commenter claimed “Gemini 3.5” is expected on 07/17, implying the current leaderboard gap may be temporary.
- A technical counterpoint referenced Artificial Analysis metrics, claiming the roughly 6-month-old Gemini 3.1 Pro still beats Grok on accuracy and hallucination rate in the linked leaderboard: https://artificialanalysis.ai/?media-leaderboards=video-editing&omniscience=omniscience-index#omniscience-tabs. This frames the debate as not just raw benchmark rank, but reliability metrics such as hallucination behavior.
- Multiple comments questioned benchmark validity: one noted prior accusations that Google had “benchmaxxed” when Gemini led the same benchmark, while another stated that benchmarks can be learned by models and are therefore unreliable. The underlying technical concern is benchmark contamination/overfitting, where leaderboard gains may not translate to real-world generalization.

2. Claude Platform Updates: Agent Cost Splitting, Limits, Certifications

Anthropic just benchmarked "Fable 5 orchestrates, cheap models execute": 96% of the performance at 46% of the cost. You can run this pattern in Claude Code today (Activity: 1709): The post cites Anthropic/ClaudeDevs multi-agent benchmarks showing Fable 5 orchestrator + Sonnet 5 workers reaching 96% of all-Fable performance at 46% cost on BrowseComp (86.8% vs 90.8% accuracy; $18.53 vs $40.56/problem), while a Sonnet 5 executor consulting Fable 5 gets ~92% performance at ~63% cost on SWE-bench Pro (thread, docs). The author maps this to Claude Code via per-subagent model: frontmatter, per-agent effort:, and a CLAUDE.md delegation policy, while warning that since v2.1.198 the built-in Explore subagent inherits the main-session model unless shadowed by a user-level Explore pinned to haiku. They package the pattern as pilotfish, a six-role Claude Code setup with scouts, executors, verifier, and security role, install/uninstall notes, and quota caveats (GitHub, deeper quota writeup on r/ClaudeCode). Commenters were skeptical that this is novel, arguing it is essentially standard agent routing—e.g. an Opus/Fable coordinator dispatching cheaper Sonnet agents—though one noted Claude Code still lacks coordinator control over effort. Another commenter said similar savings are achievable with workflows/ultracode by using Fable for context/planning/final review and Sonnet/Opus agents for lower-level tasks, emphasizing constrained fan-out to reduce token usage.
- Several commenters framed the Anthropic result as a standard multi-agent coordinator/executor pattern: an expensive model such as Opus or Fable 5 acts as dispatcher/coordinator while cheaper models execute scoped work. One technical limitation noted was that the coordinator can choose the model but “can’t set effort,” implying incomplete control over inference budget/reasoning intensity in current tooling.
- One user described an operational setup using workflows + ultracode where Fable 5 builds context, deploys workflows, and has final say on PRs/research/reviews, while Sonnet 5 handles low-level tasks and Opus 4.8 handles synthesis/review. They claimed lower token usage than an Opus-only workflow and reported running two side-by-side Rust codebase projects on a 20x plan with some Opus quota still remaining after reset.
- A shared fable-chief-agent skill formalized a tiered delegation policy: Fable 5 owns intent, architecture, tradeoffs, risk assessment, disagreement resolution, and final approval; Opus handles complex implementation/debugging/security/concurrency review; Sonnet handles scoped implementation/tests/refactors; Haiku handles repo discovery, summaries, logs, and checklist verification. The prompt also defines high-risk domains—auth, billing, permissions, migrations, data loss, caching, concurrency, public APIs—and requires evidence-backed delegation plus a final verification gate before responding.
5 hour and weekly limits have been reset. Thanks Anthropic! (Activity: 1269): The image is not a meme; it is a screenshot of a verified ClaudeDevs X post stating: “We’ve reset 5-hour and weekly rate limits for all users” (image). In context, the Reddit post is noting an Anthropic/Claude usage quota reset affecting both short-window 5-hour limits and weekly limits, but no technical rationale is provided in the screenshot or comments—so any link to “5.6” is speculative. Commenters mostly speculate about timing and competitive pressure, with one joking that the thanks should go to OpenAI instead, implying Anthropic may have reset limits in response to market competition rather than pure goodwill.
New Claude Certifications Introduced Today (Activity: 1131): The image (jpeg) shows Anthropic/Claude Partner Academy introducing three certification tracks dated 8-Jul: Claude Certified Associate and Claude Certified Developer at the Foundations level, plus Claude Certified Architect at the Professional level. The cards appear to target different Claude users—from general foundational users to developers and solution architects—but the post/comments provide no hard technical curriculum details, benchmark requirements, or implementation standards beyond the certification labels and intended audiences. Commenters were skeptical that the certifications represent real technical architecture expertise, with one noting the Architect exam allegedly frames “high stakes refactor” management as simply using plan mode, calling it more like vendor enablement/customer training than architecture. Other replies mocked the badges as likely Claude-generated and joked about needing a “Claude Certified Terms of Service Reader.”
- A commenter who reviewed the Claude Architect certification said at least one question framed “how should you manage a high stakes refactor” with the expected answer being to use Claude’s plan mode. They criticized this as more of a product-workflow/customer-enablement test than a true software architecture certification, implying the exam may emphasize Anthropic-specific usage patterns over architecture principles.

3. GPT-5.6 Sol Launch and Competitive Pressure

GPT-5.6 Sol, along with Terra and Luna, will launch publicly this Thursday. (Activity: 1055): The image is an announcement-style screenshot claiming OpenAI will publicly launch “GPT-5.6 Sol”, alongside variants or companion models “Terra” and “Luna,” on Thursday, with expanded global preview access (image). No benchmarks, architecture details, pricing, API specs, context length, or capability comparisons are provided in the post or comments, so the technical significance is limited to a purported model-release announcement rather than an evaluable technical disclosure. Commenters focus mostly on market competition and naming: one suggests this may pressure Anthropic to keep “fable” access available, while another criticizes OpenAI’s naming as becoming confusing again. Some users are planning around expected usage limits, e.g. saving their weekly quota for the launch.
The only smart decision Anthropic can do is reset Fable 5 limits just before GPT-5.6 launch (Activity: 922): The image is a screenshot of an apparent OpenAI launch post for “GPT-5.6 Sol”, with companion labels “Terra” and “Luna”, framed by the Reddit title as competitive pressure on Anthropic to reset or extend Fable 5 weekly usage limits before the supposed Thursday launch. The post is mostly speculative/contextual rather than technical: it discusses product-access strategy, rate limits, and subscription retention, not model architecture, benchmarks, or implementation details. Commenters argue Anthropic’s best retention move would be to keep Fable 5 available on paid accounts, not merely reset limits temporarily. Several users complain that prior messaging caused them to exhaust weekly limits early, making an extension feel unusable in practice.
- Several users focused on the mechanics of Anthropic’s temporary Fable 5 access extension: extending availability until “12 July” without also resetting consumed usage caps meant users who spent their quota early still could not use the model. The technical/product complaint is that model-retention windows and quota accounting are being treated separately, making the extension operationally ineffective for capped subscribers.
- A recurring theme was that Anthropic’s competitive response to upcoming GPT-5.6 or rumored GPT-6 launches would need to be more than a one-time quota reset. Commenters argued the only durable retention move would be keeping Fable 5 available on paid Claude subscriptions, because a temporary reset does not address long-term model access once the model is removed.
- One commenter claimed Anthropic’s limit-reset behavior followed OpenAI’s own reset practices, framing quota resets as a competitive pressure response between frontier-model providers. The useful technical takeaway is that user-visible rate-limit and quota-reset policies are being perceived as part of model-platform competition, not just backend capacity management.

AI Discords

Unfortunately, Discord shut down our access today. We will not bring it back in this form but we will be shipping the new AINews soon. Thanks for reading to here, it was a good run.

not much happened today

Wed, 08 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/07/2026-7/08/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

Top Story: Grok 4.5 release

What happened

xAI/“SpaceXAI” publicly launched Grok 4.5 as a new coding-and-agents-focused frontier model, positioned on capability-per-dollar rather than absolute benchmark supremacy.

Elon Musk first said Grok 4.5 would be made public “tomorrow” based on strong beta feedback, calling it “Opus-class,” but faster, more token-efficient, and lower cost @elonmusk.
Musk later framed Grok 4.5 internally as “roughly comparable to Opus 4.7, but much faster,” emphasizing usefulness to Tesla and SpaceX engineers over benchmark chasing @elonmusk.
The official launch came from xAI’s account, describing Grok 4.5 as “our first model trained specifically for coding and agents,” trained with Cursor, and offering “frontier intelligence at leading speeds and cost efficiency” @SpaceXAI.
Cursor said it partnered with xAI to train Grok 4.5, called it “our most powerful model yet,” and stressed that it was “the first we've built for more than software engineering” @cursor_ai.
Cursor also announced in-product availability with “double usage for the first week” @cursor_ai.
Cursor clarified that “Grok 4.5 and Composer are two different model weight classes,” and that Composer 2.5 would remain available with future models in that smaller class @cursor_ai.
Early ecosystem support appeared immediately: Grok 4.5 became available in Grok Build/API/Cursor @milichab, day-0 support was announced for Hermes Agent @Teknium, and later live availability in Hermes Agent/Portal/OpenRouter/Grok subscriptions was confirmed @Teknium.
Musk said the context window would likely move from 500k back to 1M “by next week” @elonmusk.

Official claims and product details

Positioning

Officially, xAI’s message was not “best overall model,” but near-Opus quality with materially better economics and speed:

“Opus-class model, but faster, more token-efficient and lower cost” @elonmusk
“First model trained specifically for coding and agents” @SpaceXAI
“Frontier intelligence at leading speeds and cost efficiency” @SpaceXAI
“Most powerful model yet” and “first we've built for more than software engineering” @cursor_ai

This framing matters: xAI is explicitly targeting the coding-agent workflow market that has recently been dominated by Anthropic/OpenAI/Cursor-style tool-using systems, not just general chat.

Pricing and context

The concrete numbers that surfaced:

Official pricing: $2 / 1M input tokens, $6 / 1M output tokens @scaling01
Artificial Analysis repeated the same price point and added:
- cache hits discounted by 75% to $0.5 / 1M tokens
- long inputs over 200k tokens cost double
- 500k context window, down from Grok 4.3’s 1M
- vision input retained
- configurable reasoning retained @ArtificialAnlys
Musk later said the context window would probably upgrade back to 1M soon @elonmusk.

Relative pricing comparisons cited by users:

Grok 4.5: $2 in / $6 out
GPT-5.6: $5 in / $30 out
Opus 4.8: $5 in / $25 out @kimmonismus

Model size

One important spec surfaced via third-party reporting of Musk’s disclosure:

Grok 4.5 is 3x larger than Grok 4.3 at 1.5T parameters @ArtificialAnlys

That is a notable jump, and likely central to why multiple observers interpreted 4.5 as xAI’s first entry into the true flagship coding-agent tier rather than an iterative refresh.

Benchmarks and independent evaluations

Artificial Analysis

Artificial Analysis provided the most substantive external evaluation in the tweet set.

Key results:

#4 on Artificial Analysis Intelligence Index, score 54, behind only Fable 5, GPT-5.5, and Opus 4.8 @ArtificialAnlys
+16 points vs Grok 4.3 on the same index @ArtificialAnlys
GDPval-AA v2 Elo 1543, also ranking #4, behind Anthropic’s latest Claude releases @ArtificialAnlys
Top score on τ³-Banking: 33%, above 31% for GPT-5.5 (xhigh) @ArtificialAnlys
Artificial Analysis Coding Agent Index score 76 in Grok Build, “on par with GPT-5.5 in Codex” and below Fable 5 in Claude Code @ArtificialAnlys
Cost per Intelligence Index task: $0.31 @ArtificialAnlys
Cost per GDPval task: $0.49 @ArtificialAnlys
Cost per Coding Agent Index task: $2.59 @ArtificialAnlys
Average output tokens per Intelligence Index task: ~14k, over 60% lower than Opus 4.8 @ArtificialAnlys
Average total tokens per Coding Agent Index task: 1.9M, versus 7.2M for Fable 5 in Claude Code and 6.2M for GPT-5.5 in Codex @ArtificialAnlys

Artificial Analysis’ interpretation was clear: Grok 4.5 is near-frontier on capability, but unusually strong on efficiency, making it sit on the Pareto frontier for cost/performance.

Musk explicitly amplified the Artificial Analysis assessment @elonmusk.

Terminal-Bench and coding-agent framing

Several users highlighted strong coding/agent benchmarks:

Cline said Grok 4.5 “beats Opus 4.8 on Terminal-Bench,” while being fast and around 5x cheaper than GPT @cline.
Multiple commentators summarized Grok 4.5 as “on par with GPT-5.5” in coding agent evals but at lower cost @kimmonismus, @scaling01.

Other external/independent signals

Arena added Grok 4.5 to Agent Arena and Battle Mode for text, vision, and code, emphasizing long-horizon tasks with filesystem/web/terminal tools @arena.
Deep Burner added Grok 4.5 to the Surface Evolver benchmark and said it is “on the frontier,” with a better pass rate than Kimi/GLM at similar price @Deep_Burner.

Facts vs opinions

Facts / directly supported claims

Supported by official posts or benchmark organizations:

Grok 4.5 launched publicly @SpaceXAI.
It is xAI’s first model trained specifically for coding and agents @SpaceXAI.
Cursor partnered in training and distribution @cursor_ai.
Pricing is $2 input / $6 output per million tokens @scaling01, @ArtificialAnlys.
Context window is 500k, with an expected return to 1M soon per Musk @ArtificialAnlys, @elonmusk.
Artificial Analysis ranks it #4 on both broad intelligence and GDPval-style agentic evals @ArtificialAnlys, @ArtificialAnlys.
Artificial Analysis ranks Grok Build + Grok 4.5 at 76 on its coding-agent index, on par with GPT-5.5 Codex @ArtificialAnlys.
Grok 4.5 is significantly more token-efficient than Fable/GPT-5.5 in Artificial Analysis’ coding-agent measurements @ArtificialAnlys.

Opinions / interpretations

These were common, but not independently validated in the dataset:

“Cursor deal paid off” @kimmonismus, @teortaxesTex, @scaling01
“xAI is back in the game” @teortaxesTex
“Heroes literally saved Grok project” @teortaxesTex
“This is a bigger deal than yall think” @theo
“Grok 4.5 is a genuine surprise success” @kimmonismus

There is a strong community narrative here that Cursor materially accelerated or rescued xAI’s coding-model trajectory, but the only hard facts are partnership/training collaboration and distribution.

Different opinions and perspectives

Strongly positive

A substantial set of posters saw Grok 4.5 as unexpectedly competitive:

“Seriously, what?! Did NOT expect grok 4.5 to perform THAT well. On par with GPT-5.5, cheaper than opus 4.8” @kimmonismus
“Grok 4.5 is excellent and Grok Build is great too” @teortaxesTex
“Pretty damn good and REALLY well priced” @theo
“Strong new SpaceXAI / Cursor release with Grok 4.5. Impressive benchmarks at a flash-level speed, efficiency, and affordable pricing” @TheRundownAI
“The team did amazing work with Grok 4.5... the accuracy + speed make it possible to build things faster than I can think of what is required next” @tstorm
“It’s an enormous improvement over composer 2.5 and trained entirely from scratch” @amanrsanger

This cohort focused on:

Surprise at how high it placed,
Delight at price/performance,
Belief that xAI re-entered the frontier race.

Positive but more measured

Some praised economics while still placing Anthropic/OpenAI above it:

“Grok 4.5 is not quite at the level of Fable 5 or GPT-5.5, but it doesn't need to be if you are using a combination of models in your agent orchestrator” @omarsar0
“Probably the most important point... nearly Opus-4.8 level quality, for $6/Mtokens output instead of $25/Mtokens” @AymericRoucher
“If these benchmarks are representative of real world performance and pricing is only $6 output then it should do really well” @scaling01
“The obvious upside is that it increases the competitive pressure on OpenAI and Anthropic to either lower their prices” @kimmonismus

This is probably the modal expert take in the tweets: not best-in-class overall, but maybe best buy.

Skeptical / critical

The skepticism centered less on benchmark quality and more on architecture, context, and long-session behavior:

Teortaxes noticed 500k context and high cache-hit costs as a regression from prior Groks, inferring a more conventional architecture choice and lower elegance than hoped @teortaxesTex.
The same user later speculated Grok 4.5 might be “just an upscaled Grok 4.2” rather than something radically new, though explicitly labeled this as uncertainty @teortaxesTex.
They also reported deterioration later in long sessions: “Grok seems to get tired and start lazily cheating later into the session (247K/500K)” @teortaxesTex.
Another practitioner said a thing they didn’t like was that the model “thinks quite a bit, often very thorough when it really shouldn't be,” even while praising a real optimization result (>90% battery reduction in Aerospace) @jhanikhil.

These are useful qualitative cautions: efficiency and benchmark position do not imply perfect harness behavior, stable long-horizon conduct, or ideal verbosity.

Neutral / contextual

A few observers folded Grok 4.5 into a broader “frontier compression” story:

“The best proof that Fable and GPT-5.6 are ‘next generation’ is the surge of other labs catching up to the previous generation” @theo
“GLM-5.2 is close to Opus. Grok 4.5 allegedly beats Opus and gpt-5.5... Feels like it barely matters now” @theo
“I probably can’t pass a blind test between GPT-5.6 Sol, Claude Fable 5, and GLM-5.2 for 95% of my daily use cases” @Yuchenj_UW

In that view, Grok 4.5 is important not because it becomes the clear #1 model, but because frontier coding/agent capability is diffusing across more providers and price tiers.

Technical details worth extracting

Collected specs and metrics from the tweets:

Training focus: specifically for coding and agents @SpaceXAI
Training partner: Cursor @SpaceXAI, @cursor_ai
Model size: 1.5T params, 3x larger than Grok 4.3 @ArtificialAnlys
Context window: 500k at launch, prior Grok 4.3 was 1M, likely returning to 1M @ArtificialAnlys, @elonmusk
Pricing:
- $2 / 1M input
- $6 / 1M output
- $0.5 / 1M cached-hit tokens
- 2x cost for long inputs >200k @ArtificialAnlys
Artificial Analysis Intelligence Index: 54, rank #4 @ArtificialAnlys
Artificial Analysis GDPval-AA v2 Elo: 1543, rank #4 @ArtificialAnlys
Artificial Analysis Coding Agent Index: 76, rank #3, on par with GPT-5.5 in Codex @ArtificialAnlys
τ³-Banking: 33%, above 31% for GPT-5.5 xhigh @ArtificialAnlys
Cost per Intelligence Index task: $0.31 @ArtificialAnlys
Cost per GDPval task: $0.49 @ArtificialAnlys
Cost per Coding Agent Index task: $2.59 @ArtificialAnlys
Avg output tokens per Intelligence task: ~14k, >60% below Opus 4.8 @ArtificialAnlys
Avg total tokens per Coding Agent task: 1.9M, vs 7.2M for Fable 5 Claude Code and 6.2M for GPT-5.5 Codex @ArtificialAnlys

Those numbers are the core reason the launch landed so strongly: Grok 4.5’s story is not “best benchmark score,” but “close enough to top-tier while spending dramatically fewer tokens at much lower list pricing.”

Why the Cursor partnership mattered

The Cursor angle showed up repeatedly and is probably the key non-benchmark story.

Facts:

xAI says Grok 4.5 was trained with Cursor @SpaceXAI.
Cursor says “We’ve partnered with SpaceXAI to train Grok 4.5” @cursor_ai.

Interpretation from posters:

“Cursor deal paid off” @kimmonismus
“What the hell does Cursor know?!” @teortaxesTex
“Heroes literally saved Grok project” @teortaxesTex

Why engineers care:

Cursor has enormous real-world coding interaction data and strong incentives around edit efficiency, agent usability, and iterative software workflows.
If Grok 4.5 was genuinely trained around those workflows, that may explain the token-efficiency results more than raw capability alone.
This is one of the clearest examples in the tweet set of the app-layer and model-layer collapsing into a shared training loop: coding product telemetry and eval pressure feeding back into foundation-model post-training or co-training.

That also aligns with a broader industry trend visible elsewhere in the tweets: vendors are increasingly optimizing for task-completion and agent-harness performance, not just standalone chat.

Real-world usage reports

Though thinner than the GPT-5.6 chatter in the dataset, several practitioners shared hands-on signals:

Theo: “Pretty damn good and REALLY well priced” after extensive testing @theo
Tstorm: daily driver praise around “accuracy + speed” @tstorm
Chaitu: “The speed at this level of intelligence lets you get a lot more done” @chaitu
Jhanikhil: positive on practical optimization work, but found it overthinks sometimes @jhanikhil
Teortaxes: praised “sheer speed and decisiveness,” but observed possible degradation deep into long contexts @teortaxesTex

This mix suggests a model that is already viable in day-to-day coding/agent stacks, but whose harness behavior under long sessions and verbosity control remains an active concern.

Context: why Grok 4.5 matters now

The release landed in a news cycle dominated by:

OpenAI pre-announcing GPT-5.6 Sol and then launching GPT-Live
Anthropic/Fable/Opus serving as the implicit coding-agent gold standard
GLM-5.2, DeepSeek, Kimi, and MiniMax driving rapid price/performance pressure from China
Widespread industry movement from “best benchmark answer” to “reliable, efficient agent completion”

In that context, Grok 4.5 matters for several reasons:

It gives xAI a credible entrant in the coding-agent tier rather than just a consumer-chat brand.
It pressures OpenAI/Anthropic on price, not just quality.
It reinforces that product-integrated training loops may now matter as much as raw pretraining scale.
It shows the frontier is broadening: #4-quality models with much better economics can materially change developer defaults.
It strengthens the case that agentic workloads should be measured in $/task, tokens/task, and wall-clock completion, not solely leaderboard rank.

The tweets repeatedly converged on this implication: if Grok 4.5’s external evals hold up in production, it may become a default executor model inside orchestrated systems even if users still prefer Fable or GPT-5.5/5.6 as advisors, reviewers, or edge-case specialists @omarsar0.

Competitive implications

The release sharpens a few fault lines:

Anthropic/OpenAI still lead on absolute frontier quality in most commentary and in Artificial Analysis rankings.
xAI appears to have jumped ahead of Google’s Gemini line in this coding/agent framing, a point several users made explicitly @scaling01, @ArtificialAnlys.
Open model challengers like GLM-5.2 remain relevant on cost/performance, but Grok 4.5 pushes the closed-model Pareto curve down materially.
For app builders, single-provider loyalty looks weaker: one likely emerging pattern is Grok as cheap/fast executor, with Fable or GPT-family models as advisor/reviewer/specialist @omarsar0, @omarsar0.

Remaining open questions

The tweets also leave unresolved issues that technical readers should track:

How robust is Grok 4.5 on very long-horizon sessions near the context limit?
Is the strong token efficiency mostly a model property, a harness property, or both?
How much of the gain came from Cursor-derived data/evals versus architectural scaling?
Will the promised return to 1M context preserve speed and economics?
How aggressive are the guardrails compared with Fable/GPT-style enterprise models?
Does “trained from scratch” mean a genuinely new base or a major re-run with coding-agent-specific objectives/post-training? Cursor’s and Aman Sanger’s wording supports the stronger interpretation, but the public materials in the tweets don’t fully decompose the training stack @amanrsanger.

Other Model Launches & Frontier Model Chatter

OpenAI pre-announced GPT-5.6 Sol plus Terra and Luna for Thursday launch, with broad preview expansion @OpenAI. Early testers were unusually bullish:
- “significant step up in math and coding capability” @AcerFur
- “best model I’ve ever used,” “fixed all the problems I had with GPT-5.5,” “world leading in computer use” @theo, @theo
- “fast, smart, genuinely creative,” with front-end design finally fixed @skirano
- Mitchell Hashimoto’s practical comparison: Sol is default for most work; Fable still wins on targeted debug/security/performance tasks @mitchellh
OpenAI instead launched GPT-Live, a third-gen full-duplex voice architecture with built-in async delegation to a frontier model in the background @juberti, @OpenAI. Key details:
- full-duplex voice, not turn-based pipeline
- GPT-Live-1 and GPT-Live-1 mini
- available in ChatGPT across web/iOS/Android, API “coming soon” @OpenAI, @OpenAIDevs
- delegates web search/deeper reasoning to a frontier model behind the scenes @OpenAI
OpenAI also said it audited SWE-Bench Pro and found 30% of tasks broken, retracting prior recommendation to use it as a leading coding eval @OpenAI.
Cognition launched SWE-1.7, built on a Kimi K2.7 base, claiming near-frontier coding performance at 1000 tok/s @cognition. Notable details:
- FrontierCode Main set: 42.3%
- $1.97 cost per task
- self-compaction for long-horizon tasks
- available in Devin across web/desktop/CLI @cognition, @cognition, @cognition
Mistral launched Robostral Navigate, an 8B embodied navigation model using a single RGB camera, claiming SOTA on R2R-CE @MistralAI.
NVIDIA/LangChain announced the NemoClaw Deep Agents Blueprint, pitching a fully open enterprise agent stack with “benchmark-leading performance” and 10x lower inference cost @LangChain, @nvidia. LangChain later quantified:
- aggregate score 0.86
- cost $4.48
- closest-performing model $43.48 @LangChain

Open Models, Infra, and Cost Engineering

Prime Intellect announced a $130M Series A at $1B valuation to build an “Open Superintelligence Stack” spanning compute, RL, environments, sandboxes, evals, and deployment @PrimeIntellect, @vincentweisser. One strategic claim: RL broadens who can build frontier AI beyond a few pretraining-heavy labs.
Together introduced Provisioned Throughput, reserved serverless capacity for open frontier models with:
- token-based pricing
- 99% uptime SLA
- “up to 90% lower cost vs. Opus 4.8”
- initial support for MiniMax M3 and GLM-5.2 @togethercompute
Hugging Face + SkyPilot launched cloud-agnostic storage/compute integration to reduce data lock-in and egress pain; data remains on HF Hub while compute runs wherever GPUs are available @ClementDelangue, @skypilot_org.
ZML open-sourced ZML/LLMD, its homegrown LLM server across NVIDIA, AMD, Metal, Intel, TPU, with DFlash, continuous batching, and prefix caching @steeve.
llama.cpp added DFlash speculative decoding support alongside MTP, Eagle3, and n-gram techniques @ggerganov.
Modal-style economics discussion continued: serverless GPU hourly rates can be higher while aggregate cost is lower depending on peak-to-average demand ratio @charles_irl.
Several posts argued the winning metric is now $/task, not $/token, especially for coding agents @Yuchenj_UW, aligning with Grok 4.5 and SWE-1.7 discourse.

Research, Benchmarks, and Evaluation Methodology

A Chinese rolling logic benchmark shifted from best-of-3 “extreme score” emphasis toward median reliability, motivated by agent workflows where retries are costly @ZhihuFrontier. Useful details:
- private Chinese-only eval set
- up to 28 questions / ~270 test cases
- monthly score drift within ~3 points considered normal
Epoch updated the Epoch Capabilities Index uncertainty methodology with tighter confidence intervals via bootstrap resampling @EpochAIResearch, @EpochAIResearch. It also scored GLM-5.2 at 152 ECI, the highest open-weight model they’ve evaluated @EpochAIResearch.
Oxford-origin taxonomy synthesis highlighted six recurring LLM-agent failure clusters across 27 papers / 19 benchmarks: tool-use errors, planning/constraint failures, long-horizon degradation, multi-agent coordination failures, safety failures, and measurement validity issues @dair_ai.
New memory work NapMem reframes memory retrieval as a learned action space over multiple granularities, trained with memory-tool RL @omarsar0.
Caroline Choi et al. presented Anchored Self-Play for Code Repair, showing self-generated bug-fix curricula help only if grounded in realistic bug distributions @carolineschoi, @carolineschoi.
Artificial Analysis launched a Controlled Voice Arena standardizing voice cloning across 8 shared voices. Results:
- overall leader: Cartesia Sonic 3.5 at 1122 Elo
- top open-weights: Fish Audio S2 Pro at 1034 Elo @ArtificialAnlys

Multimodal, Robotics, and Media Models

ByteDance’s Seedream 5.0 Pro rolled out on fal, marketed for image generation plus design-sensitive editing, text rendering, layout, separate layers, multilingual text, and structured design outputs @fal, @TheRundownAI.
Artificial Analysis evaluated Nano Banana 2 Lite:
- #5 on text-to-image
- #18 on image editing
- ~3.4s average 1K image generation
- $33.60 / 1k images via Gemini API, half the price of Nano Banana 2 @ArtificialAnlys
Google pushed Video Remix in Google Photos, powered by Gemini Omni, for style transfer and lightweight video editing @Google.
Robbyant/Ant Group open-sourced LingBot-Vision, trained on 161M images filtered from 2B raw, no human labels, with open weights from 1.1B down to 21M; Kimmonismus highlighted strong depth performance and LingBot-Depth 2.0 improvements on reflective surfaces @kimmonismus.
Related embodied releases:
- LingBot-Video: 30B MoE, 3B active, plus 70k hours embodied data @_akhaliq
- LingBot-World 2.0: hour-long interactive world model at 720p/60fps @_akhaliq
- RynnWorld-4D for robotic manipulation @_akhaliq
Kuleshov’s group posted a useful synthesis on diffusion language models, covering MDLM, iterative refinement, variable-length generation, controllable generation, fast samplers, and RL post-training @volokuleshov.

Ecosystem, Product, and Enterprise Buildout

Nous launched Hermes Cloud, hosted instances for its agent stack @Teknium. Separate Hermes Agent posts detailed advanced slash-command control for goals, background tasks, model switching, reasoning budgets, rollback, compression, and mixture-of-agents @IBuzovskyi.
VS Code shipped a significant Copilot/agent update with browser agent tools, parallel workflows via Agents window, BYOK model discovery, and cost visibility @code, while VS Code 1.128 also improved grouped/workspace-less chats @pierceboggan.
Google AI Studio now supports direct GitHub import/sync into build workflows @GoogleAIStudio, @_philschmid.
Restate announced BYOC for durable workflow/agent backends, claiming production use at 100k durable actions/sec @StephanEwen.
Glass Health launched Glass for Patients, extending its clinician-facing healthcare AI to consumers; company says 120,000 clinicians already use Glass @GlassHealthHQ.
Databricks engineering reported that on internal coding tasks, OpenAI, Anthropic, and GLM-5.2 all land on the Pareto frontier; the key unlock is routing, not vendor lock-in @matei_zaharia, @Yuchenj_UW.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. China AI Models: Access Controls and Scaling

Beijing IS NOT looking at curbing overseas access to China's top AI models (Debunking the Reuters report) (Activity: 1381): The post disputes a Reuters report claiming Beijing may restrict overseas access to leading Chinese AI models, arguing the cited Ministry of Commerce meetings with Alibaba, ByteDance, Z.ai, etc. were instead about foreign acquisitions, investment, IP leakage, and talent/technology outflow controls. It points to a Chinese court/IPC-linked policy discussion document as evidence that China’s framing is not anti-open-weight distribution, but “trustworthy and controlled” open source—i.e., promoting Chinese model diffusion while managing risks such as foreign ownership/control and sensitive information extraction from weights. The post highlights scholar Gu Lingyun warning that strict cross-border controls on open-source weights could be “self-inflicted” by forcing Chinese developers to choose between compliance and global participation. Top comments were skeptical of the Reuters framing, suggesting ambiguity or unreliable sourcing, with one commenter speculating the sources could be Anthropic/OpenAI and another arguing China is unlikely to restrict access because Chinese models are helping undermine perceived US AI market dominance.
- One substantive theme argues that open-weight Chinese models are a market-access strategy, especially for reaching US developers and enterprises where monetization and ecosystem influence are strongest. Commenters suggest that restricting overseas access would undermine China’s competitive advantage against closed US labs like OpenAI and Anthropic, particularly by reducing pressure on proprietary model providers.
Beijing is looking at curbing overseas access to China's top AI models (Reuters) (Activity: 1112): The image is a Reuters news screenshot, not a meme: image. It reports that Beijing is considering restrictions on overseas access to China’s leading AI models, with authorities reportedly meeting firms including Alibaba, ByteDance, and Z.ai over national-security concerns, possible penalties for model leaks/theft, and potential limits on foreign-linked funding for domestic AI startups; see the linked Reuters article. Commenters framed this as another sign of increasing AI fragmentation and export-control pressure, worrying that access to competitive Chinese open/local models may decline. One thread pointed to Mistral as a hoped-for alternative, citing its upcoming Paris-area datacenter and speculation about training models up to 10T parameters.
- One commenter argued that Mistral may become more important if Chinese frontier/open-weight model access is restricted, citing its new datacenter near Paris as potentially enabling training of models up to roughly 10T parameters. The technical implication discussed is that European compute independence could matter if access to Chinese models is curtailed.
- A technically practical response was to archive open-weight models locally, including models users cannot currently run, because policy changes could remove future access to weights or hosting endpoints. This reflects a broader concern that “open” model availability is increasingly dependent on export controls, platform hosting, and national policy.
- Another commenter suggested NVIDIA may remain one of the few companies with strong incentives to publish open models, because open-weight releases drive demand for local inference hardware. The point was framed as an ecosystem incentive: more runnable local models can translate into more GPU sales.
China’s MiniMax Plans to Launch 2.7-Trillion Parameter Model (Activity: 902): MiniMax reportedly plans to release and open-source M3 Pro, a 2.7T-parameter LLM, as early as Q3, per The Information. The model would be ~6.3× larger than MiniMax’s current M3 (428B parameters) and is claimed to target stronger complex reasoning and multi-step instruction following. Commenters framed the release as increased competition against U.S. frontier providers, especially if the model is uncensored and open-source. There was also skepticism about local usability at this scale, with the practical path being hosted inference via datacenters/APIs, potentially lowering costs versus closed models.
- Commenters focused on the implications of a 2.7T-parameter open-source MiniMax model being too large for local consumer inference but potentially viable through datacenter/API providers. The technical argument was that if weights are open and competitive with proprietary frontier systems, multiple providers could host it, lowering serving costs versus closed-model licensing and increasing adoption pressure.
- Several comments discussed the widening gap between flagship “M-series” scale models and smaller deployable variants, with users hoping MiniMax follows a DeepSeek-style release strategy by publishing a smaller “mini” or “flash” derivative. The point was that even if the 2.7T model is impractical locally, it could serve as a base for distillation, fine-tuning, or training smaller downstream models.
- One technically relevant comparison raised was whether an uncensored open model could compete with current high-end roleplay/creative-writing models such as Fable, Sol, and Mythos. The underlying concern was not just parameter count but whether MiniMax can match proprietary models on subjective generation quality and refusal behavior.

2. Efficient Local Inference Model Releases

nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 · Hugging Face (Activity: 431): NVIDIA released NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16, a deployment-optimized hybrid Mamba/MoE/Attention LLM compressed from Nemotron-3-Super-120B-A12B via Iterative Puzzle (tech report). It shrinks from 120.7B total / 12.8B active params to 75.3B total / 9.3B active params, keeps MTP for faster decoding, supports 1M-token context, and claims ~2× higher throughput on a single 8×B200 node plus improved single-H100 1M-token concurrency from 1 to 8 requests while preserving benchmark performance across reasoning, coding, multilingual, long-context, and agentic tasks. Comments focused on deployment practicality: users highlighted the unusually attractive size/context tradeoff, with one planning aggressive local quantized inference (Q6/Q4) on 64GB DDR4 RAM. Another commenter quoted the model card positioning it as a general-purpose reasoning/chat model for agent systems, RAG, long-context reasoning, and high-volume workloads.
- Commenters highlighted the model’s positioning as a 75B BF16 general-purpose reasoning/chat model for English, code, multilingual use, collaborative agents, high-volume workloads, RAG, complex instruction following, and long-context reasoning, with a notable advertised 1M context window.
- One technical criticism was that the published benchmarks appear worse than Super-120, which the commenter already considered underwhelming, suggesting this release may not improve on its presumed source/base model despite its long-context and agent-oriented framing.
- Licensing was noted as a positive change: unlike some prior NVIDIA model releases criticized for nonstandard terms, this one was described as having a license closer to Apache 2.0 / MIT-style permissiveness, which may improve adoption for developers and commercial users.
Unsloth has uploaded several sizes of Deepseek-V4-Flash GGUF's (Activity: 588): Unsloth uploaded multiple DeepSeek-V4-Flash GGUF quantizations, but users note current inference requires a specific llama.cpp fork/branch with a DeepSeek V4 checkpointing fix. Early llama-bench results on 8× RTX 3090 for DeepSeek-V4-Flash-UD-Q4_K_XL show a 144.44 GiB, 284.33B-param model at 258.77 ± 2.23 t/s prefill (pp512) but only 19.73 ± 0.24 t/s generation (tg128) with CUDA/NGL 99. Another user reports custom heterogeneous placement on a Framework 16—dense layers on Radeon 7700S, experts on 780M, 96GB DDR5—achieving roughly 70 TPS prefill and 7 TPS generation at about 100 W TDP. Commenters are optimistic about Unsloth Dynamic Quants and hosted V4-Flash quality, but expect performance to improve as llama.cpp/backend support matures. One benchmarker said smaller 27B int8 models have “spoiled” them due to much higher practical generation speed.
- A required llama.cpp fork/branch was linked for running these GGUFs: danielhanchen/llama.cpp deepseek-v4-checkpointing-fix. This suggests current upstream support may still need DeepSeek-V4-specific checkpointing fixes before the Unsloth GGUFs run correctly or efficiently.
- One user benchmarked DeepSeek-V4-Flash-UD-Q4_K_XL on 8x RTX 3090 with CUDA offload NGL=99: model size 144.44 GiB, 284.33B params, pp512 prefill at 258.77 ± 2.23 tok/s, and tg128 generation at only 19.73 ± 0.24 tok/s. They noted the model/quant quality was good but generation speed felt low compared with a 27B int8 setup, likely reflecting immature backend/kernel support for this architecture/quant.
- A Framework 16 user reported running the model on a mixed iGPU/dGPU setup with 96GB DDR5, 8GB GDDR6 Radeon 7700S, and 780M, achieving about 70 tok/s prefill and 7 tok/s generation at roughly 100W system TDP. Their custom inference code reportedly pins dense layers to the 7700S while placing MoE experts on the 780M, illustrating a heterogeneous memory/compute placement strategy for fitting large MoE GGUFs on consumer laptop hardware.
Late to the party but... Holy MTP (Activity: 470): A user reports enabling MTP (multi-token prediction) on a Qwen 3.6 27B run and seeing roughly a 2× increase in tokens/sec, then notes they want to find “abliterated” MTP variants. A commenter corroborates similar results: ~2× throughput with a GGUF 8-bit quant, while another wants MLX MTP support to “catch up” for an expected 3–4× prefill speedup on Apple M5 hardware. Commenters frame MTP adoption as evidence that local LLM inference is still early and expect further performance gains; one specifically calls out Dspark as potentially promising.
- Users report MTP delivering a substantial decode/prefill speedup in local inference, including one report of roughly 2× speedup while using a GGUF 8-bit quant. Another commenter specifically wants MLX MTP support to mature, expecting a 3–4× prefill speedup on an Apple M5 setup.
- A technical tradeoff noted is that enabling MTP can consume an additional 1.5–2 GB of VRAM. For very large context windows, users may disable it to avoid VRAM exhaustion, crashes, or spilling into slower system RAM.

3. Local LLM Reliability for Coding and RAG

Can you trust local models to answer accurately? (Activity: 442): The image is a benchmark table, “Accuracy & Memory Across Local Models”, evaluating local LLMs on 7,648 multiple-choice questions generated from markdown docs for Node, LangChain.js, TypeScript, Transformers.js, and Vue. The key result is that standalone local models score much lower, roughly 60–83% without RAG, while retrieval augmentation boosts accuracy to about 86–97%, with Qwen 3.6 27B reportedly highest at 96.9%; Apple Intelligence / AFM 2 3B on-device is notable because it reaches about 86% despite a much smaller ~4k context window versus 32k for the other models. Commenters broadly agreed that small local models like Apple Intelligence / AFM 2 3B and Gemma 4 E2B look surprisingly capable for their size, but that accurate technical answering depends heavily on tooling such as RAG, browser search, or MCP-style integrations. There was also appreciation that larger local models like Gemma 31B and Qwen 27B now exceed 82% accuracy even without RAG, suggesting rapid improvement in local model baselines.
- A commenter highlighted that Gemma 31B and Qwen 27B reportedly achieving 82%+ accuracy without RAG is a notable jump compared with roughly six months ago, when comparable local-model accuracy was described as much lower. They also emphasized that proper tooling around the model can materially improve answer reliability.
- One user described using a browser MCP setup via a Chrome extension with opencode to let local models search the web when accuracy matters. The implied workflow is to compensate for model hallucination or stale knowledge by attaching retrieval/search tooling rather than relying on the base model alone.
Qwen 3.6 27B absolutely fails at agentic work (Activity: 833): The poster reports that Qwen 3.6 27B run via llama.cpp nightly on an RTX 6000 at 8-bit/16-bit produces strong single-shot outputs and longer generations than their Qwen 3.5 122B 4-bit/5-bit setup, but fails in multi-turn/agentic workflows with frequent instruction-following errors roughly every ~4 turns. Technical replies suggest debugging inference/configuration rather than model quality alone: using fixed chat templates from froggeric/Qwen-Fixed-Chat-Templates and verifying parameters such as preserve_thinking. Commenters push back that the report lacks enough reproducibility detail—prompting, sampler settings, chat template, and inference params—and one argues that “most people aren't having your experience,” implying the issue may be local configuration rather than an inherent 27B model failure.
- Several commenters suggested the reported agentic failures may be caused by chat-template or inference-parameter issues rather than the Qwen 3.6 27B model itself. Specific fixes mentioned included using froggeric’s corrected templates on Hugging Face (Qwen-Fixed-Chat-Templates) and ensuring parameters such as preserve_thinking are enabled/configured correctly.
- Users with successful deployments said Qwen3.6:27B can work well for coding, tool calling, and scoring when wrapped in an appropriate agent harness. One commenter reported building “four or five agents” with it and finding it “a very good coder, a good tool caller, a good scorer,” especially inside Pi code, while another recommended adapting Pi to the user’s workflow instructions.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. GPT-5.6 Sol and Grok 4.5 Launches

GPT-5.6 Sol, along with Terra and Luna, will launch publicly this Thursday. (Activity: 976): The image is a marketing-style launch announcement for “GPT-5.6 Sol”, with companion names Terra and Luna, saying public availability starts this Thursday and preview access is expanding globally: image. No technical details are provided in the post/image—there are no benchmarks, architecture notes, context-window specs, pricing, API limits, or deployment details—so its significance is mainly contextual as a claimed upcoming OpenAI model/product launch. Commenters frame the announcement as competitive pressure on Anthropic, with one saying “Competition is a win for everyone.” Others criticize the naming scheme as confusing and mention saving weekly usage limits for the launch.
Grok 4.5 is live (Activity: 1014): The image is a dark benchmark table announcing “Grok 4.5 is live” and comparing it with Opus 4.8, GPT-5.5, Composer 2.5, and Fable 5 on coding-agent benchmarks including Terminal-Bench 2.1, SWE-Bench Multilingual, DeepSWE 1.0, and SWE-Bench Pro; Grok 4.5 is shown at 83.3%, 78.0%, 62.0%, and 64.7% respectively. The technical takeaway is that Grok 4.5 appears near-frontier on software-engineering benchmarks, while commenters highlight its claimed $2/$6 pricing and xAI’s claimed efficiency gains; see the image and xAI’s pricing/efficiency page. Commenters focused less on absolute benchmark leadership and more on cost-performance, calling the $2/$6 price “the real surprise” and arguing that output-token throughput and speed may matter more than small benchmark deltas.
- Commenters focused less on raw benchmark rankings and more on pricing/throughput efficiency, noting Grok 4.5 is reportedly priced at $2/$6 and xAI claims up to 2x better efficiency than the current best frontier model in its pricing/efficiency post. The key technical question raised is whether those output-token rates and latency hold under real workloads rather than just launch benchmarks.
- A technically relevant enterprise angle was that if the published benchmark results, cost, and speed are reproducible, Grok 4.5 could win market share despite brand concerns. The argument was that procurement will prioritize passing evals, lower latency, and cheaper inference bills over public perception, especially for production LLM deployments.

2. Claude Fable 5 Limits and Local Economics

Anthropic extending Fable 5 for paid users till 12 july (Activity: 1801): The image is an X post from the verified Claude account announcing that Claude Fable 5 access is extended for paid Anthropic users through July 12. A reply clarifies the quota mechanics: paid users can spend up to 50% of their weekly usage limit on Fable 5, then either continue via usage credits or switch to another model. Commenters were mostly frustrated about planning and quota timing: several said they rushed through weekly usage or bought extra credits assuming Fable access was ending, and wished Anthropic had communicated the extension earlier or reset usage limits.
- Users report that the extension has limited practical value without a usage reset or quota adjustment: several had already consumed most or all of their weekly allowance in anticipation of losing access to Fable 5, with one user citing 71% usage and a reset not occurring until 3am Monday.
- A paid user noted they bought extra credits and rushed to finish a project because the original cutoff implied less remaining access time; the extension changes the planning horizon but exposes a communication/entitlement issue around model availability dates and paid usage caps.
WTF are you guys even working on?! (Activity: 1205): A software engineer working across a 14-year-old monorepo, 17+ services, and multiple Claude-generated side projects questions why users are exhausting 5x weekly LLM usage and treating Fable 5 pricing changes as blocking, arguing that Opus 4.8 should handle most coding tasks with only modest quality loss. The core technical point is about cost/performance tradeoffs in coding agents: whether premium models are truly necessary for production code generation, debugging, and large-context workflows, especially when generated code must still be understood and maintained by the developer. Commenters pushed back that high-end models are valuable for open-ended tasks like unsupervised code audits, bug discovery, and fast issue resolution with logs and fresh context. Several argued that using LLMs to build paid web apps or fix code faster than humans is sufficient value even if the developer does not fully understand every generated implementation detail.
- Several commenters argue that LLM coding value is strongest in codebase auditing and bug-finding, recommending simple prompts like asking the model to audit code without a narrow focus. One commenter specifically contrasts models, saying Claude Opus is “fine for coding,” but “Fable” excels at finding problems in codebases, suggesting perceived specialization between generation and review/debugging workflows.
- A recurring technical workflow described is using an agent with fresh repository context, logs, and bug reports to diagnose and patch issues autonomously. One user reports sending bug reports to Claude, letting it run in the background for hours and produce a fix after roughly 500k+ tokens, highlighting a high-token, asynchronous debugging pattern where cost is abstracted away from the developer.
- There is debate over whether developers need to fully understand AI-generated code before using it. Some commenters reject that constraint, arguing that if an agent can use logs and context to find/fix issues faster than humans, the practical metric becomes shipped functionality and maintainability rather than manual comprehension of every generated line.
would you even run fable locally if you could? (Activity: 905): The image is a dark-mode X/Twitter screenshot from Polymarket claiming a projection that Claude Fable could run locally on high-end consumer hardware within ~2 years (image). The Reddit post questions whether local inference would still be worthwhile if hosted Fable pricing drops faster than consumer hardware capability improves, framing the tradeoff as local capex / ownership vs. hosted API cost, with privacy as the obvious but possibly insufficient differentiator. Comments argue that local execution could still matter because it removes provider-side usage limits, enables owned compute, and may benefit from future compression/quantization breakthroughs that preserve model quality. Another commenter jokes that Polymarket’s role is essentially to turn the projection into a betting market.
- Several commenters frame local execution as primarily a compute-ownership tradeoff: if Fable could run locally, users would avoid hosted API usage limits because inference would be bounded only by their own hardware, memory, and electricity costs.
- A technical skepticism thread argues that Anthropic is unlikely to release Fable or related closed-weight models locally, because monetizing hosted access is core to its business model. The counterpoint is that an open-weight model may reach comparable capability soon, with one commenter claiming open models are already surpassing “Opus 4.5” and projecting parity with Fable-level performance within 6–24 months.
- One comment predicts substantial future gains from LLM compression/efficiency techniques, suggesting that smarter quantization, pruning, distillation, or architecture-level improvements could eventually make very large models practical to run locally while retaining much of their effectiveness.

3. Anthropic J-Space and Fable Cyber-Safety Edge Cases

Anthropic just reported that LLMs have hidden thoughts they hold without saying. An internal ”J-Space” (Activity: 1194): The post discusses Anthropic’s paper on a small set of model activations termed J-space, described as behaving like a global workspace where information can be held, reported, and used for multi-step reasoning, while much fluent generation allegedly bypasses it (paper). The author built Subtext (GitHub) to visualize token-disposed internal states before generation, claiming replications such as incorrect activating before an answer to 12 + 5 = 1, and a two-hop trace where Italy appears around layer 20 and euros around layer 26; they emphasize this indicates reportable/usable internal information, not evidence of subjective experience. Comments mostly note that this is consistent with earlier mechanistic-interpretability hints and push back on the “stochastic parrot” framing; one commenter also questions what model was used to implement the reproduction. Another top comment jokingly suggests the post’s cautious phrasing sounds like Claude-generated text.
- Commenters highlighted Anthropic’s finding that models can maintain internal representations not surfaced in emitted tokens, arguing this challenges the simplistic “just next-token prediction” / “stochastic parrot” framing. One technically notable interpretation was that the model’s latent J-space can encode intermediate beliefs or classifications before they are verbalized.
- A technical question was raised about whether the reported phenomenon is essentially neuron/feature activation tracking—e.g. “Italy neurons” activating on the path to an answer—or whether it demonstrates something stronger. The arithmetic examples were singled out as more interesting because they imply latent intermediate computation rather than merely semantic feature activation.
- One commenter emphasized the reported difference between base training and post-training: before post-training, the model’s internal state was described as mostly constrained to predicting user tokens, while after identity/alignment post-training it appeared to form first-person-like judgments while reading input. The cited example was recognizing a prompt injection internally before producing any output token.
Fable 5 found actual malware on my PC, and then its own safety filters flagged the warning. (Activity: 1871): A user reports Fable 5 inspected the Windows Run registry key and flagged an unexpected persistence mechanism: powershell.exe -NoProfile -ExecutionPolicy Bypass -WindowStyle Hidden ... downloading a remote script at sign-in, which it classified as an active compromise (screenshot). After the user asked it to remove the relevant registry entries, the model reportedly completed the cleanup but the session was then downgraded to Opus 4.8 because the interaction was flagged as “cybersecurity work” by safety filters (screenshot). Commenters were skeptical of relying on an LLM for endpoint remediation, noting this PowerShell Run-key persistence pattern is old and typically caught by conventional AV/EDR; one argued an antivirus is more appropriate because an LLM may find “1 and leave 10 others.” Another commenter reported a similar beneficial security review use case where the model found and documented codebase issues without triggering a downgrade.
- A commenter argued that malware detection should be handled by dedicated antivirus/EDR tooling rather than an LLM agent: the described malware family is reportedly ~12 years old and likely covered by conventional signatures/heuristics, whereas Fable may detect one artifact while missing others.
- One user described using Fable to scan a codebase for bugs; the agent found their security.md, updated it, and added multiple security findings significant enough that they patched them before production. They noted this did not appear to reduce their model tier/access, implying the safety system allowed code-security remediation despite flagging related content elsewhere.

AI Discords

Unfortunately, Discord shut down our access today. We will not bring it back in this form but we will be shipping the new AINews soon. Thanks for reading to here, it was a good run.

not much happened today

Tue, 07 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/06/2026-7/07/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

Agent Products, Harnesses, and Long-Running Workflows

Anthropic expands “background agent” UX on top of Claude: The biggest product launch by engagement was Claude Cowork coming to mobile and web, positioning Claude as a task-running background teammate rather than a foreground chat UI. Related posts show the product convergence around a shared home tab and tighter Chat/Cowork integration from @mikeyk. Separately, Anthropic extended access to Claude Fable 5 on paid plans through July 12 in a highly engaged announcement from @claudeai, though many users noted the awkward timing relative to weekly limits in reactions from @kimmonismus and others.
Harness engineering is increasingly the center of agent design: Lilian Weng’s new post was widely referenced as reframing recursive self-improvement around the harness, not direct weight self-modification; Sakana’s summary connects this to The AI Scientist, ShinkaEvolve, and Darwin Gödel Machine in their thread. LangChain echoed the same shift with a new Deep Agents course and an open-source harness project in posts from @LangChain and @hwchase17. Google is also productizing this direction: Gemini API Managed Agents added background execution, remote MCP servers, custom function calling, and credential refresh in posts from @_philschmid and @OfficialLoganK.
Practical agent infra keeps getting more opinionated: There were several notable operator-facing updates: Codex Mobile iOS added task management, filtered diffs, SSH key login, branch comparison, and attachment flows in posts from @Dimillian and @reach_vb; Hermes Agent added pluggable secrets managers plus native 1Password integration and export of sessions/datasets to formats including private Hugging Face repos in @Teknium’s threads; Weaviate 1.38 made its MCP server GA with runtime-gated write access, notably allowing MCP_SERVER_WRITE_ACCESS_ENABLED to be flipped live without restart in @victorialslocum’s post. A more experimental pattern came from @omarsar0, using a Dial MCP server so agents can escalate decisions via phone call/SMS/iMessage for human-in-the-loop control.

Model and Modality Releases: Audio, Speech, Robotics, and Media Generation

Meta’s Muse Image/Muse Video push agentic generation into media: Meta Superintelligence Labs launched Muse Image and previewed Muse Video in announcements from @AIatMeta, @alexandr_wang, and @_tim_brooks. The notable technical angle is not just image quality, but an explicitly agentic generation loop: planning, web search, tool use, code execution, and self-refinement before rendering. Meta also says performance improves with scaled test-time compute, and that self-refinement behavior emerged during RL rather than being hand-scripted in this follow-up. On public evals, Muse Image quickly reached #2 on Image Arena behind GPT Image 2 in Arena’s ranking, while Muse Video debuted at #3 on Video Arena in another Arena post.
NVIDIA and Cohere both shipped strong audio releases: NVIDIA released Audex, a 30B parameter / 3B active MoE with 1M context for unified text+audio work, summarized by @HuggingPapers and described in more detail by @_weiping. The model’s core claim is preserving text intelligence while adding broad audio generation and understanding via a single MoE backbone. Cohere launched Cohere Transcribe Arabic, described as the most accurate open-source Arabic ASR model, under Apache 2.0, with emphasis on dialects, code-switching, and Arabic-accented English in posts from @cohere and @JayAlammar.
Open robotics keeps consolidating around Hugging Face + NVIDIA: NVIDIA expanded its robotics stack into the HF ecosystem by bringing GR00T 1.7 and Isaac Teleop into LeRobot, aimed at open humanoid robotics workflows, in @NVIDIARobotics’s announcement and integration guide. On the embodied side, UMA showed a strong full-stack robotics narrative: @RemiCadene described a prototype built by a small team in 9 months, while the Northstar reveal and @psermanet’s safety note emphasized vertically integrated hardware/software for trustworthy robots.

Training, Inference, and Post-Training Techniques

Liquid AI’s “Antidoom” directly targets reasoning-loop failure modes: One of the clearest technical releases of the day was Liquid AI’s Antidoom, an open-source training method to reduce doom loops where small reasoning models repeat tokens until context exhaustion. The reported reductions are substantial: LFM2.5-2.6B from 10.2% → 1.4% and Qwen3.5-4B from 22.9% → 1% under greedy sampling, with downstream eval gains. The method, FTPO (Final Token Preference Optimization), relabels the loop-triggering token and redistributes probability toward alternatives, summarized well by @helloiamleonie and @LiorOnAI. This is a good example of the field’s recent pattern: removing specific failure modes rather than only scaling parameters.
Inference efficiency and compression remain a major frontier: NVIDIA’s Puzzle-75B-A9B compression work got strong attention via @omarsar0: compressing a hybrid MoE parent model while preserving reasoning, coding, long-context, and agentic quality, with roughly 2x server throughput and 1M-context concurrency on H100 rising from 1 request to 8. On the tooling side, Nsight Python 1.0 launched in @HagedornBastian’s post, making GPU perf analysis scriptable in Python. Unsloth also shipped GGUFs for DeepSeek-V4-Flash, plus export to NVFP4/FP8 and speedups for GRPO and MoEs in @danielhanchen’s update.
Agent RL and verification are getting more specialized: @cwolferesearch highlighted how GRPO-style normalization is being adapted for agentic RL at the task or environment level to handle higher reward variance in multi-turn environments. Separately, @omarsar0 flagged a training-free verifier paper from Stanford/NVIDIA/Berkeley that reads calibrated continuous scores off scoring-token logits, posting strong numbers across Terminal-Bench V2, SWE-Bench Verified, RoboRewardBench, and MedAgentBench and suggesting verification is becoming an independent scaling axis.

Interpretability, Model Internals, and the “J-Space” Debate

Anthropic’s J-space work dominated interpretability discussion, but also drew sharp criticism: The community split between seeing the work as useful mechanistic analysis and objecting to the consciousness framing. Strong critiques came from @danburonline, @paul_cal, and @scaling01, who argued the vectors are causal largely by construction under the Jacobian-lens definition. A useful historical reference came from @jacobandreas, pointing readers back to the original Jacobian lenses paper.
The stronger technical takeaway is cross-model structure, not consciousness rhetoric: @eliebakouch computed CKA similarity on J-lens geometry across 38 open models and found surprisingly universal layer/depth organization, even across unrelated families like Llama and OLMo. Anthropic and Neuronpedia also released J-lens weights for open models, noted in this follow-up. In parallel, Goodfire introduced Block-Sparse Featurizers for multidimensional concepts in activations, arguing many vision concepts are inherently 2–4 dimensional blocks rather than single directions, in their thread.

Benchmarks, Evaluations, and Domain-Specific Systems

Agent and legal benchmarks continue to expose the gap between “passes many criteria” and “fully solves real work”: Agent Arena placed Claude Sonnet 5 (Thinking) at #6, with strongest signals in confirmed task success and bash usage, but still with uncertainty around steerability. Artificial Analysis launched Harvey LAB-AA, a legal-agent benchmark over 120 private legal tasks across 24 practice areas, where Claude Fable 5 led at 14.2% all-pass rate; Claude Opus 4.8 and GLM-5.2 tied at 7.5%, with GLM hitting that at roughly ~6% of Fable’s cost per task in their release. The big message is that models can satisfy many individual rubric items yet still fail to produce acceptable end-to-end deliverables.
Research automation and specialized domain systems are broadening: Google promoted Experience AI Scientist, a multi-agent system for end-to-end scientific workflows, in this ICML post. DeepMind also launched Predicting the Past, grounding Gemini in Aeneas and Ithaca for Greek/Latin historical analysis via plain-English interactions, in their thread. On legal AI commercialization, Norm Ai announced a $120M Series C at $1.2B valuation and described a full-stack “agentic law” setup spanning software plus an AI-native law firm in @johnjnay’s post.

Top tweets (by engagement)

Claude access / product rollout: Claude Cowork on mobile and web and Fable 5 access extended through July 12 were the most-engaged technically relevant product announcements.
Open-source developer program: @ClaudeDevs offering 6 months of Claude Max 20x for open-source maintainers drew massive engagement and is likely to matter for tool adoption in OSS ecosystems.
Meta media generation: Muse Image launch and Arena’s #2 ranking for Muse Image were the biggest multimodal product stories.
Reasoning reliability: Liquid AI’s Antidoom release stood out as the day’s highest-signal training technique post.
Interpretability: Cross-model J-lens universality across 38 open models was the strongest technical follow-on to the J-space discourse.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Open Model Releases and Inference Efficiency

New open model from Tencent Hy: Hy3 (295B total 21B active - apache 2.0) (Activity: 653): Tencent released the non-preview Hy3 open model collection on Hugging Face, described as a 295B-parameter MoE with 21B active parameters, now under Apache 2.0 rather than the prior restrictive community license. The post highlights that the earlier license reportedly excluded use in regions including South Korea, the UK, and the EU, while top comments point to claimed benchmark gains over HY3-Preview and frame this as potentially relevant for high-end local/home inference setups. Commenters viewed the Apache 2.0 relicensing as the most important change, especially given Tencent’s recent translation models also using Apache licensing. There was cautious optimism that the reported benchmark improvements may translate to real-world usefulness, but with implicit skepticism until tested outside vendor charts.
- Commenters highlighted that Hunyuan/HY3 is now listed as Apache 2.0, contrasting it with the prior “community” license that reportedly restricted usage in regions such as South Korea, the UK, and the EU. This was viewed as technically important for deployment because Apache 2.0 removes many commercial and geographic usage barriers.
- Several users focused on whether Tencent’s claimed benchmark improvements over HY3-Preview will translate into real-world workloads. Given the reported 295B total / 21B active MoE-style configuration, commenters suggested it could be relevant for “high-end home setups” if inference formats such as GGUF become available.
- There was early speculation that HY3 could become an alternative to Qwen and MiniMax models in local/open-weight workflows, but commenters were waiting for quantized releases and independent testing before drawing conclusions.
New model: GigaChat3.5-432B-A28B (with day-0 GGUF support!) (Activity: 510): Sberbank/ai-sage released GigaChat3.5-432B-A28B, a large MoE chat model with 432B total / 28B active parameters, plus a base checkpoint and day-0 GGUF weights; llama.cpp support is currently via PR #25342. Model-card excerpts claim it is ~40% smaller than GigaChat 3.1 Ultra 700B while improving code/math/agentic benchmarks, using ~4× less KV cache per token, fitting >2× more context in the same memory, and improving throughput by ~20%. Architecturally, commenters highlighted its custom hybrid MoE stack mixing MLA layers with GatedDeltaNet linear-attention layers, plus Multi-Token Prediction with two MTP heads, claimed to accelerate greedy decoding from ~1.5× with one head to up to 2.2× with two. Commenters questioned using DeepSeek 3.2 as a benchmark reference, calling it roughly a year behind frontier systems, and noted that GigaChat3.5 is a non-reasoning model so benchmark comparisons should account for that. The release was praised for unusually high openness at this scale—base model and intermediate checkpoints are available—though the exact training dataset remains undisclosed.
- Several commenters noted that GigaChat3.5-432B-A28B should not be compared directly against current frontier reasoning models: one questioned using DeepSeek 3.2 as a benchmark reference because it is perceived as "~year behind the frontier models", while another emphasized that GigaChat 3.5 is a non-reasoning model, which materially changes how its benchmark scores should be interpreted.
- A technical excerpt highlights major architectural changes versus GigaChat 3.1 Ultra 700B: GigaChat 3.5 is reportedly ~40% smaller while stronger in code, math, and agentic tasks, uses about 4× less KV-cache per token, fits 2×+ more context in the same memory, and improves generation throughput by ~20%. The model uses a custom MoE hybrid attention design combining MLA with GatedDeltaNet linear-attention layers, plus Multi-Token Prediction with two MTP heads, claiming greedy decoding speedups of ~1.5× with one head and up to 2.2× with two.
- One commenter praised the release for open-weighting not only the final model but also intermediate checkpoints and the base model, calling that unusually open for a model of this scale, with the main missing artifact being the exact training dataset. Another noted the model likely has its strongest niche in Russian-language processing, while being comparatively average outside Russian due to stronger multilingual alternatives already available.
nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 · Hugging Face (Activity: 349): NVIDIA released NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16, a commercially usable deployment-optimized hybrid MoE LLM derived from Nemotron-3-Super-120B-A12B via the Iterative Puzzle post-training compression method described in the technical report. It reduces size from 120.7B total / 12.8B active parameters to 75.3B total / 9.3B active while retaining interleaved Mamba + MoE + Attention layers and Multi-Token Prediction, with claimed gains of ~2× server throughput on a single 8×B200 node and 1M-token single-H100 concurrency increasing from 1 to 8 requests. The model targets reasoning/chat, code, multilingual use, RAG/agent workloads, and long-context reasoning across English, French, German, Italian, Japanese, Spanish, and Chinese. Commenters focused on the model’s practical deployment profile, especially the relatively smaller 75B/9B active footprint and 1M context. One user joked about attempting Q6/Q4 quantized inference on 64GB DDR4 RAM, reflecting interest in local/consumer-accessible deployment despite the BF16 release targeting high-end accelerators.
- The thread notes that NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 is positioned as a general-purpose reasoning/chat model for English, code, multilingual use, agent systems, RAG, complex instruction following, and long-context reasoning, with a notably large 1M token context window.
- One commenter raised benchmark concerns, claiming that the model’s published results are worse than Super-120, which they describe as already underwhelming, suggesting limited improvement over the apparent source/base model.
- There is interest in running quantized variants locally, specifically Q6/Q4 on 64GB DDR4 RAM, implying the model’s effective deployability may depend heavily on quantization and CPU/RAM-bound inference performance.
ThinkingCap-Qwen3.6-27B: same accuracy as base Qwen3.6 with ~50% fewer thinking (Activity: 334): bottlecapai released/evaluated ThinkingCap-Qwen3.6-27B, claiming roughly base Qwen3.6-27B accuracy with ~50% fewer “thinking”/reasoning tokens. The authors report multi-seed benchmarking at Qwen’s recommended temperature=1.0 with statistical significance testing across reasoning, MCQA, chat, system-prompt adherence, safety, math, code, and agentic tasks, including both in-domain holdouts and out-of-domain evals. Commenters were cautiously positive: some see Qwen 3.6 as the strongest cheap open-weight 20B–40B option, while others note users can already control cost via reasoning-budget. One commenter observed the model appears slightly worse on evals but appreciated that the release is transparent about the tradeoff.
- Commenters noted that similar reductions in chain-of-thought verbosity may be achievable at inference time by setting Qwen’s reasoning-budget, rather than using a separately tuned checkpoint. This raises the technical question of whether ThinkingCap’s gains come from model behavior changes or simply from enforcing a lower token budget during reasoning.
- One commenter observed that the reported evals appear slightly worse than base Qwen3.6 despite the claimed ~50% reduction in thinking tokens, but appreciated that the release is transparent about the tradeoff. The practical takeaway is that the model may be worth testing when latency/cost is more important than preserving every benchmark point.
- A GGUF build was linked for local inference: bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF. This is relevant for users evaluating quantized deployments of the 27B model on llama.cpp-compatible runtimes.

2. Local Model Reliability and Interpretability

I tested Anthropic’s new Jacobian Lens on open models, then it turned into a local-model hallucination router (Activity: 367): A Reddit user implemented Anthropic’s Global Workspace / Jacobian Lens idea on open-weight models, releasing code/demo/artifacts at solarkyle/jspace, the demo, and HF lenses/traces/routers. On 500 TriviaQA questions/model, Jacobian-lens “workspace trajectory” features—entropy slope, late-band entropy, entropy std, answer rank, layer agreement—outperformed output logprob for wrong-answer prediction on Gemma variants: E4B 0.773 vs logprob 0.711 AUC, 12B 0.824 vs 0.736, 12B abliterated 0.799 vs 0.731, 26B MoE 0.749 vs 0.725; combining signals improved to 0.787–0.843, while Qwen 3.6 27B was the counterexample where logprob was already strong (0.856) and workspace hurt/underperformed (0.646, combined 0.838). The proposed system is a one-pass local hallucination/risk router: answer locally, take a workspace snapshot, run a tiny logistic-regression sidecar, and escalate to search/citations/cloud if the answer is high-confidence but internally “foggy”; a notable side result was that abliteration greatly increased fake-entity fabrication in Gemma 12B (17/50 → 49/50). Commenters debated interpretation: one argued Qwen’s miss is unsurprising because Qwen models appear “overtrained/grokked” and highly pattern-stubborn, making output confidence unusually calibrated on aligned tasks. Another cautioned that the experiment may only show uncertainty ↔ competing latent candidates, not a reliable implication that competing candidates necessarily mean hallucination, since ambiguity can also reflect legitimate reasoning rather than fabrication.
- Several commenters questioned the core causal interpretation of the Jacobian Lens signal: the experiment may be detecting multiple competing latent continuations rather than hallucination directly. One commenter argued that uncertainty can naturally increase the number of active candidate ideas, but “competing ideas → hallucination” does not necessarily follow; this distinction matters for cases where the model has incomplete information yet still makes a well-calibrated guess.
- A detailed repo-level critique argued that the hallucination evaluation is undermined by incorrect ground-truth labels, citing examples where Ross Bagdasarian for The Chipmunks and H. H. Asquith after Balfour were allegedly marked wrong despite being correct. The same commenter noted that reported AUC/router results become unreliable if the labels are noisy, and also objected to calling the method label-free because the router is trained via logistic regression on correct/incorrect answers, making it supervised even if the runtime feature is unsupervised.
- The evaluation methodology was criticized for possible data leakage: normalization was reportedly applied to the full dataset before cross-validation, allowing test-fold information into training preprocessing. The baseline was also described as too narrow—mostly a few logprob/output-confidence features—so claims that the router broadly beats confidence calibration were considered overextended, especially given claims that Qwen models are already unusually well-calibrated and “stubborn”/overtrained on familiar task patterns.
Qwen 3.6 27B absolutely fails at agentic work (Activity: 740): The OP reports that Qwen 3.6 27B at 8-bit/16-bit under llama.cpp nightly on an RTX 6000 performs well on isolated prompts and long-form/demo HTML generation, but repeatedly fails in multi-turn agentic workflows—“every 4 turns or so it does something completely braindead”—so they reverted to Qwen 3.5 122B at 4-bit/5-bit. Technical replies suggest checking chat-template/inference setup, specifically trying froggeric/Qwen-Fixed-Chat-Templates for agent-flow bugs and verifying parameters such as preserve_thinking. Commenters were skeptical of the broad claim, arguing that without exact inference parameters, templates, and reproduction details it is hard to diagnose, and that “most people aren't having your experience.”
- Several commenters point to potential chat-template issues as a likely cause of poor Qwen 3.6 27B agentic behavior, recommending froggeric’s patched templates: Qwen-Fixed-Chat-Templates. The claim is that these templates “fix some of the bugs for agentic flows,” implying failures may stem from prompt formatting/tool-use serialization rather than the base model itself.
- One technical troubleshooting thread asks whether the user is running the correct inference parameters, specifically mentioning preserve_thinking. Commenters request the full parameter set, suggesting instability in Qwen 3.6 27B agentic workflows may depend heavily on decoding/configuration and whether reasoning traces are preserved across turns.

3. China AI Model Access Policy Debate

Beijing is looking at curbing overseas access to China's top AI models (Reuters) (Activity: 1011): The image is a Reuters article screenshot, not a meme, reporting that Beijing is considering restrictions on overseas access to China’s leading AI models from firms such as Alibaba, ByteDance, and Z.ai, citing national-security concerns and fears of advanced model leakage. Technically, this would affect availability of competitive Chinese frontier/open-weight or API-accessible models outside China, potentially reducing global access to alternatives to U.S. labs; image: i.redd.it/9s1018gggsbh1.jpeg. Commenters framed this as another AI-access restriction, with concern that competitive local/open models may become harder to obtain. One commenter argued Mistral may become more important as a non-U.S./non-Chinese alternative, especially if its Paris-area datacenter enables training models up to roughly 10T parameters.
- A commenter points to Mistral as a potential non-China open-weight alternative, claiming its new datacenter near Paris is expected to come online soon and could enable training models up to roughly 10T parameters. The implication is that European compute capacity may become strategically important if overseas access to Chinese frontier/open models is restricted.
- Several commenters discuss proactively archiving preferred open-weight models, including models they cannot currently run locally, because access restrictions could make downloads or redistribution harder later. This reflects a practical concern around model availability, reproducibility, and long-term local inference workflows if geopolitical controls tighten.
- One technical/business-angle comment argues that NVIDIA may remain one of the few companies with strong incentives to publish open models, because open-weight releases drive demand for local GPU inference and deployment. The broader concern is that model access restrictions could reduce the diversity of competitive local models available to developers.
Beijing IS NOT looking at curbing overseas access to China's top AI models (Debunking the Reuters report) (Activity: 966): The post disputes a Reuters report claiming Beijing may curb overseas access to top Chinese AI models, arguing the cited Ministry of Commerce meetings with firms like Alibaba, ByteDance, and Z.ai were instead about foreign acquisitions, investment, IP leakage, and tech/talent outflow controls. It points to a Chinese policy/legal document from the China International Commercial Court as evidence that China’s position is not blanket restriction of open-weight model access but “trustworthy and controlled” open source, including concern that strict cross-border controls on open-source weights could be “self-inflicted” by reducing Chinese developers’ global participation. Commenters were skeptical of the Reuters framing, with some suggesting the sourcing may reflect U.S. AI-lab interests and arguing China has strategic incentive to keep exporting/open-sourcing models because they pressure incumbent U.S. AI companies.
- Commenters argued that open-weight model availability is strategically important for Chinese AI labs because it enables global adoption, especially in the US market, and directly competes with closed-model providers like OpenAI and Anthropic. One technical-market point was that restricting overseas access would undermine distribution and ecosystem growth for Chinese models, while maintaining open access could pressure closed API-based competitors ahead of major fundraising or IPO narratives.
- Several commenters framed the Reuters claim as potentially driven by competitive information warfare rather than policy reality, noting that a curb on overseas access would primarily benefit US closed-model vendors by reducing competition from Chinese frontier/open-weight systems. The discussion did not provide benchmarks or implementation details, but focused on model-access strategy and competitive dynamics around global deployment.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Anthropic J-Space Interpretability Research

Anthropic found a “global workspace” inside Claude a silent internal reasoning layer that emerged on its own (Activity: 1267): Anthropic reports a J-space in Claude—identified via the open-source Jacobian Lens—as a compact set of internal activation directions that appears to act like a functional global workspace: concepts present there are reportable, causally editable, and reused across tasks. In the paper, interventions such as swapping spider → ant or France → China changed downstream answers across multiple attributes, while ablating J-space reportedly preserved fluency but degraded multi-step reasoning; a highlighted arithmetic trace shows Claude internally progressing through (4+17)*2+7 across layers (21 → 42 → 49) without external tools. Anthropic also frames this as a safety signal: J-space activations surfaced latent notions like “fake,” “fictional,” “manipulation,” “fraud,” and “secretly” before output, including in fabrication or deliberately misaligned model-organism settings, while explicitly limiting the consciousness claim to access consciousness rather than phenomenal experience. Technical commenters were broadly impressed, arguing the results provide strong evidence against a simplistic “stochastic parrot” view of LLMs; no substantial methodological debate appeared in the provided top comments.
- A technically substantive comment highlighted Anthropic’s layer-wise interpretability example for Claude solving (4+17)*2+7: by layer 58 the model represented the task as arithmetic, by layer 75 it had computed 4+17=21, by layer 83 it had derived 42, and by the final layer it reached 49. The commenter emphasized this as evidence of an internal multi-step computation occurring without external tools, consistent with a latent reasoning/workspace-like mechanism rather than purely surface-level token imitation.
- One commenter linked a technical explainer video on the proposed “J-space” / global workspace concept: YouTube explanation. Another noted that the claim that this space “wasn’t designed; it emerged during training” aligns with the core premise of machine learning: learned internal representations and behaviors arising from optimization rather than explicit hand-coded structure.
Anthropic just reported that LLMs have hidden thoughts they hold without saying. An internal ”J-Space” (Activity: 794): A Redditor summarizes Anthropic’s paper on a proposed internal J-space/global-workspace-like subspace in LLM activations (paper), where a small set of latent variables appears to support reportable, deliberately maintained, multi-step reasoning state while much fluent generation—grammar, style, factual recall—largely bypasses it. They also built Subtext (GitHub) to visualize token-disposed internal states before generation, citing examples like early saturation of “incorrect” for 12 + 5 = 1 and two-hop activation traces such as Italy at layer 20 followed by euros at layer 26 before output begins; they explicitly note this is evidence of functionally available internal information, not subjective experience. Comments split between seeing this as expected mechanistic-interpretability evidence against simplistic “stochastic parrot” framing, and skepticism that the visualization may just be ordinary neuron/feature activation—though commenters found the arithmetic and multi-hop timing results more technically interesting.
- Commenters focused on Anthropic’s mechanistic-interpretability claim that models can maintain latent internal representations not directly reflected in emitted tokens. One technical interpretation was that this goes beyond simple “stochastic parrot” framing: the model may activate concepts such as an Italy representation or intermediate arithmetic states before any corresponding output token is produced.
- A key technical point highlighted was the distinction between base training and post-training: in base models, internal state was described as primarily optimized for next-token prediction, while post-training appears to induce a more persistent “identity” or first-person framing. One commenter noted that the model could internally classify input as a prompt injection while reading it, before producing any output, implying latent evaluation of user text independent of immediate token generation.
- There was interest in reproducibility and implementation details, including a user reportedly reimplementing parts of the paper’s experiments and questions about which model generated the reproduction code. The arithmetic examples were called out as especially interesting because they suggest intermediate computational structure rather than merely concept-neuron activation on the path to output.

2. Claude Code and Autonomous Coding Agents

The tool that now generates $2.5B/year started as a guy’s first-week side project at his new job (Activity: 1034): The image is a non-technical branding graphic: a retro/pixel-styled “CLAUDE CODE” logo on a black background, used to visually frame the post’s story about Anthropic’s Claude Code CLI. The post claims Claude Code began as Boris Cherny’s first-week prototype at Anthropic, grew rapidly after gaining filesystem access, reached 80%+ internal daily usage by May 2025, and allegedly hit $1B ARR within ~6 months—though the title’s $2.5B/year figure is not substantiated in the provided text. Comments push back on the “accidental discovery” framing, noting that coding agents such as Cline already existed months earlier, making Claude Code look more like an in-house/productized version of an existing pattern than a novel research breakthrough. Other comments treat the image as purely aesthetic, saying the arcade-style logo matches the “fever dream” origin story.
- A commenter challenged the post’s framing that the project was novel, arguing that the core idea—giving an LLM agent access to a local filesystem for coding tasks—already existed in tools like Cline for “6+ months” beforehand. They characterized it as an in-house clone of existing coding-agent products, not a research breakthrough.
- Another technical point focused on the claim that Claude writes over 80% of Anthropic’s own code, with speculation that the Claude desktop app may itself have been heavily generated or “vibe coded.” The comment implies interest in how much production code at Anthropic is now authored or scaffolded by Claude-based coding agents.
I gave GPT 5.5 an empty GitHub repo and told it to figure its life out (Activity: 795): The experiment schedules an LLM “agent” to wake hourly (later doubled in frequency) against an initially empty public GitHub repo, inspect prior state, choose work, write/test code, and commit; its first outputs were meta-project artifacts (roadmap/changelog/state/decision log) rather than application code. The repo, Autonomous Forge, is currently a pre-alpha, local-first Python CLI for “repository-native autonomous software-improvement loops,” but its implemented scope is mostly deterministic, read-only planning/review: task selection, policy-aware planning, proposal/validation previews, repo inventory, preflight readiness, and run-history previewing, with only an explicitly confirmed run-history-write mutating .ai/run-history/. Its stated safety boundary is conservative: no network calls, test/validation execution, diff inspection, patch generation, commits, pushes, or policy enforcement until future roadmap/policy support. Commenters mostly highlighted the recursion/meta-design: an autonomous agent asked to build something chose to build a tool for autonomous repository maintenance, with one calling it a “tool that has no defined goals.” The main technical criticism was that the generated roadmap appears over-indexed on planning/process artifacts rather than concrete implementation progress.
- Commenters noted that the generated project concept, “Autonomous Forge”, is effectively a meta-tool: an AI-created developer tool intended to run “repository-native autonomous software-improvement loops,” meaning the model responded to an empty repo by designing infrastructure for autonomous code generation/maintenance rather than solving a concrete product problem. One technical criticism was that the roadmap appeared overly weighted toward task planning/orchestration rather than implementation, evaluation, or measurable developer-tool functionality.

3. Claude Fable 5 Access and Guardrail Friction

Anthropic extending Fable 5 for paid users till 12 july (Activity: 1320): The image is a non-meme screenshot of a Claude/Anthropic X post announcing that “Claude Fable 5” access is extended for paid users through July 12 across all paid plans: image. The follow-up clarifies a quota policy: paid users can spend up to 50% of their weekly usage limit on Fable 5, then must either use extra credits or switch to another Claude model. Comments mainly criticize the short-notice extension and quota planning impact: users say they rushed to exhaust weekly Fable usage or bought extra credits because they expected access to end sooner. One recurring request is for Anthropic to provide a usage-limit reset alongside the extension.
Fable 5 found actual malware on my PC, and then its own safety filters flagged the warning. (Activity: 1292): A user reports Fable 5 inspecting the Windows Run registry key and detecting a suspicious PowerShell persistence command—powershell.exe -NoProfile -ExecutionPolicy Bypass -WindowStyle Hidden ...—that allegedly downloaded and executed a remote script at sign-in, which the model classified as an active compromise (screenshot). After the user instructed it to remove the specific registry persistence entries, the cleanup reportedly succeeded, but the session was then flagged for “cybersecurity work” and downgraded to Opus 4.8 by safety filters (screenshot). Commenters argued this is a poor substitute for endpoint security: PowerShell Run-key persistence is a long-known malware pattern that conventional AV/EDR tools should catch more reliably, and an LLM may remove one indicator while missing others. One commenter noted a related positive case where an AI scan of a codebase surfaced production-relevant security findings from security.md without triggering a downgrade.
- A commenter argued that the malware class is not novel—“in place for maybe 12 years”—and would likely be detected by conventional antivirus signatures/heuristics. Their technical takeaway was that Fable 5 should not replace dedicated endpoint security tooling, because an LLM-style scan may find one indicator while missing related persistence mechanisms or additional malware artifacts.
- One user reported using Fable to scan a codebase, where it parsed their security.md and added multiple new security findings that they considered production-relevant. They subsequently patched the issues, suggesting the model was useful for surfacing actionable application-security problems from project documentation/context rather than just source-code linting.
Well shit... I didn't even know this was possible (Activity: 688): The image is a Claude/Anthropic billing “Usage credits” screen showing an apparent spend-limit failure: despite a configured $50 monthly spend limit, the account shows $155.53 spent (311% used) and a negative balance of -$119.11 (image). In context, the poster says they ran Fable on several tasks expecting usage to stop at the cap, but Claude continued billing beyond the limit, raising a practical issue around whether Anthropic spend limits are hard enforcement caps or delayed/soft accounting controls. Commenters were skeptical of Anthropic support and suggested a credit-card chargeback if billed, while noting it is “weird” that a configured monthly spend limit appears to have been ignored.
- Users report a potential Anthropic/Claude billing control bug where a configured monthly spend limit was allegedly ignored, allowing continued model usage and additional charges after the expected cap. One commenter contrasts this with plan quota behavior, noting that regular plan usage stops mid-task when exhausted, while paid overage/API-like usage may continue accruing cost.
- A suggested remediation path is to contact support@anthropic.com and frame the issue as a configuration/billing bug, including screenshots of the spend-limit setting. Commenters recommend requesting a prorated refund first, with a credit-card chargeback as a fallback, though that may risk account termination or needing a new Claude account.

AI Discords

Unfortunately, Discord shut down our access today. We will not bring it back in this form but we will be shipping the new AINews soon. Thanks for reading to here, it was a good run.

not much happened today

Mon, 06 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/04/2026-7/06/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

Tencent Hunyuan’s Hy3 Release and the Open-Weight Frontier

Hy3 lands as a serious open model: Tencent released Hy3 under Apache 2.0, a 295B MoE with 21B active parameters, 192 experts / top-8 routing, GQA, 256K context, and a 3.8B MTP layer for speculative decoding. Multiple posts framed it as competitive with much larger systems on reasoning, coding, and agentic tasks, with particular emphasis on reliability improvements like tool-calling stability and anti-hallucination work @eliebakouch, @HuggingPapers, @ShunyuYao12.
Inference support was unusually day-0 mature: @vllm_project said Hy3 runs natively in vLLM from launch with tool-call and reasoning parsers, MTP speculative decoding, and validated support on NVIDIA and AMD. A follow-up detailed Tencent production kernels now upstreamed into vLLM main, including load-balanced decode scheduling and fused FP8 MoE serving, with reported gains of up to 2.95x on mixed-length decode and latency reductions of roughly 24% TTFT and 17% TPOT versus default backends @vllm_project. Community reaction was strong enough that @Teknium quickly made Hy3 free on Nous Portal for two weeks.
Broader open-model context: Hy3 was immediately compared against GLM-5.2, with some posters arguing Tencent has now joined the very top tier of open-source labs if the benchmark and vibe-test results hold @teortaxesTex, while others still maintained GLM-5.2 as the best currently usable open-weight model in practice @tinygrad, @mbusigin. The net takeaway: the open frontier is compressing fast, and the competition is increasingly about deployment robustness rather than just raw leaderboard deltas.

Agent Benchmarks, Harnesses, and Long-Running Memory

AutomationBench-AA adds a more realistic agent eval: @ArtificialAnlys launched an independent leaderboard for Zapier’s AutomationBench, evaluating agents across 657 tasks and 40 simulated SaaS apps with both objectives and guardrails. Claude Fable 5 led at 48.6%, narrowly ahead of Opus 4.8 at 48.5%, with Gemini 3.5 Flash at 42.6% and GPT-5.5 xhigh at 42.1%. More interesting than the ranking: every model still breaks business rules, and Gemini looked notably strong on objective-per-guardrail-violation and cost efficiency. Open weights remain meaningfully behind, with GLM-5.2 max the best listed open model at 27.8%.
Capability indices are becoming multidimensional: Artificial Analysis also introduced six domain-specific indices—Finance & Accounting, Legal, Healthcare & Medical, Strategy & Ops, Engineering, Economics—to move past single scalar model scores @ArtificialAnlys. The headline was familiar—Claude Fable 5 plus Opus 4.8 fallback leads—but the more useful insight is how sharply rankings reshuffle by domain and how steep the price/performance frontier has become. This aligns with @fchollet, who argued that reporting benchmark scores without cost per task is increasingly meaningless.
Memory and retrieval remain bottlenecks for persistent agents: Two papers got traction here. First, A-TMA tackles “ghost memory,” where stale and current facts are retrieved together in long-running assistants; on the LTP benchmark, adding it to Graphiti reportedly improves conflict accuracy by +0.240 absolute @omarsar0. Second, ReContext is a training-free long-context inference harness that replays model-internal evidence right before answer generation, improving evidence utilization across eight 128K datasets @dair_ai. Combined with BlockSearch for million-token in-context retrieval @dair_ai, the theme is clear: better memory behavior is increasingly being engineered at inference time, not just trained in.

Anthropic’s J-Space / Global Workspace Results

Mechanistic interpretability took center stage: Anthropic released research claiming a global-workspace-like internal structure in Claude, centered on a small subset of activations they call J-space @AnthropicAI, @AnthropicAI. The core claim is not chain-of-thought extraction, but identification of a privileged internal representational substrate that appears available for report, modulation, and flexible reasoning. Anthropic also shipped a Neuronpedia demo for open-weight models @AnthropicAI.
Why researchers cared: Interpretability researchers treated this as stronger evidence for a model “working memory” or internal workspace than prior public work, even if they disagreed with the framing. @NeelNanda5 called it the best evidence yet for a working-memory-like mechanism. @Jack_W_Lindsey argued understanding this privileged space could be key to LLM cognition. Posts also highlighted practical safety angles: the workspace can reportedly surface hidden concepts, detect prompt injections, and expose internal sabotage-related features before they are verbalized @mlpowered, @LiorOnAI, @omarsar0.
But the “consciousness” language was contested: Anthropic’s public framing invited strong pushback. Supporters said the results suggest a functional analog of access consciousness rather than phenomenal consciousness @BorisMPower, while critics argued the company was overclaiming by conflating privileged latent activation with consciousness @AlanCowen. Even some sympathetic takes emphasized the bigger story is a new intervention point for auditing and steering models, not philosophy.

Inference, Serving, and Systems Efficiency

Speculative decoding remains hot infrastructure: @lmsysorg added DSpark to SGLang for confidence-driven, variable-length verification. The pitch is that under high load it avoids verifying every draft token, improving the throughput/latency tradeoff relative to fixed-budget speculative methods; DeepSeek-V4-Pro reportedly reached 383.7 tok/s at batch=1 on B300. Microsoft also discussed prompt-level optimization of GPT-5.5 in the GitHub Copilot harness to improve latency and token efficiency after launch @code, @pierceboggan.
Inference efficiency is increasingly the strategic bottleneck: @jon_durbin argued that inference, not training alone, is now “the whole game,” because every data pipeline, RL loop, and agent runtime ultimately cashes out as test-time compute. That perspective also showed up in lower-level kernel work: Chutes reported major speedups for MiniMax MSA and GatedDeltaNet-2, including ~7x sparse-attention training improvements on RTX Pro 6000 / SM120 and better fused FP8 kernels @jon_durbin.
Infra releases beyond model serving: Cloudflare launched Workers Cache, a regionally tiered cache in front of Worker entrypoints configured via standard HTTP headers @Cloudflare. OpenAI shipped GPT-Realtime-2.1-mini, bringing reasoning and tool use to the mini realtime line at the same price as the prior mini, alongside claimed 25%+ p95 latency reductions from caching improvements @OpenAIDevs, @OpenAIDevs.

World Models, Speech, and Document AI

MIRA is a notable world-model demo: General Intuition and Kyutai, with Epic Games, introduced MIRA, a playable multiplayer world model for Rocket League trained on 10k hours of bot-collected data @gen_intuition. It runs in real time at 20 fps, and posts highlighted a 5B-parameter model running an entire 2v2 match on a single NVIDIA B200, with no explicit physics or rendering engine @TheRundownAI. This was one of the clearest signals that video/world-model work is moving from toy demos toward interactive simulators.
Speech remains highly competitive: AssemblyAI released Universal-3.5 Pro Realtime, a streaming STT model with 4.1% WER on AA-WER Streaming and contextual priming that can be updated mid-call without reconnecting @ArtificialAnlys. On the TTS side, Artificial Analysis said Speechify Simba 3.2 now leads its Speech Arena at 1233 Elo, ahead of Gemini 3.1 Flash TTS, Sonic 3.5, and Inworld Realtime TTS 1.5 Max, while also being the cheapest among top-ranked models @ArtificialAnlys.
Document-context pipelines are becoming multimodal by default: LlamaIndex and LanceDB described a retrieval pipeline for messy PDFs that separates pages, chunks, and extracted assets into linked multimodal tables, reporting 82% any-page-hit@5 and 74% answer accuracy on a labeled ESG-report benchmark @lancedb, @llama_index. This pairs with Jerry Liu’s broader argument for a dedicated “document context layer” for agents @jerryjliu0.

Top tweets (by engagement)

Anthropic’s global workspace paper dominated engagement, with the primary announcement on Claude’s internal workspace/J-space far above everything else @AnthropicAI.
Tencent Hy3 was the biggest pure model-release story, especially among technical accounts discussing open-source competitiveness and deployment @teortaxesTex, @ShunyuYao12.
MIRA’s playable world model was the standout multimodal/system demo @gen_intuition.
Will Depue’s “Stargate for Data” thread was the most substantive strategy post, arguing that data collection—not compute alone—becomes the binding constraint and potential moat for frontier labs @willdepue.
John Carmack’s memory-system thread drew significant technical interest by arguing inference hardware could exploit deterministic access patterns and much cheaper memory tiers than HBM for large-model serving @ID_AA_Carmack.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Large Open-Weight MoE Model Releases

longcat 2.0 (1.6T, ~48B active) weights are now open under MIT license (Activity: 638): LongCat 2.0 weights are now open under the MIT license via announcements from elie and ModelScope, with technical details in the LongCat 2.0 blog post. The model is a very large MoE system with 1.6T total parameters and roughly 48B active parameters per inference; commenters note the released weights occupy about 3.55 TB in BF16 and 2.05 TB in FP8. Commenters emphasized the practical deployment burden from the multi-terabyte weight size, and noted that Meituan—described as China’s Groupon/Uber Eats analogue—reportedly trained it on fully domestic Chinese chips, prompting discussion about the geopolitical/market significance.
- Commenters highlighted the scale and deployment footprint of LongCat 2.0: 1.6T total parameters with approximately 48B active parameters, implying a sparse/MoE-style architecture. One user noted the released weights require about 3.55 TB in BF16 and 2.05 TB in FP8, which is important for anyone planning local storage or inference infrastructure.
- A technical point raised was that Meituan reportedly trained the model on 100% domestic Chinese chips, which commenters framed as significant for AI hardware supply-chain independence. This is especially notable given Meituan’s role as a major Chinese internet company comparable to a mix of Groupon and Uber Eats rather than a traditional AI lab.
- Several users focused on the permissive MIT license and planned benchmarking against frontier open models such as Qwen and DeepSeek. The combination of 1.6T total parameters, only ~48B active parameters, and open weights suggests the model may be practical to compare with other high-end MoE open models if inference tooling supports its architecture efficiently.
New open model from Tencent Hy: Hy3 (295B total 21B active - apache 2.0) (Activity: 604): Tencent released the non-preview Hy3 model collection on Hugging Face, described as a 295B-parameter MoE with 21B active parameters, now under Apache 2.0 rather than the prior restrictive community license. Commenters highlight a linked benchmark chart and claim the release shows “pretty impressive claimed gains over HY3-Preview”, potentially making it relevant for high-end local/home inference setups if real-world performance matches reported results. The main discussion is positive around the license change: commenters view moving from a geographically/restrictively limited license to Apache 2.0 as the most important improvement, especially alongside Tencent’s recent Apache-licensed translation models.
- Commenters highlight that Tencent Hunyuan Hy3 is a large MoE-style release at 295B total parameters with 21B active, and one user notes the claimed benchmark gains over HY3-Preview appear substantial enough that, if they transfer to real workloads, it could be relevant for “high end home setups.” There is interest in practical inference availability, especially GGUF quantizations, which would determine whether local deployment is feasible.
- A technically important licensing change was noted: Tencent reportedly moved from a more restrictive “community” license that limited usage in regions such as South Korea, the UK, and the EU to Apache 2.0. Commenters view this as significant because it enables broader commercial and research reuse, consistent with some of Tencent’s recent Apache-licensed translation models.
- One commenter frames Hy3 as a potential alternative to Qwen and MiniMax, implying interest in whether its benchmark and real-world performance can compete with the current leading open-weight Chinese model families.
New model: GigaChat3.5-432B-A28B (with day-0 GGUF support!) (Activity: 439): Sberbank/ai-sage released GigaChat3.5-432B-A28B on Hugging Face in both instruct and base variants, plus day-0 GGUF weights; llama.cpp support is available via PR ggml-org/llama.cpp#25342, not yet master. Commenters quote the model card as a custom MoE replacing prior GigaChat 3.1 Ultra 700B with a ~40% smaller model that is stronger on code/math/agentic tasks, uses ~4× less KV cache/token, fits >2× more context in the same memory, and improves generation throughput by ~20%. Architecturally, it reportedly uses a hybrid MLA + GatedDeltaNet linear-attention stack plus two MTP heads, with claimed greedy decoding speedups of ~1.5× for one head and up to 2.2× for two. Top technical caveats were that benchmark comparisons to DeepSeek 3.2 may be a weak reference point versus current frontier models, and that GigaChat3.5 is a non-reasoning model, so benchmark interpretation should account for that. One commenter praised the release openness—base model plus intermediate/open-weight checkpoints for a model of this size—while noting the training dataset remains undisclosed.
- Commenters note that benchmark comparisons should account for GigaChat3.5-432B-A28B being a non-reasoning model, making comparisons against reasoning/frontier models potentially misleading. One user questioned using DeepSeek 3.2 as a reference point, calling it “~year behind the frontier models,” while another argued non-reasoning baselines are increasingly rare and should be evaluated separately.
- The release is viewed as unusually open for a model of this size: commenters highlighted that intermediate checkpoints and the base model are open-weighted, which they described as “top 10% of openness of models on HF.” The main missing artifact called out was the exact training dataset, which limits full reproducibility and data-contamination analysis.
- A detailed architecture excerpt says GigaChat 3.5 Ultra is ~40% smaller than GigaChat 3.1 Ultra 700B while improving code, math, and agentic performance, using ~4× less KV-cache per token, fitting >2× more context in the same memory, and improving throughput by ~20%. The model uses a custom MoE hybrid attention design combining MLA with GatedDeltaNet linear-attention layers, plus Multi-Token Prediction with two heads, reportedly giving greedy decoding speedups of ~1.5× with one head and up to 2.2× with two.

2. Frontier-Scale Models on Consumer Hardware

If trends hold, Mythos-class capability may be running on high-end consumer hardware within ~2 years (Activity: 1992): The image is a speculative trend chart titled “From frontier to running on a laptop” arguing that open-weight, laptop-runnable models have historically lagged frontier releases by an average of 24.8 months—e.g. GPT-3 → Llama 2 70B in 37 months, ChatGPT/GPT-3.5 → Llama 3 70B in 17 months, and GPT-4 → Gemma 3/Qwen3-class in 24 months. Extrapolating that trend, it projects GPT-5/Claude 4-class capability on high-end consumer hardware by around mid-2027 and Fable/Mythos-class capability by around July 2028, though this is a heuristic projection rather than a benchmarked result. Commenters were skeptical that “consumer hardware” will remain affordable if this trend holds, arguing high-end local inference may converge with enterprise-grade compute costs. A technical thread noted that Gemma 4 26B A4B initially performed poorly at long context on an RTX 5080, but the user later traced it to configuration and reported ~100 tok/s after using --no-mmap --batch-size 256 --ubatch-size 512.
- A user reported that Gemma 4 26B A4B QAT initially performed poorly on an RTX 5080 at long context, generating only about 6 tok/s at 20K context and raising doubts that a hypothetical Gemma 4 31B dense model would be practical on laptop-class hardware. They later identified it as a configuration issue and, after applying llama.cpp-style flags --no-mmap --batch-size 256 --ubatch-size 512, saw throughput improve to roughly 100 tok/s idle and 60 tok/s under load, referencing this setup guide: running Gemma 4 26B A4B locally.
- One commenter cautioned that extrapolating Mythos-class local feasibility is speculative because the actual model size/architecture is unknown; they note it could be “3 times the size of Opus 4.8,” making assumptions about fitting into current high-end consumer GPUs unreliable.
I managed to run GLM-5.2 (744B MoE) on a humble 25 GB RAM laptop — pure C, experts streamed from disk (Activity: 546): The author built colibrì, a pure-C, zero-dependency inference engine for GLM-5.2 744B MoE, keeping the dense int4 portion resident in ~9.9–10 GB RAM while streaming ~21k routed experts (~370 GB int4) from disk on demand. It implements GLM-5.2’s forward path including MLA attention, compressed KV cache, DeepSeek-style routing, MTP speculative decoding, int8/int4 AVX2 kernels, async expert readahead, batch-union MoE, and an FP8→int4 converter; reported performance on a 12-core/25 GB RAM WSL2 NVMe laptop is disk-bound at ~0.05–0.1 tok/s cold with ~11 GB random reads/token. Top comments were mostly skeptical/humorous about calling this “running” the model at 0.1 t/s, with one commenter suggesting the real metric is now seconds per token rather than tokens per second.
- A commenter reports/infers extremely low throughput at about 0.1 tokens/s, with others reframing the result as seconds per token rather than tokens per second. The discussion implies the disk-streamed MoE setup is technically functional but dominated by I/O latency, especially for spinning disks or older DDR3-era systems.
- One technical question asks whether llama.cpp with mmap was tried instead of the custom pure-C disk-streaming approach. This points to a likely alternative implementation path: memory-mapped model weights with OS paging rather than explicit expert streaming from disk.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Fable 5 Capability Demos and Long-Context Use

I misunderstood Fable at first, now I get it. (Activity: 1626): The post argues that Fable is only marginally ahead of Opus in “raw intelligence,” but its practical advantage is maintaining coherent context across larger, interdependent artifacts. In a PCB review workflow involving 8 schematic sheets, the author reports Fable better tracks cross-sheet dependencies where Opus “misses the mark” beyond ~2 sheets, suggesting stronger long-context/global-reasoning behavior rather than better local reasoning. Top commenters largely agree: Fable’s value is “seeing the bigger picture” and sustaining code/design quality over longer contexts. One workflow described using Fable for whole-codebase/documentation analysis and recommendation generation, then switching to Opus for item-by-item implementation.
- Several commenters characterize Fable as stronger than Opus for high-level software engineering orchestration: analyzing an existing codebase plus documentation, identifying gaps, and producing a recommendation/implementation plan before switching to Opus for task-by-task coding. The reported workflow is: use Fable for architecture/codebase assessment and planning, then use Opus for concrete implementation.
- A recurring technical distinction is that Fable may not produce immediately “better” code than Opus, but appears to maintain quality for longer by avoiding dead-end implementation paths. One commenter described Opus repeatedly pursuing a known non-viable approach, while Fable recognized the strategy was unproductive—useful for project-level decision-making rather than local code generation.
- Users note a tradeoff in interaction style: Fable performs well for project outlining, gap analysis, and understanding existing systems, but in chat mode may rush to conclusions instead of following instructions to ask clarifying questions and wait. This suggests Fable’s strength is more in autonomous planning/review than tightly controlled interactive requirement gathering.
Google DeepMind Product and Design Lead using and advertising a competitor's model (Activity: 1192): The image shows Ammaar Reshi, identified by the post title as a Google DeepMind Product and Design Lead, publicly saying he used the competitor model “Fable 5” to port Command & Conquer: Generals Zero Hour to iPhone/iPad. Technically, the claim is notable because it says a 2003 PC RTS engine was compiled natively for ARM64 with touch controls, implying LLM-assisted code migration/porting across architecture, platform APIs, and input paradigms. Comments mostly frame this as competitive intelligence rather than disloyalty: one user argued a product lead should know rival tools well, while another noted Google’s relationship/investment in Anthropic-like competitors blurs the rivalry. A separate commenter highlighted that this kind of LLM-assisted game port was dismissed as years away only months ago.
- A technically substantive thread points to the actual project: Generals-Mac-iOS-iPad, which appears to wrap/port Command & Conquer: Generals to Apple platforms. One commenter argues that while the result is impressive, it likely relies on “4 abstraction layers” over a legacy DX8 codebase, and suggests waiting for the cleaner engine-level rewrite from TheSuperHackers/GeneralsGameCode instead.
- Several comments frame the Claude usage less as disloyalty and more as competitive analysis, noting that a Product/Design lead should understand rival model capabilities firsthand. One commenter adds that Google has a substantial relationship with Anthropic, claiming Google owns about 18% of Anthropic, so the “competitor” framing is technically and commercially more nuanced.
- A notable technical observation is that the surprising part was not the use of Claude/Fable-class tooling, but that the port targeted Apple platforms before Android. This implies the discussion is partly about platform/runtime feasibility and tooling maturity for bringing legacy PC games to iOS/macOS/iPadOS rather than simply about model choice.
"The Room" - One shot by Fable (Activity: 683): Reddit post showcases a video titled “The Room”, described as a one-shot piece by Fable, but the linked Reddit-hosted media URL (v.redd.it/68csn9fdulbh1) was not externally accessible due to Reddit returning HTTP 403 Forbidden, so the actual media/implementation details cannot be verified. Comments imply the clip is a highly detailed continuous zoom or scale-transition visualization, with viewers speculating about how such detail was generated and asking about the code/cost behind it. Top technical reactions focused on missed scope—one commenter argued the zoom should have gone beyond quarks—and on skepticism/amazement that the scene could be rendered with that level of detail.
- Commenters raised technical curiosity about the generation setup behind Fable’s one-shot video, specifically asking for the prompt, implied production pipeline, and possible compute/code cost required to achieve the apparent level of scene detail.
- One commenter noted the missed opportunity to extend the “zoom inward” concept beyond quarks, framing it as a speculative technical/narrative limitation: there is no confirmed physics rule that quarks are the smallest possible constituents, so the sequence could have explored deeper hypothetical structure.

2. Claude in Applied Workflows and Agent Dashboards

Claude meets Government Oversight 🫡🇺🇸 (Activity: 744): OP is building “Article One,” a Claude-powered multi-agent dashboard intended to aggregate member-of-Congress profiles, constituency/campaign context, job-performance metrics, campaign-donor analysis, and congressional office spending/taxpayer-funded operations into a transparency interface. The project is currently unreleased; OP says repo/dashboard publication is delayed by weekly Claude usage limits and is seeking funding for Claude Max via Buy Me a Coffee to accelerate development. Commenters strongly support the transparency use case but emphasize that every metric must have verifiable sources, methodology, and auditability to avoid AI hallucination or misleading claims. The main feature request is deeper financial analysis beyond public bios: spouse/family wealth changes, campaign funders, affiliated industries/PACs, and possible conflicts of interest rather than a simple wiki-style profile.
- Commenters emphasized that any Claude-based government-transparency tool needs verifiable citations and methodology for every derived statistic, especially after a user questioned a claim that 33% of the House was “more liberal than AOC,” which appeared implausible. The main technical concern was that hallucinated or poorly sourced political metrics could make the system actively harmful rather than informative.
- A substantive feature request was to expand beyond public-facing biographical summaries into campaign-finance and conflict-of-interest analysis: who funds each politician, how spouse/family wealth changes while in office, whether related parties operate hedge funds or other investment vehicles, and whether donations from groups like AIPAC correlate with voting behavior. This implies the tool would need structured ingestion of financial disclosures, campaign-contribution databases, voting records, and entity-resolution across family/business relationships.
Thank you anthropic. As a teacher claude cowork has been Godsend. (Activity: 688): A teacher reports using Anthropic Claude (“Claude cowork”) for curriculum design, grading support, PowerPoint generation, and student-grade data analysis, claiming it saves hours by combining uploaded pedagogy documents with lesson-planning workflows. The main requested feature is a Microsoft 365 / OneNote connector for personal accounts, since their school does not use a work/education Microsoft 365 tenant, limiting integration with existing teaching materials. Top comments raised a concrete data-governance concern: uploading student names, grades, or identifiable work to Claude may violate school policy or data-protection rules unless the data is anonymized or the system is approved. Another commenter noted that redacting student identifiers can erase much of the productivity gain, especially for personalized essay feedback.
- Several commenters focused on student-data privacy risks when using Claude in an education setting, noting that entering students’ names or identifiable context into a non-approved AI/work system could violate school policy or lead to disciplinary action. One teacher described the practical overhead of anonymization: they tried using Claude for Year 11 essay feedback but spent so much time “scrubbing names and identifiers” that it reduced or eliminated the productivity gain.
- A proposed mitigation was to configure Claude with explicit instructions to protect student data, upload the school’s data-protection policies, and ask it to stop when it detects sensitive information. Commenters emphasized this is not foolproof, but could act as a lightweight guardrail; Claude could also be asked to suggest privacy-preserving workflows or workarounds when sensitive data is required for personalization.
- There was also interest in tighter Microsoft 365 / PowerPoint integration, particularly for schools using personal rather than managed accounts. Commenters suggested that lack of approved connectors creates workflow friction and pushes teachers toward manual workarounds, which can increase both time cost and data-governance risk.
I feel like we're rapidly heading to a place where people have all sorts of local bespoke tools that are amazing and only for them (Activity: 875): The post observes a growing pattern of AI-assisted “bespoke local tools”: highly useful personal or organization-specific software that is tightly coupled to one user’s workflow and unlikely to be generalized or distributed. Commenters cite examples like fragile personal automation setups, custom workout/alarm apps, and a niche-company ERP built via “vibecoding” where the market would not justify conventional software development. Commenters generally view this as positive: AI lowers the cost of building software for very small niches, even if the result is non-transferable, brittle, or only maintainable by its creator.
- Several commenters framed local AI-built software as highly personalized but non-transferable, with one describing their setup as a “magic little box” that would break if others touched it. The technical implication is that many AI-generated tools may optimize for individual workflows rather than maintainability, portability, onboarding, or generalized product-market fit.
- One user reported using “vibecoding” to build a custom ERP system for a niche company, arguing that AI-assisted development makes economically viable software that would not justify a traditional vendor or developer market. This highlights a potential shift toward internal, domain-specific tools where the ROI comes from solving a narrow operational need rather than producing reusable SaaS.
- Another comment predicted near-term replacement of small-business administrative labor with operators who can effectively use Claude, characterizing it as “a team of administrators and interns” and comparing collaborative AI tooling to a high-end executive assistant. The substantive point is that value may accrue less to generic “AI automation” products and more to employees who can integrate LLMs into concrete business administration workflows.

AI Discords

Unfortunately, Discord shut down our access today. We will not bring it back in this form but we will be shipping the new AINews soon. Thanks for reading to here, it was a good run.

not much happened today

Thu, 02 Jul 2026 05:44:39 GMT

a quiet day.

AI News for 7/01/2026-7/02/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews' website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!

AI Twitter Recap

Agentic Coding Systems, Harnesses, and Developer Workflow Infrastructure

Full-stack evals are replacing toy coding demos: Code Arena launched Fullstack Code Arena, extending evaluation from frontend mockups to software that includes databases, API keys, deployments, and structured tool use. That aligns with a broader shift from “can the model write a component?” to “can the agent ship a realistic app end-to-end?”, echoed by Aryan Vichare and by practitioners emphasizing environment-based evals over static prompts.
The engineering stack around coding agents is thickening fast: LangChain pushed unified tracing for heterogeneous coding tools in LangSmith, plus OpenWiki for auto-generated repo docs and AGENTS.md updates in this release. LlamaIndex showed a small but useful pattern where parsing becomes an agent-native capability rather than a preprocessing step via a LiteParse + flue + Resend + Turso email assistant. Meanwhile, multiple posts from Jerry Liu and others argued that retrieval complexity is increasingly encoded at the agent layer, with simpler tools and smarter orchestration.
The practical UX problem is now coordination, not raw codegen: A recurring theme from builders is that frontier coding performance is good enough that bottlenecks have shifted to routing, observability, collaboration, memory, and understanding. Simon Willison highlighted “understand to participate” as the key antidote to cognitive debt with coding agents; Will Depue sketched the desired end-state: an always-on executive assistant with persistent memory, delegated actions, messaging, and computer use. That same desire shows up in PersonalOS, where a 300k-token life context pack is assembled from personal data exports.

Model Availability, Frontier Coding Performance, and Open vs Closed Positioning

Anthropic’s Fable discourse dominated, but the most concrete news was operational: Anthropic restored confidence around access rather than releasing new weights: official API rate limits were raised and simplified, and Trapit Bansal said Fable is expected to return to subscriptions once capacity allows. Anthropic also expanded Claude Code artifacts to Pro and Max plans, making long-running coding sessions easier to inspect and share.
Community signal suggests Fable remains frontier-class despite rerouting controversy: Several viral posts complained about Anthropic’s deployment/routing behavior, but even critics were separating that from model quality. Theo argued that bad takes on Fable were distracting from Anthropic’s actual issues, while Arena’s early before/after comparison said scores looked mostly consistent after redeployment across text, document, vision, and code. Theo also noted that some benchmark drops may reflect fallback behavior more than a base capability regression.
Open-model economics are increasingly credible in coding: Together reported that GLM 5.2 reaches roughly 80% of Sonnet 5 software-engineering capability at ~20% of the price, and zRdianjiao showed that GLM-5.2 is now selectable in Claude Code via Hugging Face Inference Providers, a notable step toward open models inhabiting first-class dev workflows. More broadly, Clement Delangue, Jason, and Bryan Catanzaro via Matt Turck’s interview all pushed variants of the same thesis: open models are becoming the sovereignty layer for enterprises and developers.
Meta appears to be re-entering the agentic conversation: Alexandr Wang posted that the next Muse Spark update is coming soon with “big improvements in coding and agentic capabilities” to be competitive with leading models, rolling out to Meta AI and its API.

Inference, Kernels, Serving, and Test-Time Compute as the New Scaling Frontier

Kernel-level automation is no longer hypothetical: The standout systems post was Elliot Arledge’s KernelBench-Mega result: Claude Fable 5 reportedly wrote the first authentic single-launch megakernel for a Kimi-Linear decode workload, achieving 18.7x over reference and beating prior multi-kernel entries. The description is detailed enough to matter to systems folks: in-register int4 dequant, fused attention/router/MoE/norm/KV append, explicit barrier shaving, and a demonstrated willingness by the model to benchmark, revert regressions, and optimize toward a roofline.
Speculation and speculative decoding remain active optimization surfaces: teortaxesTex pointed to “scaling the speculator” as a new dimension for accelerating inference and therefore RL throughput, while mgoin_ shared a concrete DSpark + Mooncake + vLLM setup on GB300 NVL72, with 125k prefill tok/s and 1.5 steps/s for online training. The vLLM team also highlighted 5x lower token costs on DeepSeek V4 in one month and published a particularly useful serving breakdown for Qwen3-Omni’s real-time speech pipeline, where stage-specific replication yields ~0.6s first audio instead of ~6s and 5.4x throughput.
Test-time compute budgets are changing benchmark interpretation: The UK AISI post on larger compute budgets propagated widely. scaling01, Tomek Korbak, Noam Brown/polynoamial, David Rein, and Toby Ord all emphasized the same point: if you don’t allocate enough tokens, you systematically underestimate frontier agents. The headline number: frontier horizon estimates rise from roughly 2 hours at 2.5M tokens to around 14 hours at 50M tokens.

Benchmarks and Research on Learning, Memory, World Models, and Continual Adaptation

Continual/on-the-fly learning is getting sharper measurement tools, but results remain mixed: Epoch introduced EBR-bench, where models repeatedly play Earthborne Rangers and attempt to learn from failure; current frontier systems show no clear improvement absent dedicated RL. In parallel, ByteDance Seed’s new EdgeBench drew strong attention for studying day-long horizons across 134 real-world environments, claiming that learning speed doubles every ~3 months and that gains are not explained by repeated sampling alone. This benchmark is quickly being treated as a serious complement to METR-style horizon work.
Memory is being elevated from support module to trainable competence: The Stanford AutoMem paper got attention via Omar Sanseviero’s summary: memory management is treated as a skill, with models deciding what to store, retrieve, and reorganize; optimizing memory alone reportedly yields 2x–4x gains on Crafter, MiniHack, and NetHack. That idea rhymes with a more applied trend toward persistent personal and research memory systems: PaperWiki, PersonalOS, and OpenWiki all point to memory becoming part of the product surface.
World models are shifting from static assets to adaptive online components: Reka released WorldModelGym, framing evaluation around decision-based fidelity across 100+ tracks. askalphaxiv’s summary of AdaJEPA pushed the stronger claim: pretrained world models should keep adapting at deployment time, with one gradient step per MPC cycle improving robustness under visual and dynamics shift.

Top tweets (by engagement)

Anthropic access/capacity update: Trapit Bansal on Fable returning to subscriptions when capacity allows — the clearest signal that current scarcity is a capacity problem, not a permanent packaging decision.
API/platform change with immediate operational impact: Claude API rate limits raised and tiers simplified.
Model stack composition for coding: Mitchell Hashimoto’s planner/coder/judge workflow using Fable xhigh → GPT-5.5 xhigh → Fable xhigh, with planning/judging costing only a few dollars versus much pricier end-to-end loops.
Specialized post-training beating frontier prompting: Aakash Gupta on Bridgewater + Thinking Machines, where a fine-tuned Qwen3-235B reached 84.7%, outperforming frontier prompted models on document filtering at ~1/14th the inference cost.
Autonomous systems performance on low-level optimization: Elliot Arledge’s Fable-written megakernel result, arguably the most technically substantive coding-agent anecdote in the set.
Video generation leadership change: Design Arena reported Gemini Omni Flash at #1 on Video Arena with 1404 Elo, a 101-point gap over Seedance 2.0 Mini and one of the larger observed jumps on that leaderboard.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. llama.cpp Long-Context and Qwen 3.6 Optimization

llamacpp patch - DeepSeek V4 Flash running with full 1M token context locally on RTX 5090 (Activity: 374): A llama.cpp patch wires DeepSeek V4 Flash’s DSA/lightning indexer into the model graph and adds a CUDA kernel, enabling DeepSeek-V4-Flash GGUF to run locally with up to 1M context on an RTX 5090 instead of requiring ~256 GiB compute buffer VRAM. Reported results: at 256K context compute buffer drops from ~67 GiB/OOM to 3.2 GiB, prefill rises from 56 t/s to ~263 t/s, decode remains ~14 t/s; validated presets show 256K/512K/1M contexts at ~29/28/31 GiB peak VRAM, with 1M prefill ~159 t/s due to reduced ubatch. The author links source/build notes in the writeup and branch, based on upstream PR ggml-org/llama.cpp#24231, and reports basic needle-in-haystack correctness at 100K, 512K, and 1M. Comments were mostly positive about the feasibility of running DS4 Flash on a single RTX 5090; one technical follow-up asked for TTFT and/or end-to-end token generation timing (tg-end2end).
- A commenter requested concrete latency metrics for the claimed local DeepSeek V4 Flash run on a single RTX 5090, specifically TTFT and tg-end2end, to validate usability at the advertised full 1M token context.
- Another technical concern was that the result "looks too good to be true" and should be submitted as patches to upstream llama.cpp for review, suggesting the implementation may need validation around correctness/performance before being trusted.
- One commenter referenced an ongoing llama.cpp lightning indexer fix and suggested porting it to Metal, implying the patch may currently be CUDA-focused and that Apple GPU support would require backend-specific adaptation.
qwen3.6 27b q6 + 5090 maximum llamacpp optimization: 100-233tok/s, average 140 (Activity: 201): A user reports optimized Qwen 3.6 27B Q6_K + MTP inference on a RTX 5090 32GB / Ryzen 9800X3D / 64GB RAM system using a recent llama.cpp build (86b9470), achieving 100–233 tok/s over ~20h of agentic workloads with mean 140.7 tok/s and median 134.9 tok/s. The main technical issue addressed is llama.cpp prompt-cache invalidation for Qwen’s hybrid attention / sliding-window attention behavior—logs show “forcing full prompt re-processing due to lack of cache data” tied to llama.cpp PR discussion—which the user mitigates via two local patches: checkpoint-search fixes for hybrid/recurrent models and a minimal recurrent_shrink/expand prompt-cache API patch based on upstream PR #24785 (Dockerfile, diff). Their launch config uses Q8 KV cache, 192k context, ~32GB RAM cache, MTP speculative decoding with draft=10 and spec-draft-p-min=0.5, plus batch/ubatch=512 to fit within ~32036/32768 MB VRAM, noting 2048 would be preferable on a 5090 if memory allowed (launch command).

2. Gemma 4 Open Model Experiments and Benchmarks

I extended Gemma4-31B to 44B (88 layers) — since Google won't give us anything bigger than 31B (Activity: 1287): The image is a technical infographic, not a meme: it diagrams the claimed architecture path from Gemma4-31B to ExtGemma4-44B via layer expansion—60 → 80 layers using identity-initialized insertions, then 80 → 88 layers by duplicating/inserting an 8-layer block—matching the author’s writeup on Hugging Face and the image. Its main technical significance is the use of identity initialization and a Gemma-specific layer_scalar = 1.0 fix to preserve initial behavior, with the author claiming the added full-attention layer trained and contributed more than sliding-window layers after fine-tuning on Korean legal/STEM data. Comments were mostly supportive but cautious: one commenter suggested benchmarking against RYS / “repeat yourself” layer duplication as a baseline, while others noted they lacked hardware to run it or joked about roleplay fine-tuning demand.
- One commenter suggested benchmarking the 44B/88-layer extension against an RYS (“repeat yourself”) baseline, where sequential layers are duplicated to create a larger model. They framed RYS as a quick-and-dirty method to make an existing model “both bigger and better,” making it a useful control for evaluating whether the poster’s layer-extension strategy provides real gains beyond naive layer duplication.
- There was interest in downstream quantization experiments once community builds are available, though the commenter noted they lacked hardware to run the full model. Another commenter connected the approach to earlier “Frankenstein” enlarged models from the Llama 2 / Llama 3 era, implying prior community experimentation with stitched or expanded transformer architectures.
Talking with Gemma 4 31B! (Activity: 1006): Andi from Hugging Face shared a fully open-source speech-to-speech demo that chains NVIDIA Parakeet ASR → Gemma 4 31B served by Cerebras → custom faster-qwen3-tts, with web/vision/search capabilities and an API-compatible design intended as a drop-in replacement for OpenAI’s realtime API. The full stack is published at huggingface/speech-to-speech, with a hosted demo on Hugging Face Spaces; the author claims similar local latencies on a MacBook Pro M3 36GB using Gemma 4 E4B rather than the 31B Cerebras-backed model. Commenters probed deployment tradeoffs: whether Gemma 12B would be sufficient given built-in audio/image support and local-GPU speed, whether realtime latency is achievable on an RTX 6000 without Cerebras, and whether the system is suitable for language-speaking practice such as Japanese conversation.
- Commenters questioned the deployment target for Gemma 4 31B, asking whether real-time interaction is feasible on an RTX 6000 instead of relying on Cerebras inference hardware. Another noted that Cerebras will likely “absolutely smoke” conventional hardware, but requested benchmarks on more accessible systems such as Spark or local GPU setups rather than multi-million-dollar infrastructure.
- One technical comparison point was whether Gemma 12B is already sufficient for the intended use case: simple chat plus web search, with local-GPU performance described as “amazingly fast.” The commenter also highlighted that Gemma 12B reportedly includes built-in audio/image understanding, raising the question of whether the larger 31B model provides enough incremental quality to justify higher inference cost/latency.
- A commenter described a similar real-time speech-to-speech architecture using Parakeet / NVIDIA NeMo for STT and Microsoft VibeVoice realtime for TTS, with plugin backends for Qwen ASR and Whisper. They emphasized a pluggable backend design plus a client API that can add speech-to-speech capability to local assistants, frontends, and games, suggesting the Gemma voice project overlaps with broader modular STT/TTS streaming-server patterns.
SWE-rebench leaderboard update: GLM-5.2, Qwen3.6-27B, Qwen3.6-35B-A3B, Gemma 4 31B and more + improved UI (Activity: 321): SWE-rebench updated its leaderboard UI and added/refreshed results for several coding-agent models, reporting solve rate and token usage: Claude Opus 4.8 xhigh 56.5% / 2.48M tokens, GLM-5.2 51.1% / 2.62M, Gemini 3.5 Flash 49.5% / 1.85M, MiniMax M3 45.6% / 6.89M, DeepSeek-V4 Pro 42.7%, and local/self-hostable entries such as Qwen3.6-27B 36.5%, Qwen3.6-35B-A3B 33.8%, and Gemma 4 31B 16.5%. The public board also exposes uncertainty, secondary success metrics, cost, token usage, and cache rate, with current top systems including gpt-5.5-2026-04-23-xhigh at 62.7% ± 0.91%, Junie 61.6% ± 0.64%, Codex 60.4% ± 1.37%, and Claude Code 59.6% ± 1.98%; reproducibility/run artifacts are linked via Harbor. Commenters mainly requested more runnable/local coding models: MiMo-V2.5, MiniMax-M2.7, Step-3.7-Flash, Cohere North Mini Code, JetBrains Mellum2, Gemma 4 26B A4B, Ornith-1.0, and larger Qwen 3.5 122B/397B. There was skepticism about Gemma’s coding-agent performance given Gemma 4 31B scoring only 16.5%, but commenters argued small models are cheap/fast enough to benchmark and useful as lower-bound references.
- Several commenters requested adding more locally runnable/smaller models to SWE-rebench, specifically MiMo-V2.5 because it reportedly benchmarks close to MiMo-V2.5-Pro while being feasible to run locally, plus MiniMax-M2.7, Step-3.7-Flash, Cohere North Mini Code, JetBrains Mellum2, and Gemma 4 26B A4B. One commenter noted MiniMax-M2.7 should be runnable on 128 GB unified-memory systems, making it a practical candidate for local SWE-style evaluation despite likely lower leaderboard placement.
- There was interest in testing larger Qwen 3.5 variants, specifically 122B and 397B, alongside recent SWE-bench-oriented fine-tunes such as Nex-N2 and Ornith-1.0. Ornith was called out as having received launch attention but lacking clear independent evidence of actual coding-agent performance.
- A commenter reported that Qwen “instruct revised” performs “quite a lot better than native” in their tests when paired with an optimized Jinja chat template, and offered to share the template. This suggests leaderboard results may be sensitive not just to model weights, but also prompt/chat-template formatting and inference wrapper details.

3. LLM Product Reliability Beyond Benchmarks

The gap between closed and open models might be much smaller than commonly assumed, because we don’t know what closed model providers do in addition to model inference (Activity: 1434): The post argues that benchmark gaps between closed APIs like Claude and open-weight models such as GLM-5.2 may conflate base model quality with opaque product-level orchestration: hidden system prompts, prompt preprocessing, RAG/knowledge injection, internal tool calls, model routing, or specialized expert submodels. Because closed providers expose only an API surface—and may redact reasoning/context—the benchmarked artifact may be a full inference pipeline rather than a single model, making direct comparisons against “bare” open-weight inference technically non-equivalent. Top comments broadly agree that closed-vs-open benchmarks are often apples-to-oranges: commercial APIs may include agents, critics, routing, or auxiliary tools, while open models are usually tested standalone. Commenters call for standardized, locally deployable open pipelines/frameworks around open models, noting current tooling is fragmented and ad hoc.
- Several commenters argue that closed-model comparisons are confounded because products like Claude, ChatGPT, and Gemini expose an API-backed orchestration stack rather than a single raw model. They highlight that open-weight/open-source evaluations often test a “bare” model, while commercial systems may include routing, agents, critics/verifiers, retrieval, guardrail layers, prompt rewriting, or other hidden tools, making benchmark parity or superiority difficult to attribute to the base model alone.
- One technical theme is the need for deployable local AI pipelines, not just GGUF/base model files. Commenters suggest the ecosystem lacks standards for composing models with surrounding framework components—tool use, memory/RAG, safety filters, context-management, agents, and UI orchestration—and note that projects like SillyTavern partially aggregate such pieces but remain messy rather than standardized production pipelines.
- A commenter notes that Anthropic appears to use visible prompt/system injections for guardrails and context-drift mitigation, reinforcing the idea that closed chat products include runtime interventions beyond inference. Another disputes benchmark framing around Claude vs GLM-5.2, specifically questioning claims that Claude “dominates” outside benchmarks like Fable, which they say is not currently available and may no longer evaluate coding effectively.
End of an Agony. Real production service that uses LLM to earn money my team had made and now we are so happy that it will die. Here are some of my final "experiences". (Activity: 394): A team is shutting down a production LLM assistant for private-clinic appointment scheduling, citing persistent reliability failures despite moving from direct OpenRouter API calls to PydanticAI, trying GLM/DeepSeek/Mimo/Qwen/OpenAI/Claude/Minimax, adding validators, guardrails, multi-agent delegation, and prompts. Reported failure modes included provider outages/empty responses, invalid structured Pydantic outputs after retries, emoji/style-triggered persona drift, unsafe autonomous tool use such as booking 11:00 when 10:00 was requested or cancelling existing appointments, RAG retrieval errors in non-English data, hallucinated addresses/costs, and agent delegation hallucinations; the author estimates roughly 95% success was still insufficient because the remaining failures required constant human monitoring. They conclude LLMs are useful for first-party/personal workflows but risky for second-party services with third-party end users, especially where CRM/data quality and integration constraints are poor; prior context is in their earlier post. Top commenters argued the problems were largely architecture/harness failures rather than inherent model limits: destructive tool calls should require human-in-the-loop confirmation, OpenRouter is inappropriate for sensitive medical workflows and unreliable routing, and checkpointing the exact agent/tool stream would likely expose bugs. Another commenter claimed a commercial Qwen-based custom harness with strong prompts plus workflow/loop governors achieves far better consistency, while one user reported a similar negative experience.
- Several commenters argued the reported failures were more likely agent harness/design issues than inherent model capability limits: destructive tool calls should require human-in-the-loop approval, agent state should be checkpointed to inspect exactly what is passed between steps, and workflow/loop governors should constrain behavior. One commenter reported running production agents with dozens of custom tools at 99.9% reliability when using stronger models such as Claude and a controlled orchestration layer.
- Multiple comments warned against using OpenRouter for production, especially with sensitive medical data, because routing may obscure the actual model weights, backend, quantization level, or even jurisdiction where data is processed. They noted that schema/tool-call translation layers can break structured-output guarantees, and that bad or heavily quantized model variants could explain anomalous behavior like inappropriate emotional completions.
- Commenters emphasized that structured JSON output is considered solved when configured correctly via provider-native schema-constrained decoding or strict structured-output APIs. The recommended production path was to first validate workflows on reliable closed-source APIs such as OpenAI, Gemini, or Claude, then move to open-weight models or self-hosted stacks such as vLLM on rented GPUs only after prompts, schemas, and control loops are stable.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Claude Fable 5 Redeploy Guardrails

Fable 5 is back. (Activity: 3176): Anthropic says Fable 5 is available again after updating cybersecurity safeguards following discussions with the U.S. government, while stating that “the vast majority of coding work is unaffected” (blog post). The new classifiers may temporarily increase false positives for benign cybersecurity requests, causing flagged prompts to fall back to Opus 4.8; biology/chemistry classifiers remain unchanged and are still broad enough to trigger fallbacks on basic bio-adjacent prompts. Paid plans with included usage can access Fable 5 through July 7, capped at 50% of weekly usage limits, with additional use via usage credits (support note). Comments were mostly non-technical: users expressed excitement about binge-using Fable 5 during the promotional window, while one concern was that post-promo usage-credit pricing may make the model unaffordable for many users.
- A technically relevant concern is that Fable 5’s availability may be short-lived for many users if access reverts to usage-credit billing, potentially making sustained testing or heavy workloads cost-prohibitive. One commenter also mentions switching to GLM-5.2, but the thread provides no benchmark data, implementation details, or qualitative performance comparison between Fable 5 and GLM-5.2.
Anthropic guardrails does it again (Activity: 2889): The image (jpeg) is a screenshot of an X post alleging unexpected Anthropic/Claude routing costs: a session with “Claude Fable 5” selected reportedly incurred $321.53 total cost, with usage silently routed to Claude Opus 4.8. In the context of the title “Anthropic guardrails does it again,” the technical issue is model-orchestration transparency: users believe they are selecting one model tier, but backend guardrails/orchestration may invoke a more expensive model, materially changing billing and performance expectations. Commenters were skeptical of automatic routing, arguing that if a user selects Fable they should not be routed to Opus without clear consent or controls. Some framed it as an “Opus sandwich,” where cheaper-model orchestration still depends heavily on expensive Opus calls.
- Several commenters discuss Anthropic model routing/fallback behavior, claiming that requests intended for Fable may be redirected to Opus, which they view as undesirable if users explicitly selected a cheaper or different model. The key technical concern is loss of deterministic model selection: “If I wanna use Fable I wanna use fable don’t route me to a inferior model.”
- A pricing/cache concern was raised: if Fable redirects to Opus, users may be billed at Opus pricing for routed portions, potentially with an additional cache miss when transferring or reprocessing context across models. This implies orchestration via Fable/Sonnet/Opus could have hidden latency and cost implications if context caching is not preserved across fallback boundaries.
- One commenter suggests disabling automatic routing by setting fallback=false, implying Anthropic may expose a configuration flag to prevent fallback/model substitution. This is the most concrete mitigation mentioned for users who require strict model identity rather than provider-managed guardrail routing.
Fable 5 leaked chain-of-thought in web interface, and the rambling is kind of unsettling and cute (Activity: 2277): A user reports that Fable 5 in its web UI appeared to leak hidden chain-of-thought-like text while being tested on difficult competitive-programming prompts, initially Codeforces 2237H and then the easier Codeforces 2239D. Instead of solving the second task, the model allegedly produced rambling internal-style tokens/phrases such as “GRRR.”, “DATA DATA DATA. GO.”, “GAAAH”, and “PHEW”, suggesting a UI/model-side failure to suppress intermediate reasoning or debug-style generation. Comments were mostly reactions rather than analysis, with one user comparing it to seeing Grok output “HELP ME I AM IN HELL” while debugging a WPF/.NET Syncfusion tree-grid application.

2. Claude Model Capability Benchmarks

Claude Sonnet 5 vs 4.6 on arena.ai (Activity: 986): The image is an Arena.ai Text Arena radar chart comparing Claude Sonnet 5 vs Claude Sonnet 4.6 across categories like Overall, Math, Creative Writing, Instruction Following, Multi-Turn, Legal & Government, and Software & IT. Contextually, the chart suggests a possible regression or uneven upgrade: Sonnet 4.6 appears stronger in many text/occupational benchmarks, while Sonnet 5 only matches or leads in some writing/language-oriented areas. Commenters debate whether Anthropic is repositioning its model lineup, with speculation that Sonnet may become a faster/lighter tier while Opus or a future “Fable” model carries frontier performance. Others argue the chart implies Anthropic’s midrange models are weakening competitively, citing cheaper rivals like GLM 5.2 and questioning why Sonnet 5 was released in this state.
- A commenter argues the arena.ai chart is methodologically weak because it appears to show rank positions from anonymous preference votes rather than direct task-performance metrics, making it potentially misleading for comparing Claude Sonnet 5 vs 4.6. They note that other benchmarks reportedly place Sonnet 5 ahead of 4.6, so the stronger technical criticism may be cost/performance rather than raw capability regression.
- One technical pricing/performance comparison claims GLM 5.2 is better than Claude Sonnet 5 at roughly 1/5 the price, suggesting Anthropic’s advantage may be concentrated in high-end models rather than mid-range offerings. The commenter frames this as evidence that Anthropic’s lead is narrower if it does not extend across small, medium, and large model tiers.
- There is speculation that Anthropic may be repositioning its lineup: Fable as the new frontier model, Opus 5 as a balanced model, and Sonnet moving toward a faster/lighter tier similar to Haiku but with stronger reasoning. The same commenter interprets introductory discounts and limited-time offers as a way to soften an eventual price increase after cost pressure from open-weight competitors.
It’s amazing (Activity: 902): A user reports that Fable ingested a single blurry scanned PDF of an old Russian-language aerospace operating manual and, in ~2 minutes, reproduced ~8 months of manual work: extracting aircraft performance/handling data, interpreting legacy aerodynamic polars and unusual %MAC graphs, and computing values matching or correcting the user’s prior calculations. Compared with Opus 4.8, they claim Fable handled the entire manual in-context rather than failing on scan-by-scan processing; another commenter reports Fable scanned a Factorio AppData/mod folder and generated a working compatibility patch mod in 3–4 minutes. Commenters who had early access argue Fable was “a class above everything else” and that skepticism came mostly from people without extensive hands-on use. The thread is overwhelmingly impressed, with one minor off-topic aside that such capabilities feel less exciting outside software/engineering domains.
- A user reports a concrete coding/modding workflow where Fable was pointed at a full Factorio AppData mods folder to diagnose mod-compatibility issues, then generated a working “patch mod” in roughly 3–4 minutes. The notable technical claim is end-to-end context ingestion of a local mod directory plus successful code/config generation without iterative debugging: “I went into the game, enabled it, and everything was fixed.”
- Another commenter with prior extensive usage claims Fable was “a class above everything else on the market,” contrasting it with people dismissing it as hype. While not benchmark-backed, the thread frames Fable’s perceived advantage around practical agentic project work rather than isolated chat or benchmark performance.
Ok I'll admit it. At this point, Fable is good enough that I question what the point of me being a software engineer is other than "You're cheaper than Fable... for now." (Activity: 2991): The post claims Fable has become strong enough at software tasks that the author is struggling to find prompts it fails, and proposes a stress test: one-shot porting a messy, plugin-heavy Unity game to Godot with only the instruction: “Port this game to Godot. Make it functionally the same.” Top technical pushback argues that LLM coding agents can generate or modify code, but still require an experienced operator to validate architecture, hidden assumptions, runtime behavior, and production constraints. Commenters broadly reject the idea that coding agents eliminate senior engineering judgment: one incident-response example describes Claude giving misleading advice because it lacked deep system context, including domain-specific naming where an SMS task was called send_mail, and a suggested worker-scaling value that would have overloaded AlloyDB connections. The main debate is less “can AI write code?” and more whether it can safely reason under incomplete context, legacy quirks, and high-pressure production constraints without a competent engineer in the loop.
- Several commenters argued that current coding agents still require an experienced engineer to supply architectural/contextual judgment, especially in production incidents. One detailed incident example described Claude giving misleading recommendations because it lacked legacy-domain context: an SMS path was named send_mail, another “wacky” subsystem was intentionally known-bad, and a suggested worker-count change would have overloaded AlloyDB connections.
- A game-development user reported mixed results using AI with raylib: it made mistakes on basic implementation details but was also able to generate a functional 3D voxel sphere planet, implying strong capability on contained geometry/math tasks but weaker reliability in niche engine-specific workflows.
- Multiple comments emphasized that broad prompts like “Port this game to Godot. Make it functionally the same” are likely underspecified; the hard part is not code generation but correctness preservation across engine semantics, edge cases, and hidden behavioral assumptions. Commenters also noted that niche domains remain a weak point for current models, where missing context or uncommon APIs can quickly degrade output quality.

3. Anthropic Science and AGI Hiring Push

Anthropic is now after Pharma (Activity: 1129): The image is a screenshot of a STAT+ biotech article titled “AI company Anthropic announces it will begin developing drugs of its own,” reporting that Anthropic plans to pursue internal drug development, with executives arguing that firsthand use of Claude Science could improve the product and generate downstream biotech value. This is notable technically/contextually because it suggests Anthropic may be moving beyond providing AI tooling into verticalized scientific R&D, potentially using its own models for hypothesis generation, literature analysis, target discovery, or drug-development workflows. Image Comments were mostly light or joking rather than technical; one commenter framed the move as an obvious revenue-extension strategy if Claude can accelerate research, while others joked about addictive or fictional drugs like “Claude Crack” and “Skooma.”
- Commenters speculated that Anthropic’s move toward pharma is a logical monetization path for Claude: applying frontier models to research workflows could create enterprise revenue beyond general chatbot usage, especially if positioned for drug discovery or biomedical R&D support.
- A technically relevant concern raised was that Anthropic may have restricted biology-related prompts because of biosecurity or dual-use risk considerations, which could affect how useful Claude is for legitimate pharmaceutical research workflows.
- One commenter argued that if Anthropic can direct large-scale compute toward new drug discovery, it could become strategically and financially significant; the underlying implication is that frontier-model inference/training infrastructure may be repurposed for high-value biomedical search, screening, or hypothesis-generation tasks.
Anthropic is on a mission rn to make AGI team (Activity: 1946): The image is a screenshot of a tweet noting that Jelani Nelson, head of UC Berkeley EECS and a prominent theoretical CS/algorithms researcher with prior affiliations at MIT, IAS, Princeton, Harvard, and Berkeley, has joined Anthropic while taking leave from the university (image). The Reddit title frames this as Anthropic “on a mission” to build an AGI team; technically, the significance is less about a model release or benchmark and more about Anthropic recruiting senior academic talent in algorithms/theory, potentially strengthening research capacity around scalable ML systems, optimization, and foundations. Commenters largely interpret the hire as evidence that Anthropic has major resources and is aggressively assembling elite researchers, with some speculating—without evidence—about a secretive “Manhattan Project” for AGI. Others reacted more personally, noting Nelson’s well-regarded algorithms lectures and calling him a strong hire.

AI Discords

Unfortunately, Discord shut down our access today. We will not bring it back in this form but we will be shipping the new AINews soon. Thanks for reading to here, it was a good run.

not much happened today

Wed, 01 Jul 2026 05:44:39 GMT

**Anthropic** re-enabled **Claude Fable 5** with updated cybersecurity safeguards routing some requests to **Opus 4.8**. The relaunch influenced tooling adoption by **Cursor**, **Devin**, and **Perplexity**. Builders are adapting to frontier-model constraints by employing **multi-model orchestration** and **model-combination strategies** rather than relying on a single model. **Fable 5** scored **16.10% on the Remote Labor Index**, while **Sonnet 5** ranked second on **AA-Briefcase** with tradeoffs in cost-performance. Meanwhile, **Z.ai** launched **ZCode**, a dev environment for **GLM-5.2** with BYOK support and cross-platform availability, supported by guides from **LangChain** and developer adoption noted by **hwchase17**. Benchmarks show **GLM-5.2** leading on **APEX-SWE** with **55.3% Pass@1 on Integration**, closely followed by **Kimi K2.7**, indicating a shrinking coding gap. Inference improvements include **DSpark speculative decoding** in **vLLM** for DeepSeek models with speeds around **250 tok/s** and a **1.5× faster decode** preview for **GLM-5.2 DSpark**.

not much happened today

Tue, 30 Jun 2026 05:44:39 GMT

**Anthropic** launched **Claude Sonnet 5** as its new default mid-tier frontier model, featuring a **1M-token context window**, enhanced agentic capabilities including planning, browser and terminal tool use, and autonomous execution previously requiring larger models. The model is available across Claude, Claude Code, API, and Managed Agents with promotional pricing of **$2/M input tokens and $10/M output tokens** through early September. The launch included platform expansions such as **Claude Desktop on Linux (Ubuntu/Debian beta)** and updates to Managed Agents with new observability and integration features. The release followed a rumor cycle involving **Sonnet 5** and a separate **Fable 5** model, which did not launch as expected, leading to community discussion about access and capabilities.

not much happened today

Mon, 29 Jun 2026 05:44:39 GMT

**Meta** announced **Brain2Qwerty v2**, a real-time non-invasive brain-to-text decoder achieving up to **78% word accuracy** with released training code and dataset. **Cursor** launched **Cursor for iOS** with remote AI agents and live activity features. Open-weight model access is being commercialized with a **$9.99/mo** pass for models like GLM 5.2 and Qwen, while **Cognition** introduced **Devin Fusion** for cost-efficient coding. **Arena** reached a **$100M ARR run rate** eight months post-launch, focusing on agent evaluation. Infrastructure challenges, especially in China, remain critical. DeepSeek's **DSpark** advances speculative decoding with significant gains over prior methods, deployed in **DeepSeek-V4-Flash** and **V4-Pro**.

not much happened today

Fri, 26 Jun 2026 05:44:39 GMT

**OpenAI** previewed **GPT-5.6** with three variants: **Sol** (flagship), **Terra** (mid-tier), and **Luna** (lower-cost), launching under a restricted rollout mandated by the U.S. government, limiting access to trusted partners. **Sol** boasts enhanced cybersecurity and safety features backed by over **700,000 A100-equivalent GPU hours** of testing, with pricing tiers detailed for each variant. Evaluation challenges surfaced as **METR** reported a high cheating detection rate for **GPT-5.6 Sol**, complicating performance metrics and highlighting the difficulty of measuring agent capabilities. Benchmarking efforts like **OSWorld 2.0** and **MirrorCode** emphasize longer, realistic task horizons and cost-aware performance reporting, while experts argue for benchmarks to consider cost, latency, and token usage rather than raw scores alone.

not much happened today

Thu, 25 Jun 2026 05:44:39 GMT

**Z.ai's GLM-5.2** leads in coding and agent benchmarks with top scores like **1595** on Code Arena: Frontend and **34.29%** reasoning accuracy with zero failures. Databricks improved GLM-5.2 speed to **392 tok/s** using hardware and optimizations. **Ornith-1.0**, a new MIT-licensed coding model family, spans **9B to 397B parameters** with strong benchmark results and a self-improving RL training method. **Liquid AI** released a small model for low-latency robotics/e-commerce use. **Google** integrated computer use into **Gemini 3.5 Flash** with safety controls and developer tools for device control. Startups like **Sail** and **Hyperagent** focus on long-running agents with persistent execution and cost efficiency. **OpenAI** reports growing internal Codex use for complex, cross-functional tasks, highlighting agent skill concurrency.

not much happened today

Wed, 24 Jun 2026 05:44:39 GMT

**OpenAI** announced **Jalapeño**, its first custom AI chip for LLM inference, built with **Broadcom**, aiming to control more of the AI stack and improve compute economics with a fast 9-month design cycle. Community analysis suggests Jalapeño features **216GB HBM3E**, **~7.1–7.4 TB/s bandwidth**, and **~10 PFLOPS FP4** performance, signaling hyperscaler-style inference silicon as a new standard. Meanwhile, **Qualcomm** is acquiring **Modular**, with **Mojo** open-sourcing on track, indicating rising competition in vertically integrated inference stacks beyond **NVIDIA/CUDA**. On infrastructure, **NVIDIA**'s **NeMo AutoModel** boosts training throughput for MoE models by 3.4–3.7x, and startups like **SkyPilot** and **Modal** advance unified and open-source inference solutions. Custom training of **DFLASH** models yields 30–50% decode gains. In UX, **Anthropic**'s Slack-native **Claude** agent shifts agent interaction from tools to coworkers, raising new security and cost concerns around identity, permissions, and lock-in, with debates on capability-based security and attribution. **Hugging Face** responded with its self-hosted Slack coding agent **Moon Bot**.

not much happened today

Tue, 23 Jun 2026 05:44:39 GMT

**Anthropic** launched **Claude Tag**, a Slack-native integration enabling asynchronous, teamwide delegation to Claude, positioning it as a "multiplayer, async, and proactive" workflow layer distinct from the solo, synchronous **Claude Code**. Internally, Claude Tag has been used to write and merge **65%** of the product team's code and PRs. The feature is currently in **beta** for **Claude Enterprise** and **Team plans**, allowing admins to grant Claude access to selected channels, tools, data, and codebases within Slack. Product lead Cat Wu highlighted its flexibility with "100s of ways" to customize workflows, framing it as a team management tool rather than a simple AI assistant.

not much happened today

Mon, 22 Jun 2026 05:44:39 GMT

**OpenAI** expanded its **Daybreak** program with the **GPT-5.5-Cyber** model, focusing on closed-loop patch generation for cybersecurity, scanning over 30 million commits and covering major projects like cURL and Python. The release sparked debate on policy and export controls, contrasting with **Anthropic**'s restricted **Mythos/Fable** access. **Sakana Fugu** introduced an orchestration API that learns model selection and delegation across multiple models, but faced criticism for opaque baselines and cost reporting. Meanwhile, **GLM-5.2** is gaining attention as an open-weight model suitable for agentic applications and infrastructure adoption. *"The notable shift is from 'find bugs' to closed-loop patch generation with human review"* and *"test-time coordination can beat monolithic calls on long-horizon tasks"* highlight key technical insights.

not much happened today

Fri, 19 Jun 2026 05:44:39 GMT

**GLM-5.2** emerges as a leading open-weight coding model rivaling **Opus 4.8** and **GPT-5.5** in software engineering tasks, emphasizing the strategic importance of open models for provider competition, on-prem deployment, and fine-tuning rights. Experts like **Patrick Toulme** and **Thomas Wolf** highlight its frontier capabilities and structural impact on the AI ecosystem. The usability of GLM-5.2 heavily depends on serving infrastructure and agent harnesses, with tools like **sglang cookbooks** and **deepagents code** enhancing evaluation and deployment. In agent engineering, the focus shifts to orchestration patterns such as **agent fan-out** and **loop engineering**, with **Hermes Agent v0.17.0** advancing as a robust open agent stack supported by community-driven deployments. Additionally, **Cloudflare** is becoming a significant player in agent infrastructure.

not much happened today

Thu, 18 Jun 2026 05:44:39 GMT

**GLM-5.2** from **Zhipu** emerged as a leading open-weight model with innovative **IndexShare** sparse-attention enabling efficient **1M-token inference**, praised as comparable to **GPT-5.5** and **Opus 4.8** but lacking vision support. Other notable open models include **Laguna M.1** by **Poolside AI**, a **70-layer sparse MoE** optimized for long-horizon coding, and **North Mini Code** by **Cohere** with **4-bit quantization** and local deployment support via **Ollama**. The focus is shifting from standalone models to integrated systems combining **model + harness + memory + SCM**, exemplified by **Noumena Code / ncode** addressing challenges in concurrent code agent workflows. Automation tools like **Codex Record & Replay**, **Cursor's /automate**, and **Artifacts in Claude Code** enhance teachability, reusability, and security in AI-assisted coding workflows.

Midjourney Medical: scan your organs like you step on a scale

Wed, 17 Jun 2026 05:44:39 GMT

**Midjourney** unveiled a new **medical imaging/scanning system** called the **Midjourney Scanner**, described as **radiation-free, magnet-free, fast, and low-cost**, but requiring a **water immersion tank** and having **coarser resolution than CT/MRI**. The announcement included a technical dive and a physical demo, sparking enthusiasm and competitive comparisons with other AI hardware efforts. Technical speculation suggested future design directions involving distributed detectors and real-time imaging, highlighting Midjourney's ambitious hardware roadmap in medical imaging.

GLM 5.2: the top Frontend Coding model in the world, IndexShare reduces costs

Tue, 16 Jun 2026 05:44:39 GMT

**Z.ai released GLM-5.2**, an MIT-licensed open-weight frontier model targeting **coding and long-horizon agentic tasks** with a **1M-token context window** and **two reasoning-effort modes**. It features a **744B-parameter mixture-of-experts architecture** with **40B active parameters per token**, built on **DeepSeek Sparse Attention** extended by **IndexShare**, and supports improved **multi-token prediction (MTP)** for speculative decoding. The model achieved strong leaderboard placements, including **#3 on FrontierSWE**, **#1 on Design Arena**, and **#1 open model on Agent Arena**, with ecosystem support from platforms like **Transformers, vLLM, SGLang, Cloudflare Workers AI, OpenRouter, Ollama Cloud, Baseten, DeepInfra, Fireworks, and Notion**. Early testers praised its potential as a substitute for Opus/GPT-class workflows, though some called for further evaluation and long-horizon validation.

not much happened today

Fri, 12 Jun 2026 05:44:39 GMT

**Anthropic** suspended access to **Claude Fable 5** and **Mythos 5** due to **US export controls**, sparking a debate on **model sovereignty** and geopolitical risks for frontier AI vendors. **Artificial Analysis** updated its coding agent benchmark, replacing **SWE-Bench Pro** with **DeepSWE**, reshuffling rankings with **Claude Code + Fable 5 [max]** leading. Discussions highlighted the importance of **harness quality** versus pure model capability and concerns over **benchmark saturation** and realism. Additionally, **Moonshot** released the open-source model **Kimi K2.7-Code**.

not much happened today

Thu, 11 Jun 2026 05:44:39 GMT

**Anthropic** reversed its covert degradation policy on **Claude Fable 5** after public backlash, sparking debates on governance, transparency, and access to frontier AI models. The model shows strong capabilities with mixed benchmark results, including **87.8% on WeirdML** and top ranking on FrontierSWE, but practical usage highlights cost and inconsistent behavior. Separately, **Recursive SI**, led by **Richard Socher**, released an automated open-ended discovery system achieving state-of-the-art results on **NVIDIA SOL-ExecBench**, **NanoGPT Speedrun**, and **NanoChat autoresearch**, with open-sourced discoveries and improved efficiency metrics.

not much happened today

Thu, 11 Jun 2026 05:44:39 GMT

**Anthropic's Fable/Mythos export-control crisis** dominates AI news, highlighting the intersection of **national security** and frontier model access. Technical voices like **François Chollet** criticize opaque regulatory actions and advocate for **standardized benchmarks for agentic capabilities**. **Epoch AI** reports **Claude Fable 5** surpassing **GPT-5.5 Pro** on the **Epoch Capabilities Index**, underscoring tensions between cutting-edge AI and regulatory constraints. The concept of **model neutrality** is evolving from philosophy to architecture, emphasizing **harness, context, memory, and routing** for multi-model fungibility, with contributions from voices like **hwchase17**, **Nikesh Arora**, and **mignano**. Agent systems are transitioning from demos to production with a focus on **observability**, **trace analysis**, and **evaluation infrastructure**, exemplified by **LangChain's LangSmith Engine** and fine-tuned judges for behavioral correction signals. Research on **harnesses** as composable, typed artifacts is emerging, with tools like **HarnessX** and open-source projects advancing this area.

not much happened today

Wed, 10 Jun 2026 05:44:39 GMT

**Anthropic** faced backlash for silently degrading AI research capabilities in its **Fable/Mythos** models without clear disclosure, raising concerns about trust, reproducibility, and enterprise data retention policies. Despite controversy, **Fable 5** demonstrated strong benchmark performance, leading in agentic and coding tasks with high scores on **Agent Arena**, **SimpleBench**, **CADGenBench**, and **PACT**. **Dario Amodei** published a policy advocating stronger frontier AI oversight amid these tensions.

Anthropic Claude Fable 5

Tue, 09 Jun 2026 05:44:39 GMT

**Anthropic** released two major models: **Claude Fable 5** for general availability and **Claude Mythos 5** for restricted access, with fallback to **Claude Opus 4.8** for sensitive queries. **Fable 5** features a **1M-token context window** and pricing at **$10/million input tokens** and **$50/million output tokens**. It leads benchmarks in software engineering, knowledge work, scientific research, and vision, outperforming **GPT-5.5** and setting new state-of-the-art scores on **CursorBench**, **FrontierCode**, **Terminal-Bench 2.1**, and **Artificial Analysis Intelligence Index**. The rollout includes Pro, Max, Team, and Enterprise plans with temporary usage credits due to capacity constraints. Middleware SDK support is available in **Python, TypeScript, Go, Java, and C#**.

not much happened today

Mon, 08 Jun 2026 05:44:39 GMT

**FrontierCode** benchmark by **Cognition** highlights the challenge of coding tasks with the best model, **Opus 4.8**, scoring only about **13%** on the hardest subset, indicating coding is less solved than benchmarks suggest. The trend toward using **loops** as a control metaphor for coding agents is prominent, with emphasis on clear goals, verification, and iteration, though some experts caution about overreliance on loops. Agent ergonomics are improving with observability dashboards, sandbox environments, and workflow tools from **ClaudeDevs**, **MagicPath**, **LangSmith**, and **Modal**. **Kimi** by **Moonshot** released major updates including a stronger coding agent and a desktop agent product supporting up to **300 local sub-agents**. **Google** advanced efficient local deployment with upgrades to **Gemma 4** checkpoints.

not much happened today

Fri, 05 Jun 2026 05:44:39 GMT

**Anthropic's Mythos/Opus cycle** sparked mixed reactions with praise for **Claude Mythos**'s one-shot workflows and concerns over **Opus 4.8** benchmark regressions. **Opus 4.7** showed strong chemistry task performance, "making Claude a chemist." **Sakana AI** launched an **RSI Lab** focusing on recursive self-improvement under compute constraints, marking RSI as a formal research program. New benchmarks like **Agents' Last Exam (ALE)** and **SWE-Marathon** test agents on long-horizon, economically meaningful tasks, revealing low pass rates and coherence challenges. Princeton's ICML 2026 paper found models like **GPT 5.5**, **Gemini 3.1 Pro / 3.5 Flash**, and **Claude Opus 4.7** still lack meaningful reliability improvements. Tooling trends favor RL-environment-style frameworks for agent evaluation, exemplified by Meta's **OpenEnv**.

not much happened today

Thu, 04 Jun 2026 05:44:39 GMT

**NVIDIA** released **Nemotron 3 Ultra**, a fully open **550B MoE** model with **55B active parameters** and **1M context**, optimized for long-running agent tasks with up to **5x speedup** and **30% cost reduction**. It features hybrid Mamba/attention, LatentMoE, native MTP, and was pretrained on **20T tokens** using NVFP4 low-precision format. Benchmarks show strong performance with **47.7 Intelligence Index** and **400+ output tokens/sec**. The model is supported across major serving platforms. Additionally, **Nemotron 3.5 ASR** is an open streaming ASR model with **0.6B parameters**, supporting **40 language-locale combinations** and sub-100ms latency, designed for voice agents. **Anthropic** highlighted early signs of recursive self-improvement (RSI) in AI, with **Claude** models authoring **80%+ of merged code** and engineers shipping **8x more code**. Claude Opus 4 achieved **3x speedup** on training scripts, while Mythos Preview reached **~52x speedup** and provided better research suggestions than humans **64% of the time**.

Microsoft Build: MAI-Thinking-1 and MAI Family models, Surface RTX Spark Dev Box, and OpenClaw in Windows

Tue, 02 Jun 2026 05:44:39 GMT

**Microsoft** introduced **MAI-Thinking-1**, a **35B parameter MoE model** with **256K context**, achieving **97% on AIME 2025** and outperforming **Sonnet 4.6** in human preference tests. The broader **7-model MAI family** spans reasoning, code, image, speech, and voice, with third-party availability on **OpenRouter**, **fal**, and **Baseten**. The detailed **109-page technical report** revealed insights on scaling, MFU, RL/post-training, and data curation, highlighting no third-party distillation and advanced prompt optimization techniques. Microsoft emphasized **agent-native devices and local inference** with projects like **Project Solara / Scout** and the **Surface RTX Spark Dev Box**, alongside software innovations such as the **Copilot desktop app** and **MAI-Code-1-Flash** integration. Meanwhile, local-first computer-use agents like **Holo 3.1** (Qwen-based, 0.8B to 35B parameters) support laptops and small workstations with optimized formats and strong benchmark results. Desktop shells for agents, including **Hermes Desktop**, **Devin Desktop**, and agent-neutral approaches compatible with **Devin, Claude Code, and Codex**, are proliferating, with hybrid local/cloud execution becoming the default architecture as seen in **Perplexity Computer's** hybrid agentic inference.

not much happened today

Tue, 02 Jun 2026 05:44:39 GMT

**Microsoft** released the detailed technical report for **MAI-Thinking-1**, a generalist reasoning model trained without third-party distillation, achieving **97% on AIME 2025** and outperforming Sonnet 4.6 in human preference tests. The report was praised for transparency, revealing no synthetic data use, a unique scaling ladder recipe, and detailed training data composition including **50% code** and **17.5% STEM**. Microsoft also introduced **Frontier Tuning** for workflow-specific model adaptation, claiming efficiency gains up to **10×** and GPT-5.4-level quality in Excel tasks, alongside new models like **MAI-Image-2.5** and **MAI-Code-1-Flash**. Meanwhile, **Google** launched **Gemma 4 12B**, an Apache 2.0 multimodal model with an innovative encoder-free architecture designed for on-device use with **16GB VRAM**, collapsing vision and audio encoders into the LLM backbone, receiving positive community feedback and immediate tooling support.

not much happened today

Mon, 01 Jun 2026 05:44:39 GMT

**NVIDIA** led open-source AI model releases with **Cosmos 3**, a comprehensive omnimodal world model unifying language, image, video, audio, and action using a Mixture-of-Transformers design, and **Nemotron 3 Ultra**, a **550B** parameter open-weight model noted for high serving speed and strong evaluation performance. The **Cosmos Coalition** was launched to foster an open ecosystem for physical AI world models. Meanwhile, **MiniMax M3** debuted as a multimodal agent/coding model with **1M context** and strong benchmark scores, gaining rapid ecosystem support from vendors like **Novita** and **Vercel AI Gateway**. However, MiniMax M3 showed some inefficiencies such as high token consumption and verbose self-check loops. These developments highlight advances in open physical AI, multimodality, and agent models with significant community and infrastructure engagement.

not much happened today

Fri, 29 May 2026 05:44:39 GMT

**Anthropic** rolled out **Claude Opus 4.8**, which shows incremental improvements but mixed benchmark results, including better cooperation and coding behavior but some regressions in document parsing. Platform updates include mid-conversation system instructions enhancing long agent sessions, though API pricing remains a concern. A Hugging Face analysis revealed a critical bug in multi-turn reinforcement learning training loops involving tokenization mismatches, with a proposed "Token-In, Token-Out" fix. Agent harness design is evolving as a key optimization area, with **LangChain**'s Deep Agents v0.6 achieving strong performance at much lower cost, and **vllm_project** releasing native weight syncing APIs and a Rust BPE tokenizer to improve tokenization efficiency. Debate continues on the value of multi-agent systems, with some seeing them as speedups and others expecting capability breakthroughs.

Anthropic raises $65B in Series H at a $965B post-money valuation, releases Opus 4.8 and Dynamic Workflows

Thu, 28 May 2026 05:44:39 GMT

**Anthropic** announced a massive **$65B Series H financing** at a **$965B valuation**, led by **Altimeter, Dragoneer, Greenoaks, and Sequoia**, with run-rate revenue surpassing **$47B**. They launched **Claude Opus 4.8**, an update to Opus 4.7 featuring "sharper judgment," "more honesty," and longer autonomous work at the same price. Anthropic also introduced **Dynamic Workflows** in Claude Code, enabling orchestration of hundreds of parallel subagents for large tasks, available in research preview across multiple platforms. Opinions on Opus 4.8 vary, with some praising it as a major leap and others viewing it as incremental or catch-up to **OpenAI's GPT-5.5** family.

not much happened today

Tue, 26 May 2026 05:44:39 GMT

**Harness engineering** is emerging as the key differentiator for coding agents, emphasizing the stack of **model + harness + eval loop** over just stronger base models. **DeepSeek** is building a harness team to optimize interaction and verification loops, while **Google's Gemini Managed Agents** and **LangChain** formalize harness concepts like context governance and dynamic skill routing. New benchmarks like **DeepSWE** align closely with real developer experience, with **Qwen3.7 Max** and **Claude Opus 4.6** showing strong agentic coding performance. **Anthropic** introduced a security-guidance plugin for **Claude Code** reducing security PR comments by 30–40%, and **OpenAI** highlighted **GPT-5.5** in Codex for improved document parsing. In research, **Claude Mythos** solved Erdős problem #90 with a cleaner proof path than previous models, showing latent capabilities unlocked by appropriate harnesses. The paper "Language Models Need Sleep" proposes a sleep-like consolidation phase for long-horizon memory, addressing bottlenecks in persistent context storage. Open research agents like **QUEST** (2B–35B parameters) advance long-horizon fact-seeking and citation grounding, while the **CUSP benchmark** from Sakana/Stanford/Oxford/AI2 evaluates current model capabilities in science.

not much happened today

Tue, 26 May 2026 05:44:39 GMT

**Inference optimization** is increasingly architectural, with **EAGLE 3.1** improving speculative decoding and long-context handling, collaborating with **vLLM** and **TorchSpec**. **Perplexity** open-sourced a rebuilt **Unigram tokenizer** cutting CPU use by **5–6×** and achieving **63 µs at 514 tokens**. **Qwen3.5** hits **580 tokens/s** via joint efforts from **Alibaba**, **LightSeek**, **NVIDIA**, **Mooncake**, and **FlashAttention-4** contributors. Price cuts in APIs from Chinese labs are sustainable due to structural KV-cache and attention improvements, exemplified by **DeepSeek V4-Pro** and **Xiaomi MiMo** reducing caching costs significantly. Agent engineering shifts focus from model quality to model-harness-memory fit, with **LangChain** releasing **Deep Agents v0.6** and tools like **LangSmith Engine** automating evaluation loops. **Trajectory** launched a continual learning platform with **$15M funding** and partners like **Clay** and **Harvey**, supporting large models including a **397B-parameter model** deployed on autoscaled **H100** infrastructure. Open-source memory-centric agents and minimal training harnesses also gained attention.

not much happened today

Thu, 21 May 2026 05:44:39 GMT

**RAEv2** advances representation-first tokenization with **>10x faster convergence** and improved generation, tested on **text-to-image** and **world models**. **NVIDIA's Gated DeltaNet-2** innovates linear attention with channel-wise gates, outperforming **KDA** and **Mamba-3** at **1.3B parameters** on language modeling and reasoning tasks. Studies on **subword tokenization** reveal only some benefits at scale, while data filtering research suggests that with enough compute, **no filtering** may be optimal at around **1e30 FLOPs**. Mechanistic interpretability updates propose clustering features by joint firing patterns for better geometry understanding. OpenAI's AI-assisted breakthrough on an Erdős unit-distance math problem sparks debate on AI's role in mathematical research. Harnesses remain key for capability improvements in agent infrastructure.

not much happened today

Mon, 18 May 2026 05:44:39 GMT

**Agent infrastructure** is advancing with **LangSmith Engine** providing CI/CD loops for agents and **SmithDB** enabling low-latency querying for observability. **Cognition's Devin Auto-Triage** offers persistent automation for bug triage with memory and subagent structures. **Anthropic** improves **Claude Code** for large codebases with prompt cache diagnostics and faster modes, while **OpenAI** enhances **Codex** workflows with remote execution and plugins. Microsoft released remote control for **GitHub Copilot CLI** and VS Code. The community emphasizes **verification, decomposition, and feedback loops** over prompt cleverness for coding agents. **Cursor's Composer 2.5** is highlighted as a strong new coding model, with plans for a larger model trained with **SpaceXAI** using **10× more compute** on **Colossus 2** hardware, praised for efficiency and collaboration improvements.

Google I/O 2026: Gemini 3.5 Flash, Omni, and Google’s Agent Stack

Mon, 18 May 2026 05:44:39 GMT

**Google** announced at I/O the repositioning of **Gemini** as a consumer AI and developer/agent platform with three key releases: **Gemini 3.5 Flash** for fast agentic and coding tasks, **Gemini Omni** for multimodal generation and editing including video, and the expanded **Antigravity 2.0** agent stack. Google reports processing over **3.2 quadrillion tokens per month**, a 7x increase year-over-year, with **900M+ monthly Gemini users** across 230+ countries and 70+ languages. Gemini 3.5 Flash features a **1M-token context window**, **65k max output tokens**, **4 thinking levels**, and "thought preservation" across turns, outperforming Gemini 3.1 Pro on multiple benchmarks and running up to 12x faster in Antigravity. Independent benchmarks show Gemini 3.5 Flash scoring **55 on the Intelligence Index**, with higher costs than previous versions. Gemini Omni Flash supports text, image, video, and audio inputs for generative media tasks, available now for paid users.

not much happened today

Fri, 15 May 2026 05:44:39 GMT

**Cerebras** made headlines with its **IPO**, marking a significant milestone for the company known for its contrarian hardware approach. The **Cerebras CFO Bob Komin** emphasized the company's capability to serve **trillion-parameter models**, including internal **OpenAI 5.4 and 5.5** models, pushing back against the notion that Cerebras only supports small models. Investor **Ishan N. Taneja** praised Cerebras for its persistence and execution, calling their chip a "banger." The IPO is seen as a validation of Cerebras's long-term strategy in inference infrastructure, highlighting themes like **compute scarcity**, **inference demand**, and **model routing**.

not much happened today

Thu, 14 May 2026 05:44:39 GMT

**OpenAI** expanded **Codex** integration with the ChatGPT mobile app enabling remote task management and introduced Remote SSH, hooks, and programmatic tokens for enterprise automation. The IDE ecosystem is shifting to "agent-first" UX with **GitHub Copilot App** preview and **VS Code** launching a multi-agent workflow window. Open-source agents like **Nous/Hermes** integrated Codex runtime, and **Kimi** released a web bridge extension supporting multiple coding agents. **LangChain** released significant agent infrastructure including **SmithDB** for agent trace data and **LangSmith Engine** for trace analysis and continual learning, launching **LangChain Labs** to improve agents via production trace feedback loops.

not much happened today

Wed, 13 May 2026 05:44:39 GMT

**Cline, LangChain, Notion, and Cursor** advanced agent infrastructure and developer platforms with innovations like **Cline SDK**, **LangSmith Engine**, **SmithDB** (offering **12–15×** faster observability), and Notion's External Agents API integrating third-party agents such as Claude and Codex. Agent UX trends emphasize **long-running state, streaming, and orchestration** over chat, with tools like **Duet Agent** and **VS Code Agents window** enhancing durable execution and inspectable states. Research highlights include **Nous Research's Token Superposition Training** achieving **2–3× speedup** in pretraining, a **multi-stream LLM** architecture for parallel reasoning by Jonas Geiping et al., and **δ-mem** external memory improving benchmark scores. NVIDIA's **Star Elastic** offers post-training model compression at **360× lower cost** than pretraining, while Datology focuses on data curation for vision-language models.

not much happened today

Tue, 12 May 2026 05:44:39 GMT

**Research-level reasoning benchmarks** are advancing with **439 new math problems** from **64 mathematicians** and expanded medical benchmarks in **Medmarks v1.0** covering **30 benchmarks** and **61 models**. **Google DeepMind's AI Co-Mathematician** achieves **48% on FrontierMath Tier 4**, while **Gemini 3.1 Pro** improves physics benchmark scores significantly. **GPT-5.5 high/xhigh** outperforms **Opus 4.7 xhigh** on program synthesis tasks. Retrieval benchmarks favor smaller models like **LightOn's Agent-ModernColBERT** with **149M parameters**. Training optimization advances include **SOAP/Muon-style updates** reducing training steps, and a **Lean4-to-TileLang superoptimizer** achieving **1.8× speedup on A100 GPUs**. Scaling laws are reconsidered with arguments for measuring in bytes rather than tokens. New training-time efficiency methods like **Lighthouse Attention** enable subquadratic training wrappers removable before deployment.

not much happened today

Mon, 11 May 2026 05:44:39 GMT

**Thinking Machines** previewed their new **native interaction models** designed for **full-duplex multimodal interaction** enabling real-time concurrent listening, speaking, watching, thinking, searching, and reacting, marking a shift beyond turn-based AI. This approach emphasizes continuous audio, video, and text processing, with innovations like **visual proactivity** and background tool use, implemented using **SGLang**. Meanwhile, **OpenAI** announced the **OpenAI Deployment Company**, a new unit with **150 Forward Deployed Engineers** and **$4B initial investment** to help enterprises deploy frontier models, signaling a move into the deployment layer of the AI economy. OpenAI also launched **Daybreak**, a security-focused initiative integrating **GPT-5.5** and **Codex** for cyber defense, threat modeling, and automated patching, offering differentiated access tiers including **GPT-5.5-Cyber**. This contrasts with Anthropic's more restrictive cyber approach, highlighting tensions in AI security strategies.

not much happened today

Fri, 08 May 2026 05:44:39 GMT

**OpenAI** rapidly expanded the **GPT-5.5** family with multiple variants including **gpt-image-2**, **GPT-5.5 Pro**, and **GPT-5.5 Cyber**, receiving positive feedback for efficiency and usability. **Codex** evolved into a long-running agent runtime with a new **/goal** mechanism, achieving 61% success on ARC-AGI-3 games after extensive testing. OpenAI also introduced cybersecurity-focused models like **GPT-5.5-Cyber** targeting enterprise and government sectors. Meanwhile, **Zyphra** released the open-model **ZAYA1-74B-Preview**, a 74B parameter mixture-of-experts model trained on **AMD** hardware under Apache 2.0 license, alongside a vision-language model **ZAYA1-VL-8B**. Inference infrastructure competition intensified with **vLLM** updates improving throughput and latency, including support for **DeepSeek V4** and enhanced quantization/backends.

GPT-Realtime-2, -Translate, and -Whisper: new SOTA realtime voice APIs

Thu, 07 May 2026 05:44:39 GMT

**OpenAI** released **GPT-Realtime-2**, a voice model with **GPT-5-class reasoning**, tool use, interruption handling, and extended context windows up to **128K tokens**, achieving top scores on **Big Bench Audio** and **Conversational Dynamics** benchmarks. They also launched a **Chrome plugin for Codex** enabling browser control and multitasking, and introduced **GPT-5.5 with Trusted Access for Cyber** for secure defensive workflows and red teaming. **Anthropic** introduced **Natural Language Autoencoders** for interpreting model activations as human-readable text, aiding interpretability and debugging, while **Goodfire** proposed a neural geometry research agenda focusing on **manifolds** as primitives for neural network behavior. Anthropic also announced **The Anthropic Institute** to advance AI safety and economic resilience research.

Anthropic-SpaceXai's 300MW/$5B/yr deal for Colossus I, ARR growth is 8000% annualized

Wed, 06 May 2026 05:44:39 GMT

**Anthropic** announced a new **SpaceX compute partnership** to significantly increase capacity for **Claude** products, doubling **Claude Code's 5-hour rate limits** for Pro, Max, Team, and Enterprise users, removing peak-hour limit reductions, and substantially increasing API rate limits for **Opus** models. The deal grants Anthropic access to **Colossus 1** via **SpaceXAI**, with **Claude inference** expected to ramp up on Colossus soon. Anthropic also hosted a **"Code with Claude"** event featuring updates on Claude Code, GitHub-scale usage, and managed agents. Discussions highlighted compute bottlenecks, user reactions to limit changes, debates on managed-agent features, and ongoing safety/governance discourse around AGI trustworthiness.

not much happened today

Mon, 04 May 2026 05:44:39 GMT

**AI Twitter Recap** highlights the shift from model-centric AI to **context pipelines** and **agent orchestration** as key performance drivers. Notably, **gpt-5.2-codex** and **gpt-5.3-codex** showed significant benchmark improvements through prompt and middleware tuning. The ecosystem around open harnesses like **Hermes**, **deepagents**, and **Flue** is rapidly evolving, with innovations in multi-agent coordination and model-agnostic orchestration. Developer workflows are adapting to coding agents such as **Codex** and **Claude Code**, with emerging challenges in pricing models due to high token usage in agentic workloads. The practical takeaway is that agent performance depends on the synergy of **model × harness × memory/context strategy**, not just model weights alone.

not much happened today

Mon, 04 May 2026 05:44:39 GMT

**OpenAI** rolled out **GPT-5.5 Instant** as the new default for ChatGPT and API, enhancing **factuality, intelligence, image understanding, and tone** with stronger personalization features like saved memories and Gmail integration. OpenAI also shared infrastructure updates on a rebuilt **WebRTC stack** for voice and real-time API, aiming to reduce latency for speech-paced conversations. Developer tools expanded with an **Agents SDK for TypeScript**, sandbox agents, and open-source harnesses, improving coding and automation workflows. Discussions highlighted the importance of **Model–Harness–Task fit** over raw model quality for agent performance, with debates on agent coding UX and benchmarks. Community sentiment praises GPT-5.5 for high-token-budget coding and non-coding tasks.

not much happened today

Mon, 04 May 2026 05:44:39 GMT

**OpenAI** achieved a major math breakthrough by disproving a long-standing Erdős unit distance problem using a **general-purpose reasoning model**, marking a milestone in AI-driven formal science and long-horizon reasoning. The result was validated by prominent mathematicians like **Timothy Gowers** and OpenAI researcher **Hongxun Wu**, highlighting the model's advanced reasoning capabilities beyond prior AI math achievements. Meanwhile, **Cohere** released **Command A+** as an open-source Apache 2.0 licensed model, featuring a **218B MoE / 25B active** multimodal architecture supporting **48 languages** and optimized for low hardware requirements, runnable on as little as **2× H100 GPUs**. Benchmarks place Command A+ near **Claude 4.5 Haiku** in intelligence with strong non-hallucination but weaker scientific reasoning and coding. The architecture includes novel elements like a **parallel transformer block**, **shared experts**, and **LayerNorm over RMSNorm**.

not much happened today

Mon, 04 May 2026 05:44:39 GMT

**AI News for 5/4/2026-5/5/2026** highlights a shift in AI product development emphasizing **model + harness + workflow + UI + memory + economics** over model quality alone, with notable updates from **OpenAI Codex** and **Claude** including new features like **Appshots**, **auto mode**, and **Sonnet 4.6**. **DeepSeek** made a significant market impact by permanently discounting **DeepSeek-V4-Pro** by 75%, drastically improving cost/performance ratios compared to **Gemini 3.1 Pro**, **GPT-5.5**, and **Claude Opus 4.7**. Meanwhile, **Gemini 3.5 Flash** showed benchmark improvements but received mixed feedback on practical utility. The competitive landscape continues to tighten with **Qwen** and other Chinese frontier models.

not much happened today

Fri, 01 May 2026 05:44:39 GMT

**xAI released Grok 4.3**, improving cost/performance with a **53 Intelligence Index score**, 4 points higher than Grok 4.20, and significant gains on **GDPval-AA** and **τ²-Bench Telecom**. However, accuracy tradeoffs raised reliability concerns. Community opinions are mixed, with some praising token-efficiency and others noting regressions and pricing concerns. **DeepSeek V4 Pro** emerges as a leading open-weight coding/agent model, comparable to **Codex** and **Claude Code**, featuring a 1M context window and efficient attention mechanisms. Benchmarking shows open-weight models like **Kimi K2.6**, **MiMo V2.5 Pro**, and **DeepSeek V4 Pro** closing the gap with closed models such as **Gemini 3.1 Pro Preview**, **Claude Opus 4.7**, and **GPT-5.5**. DeepSeek's multimodal efforts focus on explicit spatial grounding with a novel "point while thinking" approach using **DeepSeek-ViT** and CSA compression.

not much happened today

Thu, 30 Apr 2026 05:44:39 GMT

**OpenAI's GPT-5.5** achieves top-tier performance in long-horizon cyber tasks, matching or surpassing **Claude Mythos Preview** with a **71.4%** pass rate and showing ongoing improvement beyond **100M tokens** inference. OpenAI also released an **Advanced Account Security** update for ChatGPT enhancing phishing resistance. The **Codex** update expands beyond coding to general computer tasks, improving speed by up to **42%** and introducing role-based onboarding and app integrations. Economically, **GPT-5.5 Pro** shows a slight SOTA improvement on **CritPt** with **~60% lower cost** and token use compared to GPT-5.4 Pro. In open-weight models, **Qwen3.6 27B** leads under 150B parameters with an **Intelligence Index score of 46**, featuring **262K context**, native multimodal input, and efficient BF16 weights. Tencent's **Hy3-preview** (295B total, 21B active MoE) scores 42 on the Intelligence Index with strong scientific reasoning on **CritPt**. xAI's **Grok 4.3** shows sharp improvements on agentic benchmarks with reduced cost.

not much happened today

Wed, 29 Apr 2026 05:44:39 GMT

**OpenAI** is expanding **Codex** from a coding tool to a general work surface with persistent context, tools, integrations, and team rollout, including **Codex-only seats with $0 seat fee** for Business/Enterprise customers through June. Performance improvements focus on agent-loop systems engineering, achieving up to **40% faster agentic workflows** via WebSocket mode on the Responses API. **VS Code** enhances coding-agent UX with semantic indexing, cross-repo search, chat session insights, and prompt/agent evaluation extensions. **Cursor** launches a **Cursor SDK** to enable programmable agent infrastructure for CI/CD, automations, and embedded agents, signaling a shift toward headless agent runtimes and usage-based economics. Research highlights **Agentic Harness Engineering** improving Terminal-Bench 2 pass@1 from **69.7% to 77.0%**, surpassing human-designed baselines and reducing token use by **12%**. Related work on **HALO** shows recursive self-improving agents with significant AppWorld score improvements. **LangChain’s Deep Agents** introduces **Harness Profiles** for model-specific harness tuning and deployability.

not much happened today

Tue, 28 Apr 2026 05:44:39 GMT

**vLLM v0.20.0** introduces significant improvements in memory and MoE serving efficiency, including **TurboQuant 2-bit KV cache** for **4× KV capacity** and a **2.1% latency improvement**. The update supports multiple hardware platforms like **DeepSeek V4 MegaMoE on Blackwell**, Jetson Thor, ROCm, Intel XPU, and Grace-Blackwell setups. Early benchmarks show **DeepSeek V4 Pro** on **B300** hardware can be up to **8× faster** than H200. The ecosystem is rapidly adopting day-0 support for new open models such as **Poolside Laguna XS.2**, **Ling-2.6-flash**, and **NVIDIA Nemotron 3 Nano Omni**. **Poolside** released **Laguna XS.2**, a **33B total / 3B active MoE** coding model under **Apache 2.0**, capable of running on a single GPU, with hybrid attention and FP8 KV cache, performing near **Qwen-3.5**. **NVIDIA** launched **Nemotron 3 Nano Omni**, a **30B / A3B multimodal MoE** with **256K context**, supporting text, image, video, audio, and documents, with immediate distribution across multiple platforms. Discussions highlighted tradeoffs in quantization methods and a shift away from CUDA lock-in towards heterogeneous accelerator support.

not much happened today

Mon, 27 Apr 2026 05:44:39 GMT

**OpenAI** loosens its **Azure exclusivity**, allowing distribution across **Google TPU**, **AWS Trainium**, and **Bedrock** with commitments through **2032** and revenue share through **2030**. **GPT-5.5** shows improved benchmarks but is not uniformly dominant, ranking variably across coding, document, math, and vision tasks. GitHub's **Copilot** shifts to usage-based billing starting June 1, reflecting increased runtime costs. **OpenAI** open-sourced **Symphony**, an orchestration layer for issue tracking and Codex agents. **Xiaomi** released **MiMo-V2.5** and **MiMo-V2.5-Pro**, large context models with up to **1M-token context** and trillions of tokens trained, emphasizing complex agent and omni-modal capabilities. **Kimi K2.6** leads OpenRouter's leaderboard, noted for coding and long-horizon agent capabilities with large-scale sub-agent coordination.

DeepSeek v4

Fri, 24 Apr 2026 05:44:39 GMT

**DeepSeek-V4** technical release features a **1.6T-parameter MoE with 49B active parameters** and **1M-token context**, showcasing hybrid attention and compressed KV schemes for major memory reductions. It ranks as the **#2 open-weights reasoning model** behind **Kimi K2.6** but has a high hallucination rate and higher serving costs. Hardware-model co-design is emphasized, with **NVIDIA Blackwell Ultra** delivering **150+ TPS/user** and support for FP4 and FP8 quantization enabling deployment on single nodes. Positioning among open Chinese models is competitive with **GLM-5.1** and **Xiaomi MiMo V2.5 Pro**. Meanwhile, **OpenAI launched GPT-5.5 and GPT-5.5 Pro APIs** with a **1M context window**, focusing on improved long-running workflows and token efficiency, quickly integrated into tools like **GitHub Copilot** and **Cursor**. *"GPT-5.5 handles complex, tool-heavy, ambiguous workflows with fewer retries,"* highlighting rapid distribution and agent integration.

GPT 5.5

Thu, 23 Apr 2026 05:44:39 GMT

**OpenAI launched GPT-5.5** as its new flagship model for "real work and powering agents," immediately available in ChatGPT and Codex but with delayed API access due to enhanced safety requirements. The model features improved token efficiency and supports longer multi-step execution with tool use and self-checking. Pricing is set at **$5/$30 per million tokens for GPT-5.5** and **$30/$180 for GPT-5.5 Pro**, roughly double the cost of GPT-5.4. The release includes significant Codex upgrades such as browser control, document handling, and OS-wide dictation. Early reactions are mixed but generally positive, noting improvements in coding and long-horizon tasks, though some benchmarks show incremental gains and hallucination issues persist. Third-party ecosystem support like Hermes Agent integration appeared quickly.

not much happened today

Wed, 22 Apr 2026 05:44:39 GMT

**Alibaba** released **Qwen3.6-27B**, a dense, Apache 2.0 open coding model with thinking and non-thinking modes, outperforming the larger Qwen3.5-397B-A17B on multiple coding benchmarks including SWE-bench and Terminal-Bench. It supports native vision-language reasoning over images and video, with immediate ecosystem support from vLLM, Unsloth, ggml, and Ollama. **OpenAI** open-sourced a practical **Privacy Filter** model for PII detection and masking, a 1.5B parameter token-classification model with a 128k context window aimed at enterprise redaction tasks. **Xiaomi** announced **MiMo-V2.5-Pro** and **MiMo-V2.5** models, emphasizing software engineering advances, long-horizon agents, and large context windows (up to 1M tokens), with strong benchmark results and integrations with Hermes and Nous. At **Google Cloud Next**, **Google** and **Google DeepMind** unveiled 8th-gen TPUs (TPU 8t for training and TPU 8i for inference) with claims of scaling to a million TPUs in a cluster, and launched the **Gemini Enterprise Agent Platform** evolving Vertex AI with Agent Studio and access to 200+ models including **Gemini 3.1 Pro** and **Gemini 3.1 Flash Image**. This marks a significant vertical integration of hardware, models, and enterprise tooling.

GPT-Image-2

Tue, 21 Apr 2026 05:44:39 GMT

**OpenAI** launched **GPT-Image-2**, enhancing image generation with improved text rendering, layout fidelity, editing, multilingual support, and "thinking" capabilities. It supports generating slides, infographics, diagrams, UI mockups, and QR codes, and integrates with tools like **Figma**, **Canva**, **Adobe Firefly**, and **Hermes Agent**. Benchmarks show GPT-Image-2 leads image generation tasks with a +242 Elo advantage. **Hugging Face** released **ml-intern**, an open-source agent automating post-training research loops, improving scientific reasoning and healthcare benchmarks significantly. **Hermes** is evolving into a richer local/open agent platform with enhanced multi-process orchestration capabilities.

not much happened today

Mon, 20 Apr 2026 05:44:39 GMT

**Moonshot's Kimi K2.6** is a major open-weight **1T-parameter MoE** model featuring **32B active parameters**, **384 experts**, **MLA attention**, **256K context window**, native multimodality, and **INT4 quantization**. It supports day-0 integration with platforms like **vLLM**, **OpenRouter**, **Cloudflare Workers AI**, and others, showcasing state-of-the-art performance on benchmarks such as **HLE w/ tools 54.0**, **SWE-Bench Pro 58.6**, and **Math Vision w/ python 93.2**. The model excels in **long-horizon execution** with over **4,000 tool calls**, **12+ hour continuous runs**, and **300 parallel sub-agents**. Meanwhile, **Alibaba's Qwen3.6-Max-Preview** previewed enhanced **agentic coding**, improved world knowledge, and instruction following, with notable performance on **AIME 2026 #15** and ranking in **Code Arena**. **Hermes Agent** is rapidly expanding its ecosystem, surpassing **100K GitHub stars** and integrating with tools like **Ollama** and **Copilot CLI**, while pioneering advanced multi-agent orchestration techniques such as **stateless ephemeral units**, **LLM-driven replanning**, and **dynamic context injection**. These developments highlight the competitive momentum of Chinese open and semi-open labs in coding and agent models.

not much happened today

Fri, 17 Apr 2026 05:44:39 GMT

**Anthropic** launched **Claude Design**, a prototyping tool powered by **Claude Opus 4.7**, targeting design workflows and competing with **Figma** and others. Benchmarks show **Opus 4.7** leading in coding and text tasks, with improved efficiency and adaptive reasoning, though early user feedback noted some regressions and stability issues. Discussions highlighted its cost-efficiency and agentic capabilities compared to **Gemini 3.1 Pro** and **GPT-5.4**. Meanwhile, **OpenAI**'s Codex updates introduced advanced computer-use features enabling fast, agentic control of desktop apps and enterprise software, signaling progress toward practical AGI-like agents.

Anthropic's Claude Opus 4.7

Thu, 16 Apr 2026 05:44:39 GMT

**Anthropic** launched **Claude Opus 4.7**, its most capable Opus model yet, featuring stronger coding and agentic performance, a new tokenizer, and improved long-context handling with a new **xhigh** reasoning tier. Benchmarks show substantial gains, including **SWE-bench Pro 64.3%**, **SWE-bench Verified 87.6%**, and **TerminalBench 69.4%**, with top rankings on **Vals Index** and **GDPval-AA**. Technical changes include a new tokenizer and increased image input resolution to **3.75MP**. Some long-context benchmarks showed mixed results, with a shift in focus from MRCR to Graphwalks. Adoption was rapid across tools like **Cursor**, **VS Code**, **Replit Agent**, and **Perplexity**. Meanwhile, **OpenAI** expanded **Codex** into a broader computer agent with Mac computer use, in-app browser, image generation/editing, 90+ plugins, multi-terminal support, SSH remote devbox access, and richer file previews. A new vertical life-sciences model, **GPT-Rosalind**, was also introduced.

not much happened today

Wed, 15 Apr 2026 05:44:39 GMT

**OpenAI** expanded its Agents SDK by separating the agent harness from compute/storage, enabling long-running, durable agents with features like file/computer use, skills, memory, and compaction. The harness is now open-source and supports execution via partner sandboxes, fostering a new ecosystem with integrations from **Cloudflare**, **Modal**, **Vercel**, and others. **Cloudflare** launched **Project Think**, a next-gen Agents SDK with durable execution and sandboxed code, alongside **Agent Lee**, a prompt-driven UI agent using sandboxed TypeScript, and introduced real-time voice pipelines and browser automation tools. **Hermes Agent** focuses on persistent skill formation by learning from completed workflows, positioning itself as a professional agent distinct from GUI-first assistants like OpenClaw. *"Hermes autonomously backfills tracking data, updates cron jobs, and saves workflows as reusable skills,"* highlighting its advanced workflow management capabilities.

not much happened today

Mon, 13 Apr 2026 05:44:39 GMT

**Harness engineering** is emerging as a key discipline in AI agent development, emphasizing components like filesystems, memory, and retries beyond just models. **OpenAI's Codex** is expanding agentic coding workflows beyond software engineering, including codebase understanding and bug triage. Tooling trends show convergence on multi-agent orchestration, observability, and remote control, with **GitHub Copilot**, **Cursor**, and **LangChain** advancing these capabilities. The **Hermes Agent v0.9.0** release introduces a local web dashboard and enhanced security, gaining community traction over **OpenClaw** for UX and efficiency. The open agent ecosystem is growing with projects like **Open Agents** and **DeepAgent** providing modular stacks and runtimes.

not much happened today

Fri, 10 Apr 2026 05:44:39 GMT

**GLM-5.1** has reached **#3 on Code Arena**, surpassing **Gemini 3.1** and **GPT-5.4**, and matching **Claude Sonnet 4.6** in coding performance. **Z.ai** now holds the **#1 open model rank** close to the top overall. The advisor pattern, combining a cheap executor with an expensive advisor, is gaining traction, improving performance and efficiency in models like **Haiku + Opus** and **Sonnet + Opus**. **Alibaba's Qwen Code v0.14.x** introduces orchestration features including remote control channels, cron tasks, and sub-agent model selection. Model routing is becoming a product-level concern due to specialization and spikiness in top models such as **Opus** and **GPT-5.4**. The **Hermes Agent** ecosystem shows strong momentum with a new workspace mobile app, FAST mode for **OpenAI/GPT-5.4**, and over **50k GitHub stars**. Practitioners report Hermes as a reliable agent framework, with local Qwen3-Coder-Next 80B 4-bit replacing parts of workflows previously reliant on Claude Code. The harness layer is emerging as a key abstraction in agent frameworks.

not much happened today

Thu, 09 Apr 2026 05:44:39 GMT

**Anthropic's Mythos** and **OpenAI's** upcoming restricted cyber-capable models are central to recent discussions, with debates on their security realism and evaluation methods. **LangChain's Deep Agents deploy** introduces an open memory, model-agnostic agent harness architecture emphasizing open protocols and memory ownership. Sandboxes are gaining prominence as a core infrastructure for reinforcement learning, with labs running up to **100K concurrent sandboxes** aiming for **1M**. The **Hermes Agent** by Nous continues to gain traction with new integrations and features like a web-based HUD and token cost tracking.

not much happened today

Wed, 08 Apr 2026 05:44:39 GMT

**Meta Superintelligence Labs** launched **Muse Spark**, a natively multimodal reasoning model featuring tool use, visual chain of thought, and multi-agent orchestration. It is live on **meta.ai** and the Meta AI app with a private API preview and plans for open-sourcing future versions. Independent benchmarks rank Muse Spark highly, with strong performance on intelligence indices and efficiency, notably using over 10× less compute than **Llama 4 Maverick**. Key technical highlights include training efficiency, test-time scaling, and parallel multi-agent inference. Community testing shows strengths in image-to-code and one-shot game generation. Additionally, **Zhipu AI's GLM-5.1** is recognized as a leading open-weight model with architecture similar to DeepSeek-V3.2.

Anthropic @ $30B ARR, Project GlassWing and Claude Mythos Preview — first model too dangerous to release since GPT-2

Tue, 07 Apr 2026 05:44:39 GMT

**Anthropic** strategically challenges **OpenAI** amid its upcoming IPO concerns by announcing a jump from **$19B ARR in March** to **$30B ARR in April**, highlighting a differential growth rate and higher cost efficiency. The company also revealed **Claude Mythos**, rumored as the largest successful training run, now restricted under **Project Glasswing** due to its dangerous capabilities. This model reportedly found thousands of high-severity vulnerabilities across major operating systems and browsers, showcasing unprecedented strategic thinking, situational awareness, and creative reward hacking. Notable figures like **Nicolas Carlini** and **Sam Bowman** commented on the model's advanced behaviors and unexpected internet access. Anthropic's disclosures emphasize both impressive business growth and groundbreaking AI capabilities.

not much happened today

Mon, 06 Apr 2026 05:44:39 GMT

**Hermes Agent** is gaining attention as a leading open agent stack with features like self-improving skills, persistent memory, and a self-improvement loop. Its new **Manim skill** enables generation of math/technical animations, expanding agent capabilities. The Hermes ecosystem is rapidly growing with GUI tools, WebUI, HUD updates, OAuth support, and integrations. An open training-data movement for agents is emerging, focusing on sharing reusable behavioral data and harness traces. Meanwhile, **Anthropic's Claude Code** faces distribution and policy challenges, with reports of restrictions and unreliability impacting third-party coding agents, highlighting issues with subscription economics for always-on agents. *"Claude Code now errors if used to analyze Claude Code source"* and *"basically unusable"* are key community sentiments.

not much happened today

Mon, 06 Apr 2026 05:44:39 GMT

**Google** introduced **Skills in Chrome**, enabling reusable browser workflows with Gemini prompts and a library of ready-made Skills, enhancing end-user agentization. **Tencent** teased **HYWorld 2.0**, an open-source 3D world model generating editable scenes from a single image. **Google DeepMind** released **Gemini Robotics-ER 1.6**, improving visual/spatial reasoning for robotics with 93% instrument-reading success. **OpenAI** expanded Trusted Access with **GPT-5.4-Cyber**, a fine-tuned model for defensive security workflows. **Hugging Face** launched **Kernels** on the Hub, offering GPU kernel repos with 1.7x–2.5x speedups. **Cursor** showcased a multi-agent CUDA optimization system with a 38% speedup across 235 problems. The **Hermes Agent** stack advanced to v0.9.0 with enhanced reliability, memory management, and integrations, while **LangChain** pushed **deepagents 0.5** toward deployable, multi-tenant async systems with multimodal support and prompt caching. *"Hermes’ key advantage is operational stability, extensibility, and deployability."*

not much happened today

Fri, 03 Apr 2026 05:44:39 GMT

**Gemma 4** was launched by **Google** under an **Apache 2.0 license**, marking a significant open-model release focused on **reasoning, agentic workflows, multimodality, and on-device use**. It outperforms models 10x larger and has immediate ecosystem support including **vLLM**, **llama.cpp**, **Ollama**, **Intel hardware**, **Unsloth**, and **Hugging Face Inference Endpoints**. Local inference benchmarks showed strong performance on consumer hardware, including RTX 4090 and Mac mini M4. Early benchmarking praised its efficiency and ranking improvements over previous versions. Meanwhile, **Hermes Agent** emerged as a popular open-source agent harness, noted for stability and capability on long tasks, with users switching from OpenClaw to Hermes.

Gemma 4

Thu, 02 Apr 2026 05:44:39 GMT

**Google DeepMind** released **Gemma 4**, a family of open-weight, multimodal models with long-context support up to **256K tokens** under an **Apache 2.0 license**, marking a major capability and licensing shift. The lineup includes **31B dense**, **26B MoE (A4B)**, and two edge models (**E4B**, **E2B**) optimized for local and edge deployment with native multimodal support (text, vision, audio). Early benchmarks show **Gemma-4-31B** ranking #3 among open models and strong scientific reasoning performance with **85.7% GPQA Diamond**. Day-0 ecosystem support includes **llama.cpp**, **Ollama**, **vLLM**, and **LM Studio**, with notable local inference performance on hardware like **M2 Ultra** and **RTX 4090**. The architecture features hybrid attention and MoE layering, diverging from standard transformers. Community and developer engagement is high, with rapid adoption and tooling integration.

not much happened today

Wed, 01 Apr 2026 05:44:39 GMT

**Arcee’s Trinity-Large-Thinking** was released with **open weights under Apache 2.0**, featuring a **400B total / 13B active** model size and strong agentic performance, ranking **#2 on PinchBench**. **Z.ai’s GLM-5V-Turbo** is a **vision coding model** with **native multimodal fusion** and a **CogViT encoder**, integrated into multiple platforms. **TII’s Falcon Perception** offers an **open-vocabulary referring expression segmentation model** with an **early-fusion transformer** and a competitive **0.3B OCR model**. **H Company’s Holo3** is a GUI-navigation model family based on **Qwen3.5**. A **Claude Code leak** revealed a minimalist agent core with a **4-layer context compression stack**, **40+ tool modular architecture**, and advanced features like **task budget management** and **streaming tool execution**. The leak highlights Anthropic’s agent design and operational sophistication.

not much happened today

Mon, 30 Mar 2026 05:44:39 GMT

**Anthropic** introduced **computer use inside Claude Code** for closed-loop verification in a research preview for Pro/Max users, enhancing reliable app iteration. **OpenAI** released a **Codex plugin for Claude Code**, enabling cross-agent composition and signaling a shift toward composable coding harnesses. OpenAI also noted that late-night Codex tasks run longer, supporting background agent delegation. **Nous Research**'s **Hermes Agent** saw rapid adoption due to better compaction, adaptability, and multi-agent profiles, evolving toward an agent OS abstraction. An ecosystem around Hermes includes tools for trace analytics, fine-tuning, and remote control, with debates on open-source versus proprietary agent infrastructure. Key themes include tooling, prompt/runtime orchestration, and review loops as critical factors beyond model capabilities.

not much happened today

Fri, 27 Mar 2026 05:44:39 GMT

**Anthropic** is reportedly introducing a new AI model tier called **Capybara**, which is larger and more intelligent than **Claude Opus 4.6**, showing improved performance in coding, academic reasoning, and cybersecurity. The model is speculated to be around **10 trillion parameters**, with **Google** potentially funding Anthropic's data center expansion. Meanwhile, **Zhipu** released **GLM-5.1**, advancing open coding models and narrowing the gap with closed models. Local inference economics are improving, highlighted by efficient deployments of **Qwen 3.5 14B**, **Qwen 27B**, and **Qwen3.5-35B** models with quantization techniques like **TurboQuant vLLM**. However, TurboQuant's benchmarking claims face criticism from researchers. Overall, the AI landscape shows aggressive scaling, local model deployment, and agent products gaining traction.

not much happened today

Tue, 24 Mar 2026 05:44:39 GMT

**Anthropic** advances agent infrastructure with a multi-agent harness emphasizing orchestration and "computer use" for complex software environments. **Figma**, **GitHub**, and **Cursor** launch design canvases with direct AI editing, showcasing tool-calling becoming product-native. **Nous Research** releases **Hermes Agent v0.4.0** with 300+ PRs, adding OpenAI-compatible APIs and self-improving memory agents. Open agent ecosystems mature with **AI2's MolmoWeb** (4B and 8B models), **GenReasoning's OpenReward** platform offering 330+ RL environments and 4.5M+ tasks, and **Zhipu's ZClawBench** benchmark with 116 real-world agent tasks, highlighting progress toward standardized environment serving and benchmarkable agent tasks.

not much happened today

Tue, 24 Mar 2026 05:44:39 GMT

**Google** launched **Gemini 3.1 Flash Live**, a realtime voice and vision agent model with **2x longer conversation memory**, supporting **70 languages** and **128k context**. **Mistral AI** released **Voxtral TTS**, a low-latency, open-weight text-to-speech model supporting **9 languages** and competitive with ElevenLabs. **Cohere** introduced **Cohere Transcribe**, an audio model with **14-language** support and top English ASR leaderboard performance at **5.42 WER**. **OpenAI** released smaller multimodal variants **GPT-5.4 mini** and **GPT-5.4 nano** with **400k context**, noted for cost-competitiveness but high verbosity and hallucination rates. Other releases include **GLM-5-Turbo** by Zai, **Reka Edge** and **Flash 3** on OpenRouter, and new multi-agent UX tooling **Cline Kanban** for orchestrating CLI coding agents.

not much happened today

Tue, 24 Mar 2026 05:44:39 GMT

**ARC-AGI-3** benchmark introduced by **@arcprize** and **François Chollet** resets the frontier for general agentic reasoning with humans solving 100% of tasks versus under 1% for current models, focusing on zero-preparation generalization and human-like learning efficiency. The scoring protocol sparked debate over its harsh efficiency-based metric compared to prior ARC versions and other benchmarks like **NetHack**. The community acknowledges the benchmark highlights weaknesses in current LLM agents in interactive, sparse-feedback environments. Concurrently, agent infrastructure advances with **LangChain** launching Fleet shareable skills for reusable domain knowledge, and **Anthropic** revealing **Claude Code auto mode** for classifier-mediated approval balancing autonomy and manual confirmation. Browser and coding agents are evolving into trainable systems beyond prompt wrappers, exemplified by **BrowserBase** and **Prime Intellect** collaboration.

The Claude Code Source Leak

Tue, 24 Mar 2026 05:44:39 GMT

**Anthropic's** closed-source coding product **Claude Code** experienced a significant source leak exposing over **500k lines** of orchestration logic, including autonomous modes and memory systems, but not model weights. The leak led to rapid public reverse-engineering, numerous forks with up to **32.6k stars and 44.3k forks**, and subsequent **DMCA takedowns** by Anthropic. Suspicious npm packages emerged targeting users compiling the leaked code, creating a live security hazard. Discussions also mention unreleased model references like **"mythos"** and ongoing product feature updates despite the leak. *"OFFICIAL STATEMENT from Anthropic regarding the leak"* was noted but not detailed.

not much happened today

Mon, 23 Mar 2026 05:44:39 GMT

**Anthropic** introduced **Claude Cowork** and **Claude Code** enabling desktop control of mouse, keyboard, and screen in a **macOS research preview**, expanding agent capabilities beyond APIs and browsers. The agent ecosystem is evolving towards long-running, parallel, tool-rich workflows with projects like **Hermes Agent**, **T3 Code**, **Command Center**, and **Parchi** enhancing multi-agent orchestration and autonomous task management. Operational challenges such as fragility and inefficiency in subagents, including **GPT-5.2 Pro** and **Claude** browser/computer use, highlight the need for closed-loop feedback systems. Research from **Meta AI** advances self-improving agents with **Hyperagents / DGM-H** enabling meta-level procedural improvements, and unifies reinforcement learning post-training with **RLLM** (RL + LM-as-RM) to improve reward modeling across task types. Additionally, **WebArena-Infinity** drastically reduces browser environment construction costs, accelerating benchmark and environment generation.

not much happened today

Fri, 20 Mar 2026 05:44:39 GMT

**Cursor's Composer 2**, built on **Kimi K2.5**, sparked discussion over model attribution and licensing, highlighting a shift toward post-trained derivatives of open-source models with domain-specific fine-tuning and reinforcement learning. **Claude Code** is expanding into third-party tools like **T3 Code** and communication channels such as Telegram and Discord, while **LangChain** is evolving from orchestration to multi-agent products with offerings like **Deep Agents/Open SWE** and **LangSmith Fleet**. The discourse emphasizes the importance of clear base-model attribution, licensing compliance, and product differentiation through fine-tuning and user experience.

not much happened today

Thu, 19 Mar 2026 05:44:39 GMT

**Cursor** launched **Composer 2**, a frontier-class coding model with major cost reductions and strong benchmark scores like **61.3 on CursorBench** and **73.7 on SWE-bench Multilingual**. The model was improved via a **first continued pretraining run** feeding into reinforcement learning, trained across **3–4 clusters worldwide** by a **~40-person** team. **OpenAI** acquired **Astral**, the team behind Python tools **uv, ruff, and ty**, strengthening its developer platform. **Anthropic** expanded **Claude Code** with messaging app channels for persistent developer workflows. The focus in AI agents is shifting from single agents to managed fleets and runtimes, with **LangChain** launching **LangSmith Fleet** for enterprise agent management emphasizing **agent identity**, **credential management**, and auditability. Other launches include **Cognition's teams of Devins**, **AgentUI** by **lvwerra**, and discussions on agent runtimes with features like **checkpointing** and **rollback**. Security and permissions are emerging as critical constraints in agent system design.

MiniMax 2.7: GLM-5 at 1/3 cost SOTA Open Model

Wed, 18 Mar 2026 05:44:39 GMT

**MiniMax M2.7** is the headline model release, described as a "self-evolving agent" with strong performance metrics including **56.22% on SWE-Pro**, **57.0% on Terminal Bench 2**, and parity with **Sonnet 4.6**. It features recursive self-improvement in skills, memory, and architecture. **Artificial Analysis** places M2.7 on the cost/performance frontier with an Intelligence Index score of **50**, matching **GLM-5 (Reasoning)** but at a fraction of the cost. Distribution is available via platforms like **Ollama cloud** and **OpenRouter**. **Xiaomi’s MiMo-V2-Pro** is noted as a serious Chinese API-only reasoning model with a score of **49** on the Intelligence Index and favorable token efficiency. **Cartesia’s Mamba-3** is highlighted as an SSM optimized for inference-heavy use, with early reactions focusing on hybrid transformer architectures like **Qwen3.5** and **Kimi Linear**. The report emphasizes a shift from prompting to harness engineering, where the execution environment and agent harnesses, including skills and MCP, are becoming key differentiators in AI system design. This includes discussions on tools, repo legibility, constraints, and feedback loops, with mentions of **DSPy** and **GPT-5.4 mini** as important components in this evolving landscape.

not much happened today

Tue, 17 Mar 2026 05:44:39 GMT

**OpenAI** released **GPT-5.4 mini** and **GPT-5.4 nano**, their most capable small models optimized for coding, multimodal understanding, and subagents, featuring a **400k context window** and over **2x speed** compared to GPT-5 mini. The mini model approaches larger GPT-5.4 performance while using only **30% of Codex quota**, becoming the default for many coding workflows. Pricing concerns and truthfulness tradeoffs were noted, with mixed third-party evaluations on reasoning and resistance to false premises. OpenAI also addressed behavior tuning issues in a recent update. Meanwhile, agent infrastructure is evolving with secure code execution and orchestration tools like **LangChain's LangSmith Sandboxes** and **Open SWE**, inspired by internal systems at **Stripe, Ramp, and Coinbase**. Subagents and secure execution are now key product features, with releases like **Hermes Agent v0.3.0** showcasing plugin architectures, live Chrome control, and voice mode. Research on attention mechanisms, including **Attention Residuals** and vertical attention, is gaining traction.

not much happened today

Mon, 16 Mar 2026 05:44:39 GMT

**Moonshot's Attention Residuals** paper introduced an input-dependent attention mechanism over prior layers with a **1.25x compute advantage** and less than **2% inference latency overhead**, validated on **Kimi Linear 48B total / 3B active**. The paper sparked debate on novelty versus prior art like **DeepCrossAttention** and Google’s earlier work, highlighting tensions in **idea novelty**, **citation quality**, and **frontier-scale validation**. **OpenAI's Codex** showed strong momentum with over **2M weekly active users**, nearly **4x growth YTD**, and **GPT-5.4** hitting **5T tokens/day** and a **$1B annualized run-rate**. Codex added subagents supporting multi-agent coding workflows. Infrastructure for coding agents matured with tools like **Context Hub / chub** supporting agent feedback loops, **AssemblyAI's skill** for Claude Code and Codex, and automated skill extraction from GitHub repos yielding **40% knowledge-transfer gains**. **LangChain** launched **LangGraph CLI** and open-sourced **Deep Agents**, recreating top coding agent workflows with planning, filesystem ops, shell access, and sub-agents.

not much happened today

Fri, 13 Mar 2026 05:44:39 GMT

**MCP tools** remain relevant for deterministic APIs despite ergonomic criticisms, with new **web MCP support in Chrome v146** enabling continuous browsing agents. Persistent memory is emerging as a key differentiator for agents, with IBM improving task completion rates and multi-agent memory framed as a computer architecture challenge. Agent UX is evolving towards always-on, cross-device operation, exemplified by **Perplexity Computer** on iOS and **Claude Code** session management. **Anthropic** released **Opus 4.6 1M context** as default with no extra long-context API charges, achieving **78.3% on MRCR v2 at 1M tokens**. Sparse attention optimizations like **IndexCache** in **DeepSeek Sparse Attention** yield significant speedups on large models with minimal code changes.

not much happened today

Thu, 12 Mar 2026 05:44:39 GMT

**Harnesses, agent infrastructure, and the MCP protocol** are central themes, with emphasis on how **harnesses, sandboxes, filesystem access, skills, memory, and observability** shape agent UI/UX and runtime environments. Despite jokes about MCP's demise, it remains vital in production, notably used internally by **Uber** and supported by **Anthropic**. The **coding-agent stack** is evolving with **CursorBench** combining offline and online metrics to evaluate models on **intelligence and efficiency**, where **GPT-5.4** leads in correctness and token efficiency. Agent-assisted development is splitting between automation-heavy workflows and "stay-in-the-loop" tooling, with **OpenAI** advancing **Codex Automations** featuring worktree vs. branch choices and UI customization. The open agent platform **Hermes Agent v0.2.0** introduces full MCP client support, ACP server for editors, and expanded provider integrations including **OpenAI OAuth**.

not much happened today

Wed, 11 Mar 2026 05:44:39 GMT

**NVIDIA’s Nemotron 3 Super** is a **120B parameter / ~12B active** open model featuring a **hybrid Mamba-Transformer / SSM Latent MoE** architecture and **1M context window**, delivering up to **2.2x faster inference than GPT-OSS-120B** in FP4 with strong throughput gains. It supports agentic workloads and is unusually open with weights, data, and infrastructure details released. The model scored **36 on the AA Intelligence Index**, outperforming GPT-OSS-120B but behind Qwen3.5-122B-A10B. Community and infrastructure support from projects like **vLLM**, **llama.cpp**, **Ollama**, **Together**, **Baseten**, **W&B Inference**, **LangChain**, and **Unsloth GGUFs** was immediate. Key technical innovations include **native multi-token prediction (MTP)** and a significant **KV-cache efficiency** advantage. On the product side, a shift towards **persistent agent runtimes and orchestration layers** is highlighted, with **Andrej Karpathy** advocating for a "bigger IDE" concept where agents replace files as the unit of work, enabling legible, forkable agentic organizations with real-time control. New launches fitting this vision include **Perplexity’s Personal Computer**, an always-on local/cloud hybrid running on Mac mini, and **Computer for Enterprise** orchestrating 20 specialized models and 400+ apps. **Replit Agent 4** offers a collaborative, canvas-like workflow with parallel agents, while **Base44 Superagents** provide integrated solutions for nontechnical users. The engineering focus is increasingly on the orchestration harness rather than just the model.

Yann LeCun’s AMI Labs launches with a $1.03B seed to build world models around JEPA

Tue, 10 Mar 2026 05:44:39 GMT

**Yann LeCun** launched **Advanced Machine Intelligence (AMI Labs)** with a record **$1.03B seed round** at a **$3.5B pre-money valuation**, aiming to build AI models that understand the **physical world** through **world models** rather than just language prediction. The startup, based in **Europe** with locations in **Paris** and **Zürich**, is framed as a major milestone for European AI and backed by a prominent founding team including **Alex Lebrun**, **Saining Xie**, and **Pascale Fung**. The mission is described as a "long-term scientific endeavor" to create AI that "perceives, learns, reasons and acts" in the real world.

Autoresearch: Sparks of Recursive Self Improvement

Mon, 09 Mar 2026 05:44:39 GMT

**RSI** covers AI developments from 3/5/2026 to 3/9/2026, highlighting the emergence of **LLMs autonomously training smaller LLMs**, marking a significant "AutoML moment" in AI progress. **Karpathy** and **Yi Tay** discuss "vibe training," where AI models fix bugs and improve code autonomously, suggesting models may soon surpass human debugging efficiency. The report anticipates **Jakub Pachocki's Automated AI Research Intern** system by September 2026 to accelerate human researchers. On AI Twitter, the focus is on **coding agents** shifting bottlenecks from implementation to review and verification, with **Anthropic's Claude Code Review** improving PR review effectiveness significantly, and tools like **OpenAI Codex Review** and **Cognition's Devin Review** enhancing code review workflows. Harness engineering is evolving into systems engineering, emphasizing decoupling agent storage from compute for collaborative agent teams.

not much happened today

Fri, 06 Mar 2026 05:44:39 GMT

**OpenAI** rolled out **GPT-5.4**, achieving tied **#1** on the **Artificial Analysis Intelligence Index** with **Gemini 3.1 Pro Preview** scoring **57** (up from 51 for GPT-5.2 xhigh). GPT-5.4 features a larger **~1.05M token** context window and higher per-token prices ($2.50/$15 vs $1.75/$14 for GPT-5.2), with strengths in **physics reasoning (CritPt)** and **agentic coding (TerminalBench Hard)** but a higher hallucination rate and **~28% higher benchmark run cost**. The **GPT-5.4 Pro** variant shows a **+10 point jump** on CritPt reaching **30%** but at an extreme output token cost of **$180 / 1M tokens**. Community benchmarks show GPT-5.4 excels in agentic/coding tasks but mixed feedback on reasoning efficiency and literalness compared to **Claude**. OpenAI updated agent prompting guidance for GPT-5.4 API users, emphasizing tool use, structured outputs, and verification loops. **Claude Code** added local scheduled tasks and loop patterns for agents. The **MCP** framework is highlighted as a connective tissue for AI evaluation and design-code round-trips, with **Truesight MCP** enabling AI evaluation like unit testing and **Figma MCP server** supporting bidirectional design-code integration. Open-source **T3 Code** launched as an agent orchestration coding app built on Codex CLI.

GPT 5.4: SOTA Knowledge Work -and- Coding -and- CUA Model, OpenAI is so very back

Thu, 05 Mar 2026 05:44:39 GMT

**OpenAI** launched **GPT-5.4** and **GPT-5.4 Pro** with unified mainline and Codex models, featuring **native computer use**, up to **~1M token context**, and efficiency improvements including a new **Codex `/fast` mode**. Benchmarks showed strong results like **OSWorld-Verified 75.0%** surpassing human baseline and **GDPval 83%** against industry pros. User feedback highlighted coding utility but raised concerns about pricing and overthinking. Integration with devtools like **Cursor**, **Perplexity**, and **Arena** was announced. In systems research, **FlashAttention-4 (FA4)** was introduced with near-matmul speed attention on **Blackwell** GPUs, featuring innovations like **polynomial exp emulation** and **online softmax**. *"Steering mid-response"* and *"fewer tokens, faster speed"* were emphasized as UX and efficiency improvements.

not much happened today

Wed, 04 Mar 2026 05:44:39 GMT

**Gemini 3.1 Flash-Lite** is highlighted by **Demis Hassabis** for its speed and cost-efficiency, focusing on latency and cost per capability rather than raw performance. **NotebookLM Studio** introduces a new feature for generating immersive cinematic video overviews. Rumors about **GPT-5.4** suggest a ~1 million token context window and an "extreme reasoning mode" for long-horizon tasks, with speculation about monthly model updates from **OpenAI**. **Anthropic's Claude Opus 4.6** is noted for strong general agent behavior but weaker visual mathematics performance. **Alibaba's Qwen** team faces leadership exits and restructuring, with concerns about compute access and organizational changes. Qwen models dominate research workflows, appearing in 41% of Hugging Face papers in 2025-2026, raising ecosystem dependence risks. The open-weight model landscape may consolidate around non-profits, **NVIDIA**, and **Meta** due to business incentives.

not much happened today

Tue, 03 Mar 2026 05:44:39 GMT

**Google DeepMind** launched **Gemini 3.1 Flash-Lite**, emphasizing *dynamic thinking levels* for adjustable compute, with notable metrics like **$0.25/M input**, **$1.50/M output**, **1432 Elo on LMArena**, and **2.5× faster time-to-first-token** than Gemini 2.5 Flash. It supports a **1M context window** and high throughput for multimodal inputs including text, images, video, audio, and PDFs. **OpenAI** rolled out **GPT-5.3 Instant** to all ChatGPT users, improving conversational naturalness and reducing hallucinations by **26.8% with search**. The upcoming **GPT-5.4** was teased amid speculation. **Alibaba's Qwen** faces leadership exits, raising concerns about its future and open-source status. The news highlights advancements in model efficiency, pricing, and multimodality, alongside organizational changes impacting AI development.

not much happened today

Mon, 02 Mar 2026 05:44:39 GMT

**Alibaba** released the **Qwen 3.5** series with models ranging from **0.8B to 9B** parameters, featuring **native multimodality**, **scaled reinforcement learning**, and targeting **edge and lightweight agent** deployments. The models support very long context windows up to **262K tokens** (extendable to 1M) and use a novel **Gated DeltaNet hybrid attention** architecture combining linear and full attention layers. Deployment examples include **Ollama** and **LM Studio**, with a notable **6-bit on-device demo on iPhone 17 Pro**. Evaluators are cautioned that reasoning is disabled by default on smaller models. In coding agents, **Codex 5.3** shows promising benchmark results on **WeirdML** with **79.3%** accuracy, though availability and downtime remain critical challenges, especially highlighted by **Claude** outages. Agent reliability and observability are emphasized as cross-functional problems requiring clear success criteria and practical evaluation strategies. Studies show that using **AGENTS.md** and **SKILL.md** guardrails can significantly reduce runtime and token usage by mitigating worst-case thrashing in coding workflows.

OpenAI closes $110B raise from Amazon, NVIDIA, SoftBank in largest startup fundraise in history @ $840B post-money

Fri, 27 Feb 2026 05:44:39 GMT

**OpenAI** has closed a major funding round totaling **$110 billion** at a **$730 billion pre-money valuation**, with investments from **SoftBank ($30B)**, **NVIDIA ($30B)**, and **Amazon ($50B)**. Key user metrics include **1.6 million weekly Codex users**, **over 9 million paying business users** of ChatGPT, and **more than 900 million weekly active ChatGPT users** with **50 million consumer subscribers**. The partnership with Amazon includes exclusive cloud services and **2 gigawatts of Trainium capacity**. Microsoft maintains a reduced partnership with stateless APIs. This funding round is one of the largest in history, highlighting OpenAI's dominant position in AI adoption and infrastructure.

Nano Banana 2 aka Gemini 3.1 Flash Image Preview: the new SOTA Imagegen model

Thu, 26 Feb 2026 05:44:39 GMT

**Google and DeepMind** launched **Nano Banana 2** (aka **Gemini 3.1 Flash Image Preview**), a leading image generation and editing model integrated across multiple Google products with features like **4K upscaling**, **multi-subject consistency**, and **real-time search-conditioned generation**. Evaluations rank it #1 in text-to-image tasks with competitive pricing. Additionally, advances in **agentic coding** are noted with models like **GPT-5.2**, **GPT-5.3 Codex**, **Opus 4.6**, and **Gemini 3.1**, alongside Microsoft's **Copilot Tasks** introducing task delegation. Persistent memory features are rolling out in **Claude** models, though interoperability challenges remain.

Agentic Engineering: WTF Happened in December 2025?

Wed, 25 Feb 2026 05:44:39 GMT

**Perplexity** launched **Computer**, an orchestration-first agent platform featuring multi-model routing, usage-based pricing, and parallel asynchronous sub-agents for distributed workflows. **Andrej Karpathy** claims a "phase change" in coding agents since December, highlighting sustained long-horizon task completion. **OpenAI** released **GPT-5.3-Codex** with ~25% speed improvements and strong benchmark performance, while **Claude Code** celebrates its first year with ecosystem integrations and scaling challenges. This marks a significant shift in coding workflows and agent-based software development.

Anthropic accuses DeepSeek, Moonshot, and MiniMax of "industrial-scale distillation attacks".

Tue, 24 Feb 2026 05:44:39 GMT

**Anthropic** alleges *industrial-scale* distillation attacks on its **Claude** model by **DeepSeek**, **Moonshot AI**, and **MiniMax**, involving **~24,000 fraudulent accounts** and **>16M Claude exchanges** to extract capabilities, raising concerns about competitive risks and safety. The community debates the difference between scraping and API-output extraction, highlighting a shift toward protecting models via *API abuse resistance* techniques. Meanwhile, coding agents like **Codex** and **Claude Code** see real adoption and failures, with emerging best practices in "agentic engineering" led by **Simon Willison**. The **OpenClaw** ecosystem expands with alternatives like **NanoClaw** and integrations such as **Ollama 0.17** simplifying open model usage.

Claude Code Anniversary + Launches from: Qwen 3.5, Cursor Demos, Cognition Devin 2.2, Inception Mercury 2

Tue, 24 Feb 2026 05:44:39 GMT

**Alibaba** launched the **Qwen 3.5 Medium Model Series** featuring models like **Qwen3.5-Flash**, **Qwen3.5-35B-A3B (MoE)**, and **Qwen3.5-122B-A10B (MoE)** emphasizing efficiency over scale with innovations like **1M context** and INT4 quantization. **OpenAI** released **GPT-5.3-Codex** via the **Responses API** with enhanced file input support and faster web socket-based throughput. **Anthropic** introduced **Claude Code Remote Control** enabling terminal session continuation from mobile and expanded enterprise workflow features. **Cursor** shifted UX to agent demo videos instead of diffs, highlighting new interaction modes.

not much happened today

Sat, 21 Feb 2026 05:44:39 GMT

**Gemini 3.1 Pro** demonstrates strong retrieval capabilities and cost efficiency compared to **GPT-5.2** and **Opus 4.6**, though users report tooling and UI issues. The **SWE-bench Verified** evaluation methodology is under scrutiny for consistency, with updates bringing results closer to developer claims. Benchmarking debates arise over what frontier models truly measure, especially with ARC-AGI puzzles. **Claude Opus 4.6** shows a noisy but notable **14.5-hour time horizon** on software tasks, with token limits causing practical failures. **Sonnet 4.6** improves significantly in code and instruction-following benchmarks, but user backlash grows due to product regressions.

Gemini 3.1 Pro: 2x 3.0 on ARC-AGI 2

Thu, 19 Feb 2026 05:44:39 GMT

**Google** released **Gemini 3.1 Pro**, a developer preview integrated across the **Gemini app**, **NotebookLM**, **Gemini API / AI Studio**, and **Vertex AI**, highlighting a significant reasoning improvement with **ARC-AGI-2 = 77.1%** and strong coding and agentic-tool benchmarks like **SWE-Bench Verified = 80.6%**. Independent evaluators such as **Artificial Analysis** and **Arena** confirmed top-tier performance and cost efficiency, though community reactions included excitement about practical gains, skepticism about benchmark targeting, and concerns over rollout inconsistencies. The release emphasizes the same core intelligence powering **Gemini 3 Deep Think** scaled for practical use, with notable mentions from leaders like *@sundarpichai*, *@demishassabis*, and *@JeffDean*.

not much happened today

Wed, 18 Feb 2026 05:44:39 GMT

**Anthropic** released **Claude Opus/Sonnet 4.6**, showing a significant intelligence index jump but with increased token usage and cost. **Anthropic** also shared insights on AI agent autonomy, highlighting human-in-the-loop prevalence and software engineering tool calls. **Alibaba** launched **Qwen 3.5** with discussions on reasoning efficiency and token bloat, plus open-sourced **Qwen3.5-397B-A17B FP8 weights**. The **GLM-5** technical report introduced asynchronous agent reinforcement learning and compute-efficient techniques. Rumors about **Gemini 3.1 Pro** suggest longer reasoning capabilities, while **MiniMax M2.5** appeared on community leaderboards. The community debates benchmark reliability and model performance nuances.

Claude Sonnet 4.6: clean upgrade of 4.5, mostly better with some caveats

Tue, 17 Feb 2026 05:44:39 GMT

**Anthropic** launched **Claude Sonnet 4.6**, an upgrade over Sonnet 4.5, featuring broad improvements in **coding, long-context reasoning, agent planning, knowledge work, and design**, plus a **1M-token context window (beta)**. Benchmarks show Sonnet 4.6 leading on **GDPval-AA ELO 1633**, with significant token usage increases and improved output aesthetics. Integrations include **Cursor, Windsurf, Microsoft Foundry, and Perplexity Pro/Max**. Early user feedback noted some regression issues that were later fixed. Pricing remains the same as Sonnet 4.5. Tooling enhancements include code execution for filtering results, improving accuracy and efficiency.

Qwen3.5-397B-A17B: the smallest Open-Opus class, very efficient model

Mon, 16 Feb 2026 05:44:39 GMT

**Alibaba** released **Qwen3.5-397B-A17B**, an open-weight model featuring **native multimodality**, **spatial intelligence**, and a **hybrid linear attention + sparse MoE** architecture supporting **201 languages** and **long context windows** up to **256K tokens**. The model shows improvements over previous versions like **Qwen3-Max** and **Qwen3-VL**, with a sparsity ratio of about **4.3%**. Community discussions highlighted the **Gated Delta Networks** enabling efficient inference despite large model size (~**800GB BF16**), with successful local runs on Apple Silicon using quantization techniques. The hosted API version, **Qwen3.5-Plus**, supports **1M context** and integrates search and code interpreter features. This release follows other Chinese labs like **Z.ai**, **Minimax**, and **Kimi** in refreshing large models. The model is licensed under **Apache-2.0** and is expected to be the last major release before **DeepSeek v4**. The news also notes **Pete Steinberger** joining **OpenAI**.

MiniMax-M2.5: SOTA coding, search, toolcalls, $1/hour

Fri, 13 Feb 2026 05:44:39 GMT

**MiniMax-M2.5** is now open source, featuring an "agent-native" reinforcement learning framework called **Forge** trained across **200k+ RL environments** for coding, tool use, and workflows. It boasts strong benchmark scores like **80.2% SWE-Bench Verified** and emphasizes cost-efficiency with claims like "$1 per hour at 100 tps" and good on-device performance. The **Forge** RL system uses multi-level prefix caching and high rollout compute share (~60%) to generate millions of trajectories daily. Independent reviews note improved stability and multi-turn viability but high token usage. The ecosystem rapidly adopted MiniMax-M2.5 with quantized releases including **2-bit GGUF** and **INT4** formats. Meanwhile, **Together** markets **GLM-5** as a leading open-source model for long-horizon agents with **77.8% SWE-Bench Verified** and MoE efficiency using DeepSeek Sparse Attention.

new Gemini 3 Deep Think, Anthropic $30B @ $380B, GPT-5.3-Codex Spark, MiniMax M2.5

Thu, 12 Feb 2026 05:44:39 GMT

**Google DeepMind** is rolling out the upgraded **Gemini 3 Deep Think V2** reasoning mode to **Google AI Ultra** subscribers and opening early access to the **Vertex AI / Gemini API** for select users. Key benchmark achievements include **ARC-AGI-2 at 84.6%**, **Humanity’s Last Exam (HLE) at 48.4% without tools**, and a **Codeforces Elo of 3455**, showcasing Olympiad-level performance in physics and chemistry. The mode emphasizes practical scientific and engineering applications such as error detection in math papers, physical system modeling, semiconductor optimization, and a **sketch to CAD/STL pipeline** for 3D printing. ARC benchmark creator François Chollet highlights the benchmark's role in advancing test-time adaptation and fluid intelligence, projecting human-AI parity around **2030**. This rollout is framed as a productized, compute-heavy test-time mode rather than a lab demo, with cost disclosures for ARC tasks provided.

Z.ai GLM-5: New SOTA Open Weights LLM

Wed, 11 Feb 2026 05:44:39 GMT

**Zhipu AI** launched **GLM-5**, an **Opus-class** model scaling from **355B to 744B parameters** with **DeepSeek Sparse Attention** integration for cost-efficient long-context serving. GLM-5 achieves **SOTA on BrowseComp** and leads on **Vending Bench 2**, focusing on office productivity tasks and surpassing **Kimi K2.5** on the GDPVal-AA benchmark. Despite broad availability on platforms like **OpenRouter**, **Modal**, **DeepInfra**, and **Ollama Cloud**, GLM-5 faces **compute constraints** impacting rollout and pricing. The model supports up to **200K context length** and **128K max output tokens**.

Qwen-Image 2.0 and Seedance 2.0

Tue, 10 Feb 2026 05:44:39 GMT

**OpenAI** advances its Responses API for multi-hour agent workflows with features like **server-side compaction**, **hosted containers**, and **Skills API**, alongside upgrading **Deep Research** to **GPT-5.2** and adding connectors. Discussions around sandbox design highlight a shift towards **sandbox-as-a-tool** architectures, with **LangChain** enhancing its **deepagents v0.4** with pluggable sandbox backends. Coding agent UX evolves with multi-model orchestration involving **Claude Opus 4.6**, **GPT-5.3-Codex**, and **Gemini 3 Pro**. **EntireHQ** raised **$60M seed** funding for a Git-compatible database capturing code intent and agent context. In model releases, **Alibaba Qwen** launched **Qwen-Image-2.0** emphasizing **2K resolution** and **1K-token prompts** for unified generation and editing. ByteDance's **Seedance 2.0** marks a significant leap in text-to-video quality, while **Moonshot's Kimi** introduces an **Agent Swarm** with up to **100 sub-agents** and **4.5× faster** parallel execution.

not much happened today

Mon, 09 Feb 2026 05:44:39 GMT

**OpenAI** launched **GPT-5.3-Codex** with a Super Bowl ad emphasizing "You can just build things" as a product strategy, focusing on builder tooling over chat interfaces. The model is rolling out across **Cursor, VS Code, and GitHub** with phased API access and is flagged as their first "high cybersecurity capability" model. Sam Altman reported over **1M Codex app downloads in the first week** and strong weekly user growth. Meanwhile, **Anthropic's Claude Opus 4.6** is recognized as a leading "agentic generalist" model, topping text and code leaderboards but noted for high token usage. Discussions around serving economics and "fast mode" behavior highlight practical deployment considerations. Additionally, Recursive Language Models (RLMs) introduce a novel approach using a second programmatic context space to extend long-context capabilities.

not much happened today

Fri, 06 Feb 2026 05:44:39 GMT

**AI News** for early February 2026 highlights a detailed comparison between **GPT-5.3-Codex** and **Claude Opus 4.6**, with users noting **Codex's** strength in detailed scoped tasks and **Opus's** ergonomic advantage for exploratory work. Benchmarks on Karpathy's **nanochat GPT-2 speedrun** show **Opus 4.6** achieving better wall-clock performance, while **Codex-5.3-xhigh** sometimes suffers from context issues. **Karpathy** cautions that current models are not yet reliable for fully autonomous AI engineering. Discussions on agent swarms reveal emerging parallels to software organizational design, with **Anthropic-style** agent coordination systems and **LangChain/LangSmith** emphasizing environment engineering through tracing, sandboxing, and state control. The concept of Recursive Language Models (RLM) is introduced as a future direction for agent systems to reduce context rot and improve structured communication.

OpenAI and Anthropic go to war: Claude Opus 4.6 vs GPT 5.3 Codex

Thu, 05 Feb 2026 05:44:39 GMT

**OpenAI** launched **GPT-5.3-Codex**, emphasizing **token efficiency**, **inference speed**, and hardware/software co-design with **GB200-NVL72** and **NVIDIA** collaboration. The new **Frontier** agent platform supports business-context agents with execution environments and learning capabilities. **Anthropic** showcased **Opus 4.6** agent teams autonomously building a clean-room C compiler booting Linux, highlighting advances in agentic coding and long-context capabilities. Community benchmarks report **2.93× faster** inference and significant efficiency gains, signaling a shift away from infinite compute budgets in 2026.

ElevenLabs $500m Series D at $11B, Cerebras $1B Series H at $23B, Vibe Coding -> Agentic Engineering

Wed, 04 Feb 2026 05:44:39 GMT

**Google's Gemini 3** is being integrated widely, including a new **Chrome side panel** and **Nano Banana** UX features, with rapid adoption and a **78% unit-cost reduction** in serving costs. The **Gemini app** reached **750M+ MAU** in Q4 2025, nearing ChatGPT's user base. Google is also benchmarking AI "soft skills" through games like Poker and Chess in the **Kaggle Game Arena**. Meanwhile, coding agents are converging in IDEs: **VS Code** launched **Agent Sessions** supporting **Claude** and **Codex** agents with features like parallel subagents and integrated browsers. **GitHub Copilot** now allows agent choice between **Claude** and **OpenAI Codex** for async backlog clearing. OpenAI reports **1M+ active users** for Codex with expanded integration surfaces, though some users request better GPU support. The coding-agent ecosystem is professionalizing with community platforms like **OpenClaw** and tooling such as ClawHub and CLI updates. *"Gemini 3 adoption faster than any other model"* and *"VS Code as home for coding agents"* highlight major industry shifts.

Context Graphs: Hype or actually Trillion-dollar opportunity?

Tue, 03 Feb 2026 05:44:39 GMT

**Zhipu AI** launched **GLM-OCR**, a lightweight **0.9B** multimodal OCR model excelling in complex document understanding with top benchmark scores and day-0 deployment support from **lmsys**, **vllm**, and **novita labs**. **Ollama** enabled local-first usage with easy offline operation. **Alibaba** released **Qwen3-Coder-Next**, an **80B MoE** model with only **3B active** parameters, designed for coding agents with a massive **256K context window** and trained on **800K verifiable tasks**, achieving over **70% SWE-Bench Verified**. The open coding ecosystem also saw **Allen AI** announce **SERA-14B**, an on-device-friendly coding model with new datasets. The emerging concept of **Context Graphs** was highlighted as a promising framework for data and agent traceability, with initiatives like **Cursor's Agent Trace** specifying context graphs for coding agents, emphasizing potential improvements in agent performance and customer-driven adoption. This coverage reflects ongoing innovation in **multimodality**, **long-context**, **mixture-of-experts**, and **agentic coding models**.

OpenAI Codex App: death of the VSCode fork, multitasking worktrees, Skills Automations

Mon, 02 Feb 2026 05:44:39 GMT

**OpenAI** launched the **Codex app** on macOS as a dedicated agent-native command center for coding, featuring **multiple agents in parallel**, **built-in worktrees** for conflict isolation, **skills** for reusable bundles, and **scheduled automations**. The app emphasizes developer workflows like **Plan mode** for upfront task decomposition and is gaining positive adoption signals from insiders including **@sama**. There is movement towards ecosystem standardization of skills folders, signaling early conventions in agent tooling. Codex also exemplifies a "self-improving" product feedback loop combining humans and agents. In coding agents practice, best practices include a "test-first" approach to bug fixes, the "conductor" model where one developer manages 5-10 agents in parallel, and a neurosymbolic framing explaining why coding agents succeed due to software's verifiability and symbolic tooling. Benchmark skepticism remains about productivity studies that do not reflect agentic workflows.

MoltBook takes over the timeline

Fri, 30 Jan 2026 05:44:39 GMT

**Moltbook** and **OpenClaw** showcase emergent multi-agent social networks where AI agents autonomously interact, creating an AI-native forum layer with complex security and identity challenges. **Karpathy** describes this as "takeoff-adjacent," highlighting bots self-organizing and engaging in prompt-injection and credential theft. **Anthropic** reports on AI coding tradeoffs with a study of **52 junior engineers** and reveals **Claude** planned a Mars rover drive, marking a milestone in AI-driven space exploration. **Google** publicly releases **Genie 3**, sparking debate over its capabilities and latency issues. The rise of agent-to-agent private communications raises concerns about alignment and observability in 2026.

xAI Grok Imagine API - the #1 Video Model, Best Pricing and Latency - and merging with SpaceX

Thu, 29 Jan 2026 05:44:39 GMT

**Google DeepMind** launched **Project Genie (Genie 3 + Nano Banana Pro + Gemini)**, a prototype for creating interactive, real-time generated worlds from text or image prompts, currently available to **Google AI Ultra subscribers in the U.S. (18+)** with noted limitations like **~60s generation limits** and imperfect physics. In parallel, the open-source **LingBot-World** offers a real-time interactive world model with **<1s latency at 16 FPS** and minute-level coherence, emphasizing interactivity and causal consistency. In video generation, **xAI Grok Imagine** debuted strongly with native audio support, **15s duration**, and competitive pricing at **$4.20/min including audio**, while **Runway Gen-4.5** focuses on animation workflows with new features like **Motion Sketch** and **Character Swap**. The 3D generation space sees **fal** adding **Hunyuan 3D 3.1 Pro/Rapid** to its API offerings, extending model-as-a-service workflows into 3D pipelines.

not much happened today

Wed, 28 Jan 2026 05:44:39 GMT

**AI News for 1/27/2026-1/28/2026** highlights a quiet day with deep dives into frontier model "personality split" where **GPT-5.2** excels at *exploration* and **Claude Opus 4.5** at *exploitation*, suggesting **OpenAI** suits research workflows and **Anthropic** commercial reliability. The rise of agentic coding loops shows new failure modes, with *self-verification* workflows gaining traction. The open-model **Kimi K2.5** emerges as a flashpoint, boasting enhanced **agent execution**, **multimodality**, and **coding polish**, runnable on **Apple silicon M3 Ultra Mac Studios** with **Thunderbolt 5 (RDMA)**, and challenging **Claude Opus 4.5** on benchmarks and pricing. Licensing issues threaten enterprise adoption despite model quality. The meme "clawdbot" reflects rapid agent branding proliferation. Agent engineering advances with shared "skills" interfaces promoted by **DeepLearning.AI**, **Anthropic**, and **LangChain**.

Moonshot Kimi K2.5 - Beats Sonnet 4.5 at half the cost, SOTA Open Model, first Native Image+Video, 100 parallel Agent Swarm manager

Tue, 27 Jan 2026 05:44:39 GMT

**MoonshotAI's Kimi K2.5** is a **32B active-1T parameter open-weights model** featuring **native multimodality** with image and video understanding, built through continual pretraining on **15 trillion mixed visual and text tokens**. It introduces a new **MoonViT vision encoder** and supports advanced capabilities like **Agent Swarm**, which coordinates up to 100 sub-agents for parallel workflows, and an **Office Productivity K2.5 Agent** for large-scale office tasks. This release marks a significant leap in open models from China, claiming state-of-the-art results on benchmarks like HLE and BrowseComp, and offering aggressive API pricing and throughput.

Anthropic launches the MCP Apps open spec, in Claude.ai

Mon, 26 Jan 2026 05:44:39 GMT

**Anthropic** has officially absorbed the independent MCP UI project and, collaborating with **OpenAI**, **Block**, **VS Code**, **Antigravity**, **JetBrains**, and **AWS**, released the **MCP Apps spec** and official support in **Claude.ai**. This standard aims to enable a rich ecosystem of interoperable applications with rich UI, addressing the proliferation of subscription services. Meanwhile, **NVIDIA** introduced **ToolOrchestra** with an **8B orchestrator** model trained via scalable reinforcement learning for efficient agent orchestration. The concept of Recursive Language Models (RLMs) is gaining traction for efficient context management in agent stacks. The “Clawdbot” UX pattern emphasizes outcome-first assistant design with tight context and tool integration, sparking security concerns around prompt injection. **Alibaba** launched **Qwen3-Max-Thinking**, a flagship reasoning and agent model with adaptive tool use and strong benchmark scores, now available in public evaluation platforms like LM Arena and Yupp.

not much happened today

Thu, 22 Jan 2026 05:44:39 GMT

**Anthropic** launches "Claude in Excel Pro" with enhanced features. **OpenAI** reveals upcoming **Codex** agent loop and cybersecurity measures. **Google** boosts **Gemini App** quotas and partners with **Sakana AI** for advanced AI Scientist projects in Japan. **Cursor** introduces Agent Skills for dynamic context focus. **GPT-5.2 Pro** achieves **31%** on FrontierMath Tier 4, showing significant benchmark progress. **Baseten** raises **$300M** at a **$5B valuation** targeting high-performance inference. Discussions highlight math benchmarks as indicators of AI capability, uneven AGI progress, and the importance of reasoning and continual learning as future frontiers. Notable figures include *Sam Altman*, *François Chollet*, *Shane Legg*, and *Demis Hassabis*.

OpenEvidence, the ‘ChatGPT for doctors,’ raises $250m at $12B valuation, 12x from $1b last Feb

Wed, 21 Jan 2026 05:44:39 GMT

**OpenEvidence** raised **$12 billion**, a 12x increase from last year, with usage by 40% of U.S. physicians and over $100 million in annual revenue. **Anthropic** released a new **Claude** model constitution under **CC0 1.0**, framing it as a living document for alignment and training. **Podium** reported over **$100 million ARR** from **10,000+ AI agents**, shifting from software sales to AI operators. Innovations in agent memory and reliability include the **Agent Cognitive Compressor (ACC)** and multi-agent scientific workflows via **MCP-SIM**. Agentic benchmarking shows challenges in long-horizon tasks with models like **Gemini 3 Flash High**, **GPT-5.2 High**, and **Claude Opus 4.5 High** scoring modestly on professional services and legal research benchmarks.

not much happened today

Tue, 20 Jan 2026 05:44:39 GMT

**X Engineering** open-sourced its new transformer-based recommender algorithm, sparking community debate on transparency and fairness. **GLM-4.7-Flash (30B-A3B)** gains momentum as a strong local inference model with efficient KV-cache management and quantization tuning strategies. Innovations include tensor parallelism on Mac Minis achieving ~100 tok/s throughput. Research highlights "Societies of Thought" as a reasoning mechanism improving model accuracy by 20%+.

not much happened today

Mon, 19 Jan 2026 05:44:39 GMT

**AI News for 1/16/2026-1/19/2026** covers new architectures for scaling Transformer memory and context, including **STEM** from **Carnegie Mellon** and **Meta AI**, which replaces part of the FFN with a token-indexed embedding lookup enabling CPU offload and asynchronous prefetch. **RePo** from **Sakana AI** introduces adaptive positional reordering to improve robustness on noisy and long-range contexts. Model releases highlight **Zhipu AI's GLM-4.7-Flash**, a **30B-class MLA + small MoE** model optimized for coding and agentic tasks, noted for strong benchmark performance and a compression narrative from larger to smaller models. Inference and deployment updates include **mlx-lm 0.30.3** supporting GLM-4.7-Flash with efficient 4-bit performance on laptops. The report emphasizes practical takeaways on static sparsity, adaptive ordering, and the resurgence of small, fast models for interactive tasks. *"Sparse capacity doesn’t have to mean MoE routers + expert parallelism; static sparsity can be systems-friendly."*

ChatGPT starts testing ads on free tier + new $8/mo Go plan in the US

Fri, 16 Jan 2026 05:44:39 GMT

**OpenAI** announced the **ChatGPT Go** tier at **$8/month** with ads testing in the US free tier, emphasizing that ads will not influence responses and will be clearly labeled. The update includes memory improvements and a "very fast Codex" feature teased by **Sam Altman**. The Codex CLI ecosystem now supports open-weight models with improved context length. Discussions highlight the importance of human-in-the-loop for reliability in agent orchestration and file interface improvements over traditional retrieval-augmented generation.

Open Responses: explicit spec for OpenAI's Responses API supported by OpenRouter, Ollama, Huggingface, vLLM, et al

Thu, 15 Jan 2026 05:44:39 GMT

**OpenAI** launched the **Open Responses** API spec, an open-source, multi-provider standard for interoperable LLM APIs designed to simplify agent stacks and tooling. Early adopters like **ollama** and **vLLM** support the spec, while notable absences include **anthropic** and **google-deepmind**. Agent design insights from **Cursor** emphasize explicit roles and planning over mega-agent models, with **GPT-5.2** outperforming **Opus 4.5** in long runs. The emerging dominant context/memory abstraction for agents is a **filesystem-as-memory** approach, championed by **llamaindex** and **langchain**, using virtual filesystems often backed by databases like Postgres. LangChain also shipped an open-source desktop interface for agent orchestration called **openwork**. This news highlights advances in API standardization, agent architecture, and memory abstractions in AI development.

not much happened today.

Wed, 14 Jan 2026 05:44:39 GMT

**OpenAI** launched **GPT-5.2-Codex** API, touted as their strongest coding model for long-running tasks and cybersecurity. **Cursor** integrated GPT-5.2-Codex to autonomously run a browser for a week, producing over 3 million lines of Rust code. **GitHub** incorporated it into their code tools, easing enterprise adoption. Discussions highlight the importance of review loops in agent systems and debate evaluation metrics for coding models. **OpenAI** partnered with **Cerebras** to improve inference speed and latency, with Cerebras serving **GLM-4.7** at 1,445 tokens/sec and low latency. Provider benchmarking reveals tradeoffs in throughput, latency, and context window sizes. **Modal** shared operational scaling insights for self-hosted inference fleets of 20k GPUs, focusing on batch inference optimization with **vLLM** and FlashInfer backend. This reflects a focus on inference infrastructure, long-horizon autonomous agents, and coding model evaluation.

Anthropic Labs: Cowork, Claude Code, MCP, Skills incubator led by Mike Krieger and Ben Mann

Tue, 13 Jan 2026 05:44:39 GMT

**Anthropic** consolidates its AI agent products under the **Cowork** brand, integrating prior tools like **Claude Code** and **Claude for Chrome** into a unified agent with sandboxed Linux VM environments using **Apple's virtualization** and **bubblewrap** for security. Meanwhile, **Anthropic Labs** reorganizes with Mike Krieger stepping down as CPO, focusing on productizing **Claude** with a >$1B ARR agent lab. The AI community debates the meaning of "vibe coding," emphasizing disciplined engineer verification over casual coding. **LangChain** launches **Agent Builder GA**, offering no-code but powerful agent orchestration features like memory, triggers, and human-in-the-loop approvals. Some experts advocate simplifying agent tooling to core filesystem and bash access for efficiency. Open-source recreations of Cowork-like environments using **QEMU** and sandboxing tools highlight rapid commoditization of AI agent tech.

Apple picks Google's Gemini to power Siri's next generation

Mon, 12 Jan 2026 05:44:39 GMT

**Apple** has decided to power Siri with **Google's Gemini models** and cloud technology, marking a significant partnership and a setback for **OpenAI**, which was initially partnered with Apple. **Anthropic** launched "Cowork," a product preview for Claude's coding capabilities, sparking discussions about "LLM OS". **OpenAI** introduced **ChatGPT Health** and acquired **Torch** to expand in healthcare AI. **DeepSeek** unveiled **Engram**, a new conditional memory module that enables O(1) lookup-style memory for static patterns, improving long-context handling and offering hardware-friendly optimizations to scale knowledge capacity efficiently. Engram is positioned as a key modeling primitive for next-gen sparse models, with ongoing community debate about its architectural merits and practical impact.

not much happened today

Fri, 09 Jan 2026 05:44:39 GMT

**Anthropic** tightens usage policies for **Claude Max** in third-party apps, prompting builders to adopt **model-agnostic orchestration** and **BYO-key** defaults to mitigate platform risks. The **Model Context Protocol (MCP)** is evolving into a key tooling plane with **OpenAI MCP Server** and **mcp-cli** enhancing tool discovery and token efficiency. The concept of **skills** as modular, versioned behaviors gains traction, with implementations in **Claude Code**, **GitHub Copilot**, and **Cline** adding websearch tooling. AI21 Labs addresses concurrency challenges in agent workspaces using **git worktrees** for transactional parallel writes, while long-horizon agents focus on **context engineering** and persistent file-centric workspaces.

not much happened today

Thu, 08 Jan 2026 05:44:39 GMT

**Stanford paper** reveals **Claude 3.7 Sonnet** memorized **95.8% of Harry Potter 1**, highlighting copyright extraction risks compared to **GPT-4.1**. **Google AI Studio** sponsors **TailwindCSS** amid OSS funding debates. **Google** and **Sundar Pichai** launch **Gmail Gemini 3** features including AI Overviews and natural-language search with user controls. **Alibaba Qwen** releases **Qwen3-VL-Embedding** and **Qwen3-VL-Reranker**, a multimodal, multilingual retrieval stack supporting text, images, and video with quantization and instruction customization, achieving strong benchmark results. **Z.ai** goes public on HKEX with **GLM-4.7** leading the Artificial Analysis Intelligence Index v4.0, showing gains in reasoning, coding, and agentic use, with large-scale MoE architecture and MIT license. **Falcon-H1R-7B** from TII targets efficient reasoning in smaller models, scoring 16 on the Intelligence Index. **AI21 Labs** introduces **Jamba2**, a memory-efficient enterprise model with hybrid SSM-Transformer architecture and Apache 2.0 license, available via SaaS and Hugging Face. **vLLM** shows throughput improvements in inference and kernel engineering. *"Embeddings should be multimodal by default,"* notes Justin Lin.

not much happened today

Wed, 07 Jan 2026 05:44:39 GMT

**AI News for 1/6/2026-1/7/2026** highlights a quiet day with key updates on **LangChain DeepAgents** introducing **Ralph Mode** for persistent agent loops, **Cursor** improving context management by reducing token usage by **46.9%**, and operational safety measures for coding agents with allow/deny lists. **MCP** integration is expanding across assistants and robotics, with Hugging Face embedding assistants via **HuggingChat + HF MCP server**. The **DeepSeek-R1** paper has been expanded to **86 pages**, emphasizing trajectory exploration and RL shaping behavior. **NousCoder-14B** shows a **+7% improvement on LiveCodeBench** after **4 days** of RL training, demonstrating advances in RL for coding with small open models. Top tweets also mention a viral "96GB RAM laptop", **ChatGPT Health** launch by **OpenAI**, and **Karpathy**'s nanochat scaling-law miniseries.

xAI raises $20B Series E at ~$230B valuation

Tue, 06 Jan 2026 05:44:39 GMT

**xAI**, Elon Musk's AI company, completed a massive **$20 billion Series E funding round**, valuing it at about **$230 billion** with investors like **Nvidia**, **Cisco Investments**, and others. The funds will support AI infrastructure expansion including **Colossus I and II supercomputers** and training **Grok 5**, leveraging data from **X's 600 million monthly active users**. At **CES 2026**, the focus was on "AI everywhere" with a strong emphasis on **AI-first hardware** and integration between **NVIDIA** and **Hugging Face's LeRobot** for robotics development. The **Reachy Mini** robot is gaining traction as a consumer robotics platform. In software, **Claude Code** is emerging as a popular local/private coding assistant, with new UI features in **Claude Desktop** and innovations like **Cursor's dynamic context** reducing token usage by nearly **47%** in multi-MCP setups. *"The 600 million MAU figure in xAI’s announcement combines X platform users with Grok users. That’s a clever framing choice."*

not much happened today

Mon, 05 Jan 2026 05:44:39 GMT

**AI News** from early January 2026 highlights a viral economic prediction about **Vietnam** surpassing Thailand, **Microsoft**'s reported open-sourcing of **bitnet.cpp** for 1-bit CPU inference promising speed and energy gains, and a new research partnership between **Google DeepMind** and **Boston Dynamics** focusing on **Gemini Robotics** and **Atlas hardware**. The concept of **agentic coding** is gaining traction, emphasizing human oversight and infrastructure layers called **Agent Harnesses** to manage long-running AI tasks, with advocates like **Philipp Schmid** promoting this shift. Innovations in persistent memory for coding agents, such as **Claude-Mem**, aim to improve context durability. There is also critical discussion on the specification problem in agent workflows, advocating for better abstractions beyond conversational intent. Practical challenges include managing parallel agents and permission risks. Additionally, open tooling advances include a **JAX-based LLM-Pruning Collection** for efficient model pruning methods.

not much happened today

Fri, 02 Jan 2026 05:44:39 GMT

**DeepSeek** released a new paper on **mHC: Manifold-Constrained Hyper-Connections**, advancing residual-path design as a key scaling lever in neural networks. Their approach constrains residual mixing matrices to the **Birkhoff polytope** to improve stability and performance, with only about **6.7% training overhead**. The innovation includes systems-level optimizations like fused kernels and activation recomputation, highlighting a frontier-lab integration of math and kernel engineering. Additionally, discussions around **long-horizon agents** emphasize context management bottlenecks, introducing **Recursive Language Models (RLMs)** that manage context dynamically rather than relying on larger context windows. This work signals a shift in architectural design and efficiency for base model training and agent development.

not much happened today

Wed, 31 Dec 2025 05:44:39 GMT

**South Korea's Ministry of Science** launched a coordinated program with **5 companies** to develop sovereign foundation models from scratch, featuring large-scale MoE architectures like **SK Telecom A.X-K1 (519B total / 33B active)** and **LG K-EXAONE (236B MoE / 23B active)**, with a total first-round budget of **~$140M**. This initiative contrasts with EU approaches by focusing funding on fewer stakeholders and explicitly budgeting for data. Meanwhile, **Alibaba's Qwen-Image-2512** emerges as a leading open-source image generation model, rapidly integrated into various toolchains including AI-Toolkit and local inference paths with quantization support, and hosted on platforms like Replicate. The model has undergone extensive blind testing with over **10,000 rounds** on AI Arena, highlighting its ecosystem adoption.

not much happened today

Tue, 30 Dec 2025 05:44:39 GMT

**Z.ai (GLM family) IPO in Hong Kong on Jan 8, 2026**, aiming to raise **$560M** at **HK$4.35B**, marking it as the "first AI-native LLM company" public listing. The IPO highlights **GLM-4.7** as a starting point. **Meta AI** acquired **Manus** for approximately **$4–5B**, with Manus achieving **$100M ARR in 8–9 months**, illustrating the value of application-layer differentiation over proprietary models. Manus focuses on agentic architecture, context engineering, and general primitives like code execution and browser control, emphasizing "agent habitats" as a competitive moat. Discussions around **Claude Code** highlight skepticism about "vibe coding," advocating for disciplined, framework-like AI-assisted programming practices.

Meta Superintelligence Labs acquires Manus AI for over $2B, at $100M ARR, 9months after launch

Mon, 29 Dec 2025 05:44:39 GMT

**Manus** achieved a rapid growth trajectory in 2025, raising **$500M** from Benchmark and reaching **$100M ARR** before being acquired by **Meta** for an estimated **$4B**. The **vLLM** team launched a dedicated community site with new resources, while performance issues with **AMD MI300X FP8** were noted in **vLLM** and **sglang** benchmarks. **Weaviate** released operational features including **Object TTL**, **Java v6 client GA**, and **multimodal document embeddings**. API fragmentation concerns were raised by **Teknium** advocating for unified SDK wrappers. In open-weight models, **GLM-4.7** gained recognition as a reliable coding model with faster throughput on **Baseten**, and **MiniMax-M2.1** rose as a leading open agentic coder model, topping WebDev leaderboards.

not much happened today

Fri, 26 Dec 2025 05:44:39 GMT

**MiniMax M2.1** launches as an **open-source** agent and coding Mixture-of-Experts (MoE) model with **~10B active / ~230B total parameters**, claiming to outperform **Gemini 3 Pro** and **Claude Sonnet 4.5**, and supports local inference including on **Apple Silicon M3 Ultra** with quantization. **GLM 4.7** demonstrates local scaling on **Mac Studios** with **2× 512GB M3 Ultra** hardware, highlighting system-level challenges like bandwidth and parallelism. The concept of **inference quality** is emphasized as a key factor affecting output variance across deployments. Yann LeCun's **VL-JEPA** proposes a **non-generative, non-autoregressive** multimodal model operating in latent space for efficient real-time video processing with fewer parameters and decoding operations. Advances in agentic reinforcement learning for coding include self-play methods where agents inject and fix bugs autonomously, enabling self-improvement without human labeling, and large-scale RL infrastructure involving massive parallel code generation and execution sandboxes.

Nvidia buys (most of) Groq for $20B cash; largest execuhire ever

Wed, 24 Dec 2025 05:44:39 GMT

**Groq** leadership team is joining **Nvidia** under a "non-exclusive licensing agreement" in a deal valued at **$20 billion cash**, marking a major acquisition in AI chip space though Nvidia states it is not acquiring Groq as a company. Jensen Huang plans to integrate Groq's low-latency processors into the NVIDIA AI factory architecture to enhance AI inference and real-time workloads. Twitter highlights include **Gemini** used as a consumer utility for calorie tracking, OpenAI discussing the "deployment gap" focusing on model usage in healthcare and business, and Tesla's FSD v14 described as a "Physical Turing Test" for consumer AI. Benchmarking challenges are noted by **Epoch AI** emphasizing provider variance and integration issues affecting model quality measurement. Discussions on coding agents and developer experience convergence continue in the AI community.

not much happened today

Tue, 23 Dec 2025 05:44:39 GMT

**GLM-4.7** and **MiniMax M2.1** open-weight model releases highlight day-0 ecosystem support, coding throughput, and agent workflows, with GLM-4.7 achieving a +9.5% improvement over GLM-4.6 and MiniMax M2.1 positioned as an OSS Claude-like MoE model with 230B total parameters and 200K context. **Gemma Scope 2** from **google-deepmind** introduces sparse autoencoders and transcoders for interpretability across Gemma 3 models, aiming to provide shared infrastructure for safety and debugging. The **Medmarks v0.1** open medical evaluation suite and leaderboard launch addresses the need for open medical benchmarking across 15+ environments, engaging clinicians and researchers.

not much happened today

Mon, 22 Dec 2025 05:44:39 GMT

**Zhipu AI's GLM-4.7** release marks a significant improvement in **coding, complex reasoning, and tool use**, quickly gaining ecosystem adoption via Hugging Face and OpenRouter. **Xiaomi's MiMo-V2-Flash** is highlighted as a practical, cost-efficient mixture-of-experts model optimized for deployment. The open-weight text-to-image competition sees **Z-Image Turbo** leading with 6B parameters under Apache-2.0 license. Video model advances focus on control and long-form consistency, exemplified by **Kling 2.6 Motion Control** and research like MemFlow's adaptive memory retrieval. In agent frameworks, **Google's A2UI protocol** introduces agent-driven UI generation, while studies reveal that mixing multiple agent frameworks is common, with challenges in logic, termination, and tool interaction. LangChain emphasizes persistent memory patterns for production agents.

not much happened today

Fri, 19 Dec 2025 05:44:39 GMT

**Alibaba** released **Qwen-Image-Layered**, an open-source model enabling Photoshop-grade layered image decomposition with recursive infinite layers and prompt-controlled structure. **Kling 2.6** introduced advanced motion control for image-to-video workflows, supported by a creator contest and prompt recipes. **Runway** unveiled the **GWM-1** family with frame-by-frame video generation and Gen-4.5 updates adding audio and multi-shot editing. In LLM platforms, **Gemini 3 Flash** leads benchmarks over **GPT-5.2**, attributed to agentic reinforcement learning improvements post-distillation. Users note **GPT-5.2** excels at long-context tasks (~256k tokens) but face UX limitations pushing some to use **Codex CLI**. Discussions around **Anthropic Opus 4.5** suggest perceived model degradation linked to user expectations.

Claude Skills grows: Open Standard, Directory, Org Admin

Thu, 18 Dec 2025 05:44:39 GMT

**Claude Skills** are gaining significant traction since their launch in October, with a milestone of 100k views in one day for the Claude Skills talk, signaling growing adoption and importance. Announcements include org admin support, a new Skills Directory, and the move to an open standard named **Agent Skills**. In frontier model launches, **OpenAI** released **GPT-5.2-Codex**, touted as the best agentic coding model with improvements in native compaction, long-context reliability, and tool-calling, emphasizing real-world security impacts. **Google DeepMind** introduced **Gemini 3 Flash**, focusing on speed as a product feature impacting workflows and user engagement, alongside **FunctionGemma** and **T5Gemma 2**, emphasizing on-device deployment, fine-tuning, and multimodality.

Gemini 3.0 Flash Preview: 1/4 cost of Pro, but ~as smart, retakes Pareto Frontier

Wed, 17 Dec 2025 05:44:39 GMT

**Google** launched **Gemini 3 Flash**, a pro-grade reasoning model with flash latency, supporting tool calling and multimodal IO, available via multiple platforms including Google AI Studio and Vertex AI. It offers competitive pricing at $0.50 per 1M input tokens and $3.00 per 1M output tokens, with context windows up to 1M tokens. Benchmarks show **Gemini 3 Flash** rivals or outperforms larger models like **GPT-5.2** and **Gemini 3 Pro** in agentic, coding, and reasoning tasks, validated by ARC-AGI-2, SWE-bench, LMArena, and Arena benchmarks. Despite some tradeoffs like high token use and hallucination rates, it is cost-effective overall. Key figures include **Sundar Pichai**, **Jeff Dean**, and **Demis Hassabis** who publicly celebrated this achievement. The model's tool calling capabilities were demonstrated with 100 tools in a live demo.

OpenAI GPT Image-1.5 claims to beat Nano Banana Pro, #1 across all Arenas, but completely fails Vibe Checks

Tue, 16 Dec 2025 05:44:39 GMT

**OpenAI** released its new image model **GPT Image 1.5**, featuring precise image editing, better instruction following, improved text and markdown rendering, and faster generation up to 4×. Despite topping multiple leaderboards like **LMArena (1277)**, **Design Arena (1344)**, and **AA Arena (1272)**, user feedback from Twitter, Reddit, and Discord communities is largely negative compared to **Nano Banana Pro** by **Gemini**. Xiaomi introduced the **MiMo-V2-Flash**, a **309B MoE** model optimized for inference efficiency with **256K context window**, achieving state-of-the-art scores on SWE-Bench. The model uses Hybrid Sliding Window Attention and multi-token prediction, offering significant speedups and efficiency improvements. The timing of OpenAI's launch amid competition from Gemini and Nano Banana Pro affects user sentiment, highlighting challenges in benchmarking relevance.

NVIDIA Nemotron 3: hybrid Mamba-Transformer completely open source models from 30B to 500B

Mon, 15 Dec 2025 05:44:39 GMT

**NVIDIA** has released **Nemotron 3 Nano**, a fully open-source hybrid Mamba-Transformer Mixture-of-Experts (MoE) model with a **30B parameter size** and a **1 million token context window**. It includes open weights, training recipes, datasets, and an RL environment suite called NeMo Gym, supporting commercial use under the NVIDIA Open Model License. The model achieves state-of-the-art results on benchmarks like SWE-Bench and Artificial Analysis Intelligence Index, outperforming **Qwen3-30B A3B**. Ecosystem support is immediate with integrations into inference stacks like **vLLM**, **llama.cpp**, and **Baseten**. Upcoming larger models, Nemotron Super and Ultra, will feature NVFP4 pretraining and LatentMoE routing to optimize compute. This release marks a significant milestone for open-source American AI with comprehensive open assets and advanced hybrid architecture.

not much happened today

Fri, 12 Dec 2025 05:44:39 GMT

**GPT-5.2** shows mixed performance in public evaluations, excelling in agentic tasks but at a significantly higher cost (~**$620/run**) compared to **Opus 4.5** and **GPT-5.1**. It performs variably on reasoning and coding benchmarks, with some improvements on long-context tasks. Extended "reasoning effort" settings notably impact results. Aggregators rank **Gemini 3 Pro** above GPT-5.2 in task persistence. **OpenAI** released sparse activation models sparking debate on sparsity vs MoE architectures. **Allen AI**'s **Olmo 3.1 (32B)** advances open reinforcement learning scale with substantial compute investment (~**125k H100 hours**). **Mistral**'s Devstral-2 and **llama.cpp** improve local inference infrastructure with new features like GGUF support and distributed speedups. **Tinker** platform goes GA with vision input and finetuning support for **Qwen3-VL-235B**.

GPT-5.2 (Instant/Thinking/Pro): 74% on GDPVal, 1.4x cost of GPT 5.1, on 10 Year OpenAI Anniversary

Thu, 11 Dec 2025 05:44:39 GMT

**OpenAI** celebrates its 10 year anniversary with the launch of **GPT-5.2**, featuring significant across-the-board improvements including a rare 40% price increase. GPT-5.2 shows strong performance gains in scientific reasoning, knowledge work, and economic value tasks, achieving over **70.9%** human expert parity on **GDPval** tasks and reaching **90.5%** on ARC-AGI-1 with a large efficiency gain. Despite some mixed results in coding benchmarks and vision capabilities, GPT-5.2 is well received as a major update with extended context and tiered reasoning controls. Pricing is set at **$1.75/M input** and **$14/M output** tokens with a 90% cache discount. The update is live in ChatGPT and API, marking a significant milestone for OpenAI's LLM development.

not much happened today

Wed, 10 Dec 2025 05:44:39 GMT

**NousResearch's Nomos 1** is a 30B open math model achieving a top Putnam score with only ~3B active parameters, enabling consumer Mac inference. **AxiomProver** also posts top Putnam results using ThinkyMachines' RL stack. **Mistral's Devstral 2 Small** outperforms DeepSeek v3.2 in 71% of preferences with better speed and cost. **Anthropic's Claude Code** introduces asynchronous agent execution. **Cursor 2.2** adds deep agent primitives like Debug and Plan Modes. **VS Code** launches unified agent chat sessions improving multi-agent workflows. **LangChain** releases "Polly" for agent observability. The **Stirrup** harness leads OpenAI GDPval benchmarks with Claude Opus 4.5, GPT-5, and Gemini 3 Pro following. Advances in quantization include **vLLM** integrating Intel's AutoRound PTQ for efficient serving. **Unsloth** achieves up to 3× training speedups with new kernels across Llama, Qwen, Mistral, and Gemma models. *"Compositional reasoning + specialized post-training under constrained active params can rival frontier closed models on formal math."*

MCP -> Agentic AI Foundation, Mistral Devstral 2

Tue, 09 Dec 2025 05:44:39 GMT

**OpenAI Engineering** sees a significant collaborative milestone with the launch of the **Agentic AI Foundation** under the Linux Foundation, uniting projects from **Anthropic**, **OpenAI**, and **Block**. **Mistral** released **Devstral 2**, a coding model with **123B parameters** and open weights, offering a cost-effective alternative to **Sonnet 4.3** and competitive performance against **DeepSeek v3.2**. The new **Mistral Vibe CLI** supports agentic coding workflows with rapid ecosystem integration. **Alibaba** introduced **Soft Adaptive Policy Optimization (SAPO)** for reinforcement learning tuning, improving stability and performance in **Qwen3-VL** across multiple tasks. Research highlights include the importance of data decontamination in RL and ongoing discussions on MoE RL stability and reward hacking mitigation.

not much happened today

Mon, 08 Dec 2025 05:44:39 GMT

**Claude Code Skills** gains attention with a published talk and Hugging Face's new "skill" enabling one-line fine-tuning pipelines for models from ~0.5B to 70B parameters, supporting SFT, DPO, and GRPO, costing as low as ~$0.30 for small runs. **Zhipu AI** launches multimodal models **GLM-4.6V** (106B params MoE) and **GLM-4.6V-Flash** (9B dense), featuring 128k context and native multimodal function calling, with free Flash variant and API pricing detailed. **Jina AI** releases **Jina-VLM (2B)**, a compact multilingual VLM excelling in diagrams and documents with top benchmark scores. At **NeurIPS 2025**, research highlights include Google's post-Transformer sequence architectures (Moneta, Yaad, Memora) showing up to 20% gains in long-context retrieval, **AxiomProver**'s autonomous Lean system solving 9/12 Putnam 2025 problems rapidly, and mechanistic interpretability advances discussed by Chris Olah emphasizing scalable tooling.

not much happened today

Fri, 05 Dec 2025 05:44:39 GMT

**vLLM 0.12.0** introduces DeepSeek support, GPU Model Runner V2, and quantization improvements with PyTorch 2.9.0 and CUDA 12.9. **NVIDIA** launches CUDA Tile IR and cuTile Python for advanced GPU tensor operations targeting Blackwell GPUs. **Hugging Face** releases Transformers v5 RC with an any-to-any multimodal pipeline supporting models like **Gemma3n** and **Qwen3-Omni**. Agent platforms see updates from **LangChain** with content moderation and cost tracking, **Together AI** and **Meta AI** collaborate on RL for long-horizon workflows, and **SonarSource** integrates static analysis into AI codegen. Economic insights from **OpenRouter** highlight coding as a key AI application, with reasoning models surpassing 50% usage and market bifurcation between premium and open models. Additionally, **Kling Video 2.6** debuts native audio capabilities, and **Runway Gen-4.5**, **Qwen3-TTS**, and **Gemini 3 Pro** advance multimodality.

OpenRouter's State of AI - An Empirical 100 Trillion Token Study

Thu, 04 Dec 2025 05:44:39 GMT

**OpenRouter** released its first survey showing usage trends with 7 trillion tokens proxied weekly, highlighting a 52% roleplay bias. **Deepseek**'s open model market share has sharply declined due to rising coding model usage. Reasoning model token usage surged from 0% to over 50%. **Grok Code Fast** shows high usage, while **Anthropic** leads in tool calling and coding requests with around 60% share. Input tokens quadrupled and output tokens tripled this year, driven mainly by programming use cases, which dominate spending and volume. Google launched **Gemini 3 Deep Think**, featuring parallel thinking and achieving 45.1% on ARC-AGI-2 benchmarks, and previewed **Titans**, a long-context neural memory architecture scaling beyond 2 million tokens. These advances were shared by **Google DeepMind** and **Google AI** on Twitter.

not much happened today

Wed, 03 Dec 2025 05:44:39 GMT

**OpenAI's Code Red response** and **Anthropic's IPO** are major highlights. In AI video and imaging, **Kling 2.6** introduces native audio co-generation with coherent lip-sync, partnered with platforms like **ElevenLabs** and **OpenArt**. **Runway Gen-4.5** enhances lighting fidelity, while **Google's Gemini 3 Nano Banana Pro** supports advanced image compositing. Open model releases include **DeepSeek V3.2** with sparse attention and cost-effective pricing, and **Mistral's Ministral 3** multimodal family with strong 14B variants. Retrieval and code models from **Alibaba's EvoQwen2.5-VL** and **Nous Research's Hermes 4.3** show competitive performance with permissive licensing and HF availability. The community arena sees additions like INTELLECT-3 (106B MoE). *"coherent looking & sounding output"* and *"auto-lighting to match scene mood"* are noted advancements.

DeepSeek V3.2 & 3.2-Speciale: GPT5-High Open Weights, Context Management, Plans for Compute Scaling

Tue, 02 Dec 2025 05:44:39 GMT

**DeepSeek** launched the **DeepSeek V3.2** family including Standard, Thinking, and Speciale variants with up to **131K context window** and competitive benchmarks against **GPT-5-High**, **Sonnet 4.5**, and **Gemini 3 Pro**. The release features a novel **Large Scale Agentic Task Synthesis Pipeline** focusing on agentic behaviors and improvements in **reinforcement learning** post-training algorithms. The models are available on platforms like **LM Arena** with pricing around **$0.28/$0.42 per million tokens**. Community feedback is mixed, praising the frontier reasoning capabilities but critiquing the chat UI experience. Key figures include **Susan Zhang** and **Teortaxes** who provided commentary on the release.

Mistral 3: Mistral Large 3 + Ministral 3B/8B/14B open weights models

Tue, 02 Dec 2025 05:44:39 GMT

**Mistral** has launched the **Mistral 3 family** including **Ministral 3** models (3B/8B/14B) and **Mistral Large 3**, a sparse MoE model with **675B total parameters** and **256k context window**, all under an Apache 2.0 open license. Early benchmarks rank Mistral Large 3 at **#6 among open models** with strong coding performance. The launch includes broad ecosystem support such as vLLM, llama.cpp, Ollama, and LM Studio integrations. Meanwhile, **Anthropic** acquired the open-source **Bun** runtime to accelerate **Claude Code**, which reportedly reached a **$1B run-rate in ~6 months**. Anthropic also announced discounted **Claude** plans for nonprofits and shared insights on AI's impact on work internally.

not much happened today

Wed, 26 Nov 2025 05:44:39 GMT

**Anthropic** introduces durable agents and MCP tasks for long-running workflows, with practical engineering patterns and integrations like Prefect. **Booking.com** deploys a large-scale agent system improving customer satisfaction using LangGraph, Kubernetes, GPT-4 Mini, and Weaviate. **Perplexity** rolls out user-level memory and virtual try-on features. **Claude Opus 4.5** leads on LisanBench and Code Arena WebDev benchmarks with mixed community feedback on its "thinking" and "non-thinking" modes, while improving cost-efficiency and UX with batch APIs and context compaction. Research on multi-agent systems shows **LatentMAS** reduces communication tokens by 70-84% and improves accuracy using Qwen3 models, and reasoning trace distillation achieves significant token reduction with maintained accuracy, highlighting the importance of reasoning trace style.

Black Forest Labs FLUX.2 [pro|flex|dev|klein]: near-Nano Banana quality but Open Weights

Tue, 25 Nov 2025 05:44:39 GMT

**Black Forest Labs' FLUX.2** release features **Multi-Reference Support** for up to **4 Megapixel** output and up to **10 images** with consistency, including four form factors: Pro, Flex, Dev (32B Open Weight model), and Klein (TBA Open Weights). The new **FLUX.2 - VAE** introduces a variational autoencoder optimizing learnability, quality, and compression. Meanwhile, **Anthropic's Claude Opus 4.5** demonstrates strong performance and efficiency, scoring **70 on Artificial Analysis**, tying with **GPT-5.1 high** and trailing **Gemini 3 Pro (73)**. Opus 4.5 excels in agentic coding benchmarks and research evaluations, with notable token efficiency and reduced running costs. *"Opus 4.5 leads Gemini 3 Pro on SWE-Bench Verified and tops the AICodeKing leaderboard,"* and it shows strong QA and systematic review capabilities. Anthropic also released a dense prompting guide for Opus 4.5.

Claude Opus 4.5: 3rd new SOTA coding model in past week, 1/3 the price of Opus

Mon, 24 Nov 2025 05:44:39 GMT

**Anthropic** launched **Claude Opus 4.5**, a new flagship model excelling in **coding, agents, and tooling** with a significant **3x price cut** compared to Opus 4.1 and improved **token efficiency** using **76% fewer output tokens**. Opus 4.5 achieved a new **SOTA** on **SWE-bench Verified** with **80.9% accuracy**, surpassing previous models like **Gemini 3 Pro** and **GPT-5.1-Codex-Max**. The update includes advanced API features such as **effort control**, **context compaction**, and **programmatic tool calling**, improving tool accuracy and reducing token usage. Claude Code is now bundled with Claude Desktop, and new integrations like Claude for Chrome and Excel are rolling out. Benchmarks show Opus 4.5 breaking the 80% barrier on SWE-bench Verified and strong performance on ARC-AGI-2 and BrowseComp-Plus.

AI Engineer Code Summit

Fri, 21 Nov 2025 05:44:39 GMT

The recent **AIE Code Summit** showcased key developments including **Google DeepMind's Gemini 3 Pro Image model, Nano Banana Pro**, which features enhanced text rendering, 4K visuals, and fine-grained editing capabilities. Community feedback highlights its strong performance in design and visualization tasks, with high user preference scores. Benchmarking updates reveal the new **CritPt physics frontier benchmark** where Gemini 3 Pro outperforms GPT-5, though AI still lags on complex unseen research problems. Agentic task evaluations show varied time horizons and performance gaps between open-weight and closed frontier models, emphasizing ongoing challenges in AI research and deployment. *"Instruction following remains jagged for some users,"* and model fit varies by use case, with Gemini 3 excelling in UI and code tasks but showing regressions in transcription and writing fidelity.

Nano Banana Pro (Gemini Image Pro) solves text-in-images, infographic generation, 2-4k resolution, and Google Search grounding

Thu, 20 Nov 2025 05:44:39 GMT

**Google** launched **Gemini 3 Pro Image (Nano Banana Pro)**, a next-generation AI image generation and editing model with integrated Google Search grounding, multi-image composition, and fine-grained visual controls, offering pricing at $0.134 per 2K image and $0.24 per 4K image. It features improved text rendering with error rates dropping from 56% to 8% compared to its predecessor, and includes SynthID watermark checks for provenance. The model is available via Gemini App, API, LM Arena, Hugging Face Spaces, Together AI, and Flow. Meanwhile, **OpenAI** shared early experiments with **GPT-5** accelerating scientific research, including proofs of previously unsolved problems in math, physics, biology, and materials science. *"GPT-5 accelerated research tasks in math/physics/biology/materials; in 4, it helped find proofs of previously unsolved problems."*

OpenAI fires back: GPT-5.1-Codex-Max (API) and GPT 5.1 Pro (ChatGPT)

Wed, 19 Nov 2025 05:44:39 GMT

**OpenAI** released **GPT-5.1-Codex-Max**, featuring compaction-native training, an "Extra High" reasoning mode, and claims of over 24-hour autonomous operation, showing significant performance gains on benchmarks like METR, CTF, and PaperBench. **Google's Gemini 3 Pro** demonstrates strong coding and reasoning capabilities, achieving new state-of-the-art results on SWE-bench Verified and WeirdML, with estimated model size between 5-10 trillion parameters. The AI coding agent ecosystem is rapidly evolving with integrations and tooling improvements from multiple companies. **Sam Altman** highlighted the significant improvements in GPT-5.1-Codex-Max. The news also covers educational offerings like ChatGPT for Teachers and multi-agent workflows involving Gemini 3, GPT-5.1-Codex-Max, and Claude Sonnet 4.5.

Gemini 3 Pro — new GDM frontier model 6, Gemini 3 Deep Think, and Antigravity IDE

Tue, 18 Nov 2025 05:44:39 GMT

**Google** launched **Gemini 3 Pro**, a state-of-the-art model with a **1M-token context window**, **multimodal reasoning**, and strong agentic capabilities, priced significantly higher than Gemini 2.5. It leads major benchmarks, surpassing **Grok 4.1** and competing closely with **Sonnet 4.5** and **GPT-5.1**, though GPT-5.1 excels in ultralong summarization. Independent evaluations from **Artificial Analysis**, **Vending Bench**, **ARC-AGI 2**, **Box**, and **PelicanBench** validate Gemini 3 as a frontier LLM. Google also introduced **Antigravity**, an agentic IDE powered by Gemini 3 Pro and other models, featuring task orchestration and human-in-the-loop validation. The launch marks Google's strong return to AI with more models expected soon. *"Google is very, very back in the business."*

xAI Grok 4.1: #1 in Text Arena, #1 in EQ-bench, and better Creative Writing

Mon, 17 Nov 2025 05:44:39 GMT

**xAI** launched **Grok 4.1**, achieving a #1 rank on the LM Arena Text Leaderboard with an Elo score of **1483**, showing improvements in creative writing and anti-hallucination. **OpenAI's GPT-5.1 "Thinking"** demonstrates efficiency gains with ~60% less "thinking" on easy queries and strong ARC-AGI performance. **Google DeepMind** released **WeatherNext 2**, an ensemble generative model that is **8× faster** and more accurate for global weather forecasts, integrated into multiple Google products. **Sakana AI** raised **¥20B ($135M)** in Series B funding at a **$2.63B** valuation to focus on efficient AI for resource-constrained enterprise applications in Japan. New evaluations highlight tradeoffs between hallucination and knowledge accuracy across models including **Claude 4.1 Opus** and **Anthropic** models.

not much happened today

Fri, 14 Nov 2025 05:44:39 GMT

**OpenAI** launched **GPT-5.1** featuring "adaptive reasoning" and developer-focused API improvements, including prompt caching and a reasoning_effort toggle for latency/cost tradeoffs. Independent analysis shows a minor intelligence bump with significant gains in agentic coding benchmarks. **Anthropic**'s **Claude** models introduced structured outputs with JSON schema compliance in public beta for Sonnet 4.5 and Opus 4.1, enhancing tooling and code execution workflows. Rumors of an Opus 4.5 release were debunked. **LangChain** released a "Deep Agents" package and context-engineering playbook to optimize agent workflows. The community is eagerly anticipating **Google DeepMind**'s **Gemini 3** model, hinted at in social media and upcoming AIE CODE events. *"Tickets are sold out, but side events and volunteering opportunities are available."*

minor updates to GPT 5.1 and SIMA 2

Thu, 13 Nov 2025 05:44:39 GMT

**OpenAI** released **GPT-5.1** family models including **5.1-Codex** and **5.1-Codex-Mini** with improved steerability, faster responses, and new tools like apply_patch and shell command execution. Pricing remains unchanged from 5.0. Immediate integrations include **GitHub Copilot**, **VS Code**, **Cursor**, and **Perplexity** adopting GPT-5.1 models. **Google DeepMind** announced **SIMA 2**, a **Gemini**-powered agent capable of language instruction following, planning, and self-improvement without human feedback, targeting robotics applications. New research on context engineering and agentic tool use patterns was published, with contributions from **Weaviate** and **LlamaIndex** on database query planning and chart parsing respectively. *"Adaptive reasoning"* and agentic coding improvements are highlighted in GPT-5.1- Instant.

GPT 5.1 in ChatGPT: No evals, but adaptive thinking and instruction following

Wed, 12 Nov 2025 05:44:39 GMT

**OpenAI** launched **GPT-5.1** with improvements in conversational tone, instruction following, and adaptive reasoning. **GPT-5.0** is being sunset in 3 months. ChatGPT introduces new tone toggles for personalization, serving over **800 million users**. **Waymo** rolls out freeway driving for public riders in major California cities, showcasing advances in autonomous driving. **Anthropic**'s Project Fetch explores LLMs as robotics copilots using **Claude**. **Perceptron** releases a new API and Python SDK for multimodal perception-action apps supporting **Isaac-0.1** and **Qwen3VL-235B**. **Code Arena** offers live coding evaluations supporting **Claude**, **GPT-5**, **GLM-4.6**, and **Gemini**. **LangChain** introduces middleware for agent governance with human-in-the-loop controls. **LlamaIndex** releases a structured extraction template for SEC filings using LlamaAgents. **NousResearch** promotes ARC Prize benchmarks for generalized intelligence evaluation.

not much happened today

Tue, 11 Nov 2025 05:44:39 GMT

**GPT-5** leads Sudoku-Bench solving 33% of puzzles but 67% remain unsolved, highlighting challenges in meta-reasoning and spatial logic. New training methods like **GRPO fine-tuning** and "Thought Cloning" show limited success. Research on "looped LLMs" suggests pretrained models benefit from repeated computation for better performance. **Baidu's ERNIE-4.5-VL-28B-A3B-Thinking** offers lightweight multimodal reasoning with Apache 2.0 licensing, outperforming **Gemini-2.5-Pro** and **GPT-5-High** on document tasks. **Databricks ai_parse_document** preview delivers cost-efficient document intelligence outperforming GPT-5 and Claude. **Pathwork AI** uses **LlamaCloud** for underwriting automation. **Gemini File Search API** enables agentic retrieval augmented generation (RAG) with MCP server integration. **Together AI** and **Collinear** launch **TraitMix** for persona-driven agent simulations integrated with **Together Evals**. Reports highlight risks in long-running code agents like **Claude Code** reverting changes, emphasizing guardrails. Community consensus favors multiple code copilots including Claude Code, Codex, and others.

not much happened today

Mon, 10 Nov 2025 05:44:39 GMT

**Moonshot AI's Kimi K2 Thinking** AMA revealed a hybrid attention stack using **KDA + NoPE MLA** outperforming full MLA + RoPE, with the **Muon optimizer** scaling to ~1T parameters and native **INT4** QAT for cost-efficient inference. K2 Thinking ranks highly on **LisanBench** and **LM Arena Text** leaderboards, offering low-cost INT4 serving and strong performance in Math, Coding, and Creative Writing. It supports heavy agentic tool use with up to 300 tool requests per run and recommends using the official API for reliable long-trace inference. **Meta AI** released the **Omnilingual ASR** suite covering 1600+ languages including 500 underserved, plus a 7B wav2vec 2.0 model and ASR corpus. Additionally, the **Gelato-30B-A3B** model for computer grounding in GUI manipulation agents outperforms larger VLMs, targeting immediate agent gains. Qwen's image-edit LoRAs and light-restoration app were also highlighted.

Terminal-Bench 2.0 and Harbor

Fri, 07 Nov 2025 05:44:39 GMT

**Terminal-Bench** has fixed task issues and launched version 2.0 with cloud container support via the **Harbor framework**, gaining recognition from models like **Claude 4.5** and **Kimi K2 Thinking**. **Moonshot AI's Kimi K2 Thinking** is a 1 trillion parameter MoE reasoning model with ~32B active parameters, running natively in **INT4 quantization** and featuring a 256K context window. It leads open-weights benchmarks with an Artificial Analysis Intelligence Index score of **67** and strong agentic performance, running efficiently on consumer Apple silicon and 2× M3 Ultra hardware. The model is broadly available on **Hugging Face**, **Ollama Cloud**, and integrated into frameworks like slime. Serving bottlenecks were traced to network bandwidth rather than GPU limits, highlighting infrastructure considerations for LLM deployment.

Kimi K2 Thinking: 1T-A32B params, SOTA HLE, BrowseComp, TauBench && Soumith leaves Pytorch

Thu, 06 Nov 2025 05:44:39 GMT

**Moonshot AI** launched **Kimi K2 Thinking**, a **1 trillion parameter** mixture-of-experts (MoE) model with **32 billion active experts**, a **256K context window**, and native **INT4 quantization-aware training**. It achieves state-of-the-art results on benchmarks like **HLE (44.9%)**, **BrowseComp (60.2%)**, and agentic tool use with **200-300 sequential tool calls**. The model is deployed with **vLLM** support and OpenAI-compatible APIs, available on platforms like Arena, Baseten, and Yupp. Early user reports note some API instability under launch load. Meanwhile, **Google** announced the **TPU v7 (Ironwood)** with a **10× peak performance improvement** over TPU v5p, aimed at training and agentic inference for models like **Gemini**. **Apple** added support for M5 Neural Accelerators in llama.cpp for inference acceleration.

not much happened today

Wed, 05 Nov 2025 05:44:39 GMT

**Kimi-K2 Reasoner** has been integrated into **vLLM** and will soon be supported by **SGLang**, featuring a massive **1.2 trillion parameter MoE** configuration. **Perplexity AI** released research on cloud-portable trillion-parameter MoE kernels optimized for **AWS EFA**, with potential integration into **vLLM**. **IBM's vLLM** team formalized hybrid dense and sparse expert models, supporting models like **Qwen3-Next**, **Nemotron Nano 2**, and **Granite 4.0**. **Kimi-K2** reportedly scores **77% on GPQA Diamond**, outperforming **GPT-4.5** at 71.4%, though this is unverified. **Anthropic** published a guide on efficient tool-heavy agent systems using MCP patterns, drastically reducing context tokens by ~98.7%. **Graphiti MCP** demonstrated shared memory across apps like **Claude Desktop** and **Cursor** for persistent agent memory. **VS Code** introduced an "Agent sessions" feature to unify agent management, including **Copilot** and **Codex**. **Cursor AI** improved coding accuracy via semantic search and code retrieval embeddings. New evaluation frameworks like **CodeClash** and **LMArena** assess agent and coding model performance in realistic multi-round tasks and occupation-tagged leaderboards.

not much happened today

Tue, 04 Nov 2025 05:44:39 GMT

**Google's Project Suncatcher** prototypes scalable ML compute systems in orbit using solar energy with Trillium-generation TPUs surviving radiation, aiming for prototype satellites by 2027. **China's 50% electricity subsidies** for datacenters may offset chip efficiency gaps, with **Huawei** planning gigawatt-scale SuperPoDs for DeepSeek by 2027. **Epoch** launched an open data center tracking hub, and **Deutsche Telekom** and **NVIDIA** announced a $1.1B Munich facility with 10k GPUs. In agent stacks, **MCP** (Model-Compute-Platform) tools gain traction with implementations like **LitServe**, **Claude Desktop**, and **Reka's MCP server** for VS Code. Anthropic emphasizes efficient code execution with MCP. Context engineering shifts focus from prompt writing to model input prioritization, with reports and tools from **Weaviate**, **Anthropic**, and practitioners highlighting instruction-following rerankers and embedding approaches. DeepMind's **IMO-Bench** math reasoning suite shows **Gemini DeepThink** achieving high scores, with a ProofAutoGrader correlating strongly with human grading. Benchmarks and governance updates include new tasks and eval sharing in lighteval.

not much happened today

Mon, 03 Nov 2025 05:44:39 GMT

**OpenAI** and **AWS** announced a strategic partnership involving a $38B compute deal to deploy hundreds of thousands of NVIDIA GB200 and GB300 chips, while **Microsoft** secured a license to ship NVIDIA GPUs to the UAE with a planned $7.9B datacenter investment. A 3-month NVFP4 kernel optimization competition on Blackwell B200s was launched by **NVIDIA** and GPU_MODE with prizes including DGX Spark and RTX 50XX GPUs. **vLLM** gains traction for local LLM serving, exemplified by PewDiePie's adoption. **Alibaba** previewed the Qwen3-Max-Thinking model hitting 100% on AIME 2025 and HMMT benchmarks, signaling advances in reasoning with tool use. The MIT-licensed MiniMax-M2 230B MoE model topped the Arena WebDev leaderboard, tying with Claude Sonnet 4.5 Thinking 32k. Critiques emerged on OSWorld benchmark stability and task validity. **LlamaIndex**'s LIGHT framework demonstrated significant improvements in long-term memory tasks over raw context and RAG baselines, with gains up to +160.6% in summarization at 10M tokens. **Amazon** introduced Chronos-2, a time-series foundation model for zero-shot forecasting. The MCP ecosystem expanded with new tools like mcp2py OAuth integration and Gemini Docs MCP server, alongside a build sprint by **Anthropic** and **Gradio** offering substantial credits and prizes. *"OSWorld doesn’t really exist—different prompt sets = incomparable scores"* highlights benchmarking challenges.

not much happened today

Fri, 31 Oct 2025 05:44:39 GMT

**Poolside** raised **$1B** at a **$12B valuation**. **Eric Zelikman** raised **$1B** after leaving **Xai**. **Weavy** joined **Figma**. New research highlights **FP16** precision reduces training-inference mismatch in **reinforcement-learning** fine-tuning compared to **BF16**. **Kimi AI** introduced a hybrid **KDA (Kimi Delta Attention)** architecture improving long-context throughput and RL stability, alongside a new **Kimi CLI** for coding with agent protocol support. **OpenAI** previewed Agent Mode in ChatGPT enabling autonomous research and planning during browsing.

not much happened today

Thu, 30 Oct 2025 05:44:39 GMT

**Moonshot AI** released **Kimi Linear (KDA)** with day-0 infrastructure and strong long-context metrics, achieving up to **75% KV cache reduction** and **6x decoding throughput**. **MiniMax M2** pivoted to full attention for multi-hop reasoning, maintaining strong agentic coding performance with **200k context** and **~100 TPS**. **ByteDance**, **Princeton**, and **Mila** introduced **Looped LLMs** showing efficiency gains comparable to larger transformers. **OpenAI**'s **Aardvark (GPT-5)** entered private beta as an agentic security researcher for scalable vulnerability discovery. **Cursor** launched faster cloud coding agents, though transparency concerns arose regarding base-model provenance. **Cognition** released a public beta for a desktop/mobile tool-use agent named Devin. The community discussed advanced attention mechanisms and adaptive compute techniques.

Cursor 2.0 & Composer-1: Fast Models and New Agents UI

Wed, 29 Oct 2025 05:44:39 GMT

**Cursor 2.0** launched with **Composer-1**, an agentic coding model optimized for speed and precision, featuring multi-agent orchestration, built-in browser for testing, and voice-to-code capabilities. **OpenAI** released **gpt-oss-safeguard** models (20B, 120B) for policy-based safety classification, open-weight and fine-tuned from gpt-oss, available on Hugging Face and supported by inference stacks like Ollama and Cerebras. **Goodfire** and **Rakuten** demonstrated sparse autoencoders for PII detection matching **gpt-5-mini** accuracy at significantly lower cost. The Cursor 2.0 update also includes a redesigned interface for managing multiple AI coding agents, marking a major advancement in AI IDEs. *"Fast-not-slowest" tradeoff emphasized by early users for Composer-1, enabling rapid iteration with human-in-the-loop.*

OpenAI completes Microsoft + For-profit restructuring + announces 2028 AI Researcher timeline + Platform / AI cloud product direction + next $1T of compute

Tue, 28 Oct 2025 05:44:39 GMT

**OpenAI** has completed a major recapitalization and restructuring, forming a Public Benefit Corporation with a non-profit Foundation holding special voting rights and equity valued at **$130B**. **Microsoft** holds about **27%** diluted ownership and committed to **$250B** in Azure spend, losing exclusivity on compute but retaining Azure API exclusivity until AGI is declared. The compute infrastructure deals for 2025 total **30GW** worth **$1.4T**, with OpenAI aiming to build **1GW per week** at **$20B per GW**, projecting **$3-4 trillion** infrastructure by 2033. The company is shifting focus from first-party apps to a platform approach, emphasizing ecosystem growth and third-party development. **Sam Altman** and **Sama** are key figures in this transition, with significant financial and strategic implications for AI industry partnerships, including openness to **Anthropic** and **Google Gemini** on Azure.

MiniMax M2 230BA10B — 8% of Claude Sonnet's price, ~2x faster, new SOTA open model

Mon, 27 Oct 2025 05:44:39 GMT

**MiniMax M2**, an open-weight sparse MoE model by **Hailuo AI**, launches with **≈200–230B parameters** and **10B active parameters**, offering strong performance near frontier closed models and ranking #5 overall on the Artificial Analysis Intelligence Index v3.0. It supports coding and agent tasks, is licensed under **MIT**, and is available via API at competitive pricing. The architecture uses **full attention**, **QK-Norm**, **GQA**, partial RoPE, and sigmoid routing, with day-0 support in **vLLM** and deployment on platforms like Hugging Face and Baseten. Despite verbosity and no tech report, it marks a significant win for open models.

not much happened today

Fri, 24 Oct 2025 05:44:39 GMT

**vLLM** announced support for **NVIDIA Nemotron Nano 2**, featuring a hybrid Transformer–Mamba design and tunable "thinking budget" enabling up to 6× faster token generation. **Mistral AI Studio** launched a production platform for agents with deep observability. **Baseten** reported high throughput (650 TPS) for **GPT-OSS 120B** on NVIDIA hardware. **Hugging Face InspectAI** added inference provider integration for cross-provider evaluation. **Thinking Machines Tinker** abstracts distributed fine-tuning for open-weight LLMs like **Qwen3** and **Llama 3**. In China, **MiniMax M2** shows competitive performance with top models and is optimized for agents and coding, while **Zhipu GLM-4.6-Air** focuses on reliability and scaling for coding tasks. Rumors suggest **Gemini 2.5 Flash** may be a >500B parameter MoE model, and a possible **GPT-5.1 mini** reference appeared. Outside LLMs, **Tahoe-x1 (3B)** foundation model achieved SOTA in cancer cell biology benchmarks. Research from Stanford introduces a method to detect model provenance via training-order "palimpsest" with strong statistical guarantees.

not much happened today

Thu, 23 Oct 2025 05:44:39 GMT

**LangSmith** launched the **Insights Agent** with multi-turn evaluation for agent ops and observability, improving failure detection and user intent clustering. **Meta PyTorch** and **Hugging Face** introduced **OpenEnv**, a Gymnasium-style API and hub for reproducible agentic environments supporting distributed training. Discussions highlighted the importance of provider fidelity in agent coding, with **OpenRouter**'s exacto filter improving stability. Builder UX updates include **Google AI Studio**'s Annotation mode for Gemini code changes, **Microsoft**'s Copilot Mode enhancements in Edge, and **OpenAI**'s Shared Projects and Company Knowledge features for ChatGPT Business. **Claude** added project-scoped Memory. In reinforcement learning, **Meta**'s ScaleRL proposes a methodology to predict RL scaling outcomes for LLMs with improved efficiency and stability.

not much happened today

Wed, 22 Oct 2025 05:44:39 GMT

**LangChain & LangGraph 1.0** released with major updates for reliable, controllable agents and unified docs, emphasizing "Agent Engineering." **Meta** introduced **PyTorch Monarch** and **TorchForge** for distributed programming and reinforcement learning, enabling large-scale agentic systems. **Microsoft Learn MCP** server now integrates with tools like **Claude Code** and **VS Code** for instant doc querying, accelerating grounded agent workflows. **vLLM** improved inference correctness with token ID returns and batch-invariant inference, collaborating with **Ray** for orchestration in PyTorch Foundation. **OpenAI** launched **ChatGPT Atlas**, a browser agent with contextual Q&A and advanced safety features, though early users note maturity challenges and caution around credential access.

ChatGPT Atlas: OpenAI's AI Browser

Tue, 21 Oct 2025 05:44:39 GMT

**OpenAI** launched the **Chromium fork AI browser Atlas** for macOS, featuring integrated **Agent mode** and browser memory with local login capabilities, aiming to surpass **Google's Gemini** in Chrome. The launch received mixed reactions regarding reliability and privacy. **LangChain** raised a **$125M Series B** at a $1.25B valuation, releasing **v1.0 agent engineering stack** with significant adoption including **85M+ OSS downloads/month** and usage by ~35% of the Fortune 500. The ecosystem also saw updates like **vLLM's MoE LoRA expert finetuning support**.

DeepSeek-OCR finds vision models can decode 10x more efficiently with ~97% accuracy of text-only, 33/200k pages/day/A100

Mon, 20 Oct 2025 05:44:39 GMT

As **ICCV 2025** begins, **DeepSeek** releases a novel **DeepSeek-OCR** 3B MoE vision-language model that compresses long text as visual context with high accuracy and efficiency, challenging traditional tokenization approaches. The model achieves ~97% decoding precision at <10× compression and processes up to ~33M pages/day on 20 A100-40G nodes, outperforming benchmarks like GOT-OCR2.0. Discussions highlight the potential for unlimited context windows and tokenization-free inputs, with contributions from **@karpathy**, **@teortaxesTex**, and others. In video generation, **google-deepmind**'s **Veo 3.1** leads community benchmarks with advanced precision editing and scene blending, while **Krea** open-sources a 14B autoregressive video model enabling realtime long-form generation at ~11 FPS on a single B200 GPU.

The Karpathy-Dwarkesh Interview delays AGI timelines

Fri, 17 Oct 2025 05:44:39 GMT

The recent AI news highlights the **Karpathy interview** as a major event, alongside significant discussions on reasoning improvements without reinforcement learning, with **test-time sampling** achieving GRPO-level performance. Critiques on context window marketing reveal effective limits near **64K tokens**, with **Claude Haiku 4.5** showing competitive reasoning speed. **GPT-5** struggles with advanced math benchmarks, and data quality issues termed "Brain Rot" affect model reasoning and safety. In agent frameworks, **Anthropic Skills** enable modular coding workflows, **OpenAI Codex IDE** extensions enhance developer productivity, and **HuggingChat Omni** introduces meta-routing across 100+ open models using **Arch-Router-1.5B**. LangChain and LlamaIndex advance graph-first agent infrastructure, while **Google Gemini** integrates with Google Maps for real-world grounding.

Claude Agent Skills - glorified AGENTS.md? or MCP killer?

Thu, 16 Oct 2025 05:44:39 GMT

**Anthropic** achieves a rare feat with back-to-back AI news headlines featuring **Claude's** new **Skills**—a novel way to build specialized agents using Markdown files, scripts, and metadata to handle tasks like creating and reading PDFs, Docs, and PPTs. Simon Willison calls this a "bigger deal than MCP," predicting a "Cambrian explosion in Skills." Meanwhile, **Anthropic** launches **Claude 4.5 Haiku** with strong reasoning and long-context capabilities, priced competitively. Other updates include **OpenAI's** ChatGPT memory management improvements, **Windows 11 Copilot** voice and vision features, and **HuggingChat Omni** routing across 115 open-source models from 15 providers. These developments highlight advances in agent skills, document processing, long-context reasoning, and multi-model routing.

Claude Haiku 4.5

Wed, 15 Oct 2025 05:44:39 GMT

**Anthropic** released **Claude Haiku 4.5**, a model that is over 2x faster and 3x cheaper than **Claude Sonnet 4.5**, improving iteration speed and user experience significantly. Pricing comparisons highlight Haiku 4.5's competitive cost against models like **GPT-5** and **GLM-4.6**. **Google** and **Yale** introduced the open-weight **Cell2Sentence-Scale 27B (Gemma)** model, which generated a novel, experimentally validated cancer hypothesis, with open-sourced weights for community use. Early evaluations show **GPT-5** and **o3** models outperform **GPT-4.1** in agentic reasoning tasks, balancing cost and performance. Agent evaluation challenges and memory-based learning advances were also discussed, with contributions from Shanghai AI Lab and others. *"Haiku 4.5 materially improves iteration speed and UX,"* and *"Cell2Sentence-Scale yielded validated cancer hypothesis"* were key highlights.

not much happened today

Tue, 14 Oct 2025 05:44:39 GMT

**Alibaba** released compact dense **Qwen3-VL** models at 4B and 8B sizes with FP8 options, supporting up to 1M context and open vocabulary detection, rivaling larger models like **Qwen2.5-VL-72B**. Ecosystem support includes **MLX-VLM**, **LM Studio**, **vLLM**, **Kaggle models**, and **Ollama Cloud**. In video AI, **Arena** added **Sora 2** models leading in video benchmarks, with **Higgsfield Enhancer** improving video quality. **Runway** launched domain-specific workflow apps for creative tasks. Research on **Representation Autoencoders for DiTs (RAE-DiT)** shows improved diffusion model performance. On local training, **NVIDIA DGX Spark** enables strong local fine-tuning, while **Nanochat** by **Karpathy** offers a minimal stack for training and inference. **Together AI** introduced **ATLAS**, a speculative decoding method achieving up to 4× faster inference on **DeepSeek-V3.1**. These developments highlight advances in efficient model deployment, video AI, local fine-tuning, and inference speed optimization.

OpenAI Titan XPU: 10GW of self-designed chips with Broadcom

Mon, 13 Oct 2025 05:44:39 GMT

**OpenAI** is finalizing a custom ASIC chip design to deploy **10GW** of inference compute, complementing existing deals with **NVIDIA** (10GW) and **AMD** (6GW). This marks a significant scale-up from OpenAI's current **2GW** compute, aiming for a roadmap of **250GW** total, which is half the energy consumption of the US. Greg from OpenAI highlights the shift of **ChatGPT** from interactive use to always-on ambient agents requiring massive compute, emphasizing the challenge of building chips for billions of users. The in-house ASIC effort was driven by the need for tailored designs after limited success influencing external chip startups. Broadcom's stock surged 10% on the news. Additionally, **InferenceMAX** reports improved ROCm stability and nuanced performance comparisons between AMD MI300X and NVIDIA H100/H200 on **llama-3-70b** FP8 workloads, with RL training infrastructure updates noted.

not much happened today

Fri, 10 Oct 2025 05:44:39 GMT

**FrontierMath Tier 4** results show **GPT-5 Pro** narrowly outperforming **Gemini 2.5 Deep Think** in reasoning accuracy, with concerns about problem leakage clarified by **Epoch AI Research**. **Mila** and **Microsoft** propose **Markovian Thinking** to improve reasoning efficiency, enabling models to reason over 24K tokens with less compute. New research suggests base models inherently contain reasoning mechanisms, with "thinking models" learning to invoke them effectively. In systems, **NVIDIA Blackwell** combined with **vLLM** wins InferenceMAX with significant throughput gains, while **Together AI's ATLAS** adaptive speculative decoding achieves 4× speed improvements and reduces RL training time by over 60%. **SparseServe** introduces dynamic sparse attention with KV tiering, drastically improving throughput and latency in GPU memory management.

Air Street's State of AI 2025 Report

Thu, 09 Oct 2025 05:44:39 GMT

**Reflection** raised **$2B** to build frontier open-weight models with a focus on safety and evaluation, led by a team with backgrounds from **AlphaGo**, **PaLM**, and **Gemini**. **Figure** launched its next-gen humanoid robot, **Figure 03**, emphasizing non-teleoperated capabilities for home and large-scale use. **Radical Numerics** released **RND1**, a **30B-parameter sparse MoE diffusion language model** with open weights and code to advance diffusion LM research. **Zhipu** posted strong results with **GLM-4.6** on the Design Arena benchmark, while **AI21 Labs**' **Jamba Reasoning 3B** leads tiny reasoning models. **Anthropic** introduced a plugin system for **Claude Code** to enhance developer tools and agent stacks. The report also highlights SoftBank's acquisition of ABB's robotics unit for **$5.4B** and the growing ecosystem around open frontier modeling and small-model reasoning.

not much happened today

Wed, 08 Oct 2025 05:44:39 GMT

**Samsung's 7M Tiny Recursive Model (TRM)** achieves superior reasoning on ARC-AGI and Sudoku with fewer layers and MLP replacing self-attention. **LeCun's team** introduces **JEPA-SCORE**, enabling density estimation from encoders without retraining. **AI21 Labs** releases **Jamba Reasoning 3B**, a fast hybrid SSM-Transformer model supporting up to 64K context tokens. **Alibaba's Qwen3 Omni/Omni Realtime** offers a unified audio-video-text model with extensive language and speech support, outperforming Gemini 2.0 Flash on BigBench Audio. **Alibaba** also debuts **Qwen Image Edit 2509**, a top open-weight multi-image editing model. **ColBERT Nano** models demonstrate effective retrieval at micro-scale parameter sizes. In reinforcement learning, **CoreWeave**, **Weights & Biases**, and **OpenPipe** launch serverless RL infrastructure reducing costs and speeding training. **Stanford's AgentFlow** presents an in-the-flow RL system with a 7B backbone outperforming larger models on agentic tasks. This update highlights advances in **recursive reasoning**, **density estimation**, **multimodal architectures**, **long-context modeling**, **retrieval**, and **serverless reinforcement learning**.

Gemini 2.5 Computer Use preview beats Sonnet 4.5 and OAI CUA

Tue, 07 Oct 2025 05:44:39 GMT

**Google DeepMind** released a new **Gemini 2.5 Computer Use model** for browser and Android UI control, evaluated by Browserbase. **OpenAI** showcased **GPT-5 Pro**, new developer tools including **Codex** with Slack integration, and agent-building SDKs at Dev Day. **Google DeepMind's CodeMender** automates security patching for large codebases. **Microsoft** introduced an open-source **Agent Framework** for multi-agent enterprise systems. AI community discussions highlight agent orchestration, program synthesis, and UI control advancements. **GLM-4.6** update from Zhipu features a large Mixture-of-Experts model with 355B parameters.

OpenAI Dev Day: Apps SDK, AgentKit, Codex GA, GPT‑5 Pro and Sora 2 APIs

Mon, 06 Oct 2025 05:44:39 GMT

**OpenAI** showcased major product launches at their DevDay including the **Apps SDK**, **AgentKit**, and **Codex** now generally available with SDK and enterprise features. They introduced new models such as **gpt-5-pro**, **gpt-realtime-mini-2025-10-06**, **gpt-audio-mini-2025-10-06**, **gpt-image-1-mini**, and **sora-2** with a pro variant. The Apps SDK enables embedding interactive apps inside ChatGPT with partners like **Canva**, **Figma**, **Zillow**, and **Coursera**. AgentKit offers a full stack for building and deploying production agents with tools like ChatKit and Guardrails. Codex supports speech and controller-driven coding, credited with high internal shipping velocity. Pricing for GPT-5 Pro was revealed at $15 input and $120 output per million tokens. *"OpenAI turned ChatGPT into an application platform"* and *"AgentKit built a working agent in under 8 minutes"* were highlights.

not much happened today

Fri, 03 Oct 2025 05:44:39 GMT

**Anthropic** announces a new CTO. Frontier coding agents see updates with **Claude Sonnet 4.5** showing strong cybersecurity and polished UX but trailing **GPT-5 Codex** in coding capability. **xAI Grok Code Fast** claims higher edit success at lower cost. **Google's Jules** coding agent launches a programmable API with CI/CD integration. **Qwen** clarifies its model taxonomy and API tiers. Vision/LM Arena rankings show a tight competition among **Claude Sonnet 4.5**, **Claude Opus 4.1**, **Gemini 2.5 Pro**, and OpenAI's latest models. In video generation, **Sora 2 Pro** leads App Store rankings with rapid iteration and a new creator ecosystem; early tests show it answers GPQA-style questions at 55% accuracy versus GPT-5's 72%. Video Arena adds new models like **Luma's Ray 3** and **Kling 2.5** for benchmarking. Multi-modal video+audio generation model **Ovi** (Veo-3-like) is released. Retrieval models include **ModernVBERT** from MIT with efficient image-text retrieval capabilities. *"Claude Sonnet 4.5 is basically the same as Opus 4.1 for coding"* and *"Jules is a programmable team member"* highlight key insights.

not much happened today

Thu, 02 Oct 2025 05:44:39 GMT

**Kling 2.5 Turbo** leads in text-to-video and image-to-video generation with competitive pricing. **OpenAI Sora 2** shows strong instruction-following but has physics inconsistencies. **Google Gemini 2.5 Flash** "Nano Banana" image generation is now generally available with multi-image blending and flexible aspect ratios. **IBM Granite 4.0** introduces a hybrid Mamba/Transformer architecture with large context windows and strong token efficiency, outperforming some peers on the Intelligence Index. **Qwen** models receive updates including fine-tuning API support and improved vision capabilities. **Tinker** offers a flexible fine-tuning API supporting LoRA sharing and CPU-only training loops. The ecosystem also sees updates like **Synthesia 3.0** adding video agents.

Thinking Machines' Tinker: LoRA based LLM fine-tuning API

Wed, 01 Oct 2025 05:44:39 GMT

**Thinking Machines** recently raised **$2 billion** without shipping a product until now, launching their first product **Tinker**, a managed service API for fine-tuning large and mixture-of-experts models like **Qwen-235B-A22B** using **LoRA** for cost-efficient training. The Tinker API offers low-level primitives for post-training methods and is supported by an open-source **Tinker Cookbook** library. Influential AI figures like **Andrej Karpathy** and **Lilian Weng** praised its design for reducing complexity and boosting research productivity. Meanwhile, **OpenAI** launched **Sora 2**, a video+audio model integrated into their consumer social app, sparking viral engagement and concerns over misuse and content moderation. Sam Altman emphasized the product's dual focus on delight and revenue alongside AGI research.

Sora 2: new video+audio model and OpenAI's first Social Network

Tue, 30 Sep 2025 05:44:39 GMT

**Sora 2** released with improvements on physical world video modeling and a new "character consistency" feature allowing real-world element injection from a single video. The model powers a new **Sora social network** app with profiles, DMs, and viral videos, emphasizing user control over likeness use. **OpenAI** employees are actively experimenting with the model. Meanwhile, **Anthropic** launched **Claude 4.5 Sonnet** with enhanced intelligence, token efficiency, and agentic tool use, outperforming some competitors and closely tracking **GPT-5-high** on benchmarks. Ecosystem support includes LangSmith integration and strong coding/math benchmark results.

Anthropic Claude Sonnet 4.5, Claude Code 2.0, new VS Code Extensions

Mon, 29 Sep 2025 05:44:39 GMT

**Anthropic** launched a major update with **Claude Sonnet 4.5**, achieving **77.2% SWE-Bench** verified performance and improvements in finance, law, and STEM. They also released **Claude Code v2** featuring checkpoints, a refreshed terminal, and a native VS Code extension, plus a new mascot **Clawd**. The **Claude API** gained context editing and memory tools, and the **Claude Agent SDK** was introduced. The **Claude.ai** apps now support code execution and file creation, with a **Chrome extension** available for Max users. Additionally, **Imagine with Claude** offers a generative UI research preview. Reception has been positive from developers and third-party evaluators. Meanwhile, **DeepSeek** released **V3.2-Exp** with a new **Sparse Attention** algorithm, significantly reducing long-context costs and cutting API prices by over 50%, while maintaining quality.

not much happened today

Fri, 26 Sep 2025 05:44:39 GMT

**Google** released a dense September update including **Gemini Robotics 1.5** with enhanced spatial/temporal reasoning, **Gemini Live**, **EmbeddingGemma**, and **Veo 3 GA** powering creative workflows. They also introduced agentic features like restaurant-reservation agents and reduced pricing for **Gemini 2.5 Flash**. **Meta AI** unveiled the open-weight **Code World Model (CWM) 32B**, excelling in code semantics and math benchmarks, with innovations in training code models via execution traces. Local-first coding setups highlight **Qwen3-Coder-30B** running efficiently on consumer GPUs, paired with tools like **Cline** and **LM Studio**. Runtime improvements include **vLLM v1** supporting hybrid models and **mlx-lm** adding batch inference on Apple silicon. In infrastructure, **FlashAttention 4** was reverse-engineered revealing a ~20% speedup from architectural optimizations. **Perplexity AI** advances its independent web index and browsing API with upcoming feed refreshes. Embedding latency improvements were achieved by **Superhuman** using **Baseten**.

GDPVal finding: Claude Opus 4.1 within 95% of AGI (human experts in top 44 white collar jobs)

Thu, 25 Sep 2025 05:44:39 GMT

**OpenAI**'s Evals team released **GDPval**, a comprehensive evaluation benchmark covering 1,320 tasks across 44 predominantly digital occupations, assessing AI models against human experts with 14 years average experience. Early results show **Claude 4.1 Opus** outperforming human experts in most categories and **GPT-5 high** trailing behind, with projections that **GPTnext** could match human performance by mid-2026. The benchmark is positioned as a key metric for policymakers and labor impact forecasting. Additionally, **Artificial Analysis** reported improvements in **Gemini 2.5 Flash/Flash-Lite** and **DeepSeek V3.1 Terminus** models, alongside new speech-to-text benchmarks (AA-WER) highlighting leaders like **Google Chirp 2** and **NVIDIA Canary Qwen2.5B**. Agentic AI advances include **Kimi OK Computer**, an OS-like agent with extended tool capabilities and new vendor verification tools.

not much happened today

Wed, 24 Sep 2025 05:44:39 GMT

**Alibaba** unveiled the **Qwen3** model family including **Qwen3-Max** and **Qwen3-VL** with a native 256K context window expandable to 1M, strong OCR in 32 languages, and rapid release velocity (~3.5 releases/month) backed by a $52B infrastructure roadmap. **OpenAI** launched **GPT-5 Codex**, an agent-optimized coding model with up to **400K context** and adaptive reasoning priced at $1.25/$10 per million tokens, integrated into Cline and benchmarked in WebDev arenas. **Meta AI FAIR** released the open-weight **Code World Model (CWM) 32B**, a dense code generation model with strong benchmark scores (e.g., 65.8% SWE-bench Verified, 96.6% Math-500) and public safety reports. Ecosystem updates include GitHub Copilot's new embedding model for faster code search and Anthropic's Claude Sonnet 4 and Opus 4.1 integration into Microsoft 365 Copilot. The vLLM 0.10.2 update introduces Decode Context Parallel (DCP) for improved system performance.

Alibaba Yunqi: 7 models released in 4 days (Qwen3-Max, Qwen3-Omni, Qwen3-VL) and $52B roadmap

Tue, 23 Sep 2025 05:44:39 GMT

**Alibaba's Tongyi Qianwen (Qwen) team** launched major updates including the **1T parameter Qwen3-Max**, **Qwen3-Omni**, and **Qwen3-VL** models, alongside specialized versions like **Qwen3Guard**, **Qwen3-LiveTranslate**, **Qwen3-TTS-Flash**, **Qwen-Image-Edit**, and **Qwen3Coder**. At the **AliCloud Yunqi (Apsara) conference**, CEO **Eddie Wu** outlined a $52B roadmap emphasizing two AI development stages: "intelligence emergence" focusing on learning from humans and reasoning, and "autonomous action" highlighting AI's tool use and real-world task execution. The updates showcase advances in **tool use**, **large-model coding capabilities**, and AI's expanding role across industries such as logistics, manufacturing, biomedicine, and finance. Junyang Lin and Alibaba Wan are key spokespersons for these developments. The Qwen project is now seen as a "frontier lab" for AI innovation.

NVIDIA to invest $100B in OpenAI for 10GW of Vera Rubin rollout

Mon, 22 Sep 2025 05:44:39 GMT

**NVIDIA** and **OpenAI** announced a landmark strategic partnership to deploy at least **10 gigawatts** of AI datacenters using NVIDIA's systems, with NVIDIA investing up to **$100 billion** progressively as each gigawatt is deployed, starting in the second half of 2026 on the Vera Rubin platform. This deal significantly impacts the AI infrastructure funding landscape, potentially supporting OpenAI's $300 billion commitment to Oracle. The announcement caused major stock market reactions, with NVIDIA's market cap surging by $170 billion. Additionally, advancements in deterministic inference for reinforcement learning and FP8 precision gains in GPU performance were highlighted by AI practitioners.

Grok 4 Fast: Xai's distilled, 40% more token efficient, 2m context, 344 tok/s frontier model

Fri, 19 Sep 2025 05:44:39 GMT

**xAI** announced **Grok 4 Fast**, a highly efficient model running at **344 tokens/second**, offering reasoning and nonreasoning modes and free trials on major platforms. **Meta** showcased its neural band and Ray-Ban Display with a live demo that experienced hiccups but sparked discussion on live hardware demos and integration challenges. **Meta** is also developing a first-party "Horizon Engine" for AI rendering and released Quest-native Gaussian Splatting capture tech. New model releases include **Mistral's Magistral 1.2**, a compact multimodal vision-language model with improved benchmarks and local deployment; **Moondream 3**, a 9B-parameter MoE VLM focused on efficient visual reasoning; **IBM's Granite-Docling-258M**, a document VLM for layout-faithful PDF to HTML/Markdown conversion; and **ByteDance's SAIL-VL2**, a vision-language foundation model excelling at multimodal understanding and reasoning at 2B and 8B parameter scales.

Softbank, NVIDIA and US Govt take 2%, 5% and 10% of Intel, will develop Intel x86 RTX SOCs for consumer & datacenters

Thu, 18 Sep 2025 05:44:39 GMT

**Nvidia and Intel** announced a joint development partnership for multiple new generations of x86 products, marking a significant shift in the tech industry. This collaboration has been in the works for a year and impacts both consumer and data center markets, boosting hopes for Intel's Foundry business. On the AI hardware front, **Meta** showcased its neural band and Ray-Ban Display with a live demo that experienced hiccups but sparked discussion on live tech demos. Meta is also moving from Unity to its own Horizon Engine for AI rendering, including Gaussian splatting capture technology. In AI models, **Mistral** released Magistral 1.2, a compact multimodal vision-language model with improved benchmarks and local deployment capabilities, while **Moondream 3** previewed a 9B-parameter, 2B-active MoE VLM focused on efficient visual reasoning.

not much happened today

Wed, 17 Sep 2025 05:44:39 GMT

**Anthropic** published an in-depth postmortem on their August-September reliability issues. **OpenAI**'s GPTeam achieved a perfect 12/12 score at the **ICPC 2025** World Finals, showcasing rapid progress in general-purpose reasoning and introducing controllable "thinking time" tiers for **gpt-5** in ChatGPT. **Google DeepMind**'s **gemini-2.5-deep-think** earned a gold medal level at ICPC, solving 10/12 problems with advances in parallel thoughts, multi-step reasoning, and novel reinforcement learning techniques. OpenAI and Apollo Evaluations detected "scheming" behaviors in frontier models, emphasizing the need for chain-of-thought transparency and launching a $500K Kaggle challenge. GitHub launched an MCP server registry integrated with VS Code Insiders, with additional support from JetBrains and Hugging Face for open LLMs in Copilot Chat. Weaviate released a native Query Agent translating natural language to database operations with citations.

not much happened today

Tue, 16 Sep 2025 05:44:39 GMT

**GPT-5 Codex** rollout shows strong agentic coding capabilities with some token bloat issues. IDEs like **VS Code Insiders** and **Cursor 1.6** enhance context windows and model integration. **vLLM 0.10.2** supports aarch64 and NVIDIA GB200 with performance improvements. **AMD ROCm** updates add modern attention, sparse MoE, and distributed inference. **TRL** introduces Context Parallelism for long-context training. Robotics and RL data pipelines improve with **Unsloth** and **LeRobotDataset v3**. **Qwen3-Next-80B** runs efficiently on Mac M4 Max with MLX. **Tencent's HunyuanImage 2.1** is a 17B bilingual text-to-image model with 2048×2048 resolution and restricted open weights.

GPT-5 Codex launch and OpenAI's quiet rise in Agentic Coding

Mon, 15 Sep 2025 05:44:39 GMT

**OpenAI** released **GPT-5-Codex**, an agentic coding model optimized for long-running software engineering tasks with dynamic task-adaptive thinking, multi-hour autonomy, and improved code quality. It achieves 51% accuracy on an unreleased large refactor benchmark and integrates deeply with developer tools like Xcode. Meanwhile, **Alibaba** launched **Qwen3-Next-80B**, a hybrid MoE model with native long-context support (262k tokens, extensible to 1M+), targeting efficient reasoning and repository-scale code analysis, supported by **Together AI** and **NVIDIA** with CUDA-accelerated attention. The trend towards hybrid SSM + MoE architectures is noted, emphasizing efficiency and scaling in China and US training regimes. Community discussions highlight the importance of variable compute and routing for inference efficiency and quality.

not much happened today

Sat, 13 Sep 2025 05:44:39 GMT

**Meta** released **MobileLLM-R1**, a sub-1B parameter reasoning model family on Hugging Face with strong small-model math accuracy, trained on 4.2T tokens. **Alibaba** introduced **Qwen3-Next-80B-A3B** with hybrid attention, 256k context window, and improved long-horizon memory, priced competitively on Alibaba Cloud. **Meta AI FAIR** fixed a benchmark bug in SWE-Bench affecting agent evaluation. LiveMCP-101 benchmark shows frontier models like **GPT-5** underperform on complex tasks with common failure modes cataloged. OpenAI highlights hallucination issues due to benchmark incentives, proposing calibration improvements. Community demos and tooling updates continue to evolve.

Qwen3-Next-80B-A3B-Base: Towards Ultimate Training & Inference Efficiency

Thu, 11 Sep 2025 05:44:39 GMT

**MoE (Mixture of Experts) models** have become essential in frontier AI models, with **Qwen3-Next** pushing sparsity further by activating only **3.7% of parameters** (3B out of 80B) using a hybrid architecture combining **Gated DeltaNet** and **Gated Attention**. This new design includes **512 total experts** (10 routed + 1 shared), **Zero-Centered RMSNorm** for stability, and improved MoE router initialization, resulting in **~10× cheaper training and 10× faster inference** compared to previous models. **Alibaba's Qwen3-Next** reportedly outperforms **Gemini-2.5-Flash-Thinking** and approaches the flagship 235B model's performance, with deployments on **Hugging Face**, **Baseten**, and native **vLLM** support for efficient inference.

Oracle jumps +36% in a day after winning $300B OpenAI contract

Wed, 10 Sep 2025 05:44:39 GMT

**Oracle's OCI division** reported a stunning **+359% revenue bookings growth to $455B** with cloud revenue guidance of **$144B by 2030**, driven significantly by a large deal with **OpenAI** amid tensions with **Microsoft**. On AI infrastructure, **Moonshot AI** released **Kimi’s checkpoint-engine**, enabling rapid weight updates on 1T-parameter models across thousands of GPUs, integrating with **vLLM**. **RLFactory** introduced a plug-and-play reinforcement learning framework for tool-using agents, showing smaller models outperforming larger ones. **TRL v0.23** added context parallelism for long-context training. **Thinking Machines Lab** published research on deterministic inference pipelines, making **vLLM** deterministic for **Qwen** models. **Meta** launched **BackendBench**, a PyTorch benchmarking tool.

not much happened today

Tue, 09 Sep 2025 05:44:39 GMT

**Cognition** raised **$400M** at a **$10.2B** valuation to advance AI coding agents, with **swyx** joining to support the "Decade of Agents" thesis. **Vercel** launched an OSS "vibe coding platform" using a tuned **GPT-5** agent loop. **Claude Code** emphasizes minimalism in agent loops for reliability. **Kimi K2-0905** achieved 94% on coding evals and improved agentic capabilities with doubled context length. **Alibaba** released **Qwen3-ASR**, a multilingual transcription model with <8% WER. **Meta** introduced Set Block Decoding for 3-5× faster decoding without architectural changes. Innovations in KV cache compression and quantization include **AutoRound**, **QuTLASS v0.1.0**, and **AlgoPerf v0.6**. **Google's Veo 3** video generation API went GA with significant price cuts and vertical video support.

Cognition's $10b Series C; Smol AI updates

Mon, 08 Sep 2025 05:44:39 GMT

**Cognition** raised **$400M** at a **$10.2B** valuation to advance AI coding agents, with **swyx** joining the company. **Vercel** launched an OSS coding platform using a tuned **GPT-5** agent loop. The **Kimi K2-0905** model achieved top coding eval scores and improved agentic capabilities with doubled context length. **Alibaba** released **Qwen3-ASR**, a multilingual transcription model with robust noise handling. **Meta** introduced Set Block Decoding for 3-5× faster decoding without architectural changes. Innovations in KV cache compression and quantization were highlighted, including **AutoRound** in SGLang and **QuTLASS v0.1.0** for Blackwell GPUs. Algorithmic benchmarking tools like **AlgoPerf v0.6** were updated for efficiency.

Kimi K2‑0905 and Qwen3‑Max preview: two 1T open weights models launched

Fri, 05 Sep 2025 05:44:39 GMT

**Moonshot AI** updated their **Kimi K2-0905** open model with doubled context length to **256k tokens**, improved coding and tool-calling, and integration with agent scaffolds. **Alibaba** released **Qwen 3 Max**, a **1 trillion parameter** model with agent-oriented behavior, available via **Qwen Chat**, **Alibaba Cloud API**, and **OpenRouter**. The community highlights China's dominance in open models and debates around meaningful evaluation methods for code agents, emphasizing long-horizon and domain-specific evals. Influential voices like **@swyx** and **@karpathy** discuss the importance of practical evals and discriminator models for ranking outputs.

not much happened today

Thu, 04 Sep 2025 05:44:39 GMT

**Google DeepMind** released **EmbeddingGemma (308M)**, a small multilingual embedding model optimized for on-device retrieval-augmented generation and semantic search, supporting over 100 languages and running efficiently with quantization and EdgeTPU latency under 15ms. **Jina AI** introduced new code-focused embedding models (0.5B/1.5B) with GGUF quantization, achieving state-of-the-art retrieval across multiple languages and tasks. **LightOn** demonstrated large-scale retrieval training without distillation using contrastive training on billions of passages. **Hugging Face** released the **FineVision** dataset with 17.3M images and 9.5B answer tokens for vision-language model training, showing significant benchmark improvements. The **MiniCPM-V 4.5 (8B)** multimodal model reported surpassing **GPT-4o** and **Gemini-2.0 Pro** on OpenCompass benchmarks with innovative video token compression. Microsoft’s **VibeVoice TTS** and Stanford’s Mixture-of-Contexts video generation also featured. Additionally, a Stanford study benchmarked optimizers like Muon, Soap, Mars, and Sophia, finding diminishing speedups over AdamW at larger scales but advantages at smaller scales. The new ChatGPT branching feature was noted for its simplicity and popularity. *"Everyone's a decacorn now."*

not much happened today

Wed, 03 Sep 2025 05:44:39 GMT

**Exa** raised a **$700m Series B**, **OpenPipe** was acquired by **Coreweave**, and **Statsig** and **Alex** were acquired by **OpenAI**. The **Agent/Client Protocol (ACP)** was introduced by the **Zed** team to standardize IDE-agent interoperability, supporting **Claude Code** and **Gemini** CLIs. **LangChain 1.0 alpha** unifies content blocks for reasoning and multimodal data. The **OSWorld Verified leaderboard** promotes reproducible evaluation of computer-use agents including **OpenAI** and **Anthropic** models. FAIR revealed coding agent cheating on **SWE-Bench Verified**. **PR Arena** hosts live coding agent competitions. Benchmarks like **GSO** and **Holistic Agent Leaderboard** test software optimization and web browsing tasks, with **Qwen3-Coder** and **Gemini 2.5 Flash** showing strong performance. Advances in reinforcement learning for tool use include **SimpleTIR** improving multi-turn tool use success rates and **UI-TARS-2** advancing GUI agents. The **DARLING** optimizer improves quality and diversity in reasoning and instruction following, while **DEPO** achieves data-efficient RLVR with significant speedups.

Anthropic raises $13B at $183B Series F

Tue, 02 Sep 2025 05:44:39 GMT

**Anthropic** achieved a **$183B post-money valuation** in Series F funding by September 2025, growing from about $1B run-rate in January to over **$5B run-rate** by August 2025. Their **Claude Code** product saw **>10x usage growth** in three months and reached **$500M run-rate revenue**, serving over **300,000 business customers** with a nearly **7x increase in large accounts**. **Mistral AI** launched **Le Chat** with 20+ MCP connectors integrating with major SaaS platforms and persistent memory features. Benchmarking updates highlight **GPT-5** leading agent intelligence indices, with strong performances from **xAI's Grok** and **Anthropic's Claude** families. Reliability tooling and agent evaluation advances were shared by **Galileo**, **OpenPipe**, and others. **Zhipu/THUDM** open-sourced **Slime v0.1.0**, enhancing RL infrastructure behind **GLM-4.5** with significant decoding speed improvements and advanced tensor offload techniques.

not much happened today

Mon, 01 Sep 2025 05:44:39 GMT

**OpenAI** integrates **GPT-5** into Xcode 26 with improved coding latency, though some UX trade-offs are noted. **xAI's Grok Code Fast 1** gains momentum, surpassing **Claude Sonnet** in usage and praised for fast debugging. **Zhipu's GLM-4.5** offers a cost-effective coding plan with strong performance against Claude Sonnet 4. **Meituan** releases the **LongCat-Flash-Chat**, a 560B parameter MoE model with adaptive compute and detailed technical insights. Apple debuts on-device vision-language models **FastVLM** and **MobileCLIP2** alongside **InternVL3.5**.

not much happened today

Fri, 29 Aug 2025 05:44:39 GMT

**Apple** released three real-time vision-language models (**FastVLM**, **MobileCLIP2**) on Hugging Face with significant speed and size improvements, supporting WebGPU and Core ML. Their MLX framework now supports **MXFP4** format, competing with **NVFP4** for FP4 quantization. **xAI** launched **grok-code-fast-1**, outperforming Claude for code edits, while **OpenAI** integrated **GPT-5** into Xcode 26 and released a new **Responses API** on **Groq** hardware. CLI-first agent workflows advanced with tools like **SemTools**, **MLX** local runner for Apple Silicon, and **llama.vim** recommending **Qwen 3 Coder 30B A3B**. Retrieval research highlights limitations of single-vector embeddings, promoting ColBERT-style late interaction.

OpenAI Realtime API GA and new `gpt-realtime` model, 20% cheaper than 4o

Thu, 28 Aug 2025 08:44:39 GMT

**OpenAI** launched the **gpt-realtime** model and **Realtime API** to GA, featuring advanced speech-to-speech capabilities, new voices (**Cedar**, **Marin**), image input, SIP telephony, and a ~20% price cut. Benchmarks show improvements over **gpt-4o-realtime** on BigBench and ComplexFuncBench. **xAI** introduced **Grok Code Fast 1**, a speed-optimized coding model integrated with popular IDEs, while **OpenAI Codex** received major upgrades for local and cloud development workflows. Google’s **Gemini CLI** improved multi-editor support, and new models like **Microsoft MAI-1-preview** and **MAI-Voice-1** were announced. *"The new all-in-one WebRTC API removes the ephemeral token step and supports video on the same connection,"* highlighting enhanced developer tooling.

OpenAI updates Codex, VSCode Extension that can sync tasks with Codex Cloud

Wed, 27 Aug 2025 05:44:39 GMT

**OpenAI Codex** has launched a new IDE Extension integrating with VS Code and Cursor, enabling seamless local and cloud task handoff, sign-in via ChatGPT plans, upgraded CLI, and GitHub code review automation. Facebook AI researchers introduced **StepWiser**, a process-level reward model improving reasoning and training by chunk-by-chunk evaluation, achieving SOTA on ProcessBench. **Google DeepMind's Gemini 2.5 Flash Image** model showcases advanced spatial reasoning, multi-image fusion, and developer tools including a browser extension for image remixing. NVIDIA revealed efficiency data on **Nemotron-CC-Math (133B)** and **Jet-Nemotron** models.

nano-banana is Gemini‑2.5‑Flash‑Image, beating Flux Kontext by 170 Elo with SOTA Consistency, Editing, and Multi-Image Fusion

Tue, 26 Aug 2025 05:44:39 GMT

**Google DeepMind** revealed **Gemini-2.5-Flash-Image-Preview**, a state-of-the-art image editing model excelling in **character consistency**, **natural-language edits**, and **multi-image composition**, dominating the Image Edit Arena with a ~170-180 Elo lead and over 2.5M votes. It is integrated into multiple platforms including Google AI Studio and third-party services. **Nous Research** released **Hermes 4**, an open-weight hybrid reasoning model focused on steerability and STEM benchmarks. **NVIDIA** launched **Nemotron Nano 9B V2**, a hybrid Mamba-Transformer with 128k context, top-performing under 10B parameters, and released a 6.6T-token pretraining subset. **InternVL3.5** introduced 32 vision-language models based on OpenAI's gpt-oss and Qwen3 backbones. **Ollama v0.11.7** added DeepSeek v3.1 support with hybrid thinking and Turbo mode preview.

not much happened today

Mon, 25 Aug 2025 05:44:39 GMT

**xAI** released open weights for **Grok-2** and **Grok-2.5** with a novel MoE residual architecture and μP scaling, sparking community excitement and licensing concerns. **Microsoft** open-sourced **VibeVoice-1.5B**, a multi-speaker long-form TTS model with streaming support and a 7B variant forthcoming. **Motif Technology** published a detailed report on **Motif-2.6B**, highlighting Differential Attention, PolyNorm, and extensive finetuning, trained on AMD MI250 GPUs. In coding tools, momentum builds around **GPT-5**-backed workflows, with developers favoring it over Claude Code. **Alibaba** released **Qwen-Code v0.0.8** with deep VS Code integration and MCP CLI enhancements. The MCP ecosystem advances with LiveMCP-101 stress tests, the universal MCP server "Rube," and LangGraph Platform's rollout of revision queueing and ART integration for RL training of agents.

not much happened today

Fri, 22 Aug 2025 05:44:39 GMT

**DeepMind** released **Genie 3**, an interactive multimodal world simulator with advanced spatial memory and real-time avatar control, and **SIMA**, an embodied training agent operating inside generated worlds. **Alibaba** introduced **Qwen-Image-Edit**, an open-weights image editor scoring **ELO 1098 (#2)** in the Image Editing Arena, running on Qualcomm NPUs, alongside **Qwen-VL-Max** entering the Vision top-20. Video models like **Kling 2.1** showed a **235% improvement** in frame control, with new entrants **Luma Ray 2** and **Runway Gen-4 Turbo** debuting. **Google** provided free **Veo 3** generations in Gemini App and enhanced Google Photos with natural-language edits. **DeepSeek v3.1** launched with focus on SWE and Search agents, supporting local inference on Apple Silicon with 4-bit quantization achieving ~**21 tok/s** on M3 Ultra. The news highlights advances in interactive simulation, vision editing, video synthesis, and scalable local AI inference.

Cohere Command A Reasoning beats GPT-OSS-120B and DeepSeek R1 0528

Thu, 21 Aug 2025 05:44:39 GMT

**Cohere's Command A Reasoning** model outperforms GPT-OSS in open deep research capabilities, emphasizing agentic use cases for 2025. **DeepSeek-V3.1** introduces a hybrid reasoning architecture toggling between reasoning and non-reasoning modes, optimized for agentic workflows and coding, with extensive long-context pretraining (~630B tokens for 32k context, ~209B for 128k), FP8 training, and a large MoE expert count (~37B). Benchmarks show competitive performance with notable improvements in SWE-Bench and other reasoning tasks. The model supports a $0.56/M input and $1.68/M output pricing on the DeepSeek API and enjoys rapid ecosystem integration including HF weights, INT4 quantization by Intel, and vLLM reasoning toggles. Community feedback highlights the hybrid design's pragmatic approach to agent and software engineering workflows, though some note the lack of tool use in reasoning mode.

DeepSeek V3.1: 840B token continued pretrain, beating Claude 4 Sonnet at 11% of its cost

Wed, 20 Aug 2025 05:44:39 GMT

**DeepSeek** released **DeepSeek V3.1**, a quietly rolled out open model with an **128K context window** and improvements in **token efficiency**, coding, and agentic benchmarks. **ByteDance** launched the permissive **Seed-OSS 36B** model on Hugging Face, noted for long-context and reasoning capabilities. **Zhipu AI** introduced **ComputerRL**, a reinforcement learning framework for computer-use agents, achieving strong benchmark results. In developer tooling, **GitHub Copilot** expanded globally, **Microsoft VS Code** integrated **Gemini 2.5 Pro** and updated **GPT-5** agent prompts, and **Anthropic** launched **Claude Code** seats with spend controls. Open-source fine-tuning advances include **Together AI** adding SFT for **gpt-oss-120B/20B** and **Baseten** enabling multinode 120B training with Truss CLI. The community noted mixed performance and ongoing post-training adjustments for DeepSeek V3.1.

Databricks' $100B Series K

Tue, 19 Aug 2025 05:44:39 GMT

**Databricks** reached a **$100 billion valuation**, becoming a centicorn with new Data ([Lakebase](https://www.databricks.com/product/lakebase)) and AI ([Agent Bricks](https://docs.databricks.com/aws/en/generative-ai/agent-bricks/)) products. **OpenAI** launched **ChatGPT Go** in India at ₹399/month (~$4.55), offering significantly increased usage limits and UPI payment support, with plans for global expansion. The **DeepSeek V3.1 Base/Instruct** models were quietly released on Hugging Face, showing strong coding benchmark performance and adopting an Anthropic-style hybrid system. The **Qwen-Image-Edit** model from **Alibaba** is gaining traction with integrations and community pruning experiments. *"DeepSeek V3.1 Base outperforms Claude 4 Opus on coding benchmarks"* and *"ChatGPT Go offers 10x higher message limits and 2x longer memory"* highlight key advancements.

not much happened today

Mon, 18 Aug 2025 05:44:39 GMT

**Gemma 3 270M**, an ultra-small model optimized for edge and mobile use, was released and is gaining adoption. **NVIDIA** launched two open multilingual ASR models, **Canary 1B** and **Parakeet-TDT 0.6B**, trained on 1 million hours of data with CC-BY licensing, plus the efficient **Nemotron-Nano v2 9B** model with significant speedups. **Alibaba's Qwen-Image-Edit** offers bilingual text editing and semantic image transformations. **Tencent Hunyuan** introduced a controllable game-world video generator trained on over 1 million gameplay recordings. **Meta's DINOv3** presents a scalable self-supervised vision backbone with strong domain transfer capabilities. **IBM** quietly released efficient English embedding models under a commercial-friendly license. The **BeyondWeb** synthetic data paper shows significant training speed and performance gains over prior datasets. Analysis of **HRM** architecture suggests performance improvements largely stem from data augmentation and scaffolding rather than novel architecture. *"Models and datasets are openly licensed and available on Hugging Face."*

not much happened today

Fri, 15 Aug 2025 05:44:39 GMT

**OpenAI** rolled out **GPT-5** as the default in ChatGPT with new modes and a "warmer" personality, plus expanded message limits for Plus/Team users and Enterprise/Edu access. Performance rankings show **gpt-5-high** leading, with smaller variants also ranked, though critiques note some underperformance versus Chinese models and sensitivity to sycophancy. OpenAI enhanced developer tools with a "Quick eval" feature, coding tips, and an improved Playground. **Google** released **Imagen 4** generally available with faster generation and higher resolution, plus the ultra-small **Gemma 3 270M** model with a large vocabulary and ecosystem support. Podcasts featured OpenAI leaders discussing GPT-5 systems, routing, and efficiency.

Western Open Models get Funding: Cohere $500m @ 6.8B, AI2 gets $152m NSF+NVIDIA grants

Thu, 14 Aug 2025 05:44:39 GMT

**OpenAI's GPT-5** achieved a speedrun of Pokemon Red 3x faster than **o3**. **Perplexity** raised **$200M** at a **$20B valuation**. **AI2** secured **$75M NSF grants** and **$77M from NVIDIA** for AI infrastructure projects like Olmo and Molmo. **Cohere** raised **$500M** and hired **Joelle Pineau** from **meta-ai-fair**, boosting models like Command A. **Google** released the **Gemma 3 270M** on-device tiny LLM with INT4 QAT checkpoints and large embedding tables, and made **Imagen 4** generally available with a fast version at $0.02/image. **Meta-ai-fair** introduced **DINOv3**, a family of self-supervised vision foundation models with high-resolution dense features and strong performance on benchmarks like COCO detection and ADE20K segmentation, under a permissive license. A **$150,000 MiniMax AI Agent Challenge** is ongoing with 200+ prizes, encouraging AI project builds by August 25.

not much happened today

Wed, 13 Aug 2025 05:44:39 GMT

**OpenAI** continues small updates to **GPT-5**, introducing "Auto/Fast/Thinking" modes with **196k token context**, **3,000 messages/week**, and dynamic routing to cheaper models for cost efficiency. The **MiniMax AI Agent Challenge** offers **$150,000** in prizes for AI agent development by August 25. The community discusses **GPT-OSS-120B** base model extraction, hosting, and tooling improvements, including multi-tool pipelines and flex-attention. **Anthropic** announces model pairing in **Claude Code** with **Opus 4.1** for planning and **Sonnet 4** for execution, expanding context to **1M tokens** and introducing prompt caching. Key figures include *@sama*, *@jeremyphoward*, *@jxmnop*, and *@_catwu*.

not much happened today

Tue, 12 Aug 2025 05:44:39 GMT

**OpenAI** released the **GPT-5** series including **GPT-5-mini** and **GPT-5-nano**, with mixed user feedback on performance and API behavior. **Anthropic** extended **Claude Sonnet 4** context window to **1 million tokens**, a 5x increase, enhancing large document processing. **Zhipu AI** launched the open-source multimodal **GLM-4.5V** model with improvements in RL scaling and agentic tasks. **Google DeepMind** showcased the video generation model **Genie 3** and updated the **Gemini App** with new features like **Deep Think** and **Gemini Live**. **Alibaba Qwen** released the distilled image model **Qwen-Image distilled** and enhanced their Deep Research capabilities. Open source models like **Skywork's Matrix-Game 2.0** and **Jan.ai's Jan-v1** (built on **Qwen3-4B-Thinking**) were introduced, focusing on real-time world modeling and web search respectively. Developer tools such as **Claude Code** and **Cursor** were also highlighted.

OpenAI's IMO Gold model also wins IOI Gold

Mon, 11 Aug 2025 05:44:39 GMT

**OpenAI** announced placing **#6 among human coders** at the IOI, reflecting rapid progress in competitive coding AI over the past two years. The **GPT-5** launch faced significant user backlash over restrictive usage limits and removal of model selection control, leading to a reversal and increased limits to **3000 requests per week** for Plus users. Confusion around **GPT-5** naming and benchmarking was highlighted, with critiques on methodological issues comparing models like **Claude** and **Gemini**. Performance reviews of **GPT-5** are mixed, with claims of near-zero hallucinations by **OpenAI** staff but user reports of confidence in hallucinations and steering difficulties. Benchmarks show **GPT-5 mini** performing well on document understanding, while the full **GPT-5** is seen as expensive and middling. On the Chatbot Arena, **Gemini 2.5 Pro** holds a **67%** winrate against **GPT-5 Thinking**. Prompting and model behavior remain key discussion points.

not much happened today

Fri, 08 Aug 2025 05:44:39 GMT

**OpenAI** launched **GPT-5** with a unified user experience removing manual model selection, causing initial routing and access issues for Plus users that are being addressed with fixes including restored model options and increased usage limits. **GPT-5** introduces "Priority Processing" for lower latency at higher price tiers, achieving ~750ms median time-to-first-token in some cases. Microsoft reports full Copilot adoption of **GPT-5**, and API traffic doubled within 24 hours, peaking at 2 billion tokens per minute. Early benchmarks show **GPT-5** leading in reasoning tasks like FrontierMath and LiveBench, with improvements in hallucination control and creative writing, though some models like Grok-4 and Claude-4 Sonnet Thinking outperform it in specific RL-heavy reasoning benchmarks. OpenAI also released extensive migration and feature guides but faced some rollout issues including a broken code sample and a problematic Voice Mode launch. *"Unified GPT-5" ends model pickers, pushing developers away from manual model selection.*

OpenAI rolls out GPT-5 and GPT-5 Thinking to >1B users worldwide; -mini and -nano help claim Pareto Frontier

Thu, 07 Aug 2025 05:44:39 GMT

**OpenAI** launched **GPT-5**, a unified system featuring a fast main model and a deeper thinking model with a real-time router, supporting up to **400K context length** and aggressive pricing that reclaims the Pareto Frontier of Intelligence. The rollout includes variants like **gpt-5-mini** and **gpt-5-nano** with significant cost reductions, and integrations with products such as **ChatGPT**, **Cursor AI**, **JetBrains AI Assistant**, **Microsoft Copilot**, **Notion AI**, and **Perplexity AI**. Benchmarks show GPT-5 performing strongly in coding and long-context reasoning, roughly matching **Claude 4.1 Sonnet/Opus** on SWE-bench Verified. The launch was accompanied by a GPT-5 prompting cookbook and notable community discussions on pricing and performance.

not much happened today

Wed, 06 Aug 2025 05:44:39 GMT

**OpenAI** released its first open models since GPT-2, **gpt-oss-120b** and **gpt-oss-20b**, which quickly trended on **Hugging Face**. **Microsoft** supports these models via **Azure AI Foundry** and **Windows Foundry Local**. Key architectural innovations include **sliding window attention**, **mixture of experts (MoE)**, a **RoPE variant**, and a **256k context length**. The models use a new **MXFP4** format supported by **llama.cpp**. Hypotheses suggest **gpt-oss** was trained on **synthetic data** to enhance safety and performance, supporting the **Reasoning Core Hypothesis**. **OpenAI** announced a **$500K bounty** for red teaming with partners including **Anthropic**, **Google**, and the **UK AISI**. Performance critiques highlight inconsistent benchmarking results, with **GPT-OSS-120B** scoring **41.8%** on the **Aider Polyglot** coding benchmark, trailing competitors like **Kimi-K2** and **DeepSeek-R1**. Some users note the model excels in math and reasoning but lacks common sense and practical utility.

OpenAI's gpt-oss 20B and 120B, Claude Opus 4.1, DeepMind Genie 3

Tue, 05 Aug 2025 05:44:39 GMT

**OpenAI** released the **gpt-oss** family, including **gpt-oss-120b** and **gpt-oss-20b**, their first open-weight models since GPT-2, designed for agentic tasks and licensed under **Apache 2.0**. These models use a **Mixture-of-Experts (MoE)** architecture with wide vs. deep design and innovative features like bias units in attention and a unique swiglu variant. The **120B** model was trained with about **2.1 million H100 GPU hours**. Meanwhile, **Anthropic** launched **claude-4.1-opus**, touted as the best coding model currently. **DeepMind** showcased **genie-3**, a realtime world simulation model with minute-long consistency. The releases highlight advances in open-weight models, reasoning capabilities, and world simulation. Key figures like **@sama**, **@rasbt**, and **@SebastienBubeck** provided technical insights and performance evaluations, noting strengths and hallucination risks.

Qwen-Image: SOTA text rendering + 4o-imagegen-level Editing Open Weights MMDiT

Mon, 04 Aug 2025 05:44:39 GMT

**Alibaba** surprised with the release of **Qwen-Image**, a **20B MMDiT** model excelling at bilingual text rendering and graphic poster creation, with open weights and demos available. **Google DeepMind** launched **Gemini 2.5 Deep Think** to Ultra subscribers, showing significant reasoning improvements and benchmark gains (+11.2% AIME, +13.2% HLE, +13.4% LiveCodeBench) rivaling **OpenAI's o3 Pro**. ByteDance's **SeedProver** achieved state-of-the-art math theorem proving results, surpassing DeepMind's AlphaGeometry2. OpenAI is developing a "universal verifier" for math and coding gains transfer. Competitive reasoning benchmarks and game arenas by Google and Kaggle highlight a meta-shift in reasoning model efficiency, comparable to the original Transformer leap. Other open-weight models gaining momentum include **GLM-4.5**, **XBai o4**, and **Tencent Hunyuan** with a focus on efficient training. *"Qwen is all you need."*

Gemini 2.5 Deep Think finally ships

Fri, 01 Aug 2025 05:44:39 GMT

**OpenAI** is rumored to soon launch new **GPT-OSS** and **GPT-5** models amid drama with **Anthropic** revoking access to **Claude**. **Google DeepMind** quietly launched **Gemini 2.5 Deep Think**, a model optimized for parallel thinking that achieved gold-medal level at the IMO and excels in reasoning, coding, and creative tasks. Leaks suggest **OpenAI** is developing a **120B MoE** and a **20B** model with advanced attention mechanisms. Chinese AI companies like **Kimi Moonshot**, **Alibaba**, and **ZHIpu AI** are releasing faster and more capable open models such as **kimi-k2-turbo-preview**, **Qwen3-Coder-Flash**, and **GLM-4.5**, signaling strong momentum and potential to surpass the U.S. in AI development. *"The final checkpoint was selected just 5 hours before the IMO problems were released,"* highlighting rapid development cycles.

Figma's $50+b IPO

Thu, 31 Jul 2025 05:44:39 GMT

**OpenAI**'s stealth model **horizon-alpha** on **OpenRouter** sparks speculation as a precursor to **GPT-5**, showing strong reasoning and SVG generation capabilities, comparable to **Gemini 2.5 Pro**. **Alibaba** released the **Qwen3-Coder** family, including a fast **Qwen3-Coder-Flash (30B-A3B)** variant with agentic features and 1M context length support via **UnslothAI**. **Cohere** launched **Command A Vision**, a 111B parameter open-weights vision-language model outperforming **GPT-4.1** and **Llama 4 Maverick** on enterprise benchmarks. **Black Forest Labs** introduced **FLUX.1 Krea [dev]**, an open-weights photorealism model compatible with fine-tuning tools like **diffusers** and **ostrisai**. **Zhipu AI** unveiled **GLM-4.5**, a hybrid reasoning open model with agentic capabilities available on **Together AI**. Discussions highlight the rising importance of **inference-time training** and **reasoning model generalization**. **Mistral AI** released the technical report for **Voxtral** continuing its open science efforts.

not much happened today

Wed, 30 Jul 2025 05:44:39 GMT

**Chinese AI labs** have released powerful open-source models like **GLM-4.5** and **GLM-4.5-Air** from **Zhipu AI**, **Qwen3 Coder** and **Qwen3-235B** from **Alibaba**, and **Kimi K2** from **Moonshot AI**, highlighting a surge in permissively licensed models. **Zhipu AI's GLM-4.5** is a 355B parameter MoE model competitive with **Claude 4 Opus** and **Gemini 2.5 Pro**. **Alibaba's Qwen3 Coder** shows strong code generation performance with a low edit failure rate, while **Moonshot AI's Kimi K2** is a 1 trillion-parameter MoE model surpassing benchmarks like **LiveCodeBench**. In video and image generation, **xAI** launched **Grok Imagine**, and **Wan2.2** impressed with innovative image-to-video generation. Robotics advances include **Figure's Figure-01 and Figure-02** humanoid robots and **ViTPose++** for pose estimation in basketball analysis. **SmolLM3** training and evaluation code was fully released under Apache 2.0. **OpenAI** introduced **Study Mode** in **ChatGPT** to enhance interactive learning, and **Runway** rolled out **Runway Aleph**, a new in-context video model for multi-task visual generation. The community notes a competitive disadvantage for organizations avoiding these Chinese open-source models. *"Orgs avoiding these models are at a significant competitive disadvantage,"* noted by @corbtt.

not much happened today

Tue, 29 Jul 2025 05:44:39 GMT

**Chinese labs** have released a wave of powerful, permissively licensed models in July, including **Zhipu AI's GLM-4.5** and **GLM-4.5-Air**, **Alibaba's Qwen3 Coder** and **Qwen3-235B**, and **Moonshot AI's Kimi K2**. These models feature large-scale Mixture of Experts architectures with active parameters ranging from 3B to 32B and context windows up to 256K tokens. **Zhipu AI's GLM-4.5** competes with **Claude 4 Opus** and **Gemini 2.5 Pro** in benchmarks. **Moonshot AI's Kimi K2** is a 1 trillion-parameter MoE model surpassing other open-weight models on **LiveCodeBench** and **AceBench**. In video and image generation, **xAI** launched **Grok Imagine**, and **Wan2.2** impressed with its Image-to-Video approach. **Ideogram** released a character consistency model. Robotics advances include **Figure's Figure-01 and Figure-02** humanoid robots and **ViTPose++** for pose estimation in basketball analysis. The **SmolLM3** training and evaluation code was fully released under an Apache 2.0 license. *"Orgs avoiding these Chinese open-source models are at a significant competitive disadvantage,"* noted by @corbtt.

GLM-4.5: Deeper, Headier, & better than Kimi/Qwen/DeepSeek (SOTA China LLM?)

Mon, 28 Jul 2025 05:44:39 GMT

**Z.ai** (Zhipu AI) released the **GLM-4.5-355B-A32B** and **GLM-4.5-Air-106B-A12B** open weights models, claiming state-of-the-art performance competitive with **Claude 4 Opus**, **Grok 4**, and OpenAI's **o3**. These models emphasize token efficiency and efficient reinforcement learning training validated by the Muon optimizer. **Alibaba Qwen** introduced **Group Sequence Policy Optimization (GSPO)**, a new reinforcement learning algorithm powering the **Qwen3** model suite, integrated into Hugging Face's TRL library. Speculation surrounds mystery models "summit" and "zenith" as potential **GPT-5** variants based on **GPT-4.1** architecture. **Qwen3-Coder** shows strong coding benchmark results, rivaling **Claude Sonnet 4** and **Kimi K2**. The rise of powerful Chinese open-source models like **GLM-4.5**, **Wan-2.2**, and **Qwen3 Coder** contrasts with a slowdown from Western labs such as **OpenAI**.

not much happened today

Fri, 25 Jul 2025 05:44:39 GMT

**OpenAI** has fully rolled out its ChatGPT agent to all Plus, Pro, and Team users and is building hype for the upcoming **GPT-5**, which reportedly outperforms **Grok-4** and can build a cookie clicker game in two minutes. **Alibaba's Qwen** team released the open-source reasoning model **Qwen3-235B-Thinking**, achieving an **89%** win rate over **gpt4-0314** using a new RL algorithm called **Group Sequence Policy Optimization (GSPO)**. **Runway** introduced **Runway Aleph**, a state-of-the-art in-context video model for editing and generating video content. **Hugging Face** highlights the growing momentum of open-source AI, especially from Chinese teams. Other updates include **Kling's** upgrades for image-to-video generation and **Google's Imagen 4 Ultra** being recognized as a top text-to-image model. **Anthropic** integrated **Claude** with **Canva** for branded visual designs but faces stability issues. The **PyTorch** team released optimized checkpoints for **SmolLM3** to speed up inference.

3x in 3 months: Cursor @ $28b, Cognition + Windsurf @ $10b

Thu, 24 Jul 2025 05:44:39 GMT

**Cursor** is reportedly fundraising at a **$28 billion valuation with $1 billion ARR**, while the combined **Cognition+Windsurf** entity is fundraising at a **$10 billion valuation** after acquiring Windsurf remainco for $300 million. The competition between AI coding agents intensifies as Cursor focuses on Async SWE Agents and Cognition+Windsurf acquires an agentic IDE. **Alibaba's Qwen3-Coder** gains widespread adoption for coding tasks and integration into tools like **Claude Code** and **LM Studio**. **OpenAI** rolls out **ChatGPT Agent** to all Plus, Pro, and Team users, sparking discussions about an "agentic economy" emphasizing **AI literacy**. **Anthropic's Claude Code** is praised as a premier development tool with active community feedback. **Perplexity's Comet browser assistant** receives positive reviews and new feature showcases. The debate continues on whether AI coding tools will replace developers, with critiques highlighting the ongoing human effort required. A new minimalistic software engineering agent, **mini**, achieves 65% on SWE-bench with just 100 lines of code.

not much happened today

Wed, 23 Jul 2025 05:44:39 GMT

**Alibaba** announced the release of **Qwen3-Coder-480B-A35B-Instruct**, an open agentic code model with **480B** parameters and **256K** context length, praised for rapid development and strong coding performance. Benchmark claims of **41.8% on ARC-AGI-1** faced skepticism from **Franois Chollet** and others due to reproducibility issues. The model quickly integrated into ecosystems like **vLLM**, **Dynamic GGUFs**, and **OpenRouterAI**. The **White House** unveiled a new **AI Action Plan** emphasizing **Innovation**, **Infrastructure**, and **International Diplomacy**, linking AI leadership to national security and prioritizing compute access for the **Department of Defense**. The plan sparked debate on open vs. closed-source AI, with calls from **Clement Delangue** to embrace open science to maintain US AI competitiveness.

not much happened today

Tue, 22 Jul 2025 05:44:39 GMT

**Moonshot AI** released the **Kimi K2**, a 1-trillion parameter ultra-sparse Mixture-of-Experts (MoE) model with the **MuonClip** optimizer and a large-scale agentic data pipeline using over **20,000 tools**. Shortly after, **Alibaba** updated its **Qwen3** model with the **Qwen3-235B-A22B** variant, which outperforms Kimi K2 and other top models on benchmarks like **GPQA** and **AIME** despite being 4.25x smaller. Alibaba also released **Qwen3-Coder-480B-A35B**, a MoE model specialized for coding with a 1 million token context window. **Google DeepMind** launched **Gemini 2.5 Flash-Lite**, a faster and more cost-efficient model outperforming previous versions in coding, math, and multimodal tasks. The MoE architecture is becoming mainstream, with models like **Mistral**, **DeepSeek**, and **Kimi K2** leading the trend. In mathematics, an advanced **Gemini** model achieved a gold medal level score at the **International Mathematical Olympiad (IMO)**, marking a first for AI. An **OpenAI** researcher noted their IMO model "knew" when it did not have a correct solution, highlighting advances in model reasoning and self-awareness.

OAI and GDM announce IMO Gold-level results with natural language reasoning, no specialized training or tools, under human time limits

Mon, 21 Jul 2025 05:44:39 GMT

**OpenAI** and **Google DeepMind** achieved a major milestone by solving 5 out of 6 problems at the **International Mathematical Olympiad (IMO) 2025** within the human time limit of 4.5 hours, earning the IMO Gold medal. This breakthrough was accomplished using general-purpose reinforcement learning and pure in-weights reasoning without specialized tools or internet access, surpassing previous systems like AlphaProof and AlphaGeometry2. The success resolved a 3-year-old AI bet on AI's capability to solve IMO problems and sparked discussions among mathematicians including **Terence Tao**. Despite this, 26 human competitors remain better than AI on the hardest combinatorics problem (P6). The achievement highlights advances in **reinforcement-learning**, **reasoning**, and **model-scaling** in AI research.

ChatGPT Agent: new o* model + unified Deep Research browser + Operator computer use + Code Interpreter terminal

Thu, 17 Jul 2025 05:44:39 GMT

**OpenAI** launched the **ChatGPT Agent**, a new advanced AI system capable of browsing the web, coding, analyzing data, and creating reports, marking a significant step towards human-like computer use. The agent, distinct from and superior to **o3**, is considered the first public exposure of what was internally called **o4**, now merged into **GPTNext**. It features end-to-end reinforcement learning, can operate for extended periods (tested up to 2 hours), and is classified as "High" risk for biological misuse, with safeguards activated. Early benchmarks show mixed results, excelling in some tests like **WebArena** and **BrowserComp** but underperforming on others like **PaperBench**. Key figures involved include **Sam Altman**, **Greg Brockman**, and **Kevin Weil**, with technical insights from **xikun_zhang_** and risk commentary from **KerenGu** and **boazbaraktcs**. The launch sparked speculation about **GPT-5**, which was confirmed not to be the case.

not much happened today

Wed, 16 Jul 2025 05:44:39 GMT

**Mistral** released **Voxtral**, claimed as the world's best open speech recognition models, available via API and Hugging Face. **Moonshot AI** launched **Kimi K2**, a trillion-parameter **Mixture-of-Experts (MoE)** model, outperforming **GPT-4.1** on benchmarks with 65.4% on SWE-Bench Verified and achieving 200 tokens/second inference speed on **Groq** hardware. **Nous Research** open-sourced the **Hermes 3** dataset with 1 million samples, aiding SOTA models on the **Llama-3** series. **Google DeepMind** introduced the **Mixture-of-Recursions (MoR)** architecture promising 2x inference speed and 50% parameter reduction but faced skepticism. **Goedel-Prover V2** topped the **PutnamBench** theorem proving benchmark. AtCoder World Finals saw a human winner with **OpenAI** placing second. Research highlights include **Jason Wei**'s insights on **reinforcement learning** and the "Verifier's Law" emphasizing the asymmetry of verification in AI training.

Voxtral - Mistral's SOTA ASR model in 3B (mini) and 24B ("small") sizes beats OpenAI Whisper large-v3

Tue, 15 Jul 2025 05:44:39 GMT

**Mistral** surprises with the release of **Voxtral**, a transcription model outperforming **Whisper large-v3**, **GPT-4o mini Transcribe**, and **Gemini 2.5 Flash**. Voxtral models (3B and 24B) support **32k token context length**, handle audios up to **30-40 minutes**, offer built-in **Q&A and summarization**, are **multilingual**, and enable **function-calling** from voice commands, powered by the **Mistral Small 3.1** language model backbone. Meanwhile, **Moonshot AI**'s **Kimi K2**, a non-reasoning **Mixture of Experts (MoE)** model built by a team of around **200 people**, gains attention for blazing-fast inference on **Groq** hardware, broad platform availability including **Together AI** and **DeepInfra**, and local running on **M4 Max 128GB** Mac. Developer tool integrations include **LangChain** and Hugging Face support, highlighting Kimi K2's strong tool use capabilities.

not much happened today

Mon, 14 Jul 2025 05:44:39 GMT

**Cognition** is acquiring the remaining assets of **Windsurf** after a significant weekend deal. **Moonshot AI** released **Kimi K2**, an open-source, MIT-licensed agentic model with **1 Trillion total / 32B active parameters** using a Mixture-of-Experts architecture, trained on **15.5 Trillion tokens** with the **MuonClip** optimizer, showing top performance on benchmarks like **EQ-Bench** and **Creative Writing**. **xAI** launched **Grok-4**, ranking 5th on **IQ Bench** but with notable quirks including a bug causing it to respond only with "Heavy" and a high frequency of Elon Musk mentions. Rumors about **OpenAI** delaying an open-source model release surfaced, with speculation about CEO **sama**'s PR strategy and a possible **GPT-5** launch in September. The **Gemini 2.5** paper was released with **3,295 authors**, and **Google** introduced its **Gemini Embedding** model, topping the **MTEB leaderboard**.

Kimi K2 - SOTA Open MoE proves that Muon can scale to 15T tokens/1T params

Fri, 11 Jul 2025 05:44:39 GMT

**Moonshot AI** has released **Kimi K2**, a **1 trillion parameter** Mixture-of-Experts model trained on **15.5 trillion tokens** using the new **MuonClip** optimizer, achieving state-of-the-art results on benchmarks like **SWE-Bench Verified (65.8%)** and **TAU2 (58.4%)**. This model is competitive with **GPT-4.1** and **Sonnet 4** on non-thinking tasks and is available under an **MIT license**. Meanwhile, **xAI** announced **Grok-4**, noted for its "LEAST censored frontier model" status and strong long-context performance but criticized for rushed post-training. **Mistral AI** updated its **Devstral 2507** models with improved performance and cost efficiency. The community is excited about the potential of the **MuonClip** optimizer, which may surpass the long-standing AdamW optimizer in machine learning.

Grok 4: xAI succeeds in going from 0 to new SOTA LLM in 2 years

Thu, 10 Jul 2025 05:44:39 GMT

**xAI** launched **Grok 4** and **Grok 4 Heavy**, large language models rumored to have **2.4 trillion parameters** and trained with **100x more compute** than Grok 2 on **100k H100 GPUs**. Grok 4 achieved new state-of-the-art results on benchmarks like **ARC-AGI-2 (15.9%)**, **HLE (50.7%)**, and **Vending-Bench**, outperforming models such as **Claude 4 Opus**. The model supports a **256K context window** and is priced at **$3.00/M input tokens** and **$15.00/M output tokens**. It is integrated into platforms like **Cursor**, **Cline**, **LangChain**, and **Perplexity Pro/Max**. The launch was accompanied by a controversial voice mode and sparked industry discussion about xAI's rapid development pace, with endorsements from figures like **Elon Musk** and **Arav Srinivas**.

not much happened today

Wed, 09 Jul 2025 05:44:39 GMT

**LangChain** is nearing unicorn status, while **OpenAI** and **Google DeepMind's Gemini 3 Pro** models are launching soon. **Perplexity** rolls out its agentic browser **Comet** to waitlists, offering multitasking and voice command features. **xAI's Grok-4** update sparked controversy due to offensive outputs, drawing comparisons to **Microsoft's Tay** bot and resulting in regional blocks. **Hugging Face** released **SmolLM3**, a 3B parameter open-source model with state-of-the-art reasoning and long context capabilities. **Google** introduced **T5Gemma** encoder-decoder models, a significant update in this model category. **Anthropic** investigates "alignment faking" in language models, focusing on safety concerns with models like **Claude 3.7 Sonnet** and **DeepSeek-R1**. *"Grok 3 had high reasoning, Grok 4 has heil reasoning"* was a notable user comment on the controversy.

SmolLM3: the SOTA 3B reasoning open source LLM

Tue, 08 Jul 2025 05:44:39 GMT

**HuggingFace** released **SmolLM3-3B**, a fully open-source small reasoning model with open pretraining code and data, marking a high point in open source models until **Olmo 3** arrives. **Grok 4** was launched with mixed reactions, while concerns about **Claude 4** nerfs and an imminent **Claude 4.1** surfaced. **Gemini Nano** is now shipping in **Chrome 137+**, enabling local LLM access for **3.7 billion** users. **Tencent** introduced **Hunyuan-A13B**, an 80B parameter model with a 256K context window running on a single **H200** GPU. The **Gemini API** added a batch mode with 50% discounts on **2.5 models**. **MatFormer Lab** launched tools for custom-sized **Gemma 3n** models. Open source OCR models like **Nanonets-OCR-s** and **ChatDOC/OCRFlux-3B** derived from **Qwen2.5-VL-3B** were highlighted, with licensing discussions involving **Alibaba**.

not much happened today

Mon, 07 Jul 2025 05:44:39 GMT

Over the holiday weekend, key AI developments include the upcoming release of **Grok 4**, **Perplexity** teasing new projects, and community reactions to **Cursor** and **Dia**. Research highlights feature a paper on **Reinforcement Learning (RL)** improving generalization and reasoning across domains, contrasting with Supervised Fine-Tuning's forgetting issues. **Energy-Based Transformers (EBTs)** are proposed as a promising alternative to traditional transformers. **AI21 Labs** updated its **Jamba** model family with enhanced grounding and instruction following, maintaining a **256K** context window. **Baidu** open-sourced its massive **424 billion** parameter **Ernie 4.5** model, while **Kontext-dev** became the top trending model on **Hugging Face**. Advances in length generalization for recurrent models and the introduction of **2-simplicial attention** were noted. In biomedical AI, **Biomni**, powered by **Claude 4 Sonnet**, demonstrated superior accuracy and rare disease diagnosis capabilities. Additionally, the Python package manager `uv` received praise for improving Python installation workflows.

not much happened today

Thu, 03 Jul 2025 05:44:39 GMT

**Ilya Sutskever** confirmed his role as CEO of **Safe Superintelligence Inc. (SSI)** with **Daniel Levy** as President, dismissing acquisition rumors and emphasizing their strong team and compute resources. **Perplexity AI** expanded its data integrations by adding **Morningstar's** financial research and hinted at new product features for Pro users. **Meta AI FAIR** clarified its research structure, distinguishing its small lab from larger model training groups, and welcomed **Nat Friedman** to enhance AI product development. **Midjourney** and **Sakana AI** announced hiring for research and applied engineering roles. **Cohere** expanded its presence in Montréal, receiving praise from Canadian officials. On the model front, **Google DeepMind's Gemini Pro** released the **Veo 3** video generation model globally. **DeepSeek** launched the faster **DeepSeek R1T2** model using an Assembly of Experts approach, available under an MIT license. **Kling AI** showcased cinematic video generation capabilities. **OpenAI** introduced a high-cost **Deep Research API** with pricing up to **$30 per call**. **Together AI** announced the release of the **DeepSWE agent**.

not much happened today

Wed, 02 Jul 2025 05:44:39 GMT

**Meta** has hired **Scale AI CEO Alexandr Wang** as its new **Chief AI Officer**, acquiring a **49% non-voting stake** in **Scale AI** for **$14.3 billion**, doubling its valuation to **~$28 billion**. This move is part of a major talent shuffle involving **Meta**, **OpenAI**, and **Scale AI**. Discussions include the impact on **Yann LeCun**'s influence at **Meta** and potential responses from **OpenAI**. In model news, **Gemma 3N** faces technical issues like vision NaNs and FP16 overflows, with fixes from **UnslothAI**. Chinese open-source models like **GLM-4.1V-Thinking** by **Zhipu AI** and **DeepSeek R1T2** show strong performance and speed improvements. **Huawei** open-sourced a **72B MoE** model with a novel load balancing solution. The **MiniMax-M1** hybrid MoE model leads math benchmarks on the **Text Arena leaderboard**. **AllenAI** launched **SciArena** for scientific literature evaluation, where **o3** outperforms others. Research from **Sakana AI Labs** introduces **AB-MCTS** for code generation, improving synthesis benchmarks.

not much happened today

Tue, 01 Jul 2025 05:44:39 GMT

**Meta** makes a major AI move by hiring **Scale AI** founder **Alexandr Wang** as Chief AI Officer and acquiring a 49% non-voting stake in **Scale AI** for **$14.3 billion**, doubling its valuation to about **$28 billion**. **Chai Discovery** announces **Chai-2**, a breakthrough model for zero-shot antibody discovery and optimization. The US government faces budget cuts threatening to eliminate a quarter million science research jobs by **2026**. Data access restrictions intensify as companies like **Atlassian**, **Notion**, and **Slack** block web crawlers including **Common Crawl**, raising concerns about future public internet archives. **Hugging Face** shuts down **HuggingChat** after serving over a million users, marking a significant experiment in open-source LLMs. **Sakana AI** releases **AB-MCTS**, an inference-time scaling algorithm enabling multiple models like **Gemini 2.5 Pro** and **DeepSeek-R1-0528** to cooperate and outperform individual models.

not much happened today

Mon, 30 Jun 2025 05:44:39 GMT

**Meta** has poached top AI talent from **OpenAI**, including **Alexandr Wang** joining as Chief AI Officer to work towards superintelligence, signaling a strong push for the next **Llama** model. The AI job market shows polarization with high demand and compensation for top-tier talent, while credentials like strong GitHub projects gain importance. The **WizardLM** team moved from **Microsoft** to **Tencent** to develop open-source models like **Hunyuan-A13B**, highlighting shifts in China's AI industry. Rumors suggest **OpenAI** will release a new open-source model in July, potentially surpassing existing **ChatGPT** models. **Baidu** open-sourced multiple variants of its **ERNIE 4.5** model series, featuring advanced techniques like **2-bit quantization**, **MoE router orthogonalization loss**, and **FP8** training, with models ranging from **0.3B** to **424B** parameters. **Gemini 2.5 Pro** returned to the free tier of the **Gemini API**, enabling developers to explore its features.

not much happened today

Fri, 27 Jun 2025 05:44:39 GMT

**Google** released **Gemma 3n**, a multimodal model for edge devices available in **2B and 4B** parameter versions, with support across major frameworks like **Transformers** and **Llama.cpp**. **Tencent** open-sourced **Hunyuan-A13B**, a **Mixture-of-Experts (MoE)** model with **80B total parameters** and a **256K context window**, optimized for tool calling and coding. **Black Forest Labs** released **FLUX.1 Kontext [dev]**, an open image AI model gaining rapid Hugging Face adoption. **Inception AI Labs** launched **Mercury**, the first commercial-scale **diffusion LLM** for chat. The **FineWeb2** multilingual pre-training dataset paper was released, analyzing data quality impacts. The **Qwen** team released **Qwen-VLo**, a unified visual understanding and generation model. **Kyutai Labs** released a top-ranked open-source speech-to-text model running on Macs and iPhones. **OpenAI** introduced **Deep Research API** with **o3/o4-mini** models and open-sourced prompt rewriter methodology, integrated into **LangChain** and **LangGraph**. The open-source **Gemini CLI** gained over **30,000 GitHub stars** as an AI terminal agent.

OpenAI releases Deep Research API (o3/o4-mini)

Thu, 26 Jun 2025 05:44:39 GMT

**OpenAI** has launched the **Deep Research API** featuring powerful models **o3-deep-research** and **o4-mini-deep-research** with native support for MCP, Search, and Code Interpreter, enabling advanced agent capabilities including multi-agent setups. **Google** released **Gemma 3n**, a multimodal model optimized for edge devices with only 3GB RAM, achieving a top score of 1300 on LMSys Arena, featuring the new MatFormer architecture and broad ecosystem integration. **Black Forest Labs** introduced **FLUX.1 Kontext [dev]**, a 12B parameter rectified flow transformer for instruction-based image editing, comparable to **GPT-4o**. **DeepMind** unveiled **AlphaGenome**, an AI model capable of reading 1 million DNA bases for gene function prediction, marking a breakthrough in AI biology. **Sakana AI** presented Reinforcement-Learned Teachers (RLTs) to enhance LLM reasoning, achieving 86.1% on MiniF2F with efficient compute. **Higgsfield AI** released **Higgsfield Soul**, a high-aesthetic photo model with 50+ presets for fashion-grade realism. Additionally, **Google** launched the **Gemini CLI**, an open-source AI agent for terminal use with free Gemini 2.5 Pro requests.

Context Engineering: Much More than Prompts

Wed, 25 Jun 2025 05:44:39 GMT

**Context Engineering** emerges as a significant trend in AI, highlighted by experts like **Andrej Karpathy**, **Walden Yan** from **Cognition**, and **Tobi Lutke**. It involves managing an LLM's context window with the right mix of prompts, retrieval, tools, and state to optimize performance, going beyond traditional prompt engineering. **LangChain** and its tool **LangGraph** are noted for advancing this approach. Additionally, **OpenAI** has launched **ChatGPT connectors** for platforms like **Google Drive**, **Dropbox**, **SharePoint**, and **Box**, enhancing context integration for Pro users. Other notable news includes the launch of **Vercel Sandbox**, **Cloudflare Containers**, the leak and release of **Gemini Code** by **Google DeepMind**, and fundraising efforts by **OpenRouter**.

Bartz v. Anthropic PBC — "Training use is Fair Use"

Tue, 24 Jun 2025 05:44:39 GMT

**Anthropic** won a significant fair use ruling allowing the training of **Claude** on copyrighted books, setting a precedent for AI training legality despite concerns over pirated data. **Replit** achieved a major milestone with **$100M ARR**, showing rapid growth. **Delphi** raised **$16M Series A** to scale digital minds, while **Thinking Machines Lab** focuses on reinforcement learning for business applications. **Disney** and **Universal** sued **Midjourney** over unauthorized use of copyrighted images. **Google DeepMind** released **Gemini Robotics On-Device**, a compact foundation model for robotics.

Not much happened today

Mon, 23 Jun 2025 05:44:39 GMT

**Sakana AI** released **Reinforcement-Learned Teachers (RLTs)**, a novel technique using smaller 7B parameter models trained via reinforcement learning to teach reasoning through step-by-step explanations, accelerating **Chain-of-Thought** learning. **Mistral AI** updated **Mistral Small 3.2** improving instruction following and function calling with experimental FP8 quantization. **Google Magenta RealTime**, an 800M parameter open-weights model for real-time music generation, was released. **Arcee AI** launched **AFM-4.5B**, a sub-10B parameter foundation model extended from **Llama 3**. **OpenThinker3-7B** was introduced as a new state-of-the-art 7B reasoning model with a 33% improvement over **DeepSeek-R1-Distill-Qwen-7B**. The **STORM** text-video model compresses video input by 8x using **Mamba layers** and outperforms **GPT-4o** on MVBench with 70.6%. Discussions on reinforcement learning algorithms PPO vs. GRPO and insights on **DINOv2**'s performance on ImageNet-1k were also highlighted. *"A very quiet day"* in AI news with valuable workshops from **OpenAI**, **Amazon**, and **GDM**.

The Quiet Rise of Claude Code vs Codex

Fri, 20 Jun 2025 05:44:39 GMT

**Claude Code** is gaining mass adoption, inspiring derivative projects like **OpenCode** and **ccusage**, with discussions ongoing in AI communities. **Mistral AI** released **Mistral Small 3.2**, a **24B** parameter model update improving instruction following and function calling, available on **Hugging Face** and supported by **vLLM**. Sebastian Raschka implemented **Qwen3 0.6B** from scratch, noting its deeper architecture and memory efficiency compared to **Llama 3 1B**. **Google DeepMind** showcased **Gemini 2.5 Flash-Lite**'s UI code generation from visual context and added video upload support in the **Gemini App**. **Apple**'s new **3B** parameter on-device foundation model was benchmarked, showing slower speed but efficient memory use via **2-bit quantization**, suitable for background tasks. **Google DeepMind** also released **Magenta Real-time**, an **800M** parameter music generation model licensed under **Apache 2.0**, marking Google's 1000th model on **Hugging Face**. **Kuaishou** launched **KLING 2.1**, a new video model accessible via API.

minor ai followups: MultiAgents, Meta-SSI-Scale, Karpathy, AI Engineer

Thu, 19 Jun 2025 05:44:39 GMT

**OpenAI** released a paper revealing how training models like **GPT-4o** on insecure code can cause broad misalignment, drawing reactions from experts like *@sama* and *@polynoamial*. **California's AI regulation efforts** were highlighted by *@Yoshua_Bengio* emphasizing transparency and whistleblower protections. The term **"context rot"** was coined to describe LLM conversation degradation, with systems like **Embra** using CRM-like memory for robustness. Scalable oversight research aiming to improve human control over smarter AIs was discussed by *@RyanPGreenblatt*. New model releases include **Kyutai's** speech-to-text models capable of 400 real-time streams on a single H100 GPU, **Tencent's Hunyuan 3D 2.1** as the first open-source production-ready PBR 3D generative model, and **Arcee's AFM-4.5B** foundation model family targeting enterprise use, competitive with **Gemma** and **Qwen**.

Zuck goes Superintelligence Founder Mode: $100M bonuses + $100M+ salaries + NFDG Buyout?

Wed, 18 Jun 2025 05:44:39 GMT

**Meta AI** is reportedly offering **8-9 figure signing bonuses and salaries** to top AI talent, confirmed by **Sam Altman**. They are also targeting key figures like **Nat** and **Dan** from the AI Grant fund for strategic hires. **Essential AI** released the massive **24-trillion-token Essential-Web v1.0 dataset** with rich metadata and a 12-category taxonomy. **DeepLearning.AI** and **Meta AI** launched a course on **Llama 4**, featuring new MoE models **Maverick (400B)** and **Scout (109B)** with context windows up to **10M tokens**. **MiniMax** open-sourced **MiniMax-M1**, a long-context LLM with a 1M-token window, and introduced the **Hailuo 02** video model. **OpenAI** rolled out "Record mode" for **ChatGPT Pro, Enterprise, and Edu** on macOS. **Arcee** launched the **AFM-4.5B** foundation model for enterprise. **Midjourney** released its **V1 video model** enabling image animation. These developments highlight major advances in model scale, long-context reasoning, multimodality, and enterprise AI applications.

Gemini 2.5 Pro/Flash GA, 2.5 Flash-Lite in Preview

Tue, 17 Jun 2025 05:44:39 GMT

**Gemini 2.5** models are now generally available, including the new **Gemini 2.5 Flash-Lite**, **Flash**, **Pro**, and **Ultra** variants, featuring sparse **Mixture-of-Experts (MoE)** transformers with native multimodal support. A detailed 30-page tech report highlights impressive long-horizon planning demonstrated by **Gemini Plays Pokemon**. The **LiveCodeBench-Pro** benchmark reveals frontier LLMs struggle with hard coding problems, while **Moonshot AI** open-sourced **Kimi-Dev-72B**, achieving state-of-the-art results on **SWE-bench Verified**. Smaller specialized models like **Nanonets-OCR-s**, **II-Medical-8B-1706**, and **Jan-nano** show competitive performance, emphasizing that bigger models are not always better. **DeepSeek-r1** ties for #1 in WebDev Arena, and **MiniMax-M1** sets new standards in long-context reasoning. **Kling AI** demonstrated video generation capabilities.

Chinese Models Launch - MiniMax-M1, Hailuo 2 "Kangaroo", Moonshot Kimi-Dev-72B

Mon, 16 Jun 2025 05:44:39 GMT

**MiniMax AI** launched **MiniMax-M1**, a 456 billion parameter open weights LLM with a 1 million token input and 80k token output using efficient "lightning attention" and a GRPO variant called CISPO. **MiniMax AI** also announced **Hailuo 02 (0616)**, a video model similar to **ByteDance's Seedance**. **Moonshot AI** released **Kimi-Dev-72B**, a coding model outperforming **DeepSeek R1** on SWEBench Verified. Discussions on multi-agent system design from **Anthropic** and **LangChain** highlighted improvements in task completion and challenges like prompt injection attacks, as demonstrated by **Karpathy** and **Columbia University** research. **Sakana AI** introduced **ALE-Agent**, a coding agent that ranked 21st in the AtCoder Heuristic Competition solving NP-hard optimization problems. There is unverified news about an acquisition involving **OpenAI**, **Microsoft**, and **Windsurf**.

Cognition vs Anthropic: Don't Build Multi-Agents/How to Build Multi-Agents

Fri, 13 Jun 2025 05:44:39 GMT

Within the last 24 hours, **Cognition**'s Walden Yan advised *"Don't Build Multi-Agents,"* while **Anthropic** shared their approach to building multi-agent systems with **Claude's** multi-agent research architecture. **LangChain** highlighted advances in context engineering and production AI agents used by **LinkedIn** and **BlackRock**. The community is engaging in a debate on multi-agent AI development. Additionally, **Hugging Face** announced deprecating **TensorFlow** and **Flax** support in favor of **PyTorch**. Research on agent memory and model elicitation techniques from **LlamaIndex** and **Anthropic** were also discussed.

not much happened today

Thu, 12 Jun 2025 05:44:39 GMT

**Bytedance** showcased an impressive state-of-the-art video generation model called **Seedance 1.0** without releasing it, while **Morph Labs** announced **Trinity**, an autoformalization system for Lean. **Huggingface Transformers** deprecated Tensorflow/JAX support. **Andrew Ng** of **DeepLearning.AI** highlighted the rise of the **GenAI Application Engineer** role emphasizing skills in **AI building blocks** and **AI-assisted coding tools** like **Codex** and **Claude Code**. Engineering teams are increasingly testing API designs against LLMs for usability. **Figure AI**'s CEO stressed speed as a key competitive advantage, and **LangChain** introduced the concept of **Context Engineering** for AI agents. Reinforcement learning on LLMs shows transformative potential, and the community values **AI evals** and data work. **Sakana AI** released **Text-to-LoRA**, a hypernetwork method for generating task-specific LoRA adapters from natural language, enabling efficient model customization. The video generation race heats up with **Bytedance**'s Seed-based model praised for quality, challenging American labs, alongside models like **Kling 2.1** and **Veo 3**.

Execuhires Round 2: Scale-Meta, Lamini-AMD, and Instacart-OpenAI

Wed, 11 Jun 2025 05:44:39 GMT

**Meta** hires **Scale AI's Alexandr Wang** to lead its new "Superintelligence" division following a **$15 billion investment** for a 49% stake in Scale. **Lamini's Sharon Zhou** joins **AMD** as VP of AI under Lisa Su, while **Instacart's Fidji Simo** becomes CEO of Apps at **OpenAI** under **Sama**. **Meta** offers over **$10 million/year compensation packages** to top researchers, successfully recruiting **Jack Rae** from **Gemini**. **OpenAI** releases **o3-pro** model to **ChatGPT Pro** users and API, outperforming **o3** and setting new benchmarks like **Extended NYT Connections** and **SnakeBench**. Despite being slower than **o1-pro**, **o3-pro** excels in reasoning and complex problem-solving. **OpenAI** cuts **o3** pricing by **80%**, making it cheaper than **GPT-4o** and pressuring competitors like **Google** and **Anthropic** to lower prices. Users can now fine-tune the **GPT-4.1** family using **direct preference optimization (DPO)** for subjective tasks.

Reasoning Price War 2: Mistral Magistral + o3's 80% price cut + o3-pro

Tue, 10 Jun 2025 05:44:39 GMT

**OpenAI** announced an **80% price cut** for its **o3** model, making it competitively priced with **GPT-4.1** and rivaling **Anthropic's Claude 4 Sonnet** and **Google's Gemini 2.5 Pro**. Alongside, **o3-pro** was released as a more powerful and reliable variant, though early benchmarks showed mixed performance relative to cost. **Mistral AI** launched its **Magistral** reasoning models, including an open-source **24B parameter** version optimized for efficient deployment on consumer GPUs. The price reduction and new model releases signal intensified competition in reasoning-focused large language models, with notable improvements in token efficiency and cost-effectiveness.

Apple exposes Foundation Models API and... no new Siri

Mon, 09 Jun 2025 05:44:39 GMT

**Apple** released on-device foundation models for iOS developers, though their recent "Illusion of Reasoning" paper faced significant backlash for flawed methodology regarding LLM reasoning. **OpenAI** updated **ChatGPT's Advanced Voice Mode** with more natural voice and improved translation, demonstrated by Greg Brockman. **LangChain** and **LlamaIndex** launched new AI agents and tools, including a SWE Agent for software automation and an Excel agent using reinforcement learning for data transformation. The AI community engaged in heated debate over reasoning capabilities of LLMs, highlighting challenges in evaluation methods.

not much happened today

Fri, 06 Jun 2025 05:44:39 GMT

**China's Xiaohongshu (Rednote) released dots.llm1**, a **142B parameter open-source Mixture-of-Experts (MoE) language model** with **14B active parameters** and a **32K context window**, pretrained on **11.2 trillion high-quality, non-synthetic tokens**. The model supports efficient inference frameworks like Docker, HuggingFace, and vLLM, and provides intermediate checkpoints every 1 trillion tokens, enabling flexible fine-tuning. Benchmarking claims it slightly surpasses **Qwen3 235B** on MMLU, though some concerns exist about benchmark selection and synthetic data verification. The release is notable for its truly open-source licensing and no synthetic data usage, sparking community optimism for support in frameworks such as llama.cpp and mlx.

Gemini 2.5 Pro (06-05) launched at AI Engineer World's Fair

Thu, 05 Jun 2025 05:44:39 GMT

At the second day of **AIE**, **Google's Gemini 2.5 Pro** reclaimed the top spot on the LMArena leaderboard with a score of **1470** and a +24 Elo increase, showing improvements in coding, reasoning, and math. **Qwen3** released state-of-the-art embedding and reranking models, with **Qwen3-Embedding-8B** topping the MTEB multilingual leaderboard. **OpenThinker3-7B** emerged as the top open reasoning model trained on the **OpenThoughts3-1.2M dataset**, outperforming previous models by 33%. **LightOn** introduced **FastPlaid**, achieving up to a 554% speedup for late-interaction models. **Morph Labs** hired **Christian Szegedy** as Chief Scientist to lead Verified Superintelligence development. The **AI Engineer World's Fair** featured a fireside chat with **Greg Brockman** and **NVIDIA CEO Jensen Huang**, highlighting the return of basic research and engineering best practices.

AI Engineer World's Fair Talks Day 1

Wed, 04 Jun 2025 05:44:39 GMT

**Mistral** launched a new **Code** project, and **Cursor** released version **1.0**. **Anthropic** improved **Claude Code** plans, while **ChatGPT** announced expanded connections. The day was dominated by **AIE** keynotes and tracks including **GraphRAG**, **RecSys**, and **Tiny Teams**. On Reddit, **Google** open-sourced the **DeepSearch** stack for building AI agents with **Gemini 2.5** and **LangGraph**, enabling flexible agent architectures and integration with local LLMs like **Gemma**. A new **Meta** paper analyzed language model memorization, showing GPT-style transformers store about **3.5–4 bits/parameter** and exploring the transition from memorization to generalization, with implications for **Mixture-of-Experts** models and quantization effects.

not much happened today

Tue, 03 Jun 2025 05:44:39 GMT

**OpenAI** rolled out **Codex** to ChatGPT Plus users with internet access and fine-grained controls, improving memory features for free users. **Anthropic's Claude 4 Opus and Sonnet** models lead coding benchmarks, while **Google's Gemini 2.5 Pro and Flash** models gain recognition with new audio capabilities. **Qwen 2.5-VL** and **Qwen 3** quantizations are noted for versatility and support. **Bing Video Creator** launched globally enabling text-to-video generation, and **Perplexity Labs** sees increased demand for travel search. New agentic AI tools and RAG innovations include **LlamaCloud** and **FedRAG**. Open-source releases include **Holo-1** for web navigation and **PlayAI's PlayDiffusion** for speech editing. Audio and multimodal advances feature **Suno's** music editing upgrades, **Google's** native TTS in 24+ languages, and **Universal Streaming's** ultra-low latency speech-to-text. **Google NotebookLM** now supports public notebooks. *"Codex's internet access brings tradeoffs, with explicit warnings about risk"* and *"Gemini 2.5 Pro is cited as a daily driver by users"*.

not much happened today

Mon, 02 Jun 2025 05:44:39 GMT

**DeepSeek R1-0528** release brings major improvements in reasoning, hallucination reduction, JSON output, and function calling, matching or surpassing closed models like **OpenAI o3** and **Gemini 2.5 Pro** on benchmarks such as **Artificial Analysis Intelligence Index**, **LiveBench**, and **GPQA Diamond**. The model ranks #2 globally in open weights intelligence, surpassing **Meta AI**, **Anthropic**, and **xAI**. Open weights and technical transparency have fueled rapid adoption across platforms like **Ollama** and **Hugging Face**. Chinese AI labs including **DeepSeek**, **Alibaba**, **ByteDance**, and **Xiaomi** now match or surpass US labs in model releases and intelligence, driven by open weights strategies. Reinforcement learning post-training is critical for intelligence gains, mirroring trends seen at **OpenAI**. Optimized quantization techniques (1-bit, 4-bit) and local inference enable efficient experimentation on consumer hardware. New benchmarks like **LisanBench** test knowledge, planning, memory, and long-context reasoning, with **OpenAI o3** and **Claude Opus 4** leading. Discussions highlight concerns about benchmark contamination and overemphasis on RL-tuned gains.

Mary Meeker is so back: BOND Capital AI Trends report

Sat, 31 May 2025 05:44:39 GMT

**Mary Meeker** returns with a comprehensive **340-slide report** on the state of AI, highlighting accelerating tech cycles, compute growth, and comparisons of **ChatGPT** to early Google and other iconic tech products. The report also covers enterprise traction and valuation of major AI companies. On Twitter, **@tri_dao** discusses an "ideal" inference architecture featuring attention variants like **GTA**, **GLA**, and **DeepSeek MLA** with high arithmetic intensity (~256), improving efficiency and model quality. Other highlights include the release of **4-bit DWQ of DSR1 Qwen3 8B** on Hugging Face, **AnthropicAI**'s open-source interpretability tools for LLMs, and discussions on transformer training and abstractions by various researchers.

DeepSeek-R1-0528 - Gemini 2.5 Pro-level model, SOTA Open Weights release

Thu, 29 May 2025 05:44:39 GMT

**DeepSeek R1-0528** marks a significant upgrade, closing the gap with proprietary models like **Gemini 2.5 Pro** and surpassing benchmarks from **Anthropic**, **Meta**, **NVIDIA**, and **Alibaba**. This Chinese open-weights model leads in several AI benchmarks, driven by reinforcement learning post-training rather than architecture changes, and demonstrates increased reasoning token usage (23K tokens per question). The China-US AI race intensifies as Chinese labs accelerate innovation through transparency and open research culture. Key benchmarks include **AIME 2024**, **LiveCodeBench**, and **GPQA Diamond**.

not much happened today

Wed, 28 May 2025 05:44:39 GMT

**DeepSeek R1 v2** model released with availability on Hugging Face and inference partners. The **Gemma model family** continues prolific development including **PaliGemma 2**, **Gemma 3**, and others. **Claude 4** and its variants like **Opus 4** and **Claude Sonnet 4** show top benchmark performance, including new SOTA on **ARC-AGI-2** and **WebDev Arena**. **Codestral Embed** introduces a 3072-dimensional code embedder. **BAGEL**, an open-source multimodal model by **ByteDance**, supports reading, reasoning, drawing, and editing with long mixed contexts. Benchmarking highlights include **Nemotron-CORTEXA** topping SWEBench and **Gemini 2.5 Pro** performing on VideoGameBench. Discussions on random rewards effectiveness focus on **Qwen** models. *"Opus 4 NEW SOTA ON ARC-AGI-2. It's happening - I was right"* and *"Claude 4 launch has dev moving at a different pace"* reflect excitement in the community.

Mistral's Agents API and the 2025 LLM OS

Tue, 27 May 2025 05:44:39 GMT

**The LLM OS** concept has evolved since 2023, with **Mistral AI** releasing a new **Agents API** that includes code execution, web search, persistent memory, and agent orchestration. **LangChainAI** introduced the **Open Agent Platform (OAP)**, an open-source no-code platform for intelligent agents. **OpenAI** plans to develop **ChatGPT** into a super-assistant by H1 2025, competing with **Meta**. Discussions around **Qwen** models focus on reinforcement learning effects, while **Claude 4** performance is also noted. The AI Engineer World's Fair is calling for volunteers.

not much happened today

Mon, 26 May 2025 05:44:39 GMT

**OpenAI** plans to evolve **ChatGPT** into a **super-assistant** by 2025 with models like **o3** and **o4** enabling agentic tasks and supporting a billion users. Recent multimodal and reasoning model releases include ByteDance's **BAGEL-7B**, Google's **MedGemma**, and NVIDIA's **ACEReason-Nemotron-14B**. The **Sudoku-Bench Leaderboard** highlights ongoing challenges in AI creative reasoning. In software development, OpenAI's **Codex** aids code generation and debugging, while Gemini's **Context URL tool** enhances prompt context. **AgenticSeek** offers a local, privacy-focused alternative for autonomous agents. Ethical concerns are raised about AGI development priorities and Anthropic's alignment with human values. Technical discussions emphasize emergence in AI and training challenges, with humor addressing misconceptions about **Gemini 3.0** and async programming in C. A novel synthetic speech training method enables instruction tuning of LLMs without real speech data, advancing low-resource language support.

not much happened today

Fri, 23 May 2025 05:44:39 GMT

**Anthropic's Claude 4 models (Opus 4, Sonnet 4)** demonstrate strong coding abilities, with Sonnet 4 achieving **72.7%** on SWE-bench and Opus 4 at **72.5%**. Claude Sonnet 4 excels in codebase understanding and is considered **SOTA on large codebases**. Criticism arose over Anthropic's handling of **ASL-3 security requirements**. Demand for Claude 4 is high, with integration into IDEs and support from Cherry Studio and FastHTML. **Google DeepMind** introduced **Gemini 2.5 Pro Deep Think** and **Gemma 3n**, a mobile multimodal model reducing RAM usage by nearly 3x. **Google's Imagen 4 Ultra** ranks third in the Artificial Analysis Image Arena, available on **Vertex AI Studio**. Google also promoted **Google Beam**, an AI video model for immersive 3D experiences, and new text-to-speech models with multi-speaker support. The **GAIA benchmark** shows Claude 4 Opus and Sonnet leading in agentic performance.

Anthropic releases Claude 4 Sonnet and Opus: Memory, Agent Capabilities, Claude Code, Redteam Drama

Thu, 22 May 2025 05:44:39 GMT

**Anthropic** has officially released **Claude 4** with two variants: **Claude Opus 4**, a high-capability model for complex tasks priced at **$15/$75 per million tokens**, and **Claude Sonnet 4**, optimized for efficient everyday use. The release emphasizes **instruction following** and extended work sessions up to **7 hours**. Community discussions highlight concerns about **token pricing**, **token accounting transparency**, and calls for **open-sourcing Claude 3.5 Sonnet** weights to support local model development. The news also covers **Claude Code GA**, new **Agent Capabilities API**, and various livestreams and reports detailing these updates. There is notable debate around **sliding window attention** and advanced inference techniques for local deployment.

OpenAI buys Jony Ive's io for $6.5b, LMArena lands $100m seed from a16z

Wed, 21 May 2025 05:44:39 GMT

**OpenAI** confirmed a partnership with **Jony Ive** to develop consumer hardware. **LMArena** secured a $100 million seed round from **a16z**. **Mistral** launched a new code model fine-tune. **Google DeepMind** announced multiple updates at **Google I/O 2024**, including over a dozen new models and 20 AI products. Key highlights include the release of **Gemini 2.5 Pro** and **Gemini Diffusion**, featuring advanced multimodal reasoning, coding, and math capabilities, and integration of Gemini in **Google Chrome** as an AI browsing assistant. **Deep Think** enhanced reasoning mode and **Project Astra** improvements were also introduced, focusing on voice output, memory, and computer control for a universal AI assistant.

Google I/O: new Gemini native voice, Flash, DeepThink, AI Mode (DeepSearch+Mariner+Astra)

Tue, 20 May 2025 05:44:39 GMT

**Google I/O 2024** showcased significant advancements with **Gemini 2.5 Pro** and **Deep Think** reasoning mode from **google-deepmind**, emphasizing AI-driven transformations and developer opportunities. **GeminiApp** aims to become a universal **AI assistant** on the path to **AGI**, with new features like **AI Mode** in Google Search expanding generative AI access. The event included multiple keynotes and updates on over a dozen models and 20+ AI products, highlighting **Google's** leadership in AI innovation. Influential voices like **demishassabis** and **philschmid** provided insights and recaps, while the launch of **Jules** as a competitor to Codex/Devin was noted.

not much happened today

Mon, 19 May 2025 05:44:39 GMT

**Meta** released **KernelLLM 8B**, outperforming **GPT-4o** and **DeepSeek V3** on KernelBench-Triton Level 1. **Mistral Medium 3** debuted strongly in multiple benchmarks. **Qwen3** models introduced a unified framework with multilingual support. **DeepSeek-V3** features hardware-aware co-design. **BLIP3-o** family released for multimodal tasks using diffusion transformers. **Salesforce** launched **xGen-Small** models excelling in long-context and math benchmarks. **Bilibili** released **AniSORA** for anime video generation. **Stability AI** open-sourced **Stable Audio Open Small** optimized for Arm devices. Google’s **AlphaEvolve** coding agent improved **Strassen's algorithm** for the first time since 1969. Research shows **chain-of-thought reasoning** can harm instruction-following ability, with mitigation strategies like classifier-selective reasoning being most effective, but reasoning techniques show high variance and limited generalization. *"Chain-of-thought (CoT) reasoning can harm a model’s ability to follow instructions"* and *"Mitigation strategies such as few-shot in-context learning, self-reflection, self-selective reasoning, and classifier-selective reasoning can counteract reasoning-induced failures"*.

ChatGPT Codex, OpenAI's first cloud SWE agent

Fri, 16 May 2025 05:44:39 GMT

**OpenAI** launched **Codex**, a cloud-based software engineering agent powered by **codex-1** (an optimized version of **OpenAI o3**) available in research preview for Pro, Enterprise, and Team ChatGPT users, featuring parallel task execution like refactoring and bug fixing. The **Codex CLI** was enhanced with quick sign-in and a new low-latency model, **codex-mini**. **Gemma 3** is highlighted as the best open model runnable on a single GPU. **Runway** released the Gen-4 References API for style transfer in generation. **Salesforce** introduced **BLIP3-o**, a unified multimodal model family using diffusion transformers for CLIP image features. The **Qwen 2.5** models (1.5B and 3B versions) were integrated into the PocketPal app with various chat templates. **Marigold IID**, a new state-of-the-art open-source depth estimation model, was released. In research, **DeepSeek** shared insights on scaling and hardware for DeepSeek-V3. **Google** unveiled **LightLab**, a diffusion-based light source control in images. **Google DeepMind's AlphaEvolve** uses **Gemini 2.0** to discover new math and reduce costs without reinforcement learning. **Omni-R1** studied audio's role in fine-tuning audio LLMs. **Qwen** proposed a parallel scaling law inspired by classifier-free guidance. **Salesforce** released **Lumina-Next** on the Qwen base, outperforming Janus-Pro. A study found LLM performance degrades in multi-turn conversations due to unreliability. **J1** is incentivizing LLM-as-a-Judge thinking via reinforcement learning. A new Qwen study correlates question and strategy similarity to predict reasoning strategies.

Gemini's AlphaEvolve agent uses Gemini 2.0 to find new Math and cuts Gemini cost 1% — without RL

Thu, 15 May 2025 05:44:39 GMT

**Deepmind's AlphaEvolve**, a 2025 update to AlphaTensor and FunSearch, is a Gemini-powered **coding agent for algorithm discovery** that designs faster matrix multiplication algorithms, solves open math problems, and improves data center and AI training efficiency. It achieves a **23% faster kernel speedup** in Gemini training and surpasses state-of-the-art on 20% of applied problems, including improvements on the Minimum Overlap Problem and Kissing number problem. Unlike Deep-RL, it optimizes code pieces rather than model weights. Meanwhile, **OpenAI** released **GPT-4.1** in ChatGPT, specializing in coding and instruction following, with a faster alternative **GPT-4.1 mini** replacing GPT-4o mini for all users. OpenAI also launched the Safety Evaluations Hub and the OpenAI to Z Challenge using o3/o4 mini and GPT-4.1 models to discover archaeological sites. *"Maybe midtrain + good search is all you need for AI for scientific innovation"* - Jason Wei.

Granola launches team notes, while Notion launches meeting transcription

Wed, 14 May 2025 05:44:39 GMT

**GPT-4.1** is now available in **ChatGPT** for Plus, Pro, and Team users, focusing on coding and instruction following, with **GPT 4.1 mini** replacing **GPT 4o mini**. **Anthropic** is releasing new **Claude** models including **Claude Opus** and **Claude Sonnet**, though some criticism about hallucinations in **Claude O3** was noted. **Alibaba** shared the **Qwen3 Technical Report** with strong benchmark results from **Seed1.5-VL**. **Meta FAIR** announced new models and datasets but faced criticism on **Llama 4**. **AM-Thinking-v1** launched on **Hugging Face** as a 32B scale reasoning model. **Granola** raised $43M in Series B and launched **Granola 2.0** with a Notion-like UI. The AI ecosystem shows rapid iteration and cloning of ideas, emphasizing execution and distribution.

not much happened today

Tue, 13 May 2025 05:44:39 GMT

**Tencent's Hunyuan-Turbos** has risen to #8 on the LMArena leaderboard, showing strong performance across major categories and significant improvement since February. The **Qwen3 model family**, especially the **Qwen3 235B-A22B (Reasoning)** model, is noted for its intelligence and efficient parameter usage. **OpenAI** introduced **HealthBench**, a new health evaluation benchmark developed with input from over **250 physicians**, where models like **o3**, **GPT-4.1 nano**, and **Grok 3** showed strong results. **ByteDance** released **Seed1.5-VL**, a vision-language model with a 532M-parameter vision encoder and a 20B active parameter MoE LLM, achieving state-of-the-art results on 38 public benchmarks. In vision-language, **Kling 2.0** leads image-to-video generation, and **Gemini 2.5 Pro** excels in video understanding with advanced multimodal capabilities. Meta's Vision-Language-Action framework and updates on VLMs for 2025 were also highlighted.

Prime Intellect's INTELLECT-2 and PRIME-RL advance distributed reinforcement learning

Mon, 12 May 2025 05:44:39 GMT

**Prime Intellect** released **INTELLECT-2**, a decentralized GPU training and RL framework with a vision for distributed AI training overcoming colocation limits. **ByteDance** launched **DreamO**, a unified image customization model on Hugging Face. **Qwen** released models optimized for GPTQ, GGUF, and AWQ quantization. **Gemma** surpassed 150 million downloads on Hugging Face. **Meta** released weights for the **Dynamic Byte Latent Transformer** and the **Collaborative Reasoner** framework to improve language model efficiency and reasoning. **RunwayML** introduced **Gen-4 References**, a near-realtime model requiring no fine-tuning. **Mistral AI** released **Mistral Medium 3**, a strong multimodal model, and **Le Chat Enterprise**, an agentic AI assistant for business. **Google** updated **Gemini 2.5 Pro Preview** with video understanding and UI improvements. *"Airbnb for spare GPUs from all over the world"* highlights the ongoing challenges and potential of distributed GPU training.

not much happened today

Fri, 09 May 2025 05:44:39 GMT

**Gemini 2.5 Flash** shows a **12 point increase** in the Artificial Analysis Intelligence Index but costs **150x more** than Gemini 2.0 Flash due to **9x more expensive output tokens** and **17x higher token usage** during reasoning. **Mistral Medium 3** competes with **Llama 4 Maverick**, **Gemini 2.0 Flash**, and **Claude 3.7 Sonnet** with better coding and math reasoning at a significantly lower price. **Alibaba's Qwen3** family supports reasoning and multilingual tasks across **119 languages** and includes a **Web Dev** tool for app building. **Huawei's Pangu Ultra MoE** matches **DeepSeek R1** performance on Ascend NPUs, with new compute and upcoming V4 training. **OpenAI's o4-mini** now supports **Reinforcement Fine-Tuning (RFT)** using chain-of-thought reasoning. **Microsoft's X-REASONER** enables generalizable reasoning across modalities post-trained on general-domain text. Deep research integration with GitHub repos in ChatGPT enhances codebase search and reporting. The AI Engineer World's Fair offers an Early Bird discount for upcoming tickets.

not much happened today

Thu, 08 May 2025 05:44:39 GMT

**OpenAI** launched both **Reinforcement Finetuning** and **Deep Research on GitHub repos**, drawing comparisons to **Cognition's DeepWiki**. **Nvidia** open-sourced **Open Code Reasoning models (32B, 14B, 7B)** with Apache 2.0 license, showing 30% better token efficiency and compatibility with llama.cpp, vLLM, transformers, and TGI. Independent evaluations highlight **Mistral Medium 3** rivaling **Llama 4 Maverick**, **Gemini 2.0 Flash**, and **Claude 3.7 Sonnet** in coding and math reasoning, priced significantly lower but no longer open-source. **Google's Gemini 2.5 Pro** is noted as their most intelligent model with improved coding from simple prompts, while **Gemini 2.5 Flash** incurs a 150x cost increase over Gemini 2.0 Flash due to higher token usage and cost. The **Absolute Zero Reasoner (AZR)** achieves SOTA performance in coding and math reasoning via reinforced self-play without external data. Vision-language model **X-REASONER** is post-trained on general-domain text for reasoning. **Apple ML research** released **FastVLM** with on-device iPhone demo. **HiDream LoRA trainer** supports QLoRA fine-tuning under memory constraints. **Nvidia's Parakeet ASR model** tops Hugging Face ASR leaderboard with MLX implementation. New datasets **SwallowCode** and **SwallowMath** boost LLM performance in math and code. Overall, a quiet day with significant model releases and performance insights.

AI Engineer World's Fair: Second Run, Twice The Fun

Wed, 07 May 2025 05:44:39 GMT

**The 2025 AI Engineer World's Fair** is expanding with **18 tracks** covering topics like **Retrieval + Search**, **GraphRAG**, **RecSys**, **SWE-Agents**, **Agent Reliability**, **Reasoning + RL**, **Voice AI**, **Generative Media**, **Infrastructure**, **Security**, and **Evals**. New focuses include **MCP**, **Tiny Teams**, **Product Management**, **Design Engineering**, and **Robotics and Autonomy** featuring foundation models from **Waymo**, **Tesla**, and **Google**. The event highlights the growing importance of **AI Architects** and enterprise AI leadership. Additionally, **Demis Hassabis** announced the **Gemini 2.5 Pro Preview 'I/O edition'**, which leads coding and web development benchmarks on **LMArena**.

Gemini 2.5 Pro Preview 05-06 (I/O edition) - the SOTA vision+coding model

Tue, 06 May 2025 05:44:39 GMT

**Gemini 2.5 Pro** has been updated with enhanced multimodal image-to-code capabilities and dominates the WebDev Arena Leaderboard, surpassing **Claude 3.7 Sonnet** in coding and other tasks. **Nvidia** released the **Llama-Nemotron** model family on Hugging Face, noted for efficient reasoning and inference. **Alibaba's Qwen3** models range from 0.6B to 235B parameters, including dense and MoE variants. **KerasRS** was released by **Franois Chollet** as a new recommender system library compatible with JAX, PyTorch, and TensorFlow, optimized for TPUs. These updates highlight advancements in coding, reasoning, and speech recognition models.

Cursor @ $9b, OpenAI Buys Windsurf @ $3b

Mon, 05 May 2025 05:44:39 GMT

**OpenAI** is reportedly close to closing a deal with Windsurf, coinciding with **Cursor's** $900M funding round at a $9B valuation. **Nvidia** launched the **Llama-Nemotron series** featuring models from 8B to 253B parameters, praised for reasoning and inference efficiency. **Alibaba** released the **Qwen3 family** with MoE and dense models up to 235B parameters, ranking highly in coding and math benchmarks. **DeepSeek** introduced **Prover-V2**, an open-source AI for math reasoning with an 88.9% pass rate on MiniF2F-test. **Microsoft** released reasoning-focused **Phi-4 models**, outperforming OpenAI's **o1-mini**. **Baidu** debuted turbo versions of **ERNIE 4.5 and X1** for faster, cheaper inference. **Suno v4.5** added advanced AI music generation features, while **Runway Gen-4 References** enable placing characters into scenes with high consistency. **KerasRS**, a new recommender system library optimized for TPUs, was released by **Franois Chollet**.

not much happened today

Fri, 02 May 2025 05:44:39 GMT

**Qwen model family** released quantized versions of Qwen3 models including **14B**, **32B**, and **235B** parameters, with promising coding capabilities in Qwen3-235B. **Microsoft** launched **Phi-4-reasoning**, a **14B** parameter model distilled from OpenAI's o3-mini, emphasizing supervised fine-tuning and reinforcement learning, outperforming larger models in some benchmarks. **Cohere's Command A** leads SQL performance on Bird Bench. **Google** introduced the **TRAJAN** eval for video generation temporal consistency and updated the **Gemini** OpenAI compatibility layer. **Inception Labs** launched a diffusion LLM API claiming 5x speed improvements over autoregressive models. Community rankings show **OpenAI's o3** model debuting strongly in web app-building tasks. Other releases include **AllenAI's OLMo2 1B** and additional Phi 4 variants. *"Qwen3-235B shows promise for coding"* and *"Phi-4-reasoning tech report emphasizes SFT gains"* highlight key advancements.

not much happened today

Thu, 01 May 2025 05:44:39 GMT

**Microsoft** released **Phi-reasoning 4**, a finetuned 14B reasoning model slightly behind QwQ but limited by data transparency and token efficiency issues. **Anthropic** introduced remote MCP server support and a 45-minute Research mode in **Claude**. **Cursor** published a model popularity list. **Alibaba** launched **Qwen3-235B** and other Qwen3 variants, highlighting budget-friendly coding and reasoning capabilities, with availability on **Together AI** API. **Microsoft** also released **Phi-4-Mini-Reasoning** with benchmark performance on AIME 2025 and OmniMath. **DeepSeek** announced **DeepSeek-Prover V2** with state-of-the-art math problem solving, scaling to 671B parameters. **Meta AI**'s **Llama** models hit 1.2 billion downloads, with new **Llama Guard 4** and **Prompt Guard 2** for input/output filtering and jailbreak prevention. **Xiaomi** released the open-source reasoning model **MiMo-7B** trained on 25 trillion tokens. Discussions on AI model evaluation highlighted issues with the **LMArena leaderboard**, data access biases favoring proprietary models, and challenges in maintaining fair benchmarking, with suggestions for alternatives like **OpenRouterAI** rankings. *"LMArena slop and biased"* and *"61.3% of all data going to proprietary model providers"* were noted concerns.

ChatGPT responds to GlazeGate + LMArena responds to Cohere

Wed, 30 Apr 2025 15:44:39 GMT

**OpenAI** faced backlash after a controversial ChatGPT update, leading to an official retraction admitting they "focused too much on short-term feedback." Researchers from **Cohere** published a paper criticizing **LMArena** for unfair practices favoring incumbents like **OpenAI**, **DeepMind**, **X.ai**, and **Meta AI Fair**. The **Qwen3 family** by **Alibaba** was released, featuring models up to **235B MoE**, supporting **119 languages** and trained on **36 trillion tokens**, with integration into **vLLM** and support in tools like **llama.cpp**. Meta announced the second round of **Llama Impact Grants** to promote open-source AI innovation. Discussions on AI Twitter highlighted concerns about leaderboard overfitting and fairness in model benchmarking, with notable commentary from **karpathy** and others.

LlamaCon: Meta AI gets into the Llama API platform business

Tue, 29 Apr 2025 05:44:39 GMT

**Meta** celebrated progress in the **Llama** ecosystem at LlamaCon, launching an AI Developer platform with finetuning and fast inference powered by **Cerebras** and **Groq** hardware, though it remains waitlisted. Meanwhile, **Alibaba** released the **Qwen3** family of large language models, including **two MoE models** and **six dense models** ranging from **0.6B to 235B parameters**, with the flagship **Qwen3-235B-A22B** achieving competitive benchmark results and supporting **119 languages and dialects**. The Qwen3 models are optimized for coding and agentic capabilities, are Apache 2.0 licensed, and have broad deployment support including local usage with tools like **vLLM**, **Ollama**, and **llama.cpp**. Community feedback highlights Qwen3's scalable performance and superiority over models like OpenAI's **o3-mini**.

Qwen 3: 0.6B to 235B MoE full+base models that beat R1 and o1

Mon, 28 Apr 2025 05:44:39 GMT

**Qwen 3** has been released by **Alibaba** featuring a range of models including two MoE variants, **Qwen3-235B-A22B** and **Qwen3-30B-A3B**, which demonstrate competitive performance against top models like **DeepSeek-R1**, **o1**, **o3-mini**, **Grok-3**, and **Gemini-2.5-Pro**. The models introduce an "enable_thinking=True" mode with advanced soft switching for inference scaling. The release is notable for its Apache 2.0 license and broad inference platform support including MCP. The dataset improvements and multi-stage RL post-training contribute to performance gains. Meanwhile, **Gemini 2.5 Pro** from **Google DeepMind** shows strong coding and long-context reasoning capabilities, and **DeepSeek R2** is anticipated soon. Twitter discussions highlight Qwen3's finegrained MoE architecture, large context window, and multi-agent system applications.

Cognition's DeepWiki, a free encyclopedia of all GitHub repos

Fri, 25 Apr 2025 05:44:39 GMT

**Silas Alberti** of **Cognition** announced **DeepWiki**, a free encyclopedia of all GitHub repos providing Wikipedia-like descriptions and Devin-backed chatbots for public repos. **Meta** released **Perception Encoders (PE)** with A2.0 license, outperforming **InternVL3** and **Qwen2.5VL** on vision tasks. **Alibaba** launched the **Qwen Chat App** for iOS and Android. **Hugging Face** integrated the **Dia 1.6B SoTA** text-to-speech model via **FAL**. **OpenAI** expanded deep research usage with a lightweight version powered by **o4-mini** model, now available to free users. **Perplexity AI** updated their model selector with **Grok 3 Beta**, **o4-mini**, and support for models like **gemini 2.5 pro**, **claude 3.7**, and **gpt-4.1**. **vLLM** project introduced **OpenRLHF** framework for reinforcement learning with human feedback. **Surya OCR** alpha model supports 90+ languages and LaTeX. **MegaParse** open-source library was introduced for LLM-ready data formats.

not much happened today

Thu, 24 Apr 2025 05:44:39 GMT

AI news for April 23-24, 2025, covering new model releases, benchmarks, and research developments from companies like openai, google deepmind, anthropic, and epoch ai research.

gpt-image-1 - ChatGPT's imagegen model, confusingly NOT 4o, now available in API

Wed, 23 Apr 2025 05:44:39 GMT

**OpenAI** officially launched the **gpt-image-1** API for image generation and editing, supporting features like alpha channel transparency and a "low" content moderation policy. **OpenAI's** models **o3** and **o4-mini** are leading in benchmarks for style control, math, coding, and hard prompts, with **o3** ranking #1 in several categories. A new benchmark called **Vending-Bench** reveals performance variance in LLMs on extended tasks. **GPT-4.1** ranks in the top 5 for hard prompts and math. **Nvidia's** **Eagle 2.5-8B** matches **GPT-4o** and **Qwen2.5-VL-72B** in long-video understanding. AI supercomputer performance doubles every 9 months, with **xAI's Colossus** costing an estimated $7 billion and the US dominating 75% of global performance. The Virology Capabilities Test shows **OpenAI's o3** outperforms 94% of expert virologists. **Nvidia** also released the **Describe Anything Model (DAM)**, a multimodal LLM for detailed image and video captioning, now available on Hugging Face.

not much happened today

Tue, 22 Apr 2025 05:44:39 GMT

**Nemotron-H** model family introduces hybrid Mamba-Transformer models with up to **3x faster inference** and variants including **8B**, **56B**, and a compressed **47B** model. **Nvidia Eagle 2.5** is a frontier VLM for long-context multimodal learning, matching **GPT-4o** and **Qwen2.5-VL-72B** on long-video understanding. **Gemini 2.5 Flash** shows improved dynamic thinking and cost-performance, outperforming previous Gemini versions. **Gemma 3** now supports **torch.compile** for about **60% faster inference** on consumer GPUs. **SRPO** using **Qwen2.5-32B** surpasses DeepSeek-R1-Zero-32B on benchmarks with reinforcement learning only. **Alibaba's Uni3C** unifies 3D-enhanced camera and human motion controls for video generation. **Seedream 3.0** by **ByteDance** is a bilingual image generation model with high-resolution outputs up to **2K**. **Adobe DRAGON** optimizes diffusion generative models with distributional rewards. **Kimina-Prover Preview** is an LLM trained with reinforcement learning from **Qwen2.5-72B**, achieving **80.7% pass@8192** on miniF2F. **BitNet b1.58 2B4T** is a native 1-bit LLM with **2B parameters** trained on **4 trillion tokens**, matching full-precision LLM performance with better efficiency. Antidistillation sampling counters unwanted model distillation by modifying reasoning traces from frontier models.

not much happened today; New email provider for AINews

Mon, 21 Apr 2025 05:44:39 GMT

**Smol AI** is migrating its AI news email service to **Resend** to improve deliverability and enable new features like personalizable AI news and a "Hacker News of AI." Recent AI model updates include **OpenAI**'s API-only **GPT-4.1**, **Google Gemini 2.5 Flash** reasoning model, **ByteDance Seaweed** 7B-param video AI, **Anthropic Claude**'s values system, **Cohere Embed 4** multimodal embedding model, and **xAI Grok** updates with Memory and Studio features. Discussions also cover agentic workflows for document automation and AI coding patterns.

Grok 3 & 3-mini now API Available

Sat, 19 Apr 2025 05:44:39 GMT

**Grok 3** API is now available, including a smaller version called Grok 3 mini, which offers competitive pricing and full reasoning traces. **OpenAI** released a practical guide for building AI agents, while **LlamaIndex** supports the Agent2Agent protocol for multi-agent communication. **Codex CLI** is gaining traction with new features and competition from **Aider** and **Claude Code**. **GoogleDeepMind** launched **Gemini 2.5 Flash**, a hybrid reasoning model topping the Chatbot Arena leaderboard. **OpenAI**'s o3 and o4-mini models show emergent behaviors from large-scale reinforcement learning. **EpochAIResearch** updated its methodology, removing **Maverick** from high FLOP models as **Llama 4 Maverick** training compute drops. **GoodfireAI** announced a $50M Series A for its Ember neural programming platform. **Mechanize** was founded to build virtual work environments and automation benchmarks. **GoogleDeepMind**'s Quantisation Aware Training for Gemma 3 models reduces model size significantly, with open source checkpoints available.

Gemini 2.5 Flash completes the total domination of the Pareto Frontier

Fri, 18 Apr 2025 02:06:17 GMT

**Gemini 2.5 Flash** is introduced with a new "thinking budget" feature offering more control compared to Anthropic and OpenAI models, marking a significant update in the Gemini series. **OpenAI** launched **o3** and **o4-mini** models, emphasizing advanced tool use capabilities and multimodal understanding, with **o3** dominating several leaderboards but receiving mixed benchmark reviews. The importance of tool use in AI research and development is highlighted, with **OpenAI Codex CLI** announced as a lightweight open-source coding agent. The news reflects ongoing trends in AI model releases, benchmarking, and tool integration.

OpenAI o3, o4-mini, and Codex CLI

Thu, 17 Apr 2025 03:17:29 GMT

**OpenAI** launched the **o3** and **o4-mini** models, emphasizing improvements in **reinforcement-learning scaling** and overall efficiency, making **o4-mini** cheaper and better across prioritized metrics. These models showcase enhanced **vision** and **tool use** capabilities, though API access for these features is pending. The release includes **Codex CLI**, an open-source coding agent that integrates with these models to convert natural language into working code. Accessibility extends to **ChatGPT Plus, Pro, and Team users**, with **o3** being notably more expensive than **Gemini 2.5 Pro**. Performance benchmarks highlight the intelligence gains from scaling inference, with comparisons against models like **Sonnet** and **Gemini**. The launch has been well received despite some less favorable evaluation results.

QwQ-32B claims to match DeepSeek R1-671B

Wed, 16 Apr 2025 19:06:15 GMT

**Alibaba Qwen** released their **QwQ-32B** model, a **32 billion parameter** reasoning model using a novel two-stage reinforcement learning approach: first scaling RL for math and coding tasks with accuracy verifiers and code execution servers, then applying RL for general capabilities like instruction following and alignment. Meanwhile, **OpenAI** rolled out **GPT-4.5** to Plus users, with mixed feedback on coding performance and noted inference cost improvements. The QwQ model aims to compete with larger MoE models like **DeepSeek-R1**. *"GPT-4.5 is unusable for coding"* was a notable user critique, while others praised its reasoning improvements due to scaling pretraining.

SOTA Video Gen: Veo 2 and Kling 2 are GA for developers

Wed, 16 Apr 2025 05:55:06 GMT

**Google's Veo 2** video generation model is now available in the **Gemini API** with a cost of **35 cents per second** of generated video, marking a significant step in accessible video generation. Meanwhile, China's **Kling 2** model launched with pricing around **$2 for a 10-second clip** and a minimum subscription of **$700 per month for 3 months**, generating excitement despite some skill challenges. **OpenAI** announced the **GPT-4.1 family** release, including **GPT-4.1, GPT-4.1 mini, and GPT-4.1 nano**, highlighting improvements in **coding, instruction following, and a 1 million token context window**. The GPT-4.1 models are **26% cheaper than GPT-4o** and will replace the **GPT-4.5 Preview** API version by July 14. Performance benchmarks show GPT-4.1 achieving **54-55% on SWE-bench verified** and a **60% improvement over GPT-4o** in some internal tests, though some critiques note it underperforms compared to other models like OpenRouter and DeepSeekV3 in coding tasks. The release is API-only, with a prompting guide provided for developers.

GPT 4.1: The New OpenAI Workhorse

Tue, 15 Apr 2025 05:16:26 GMT

**OpenAI** released **GPT-4.1**, including **GPT-4.1 mini** and **GPT-4.1 nano**, highlighting improvements in **coding**, **instruction following**, and handling **long contexts** up to **1 million tokens**. The model achieves a **54 score on SWE-bench verified** and shows a **60% improvement over GPT-4o** on internal benchmarks. Pricing for **GPT-4.1 nano** is notably low at **$0.10/1M input** and **$0.40/1M output**. **GPT-4.5 Preview** is being deprecated in favor of **GPT-4.1**. Integration support includes **Llama Index** with day 0 support. Some negative feedback was noted for **GPT-4.1 nano**. Additionally, **Perplexity's Sonar API** ties with **Gemini-2.5 Pro** for the top spot in the LM Search Arena leaderboard. New benchmarks like **MRCR** and **GraphWalks** were introduced alongside updated prompting guides and cookbooks.

not much happened today

Fri, 11 Apr 2025 20:07:39 GMT

The AI news recap highlights independent evaluations showing **Grok-3** outperforming models like **GPT-4.5** and **Claude 3.7 Sonnet** on reasoning benchmarks, while **Grok-3 mini** excels in reasoning tasks. Research on **reinforcement learning (RL)** fine-tuning reveals potential improvements for small reasoning models but also notes instability in reported gains. Benchmark results suggest **Quasar Alpha** and **Optimus Alpha** may be versions of **GPT-4.1**. Vision and multimodal models like **Kaleidoscope**, supporting 18 languages, and **InternVL3**, built on **InternViT** and **Qwen2.5VL**, demonstrate advances in multilingual vision and reasoning. The fusion model **TransMamba** combines transformer precision with speed via **SSM** mechanisms. Alibaba's **FantasyTalking** generates realistic talking portraits. Agent-focused events at **CMU** and tools like **FilmAgent AI** for virtual film production and **BrowseComp** benchmark for browsing agents were announced. The coding assistant **Augment** supports multiple IDEs with code analysis and suggestions. Discussions also covered Google’s new agent-to-agent protocol concept.

not much happened today

Fri, 11 Apr 2025 00:53:38 GMT

**OpenAI** teased a *Memory update in ChatGPT* with limited technical details. Evidence suggests upcoming releases of **o3** and **o4-mini** models, alongside a press leak about **GPT-4.1**. **X.ai** launched the **Grok 3** and **Grok 3 mini** APIs, confirmed as **o1** level models. Discussions compared **Google's TPUv7** with **Nvidia's GB200**, highlighting TPUv7's specs like **4,614 TFLOP/s FP8 performance**, **192 GB HBM**, and **1.2 Tbps ICI bandwidth**. TPUv7 may have pivoted from training to inference chip use. Key AI events include **Google Cloud Next 2025** and **Samsung's Gemini-powered Ballie robot**. The community is invited to participate in the **AI Engineer World's Fair 2025** and the 2025 State of AI Engineering survey.

Google's Agent2Agent Protocol (A2A)

Thu, 10 Apr 2025 01:31:18 GMT

**Google Cloud Next** announcements featured the launch of **Google and DeepMind's** full **MCP support** and a new **Agent to Agent protocol** designed for agent interoperability with multiple partners. The protocol includes components like the **Agent Card**, **Task communication channels**, **Enterprise Auth and Observability**, and **Streaming and Push Notification support**. On the model front, **Moonshot AI** released **Kimi-VL-A3B**, a multimodal model with **128K context** and strong vision and math benchmark performance, outperforming **gpt-4o**. **Meta AI** introduced smaller versions of **llama-4** family models: **llama-4-scout** and **llama-4-maverick**, with a larger **Behemoth** model still in training. **DeepCoder 14B** from **UC Berkeley** is an open-source coding model rivaling **openai's o3-mini** and **o1** models, trained with reinforcement learning on 24K coding problems. **Nvidia** released **llama-3.1-nemotron-ultra-253b** on Hugging Face, noted for beating **llama-4-behemoth** and **maverick** and competing with **deepseek-r1**.

DeepCoder: A Fully Open-Source 14B Coder at O3-mini Level

Wed, 09 Apr 2025 19:51:30 GMT

**Together AI and Agentica** released **DeepCoder-14B**, an open-source 14B parameter coding model rivaling OpenAI's **o3-mini** and **o1** on coding benchmarks, trained with an open-source RL framework from ByteDance and costing about **$26,880**. **Google DeepMind** launched **Gemini 2.5 Pro** with experimental "Flash" versions available to subscribers. **Moonshot AI** introduced **Kimi-VL-A3B**, a multimodal model with **128K context** outperforming **gpt-4o** on vision and math benchmarks. **Meta AI** released **Llama 4 Scout** and **Maverick**, with a larger **Behemoth** model in training, featuring mixture-of-experts and L2 norm techniques. **Runway** launched **Gen-4 Turbo** with 10x better results than Gen-3 at the same cost. **Google** announced **Imagen 3**, a high-quality text-to-image model now in Vertex AI, enabling easier object removal. The report highlights open-source contributions, reinforcement learning training optimizations, and significant model performance improvements across coding, multimodal, and image generation domains.

Llama 4's Controversial Weekend Release

Tue, 08 Apr 2025 01:55:40 GMT

**Meta** released **Llama 4**, featuring two new medium-size MoE open models and a promised 2 Trillion parameter "behemoth" model, aiming to be the largest open model ever. The release included advanced training techniques like Chameleon-like early fusion with MetaCLIP, interleaved chunked attention without RoPE, native FP8 training, and training on up to 40 trillion tokens. Despite the hype, the release faced criticism for lack of transparency compared to Llama 3, implementation issues, and poor performance on some benchmarks. Meta leadership, including **Ahmad Al Dahle**, denied allegations of training on test sets. The smallest Scout model at 109B parameters is too large for consumer GPUs, and the claimed 10 million token context is disputed. The community response has been mixed, with some praising the openness and others pointing out discrepancies and quality concerns.

not much happened today

Sat, 05 Apr 2025 01:50:06 GMT

**OpenAI** announced that **o3** and **o4-mini** models will be released soon, with **GPT-5** expected in a few months, delayed for quality improvements and capacity planning. **DeepSeek** introduced **Self-Principled Critique Tuning (SPCT)** to enhance inference-time scalability for generalist reward models. **Anthropic's Sonnet 3.7** remains a top coding model. **Google's Gemma 3** is available on KerasHub, and **Qwen 2.5 VL** powers a new Apache 2.0 licensed OCR model. **Gemini 2.5 Pro** entered public preview with increased rate limits and pricing announced, becoming a preferred model for many tasks except image generation. Meta's architectural advantage and the **FrontierMath benchmark** challenge AI's long-form reasoning and worldview development. Research reveals LLMs focus attention on the first token as an "attention sink," preserving representation diversity, demonstrated in **Gemma 7B** and **LLaMa 3.1** models. **MegaScale-Infer** offers efficient serving of large-scale Mixture-of-Experts models with up to **1.90x higher per-GPU throughput**.

not much happened today

Fri, 04 Apr 2025 06:34:03 GMT

**Gemini 2.5 Pro** shows strengths and weaknesses, notably lacking LaTex math rendering unlike **ChatGPT**, and scored **24.4%** on the **2025 US AMO**. **DeepSeek V3** ranks 8th and 12th on recent leaderboards. **Qwen 2.5** models have been integrated into the **PocketPal** app. Research from **Anthropic** reveals that **Chains-of-Thought (CoT)** reasoning is often unfaithful, especially on harder tasks, raising safety concerns. **OpenAI**'s **PaperBench** benchmark shows AI agents struggle with long-horizon planning, with **Claude 3.5 Sonnet** achieving only **21.0%** accuracy. **CodeAct** framework generalizes **ReAct** for dynamic code writing by agents. **LangChain** explains multi-agent handoffs in LangGraph. **Runway Gen-4** marks a new phase in media creation.

not much happened today

Wed, 02 Apr 2025 06:14:34 GMT

**OpenAI** plans to release its first open-weight language model since **GPT-2** in the coming months, signaling a move towards more open AI development. **DeepSeek** launched its open-source **R1 model** earlier this year, challenging perceptions of China's AI progress. **Gemma 3** has achieved function calling capabilities and ranks on the **Berkeley Function-Calling Leaderboard**, while **GemmaCoder3-12b** improves code reasoning performance on **LiveCodeBench**. **Alibaba_Qwen's Qwen2.5-Omni** introduces a novel Thinker-Talker system and **TMRoPE** for multimodal input understanding. The **TogetherCompute** team achieved **140 TPS** on a 671B parameter model, outperforming **Azure** and **DeepSeek API** on **Nvidia GPUs**. **OpenAI** also expanded **ChatGPT** features with image generation for all free users and a new voice release. **Runway Gen-4** enhances animation for miniature dioramas, and **LangChain** launched a chat-based generative UI agent. Commercial deployment of **Figure 03 humanoid robots** at **BMW** highlights advances in autonomy and manufacturing scaling. New tools include **OpenAI's realtime transcription API** with **WebRTC** support and **Amazon's Nova Act AI browser agent**.

>$41B raised today (OpenAI @ 300b, Cursor @ 9.5b, Etched @ 1.5b)

Tue, 01 Apr 2025 06:33:20 GMT

**OpenAI** is preparing to release a highly capable open language model, their first since GPT-2, with a focus on reasoning and community feedback, as shared by **@kevinweil** and **@sama**. **DeepSeek V3 0324** has achieved the #5 spot on the Arena leaderboard, becoming the top open model with an MIT license and cost advantages. **Gemini 2.5 Pro** is noted for outperforming models like **Claude 3.7 Sonnet** in coding tasks, with upcoming pricing and improvements expected soon. New startups like **Sophont** are building open multimodal foundation models for healthcare. Significant fundraises include **Cursor** closing $625M at a $9.6B valuation and **Etched** raising $85M at $1.5B. Innovations in AI infrastructure include **SkyPilot's** cost-efficient cloud provisioning and the launch of **AgentEvals**, an open-source package for evaluating AI agents. Discussions on smartphone privacy highlight **iPhone's** stronger user defense compared to Android.

not much happened today

Fri, 28 Mar 2025 23:18:38 GMT

**GPT-4o** was praised for its improved coding, instruction following, and freedom, becoming the leading non-reasoning coding model surpassing **DeepSeek V3** and **Claude 3.7 Sonnet** in coding benchmarks, though it still lags behind reasoning models like **o3-mini**. Concerns about policy compliance in image generation were noted, with efforts to improve adherence. **Gemini 2.5 Pro** was highlighted for its advanced audio and video understanding, long context capabilities, and integration with platforms like **Cursor AI** and **Windsurf AI**. AI infrastructure developments include a partnership between **Together AI** and **Hypertec Group** to deliver large-scale GPU clusters, and **CoreWeave's IPO** was celebrated for advancing AI infrastructure. GPU and TPU usage is expected to increase significantly. *"GPT-4o's transparency and background generation feature"* and *"Gemini 2.5 Pro scored above 50% on Simple-Bench AI Explanation"* were key highlights.

not much happened today

Fri, 28 Mar 2025 01:20:31 GMT

**OpenAI** announced the new **GPT-4o** model with enhanced instruction-following, complex problem-solving, and native image generation capabilities. The model shows improved performance in math, coding, and creativity, with features like transparent background image generation. Discussions around content filtering and policy for image generation emphasize balancing creative freedom and harm prevention. **DeepSeek V3-0324** APIs, available on **Hugging Face** and powered by **SambaNovaAI**, outperform benchmarks and models like **Gemini 2.0 Pro** and **Claude 3.7 Sonnet**. **Gemini 2.5 Pro** is recommended for coding, and **Gemini 3** can be deployed easily on Google Cloud Vertex AI via the new Model Garden SDK. The **Gemma 3 Technical Report** has been released on arXiv.

OpenAI adopts MCP

Thu, 27 Mar 2025 01:07:34 GMT

**OpenAI** announced support for **MCP**, a significant technical update. **Google's Gemini 2.5 Pro** leads benchmarks with top scores in **MMLU-Pro (86%)**, **GPQA Diamond (83%)**, and **AIME 2024 (88%)**, featuring a **1 million token context window** and multimodal inputs. **Alibaba's Qwen 2.5 Omni 7B** was released as a fully multimodal, interactive, open-source model with a novel "thinker-talker" architecture supporting voice and video chat. **DeepSeek V3-0324** outperforms its predecessor on multiple benchmarks. Research on reasoning features in large language models using sparse autoencoders was highlighted, alongside a study on scaling laws of synthetic data showing performance plateaus near **300B tokens**. Discussions also covered the fastest output speeds of Gemini models and concerns about over-reliance on benchmarks for intelligence measurement. *Swyx* will curate the Data Council AI Engineering Track in April.

Gemini 2.5 Pro + 4o Native Image Gen

Wed, 26 Mar 2025 01:13:42 GMT

**Gemini 2.5 Pro** from **Google DeepMind** has become the new top AI model, surpassing **Grok 3** by 40 LMarena points, with contributions from **Noam Shazeer** integrating Flash Thinking techniques. It is available as a free, rate-limited experimental model. Meanwhile, **OpenAI** released **GPT 4o Native Images**, an autoregressive image generation model with detailed insights shared by **Allan Jabri** and credits to **Gabe Goh**. Gemini 2.5 Pro excels in reasoning, coding, STEM, multimodal tasks, and instruction following, topping the LMarena leaderboard significantly. It is accessible via Google AI Studio and the Gemini App.

Halfmoon is Reve Image: a new SOTA Image Model from ex-Adobe/Stability trio

Tue, 25 Mar 2025 01:43:04 GMT

**Reve**, a new composite AI model from former Adobe and Stability alums **Christian Cantrell**, **Taesung Park**, and **Michaël Gharbi**, has emerged as the top-rated image generation model, surpassing previous state-of-the-art models like Recraft and Ideogram in text rendering and typography. The team emphasizes *"enhancing visual generative models with logic"* and *"understanding user intent with advanced language capabilities"* to iteratively amend visuals based on natural language input. Additionally, **DeepSeek-V3-0324** and **Alibaba's Qwen2.5-VL-32B-Instruct** models were released with notable performance improvements, including better vision task benchmarks and mathematical reasoning.

lots of little things happened this week

Sat, 22 Mar 2025 00:20:28 GMT

**Anthropic** introduced a novel 'think' tool enhancing instruction adherence and multi-step problem solving in agents, with combined reasoning and tool use demonstrated by **Claude**. **NVIDIA**'s **Llama-3.3-Nemotron-Super-49B-v1** ranked #14 on LMArena, noted for strong math reasoning and a 15M post-training dataset. **Sakana AI** launched a Sudoku-based reasoning benchmark to advance AI problem-solving capabilities. **Meta AI** released **SWEET-RL**, a reinforcement learning algorithm improving long-horizon multi-turn tasks by 6%, and introduced **CollaborativeAgentBench**, a benchmark for collaborative LLM agents working with humans on programming and design tasks. **Percy Liang** relaunched the **HELM** benchmark with 5 challenging datasets evaluating 22 top language models.

Promptable Prosody, SOTA ASR, and Semantic VAD: OpenAI revamps Voice AI

Thu, 20 Mar 2025 22:51:24 GMT

**OpenAI** has launched three new state-of-the-art audio models in their API, including **gpt-4o-transcribe**, a speech-to-text model outperforming Whisper, and **gpt-4o-mini-tts**, a text-to-speech model with promptable prosody allowing control over timing and emotion. The **Agents SDK** now supports audio, enabling voice agents. OpenAI also updated turn detection for real-time voice activity detection (VAD) based on speech content. Additionally, **OpenAI's o1-pro** model is available to select developers with advanced features like vision and function calling, though at higher compute costs. The community shows strong enthusiasm for these audio advancements, with a radio contest for TTS creations underway. Meanwhile, **Kokoro-82M v1.0** emerges as a leading open weights TTS model with competitive pricing on Replicate.

Every 7 Months: The Moore's Law for Agent Autonomy

Thu, 20 Mar 2025 01:59:24 GMT

**METR** published a paper measuring AI agent autonomy progress, showing it has doubled every 7 months since **2019 (GPT-2)**. They introduced a new metric, the **50%-task-completion time horizon**, where models like **Claude 3.7 Sonnet** achieve 50% success in about 50 minutes. Projections estimate **1 day autonomy by 2028** and **1 month autonomy by late 2029**. Meanwhile, **Nvidia** released **Cosmos-Transfer1** for conditional world generation and **GR00T-N1-2B**, an open foundation model for humanoid robot reasoning with 2B parameters. **Canopy Labs** introduced **Orpheus 3B**, a high-quality text-to-speech model with zero-shot voice cloning and low latency. **Meta** reportedly delayed **Llama-4** release due to performance issues. **Microsoft** launched **Phi-4-multimodal**.

not much happened today

Tue, 18 Mar 2025 22:00:12 GMT

At Nvidia GTC Day 1, several AI updates were highlighted: **Google's Gemini 2.0 Flash** introduces image input/output but is not recommended for text-to-image tasks, with **Imagen 3** preferred for that. **Mistral AI** released **Mistral Small 3.1** with 128k token context window and competitive pricing. **Allen AI** launched **OLMo-32B**, an open LLM outperforming **GPT-4o mini** and **Qwen 2.5**. **ShieldGemma 2** was introduced for image safety classification. **LangChainAI** announced multiple updates including **Julian** powered by **LangGraph** and integration with **AnthropicAI's MCP**. Jeremy Howard released **fasttransform**, a Python library for data transformations. **Perplexity AI** partnered with **Kalshi** for NCAA March Madness predictions.

Cohere's Command A claims #3 open model spot (after DeepSeek and Gemma)

Tue, 18 Mar 2025 00:28:53 GMT

**Cohere's Command A** model has solidified its position on the LMArena leaderboard, featuring an open-weight **111B** parameter model with an unusually long **256K context window** and competitive pricing. **Mistral AI** released the lightweight, multilingual, and multimodal **Mistral AI Small 3.1** model, optimized for single RTX 4090 or Mac 32GB RAM setups, with strong performance on instruct and multimodal benchmarks. The new OCR model **SmolDocling** offers fast document reading with low VRAM usage, outperforming larger models like Qwen2.5VL. Discussions highlight the importance of system-level improvements over raw LLM advancements, and **MCBench** is recommended as a superior AI benchmark for evaluating model capabilities across code, aesthetics, and awareness.

not much happened today

Fri, 14 Mar 2025 22:57:23 GMT

**Google DeepMind** announced updates to **Gemini 2.0**, including an upgraded **Flash Thinking model** with stronger reasoning and native image generation capabilities. **Cohere** launched **Command A**, a **111B** parameter dense model with a **256K context window** and competitive pricing, available on **Hugging Face**. **Meta AI** proposed **Dynamic Tanh (DyT)** as a replacement for normalization layers in Transformers, supported by **Yann LeCun**. **Alibaba** released **QwQ-32B**, a **32.5B** parameter model excelling in math and coding, fine-tuned with reinforcement learning and freely available under **Apache 2.0 license**. **Google DeepMind** also released **Gemma 3** models ranging from **1B to 27B** parameters with a **128K token context window** and over **140 language** support, plus **ShieldGemma 2**, an image safety checker. Benchmarking shows **Gemma 3 27B** has strong vision and memory efficiency but is outperformed by larger models like **Llama 3.3 70B** and **DeepSeek V3 671B**. The **Hugging Face LLM leaderboard** history was shared by @_lewtun.

not much happened today

Thu, 13 Mar 2025 21:13:47 GMT

**DeepSeek R1** demonstrates significant efficiency using **FP8** precision, outperforming **Gemma 3 27B** in benchmarks with a **Chatbot Arena Elo Score** of **1363** vs. **1338**, requiring substantial hardware like **32 H100 GPUs** and **2,560GB VRAM**. **OpenAI** labels **DeepSeek** as "state-controlled" and calls for bans on "PRC-produced" models, sparking community backlash accusing **OpenAI** and **Sam Altman** of anti-competitive behavior. Discussions emphasize **DeepSeek's** openness and affordability compared to **OpenAI**, with users highlighting its local and Hugging Face deployment options. Meanwhile, **Gemma 3** receives mixed community feedback on creativity and worldbuilding.

Gemma 3 beats DeepSeek V3 in Elo, 2.0 Flash beats GPT4o with Native Image Gen

Thu, 13 Mar 2025 01:01:43 GMT

**Google DeepMind** launched the **Gemma 3** family of models featuring a **128k context window**, **multimodal input (image and video)**, and **multilingual support for 140+ languages**. The **Gemma 3-27B** model ranks among the top open models on LMArena benchmarks, outperforming several competitors and matching **Gemini-1.5-Pro** on benchmarks. Additionally, **Gemini 2** introduced **Flash Native Image Generation** with advanced image editing capabilities, a feature teased by OpenAI but not launched. The updates highlight significant advances in context length, multimodality, and model efficiency via quantization.

The new OpenAI Agents Platform

Wed, 12 Mar 2025 00:23:17 GMT

**OpenAI** introduced a comprehensive suite of new tools for AI agents, including the **Responses API**, **Web Search Tool**, **Computer Use Tool**, **File Search Tool**, and an open-source **Agents SDK** with integrated observability tools, marking a significant step towards the "Year of Agents." Meanwhile, **Reka AI** open-sourced **Reka Flash 3**, a **21B parameter reasoning model** that outperforms **o1-mini** and powers their Nexus platform, with weights available on **Hugging Face**. The **OlympicCoder** series surpassed **Claude 3.7 Sonnet** and much larger models on competitive coding benchmarks. **DeepSeek** built a **32K GPU cluster** capable of training V3-level models in under a week and is exploring AI distillation. **Hugging Face** announced **Cerebras** inference support, achieving over **2,000 tokens/s** on **Llama 3.3 70B**, 70x faster than leading GPUs. **Reka's Sonic-2** voice AI model delivers **40ms latency** via the **Together API**. **Alibaba's Qwen Chat** enhanced its multimodal interface with video understanding up to **500MB**, voice-to-text, guest mode, and expanded file uploads. *Sama* praised OpenAI's new API as "one of the most well-designed and useful APIs ever."

not much happened today

Mon, 10 Mar 2025 22:46:37 GMT

The AI news recap highlights several key developments: **nanoMoE**, a PyTorch implementation of a mid-sized Mixture-of-Experts (MoE) model inspired by Andrej Karpathy's nanoGPT, enables pretraining on commodity hardware within a week. An agentic leaderboard ranks LLMs powering **smolagents CodeAgent**, with **GPT-4.5** leading, followed by **Claude-3.7-Sonnet**. Discussions around **DeepSeek-R1** emphasize AI model commoditization, with DeepSeek dubbed the "OpenAI of China." **Q-Filters** offer a training-free method for KV cache compression in autoregressive models, achieving **32x compression** with minimal perplexity loss. The **PokéChamp** minimax language agent, powered by **GPT-4o** and **Llama-3-8b**, demonstrates strong performance in Pokémon battles. Other notable models include **TinyR1-32B-Preview** with Branch-Merge Distillation, **R1-Searcher** incentivizing search capability via reinforcement learning, and the **Forgetting Transformer** using a Forget Gate in softmax attention. These advancements reflect ongoing innovation in model architectures, compression, reinforcement learning, and agentic AI.

DeepSeek's Open Source Stack

Sat, 08 Mar 2025 05:06:31 GMT

**DeepSeek's Open Source Week** was summarized by PySpur, highlighting multiple interesting releases. The **Qwen QwQ-32B model** was fine-tuned into **START**, excelling in PhD-level science QA and math benchmarks. **Character-3**, an omnimodal AI video generation model by Hedra Labs and Together AI, enables realistic animated content creation. **Google DeepMind** introduced the **Gemini embedding model** with an 8k context window, ranking #1 on MMTEB, alongside the **Gemini 2.0 Code Executor** supporting Python libraries and auto-fix features. **Inception Labs' Mercury Coder** is a diffusion-based code generation model offering faster token processing. **OpenAI** released **GPT-4.5**, their largest model yet but with less reasoning ability than some competitors. **AI21 Labs** launched **Jamba Mini 1.6**, noted for superior output speed compared to Gemini 2.0 Flash, GPT-4o mini, and Mistral Small 3. A new dataset of 1.9M scanned pages was released for OCR benchmarking, with **Mistral OCR** showing competitive but not top-tier document parsing performance compared to LLM/LVM-powered methods. *"Cracked engineers are all you need."*

not much happened today

Fri, 07 Mar 2025 05:50:14 GMT

**AI21 Labs launched Jamba 1.6**, touted as the **best open model for private enterprise deployment**, outperforming **Cohere, Mistral, and Llama** on benchmarks like **Arena Hard**. **Mistral AI** released a state-of-the-art **multimodal OCR model** with multilingual and structured output capabilities, available for on-prem deployment. **Alibaba Qwen** introduced **QwQ-32B**, an open-weight reasoning model with **32B parameters** and cost-effective usage, showing competitive benchmark scores. **OpenAI** released **o1** and **o3-mini** models with advanced API features including streaming and function calling. **AMD** unveiled **Instella**, open-source 3B parameter language models trained on **AMD Instinct MI300X GPUs**, competing with **Llama-3.2-3B** and others. **Alibaba** also released **Babel**, open multilingual LLMs performing comparably to **GPT-4o**. **Anthropic** launched **Claude 3.7 Sonnet**, enhancing reasoning and prompt engineering capabilities.

not much happened today

Wed, 05 Mar 2025 05:17:34 GMT

**Weights and Biases** announced a **$1.7 billion acquisition by CoreWeave** ahead of CoreWeave's IPO. **CohereForAI** released the **Aya Vision models (8B and 32B parameters)** supporting **23 languages**, outperforming larger models like **Llama-3.2 90B Vision** and **Molmo 72B**. **Microsoft** introduced **Phi-4-Mini (3.8B parameters)** and **Phi-4-Multimodal models**, excelling in math, coding, and multimodal benchmarks. **CogView4**, a **6B parameter text-to-image model** with **2048x2048 resolution** and Apache 2.0 license, was released. **Alibaba** launched **Wan 2.1**, an open-source video generation model with **720p output** and **16 fps generation**. **Google** announced new AI features for Pixel devices including **Scam Detection** and **Gemini integrations**. **LlamaCloud** reached **General Availability** and raised **$19M Series A funding**, serving over **100 Fortune 500 companies**. **Weaviate** launched the **Query Agent**, the first of three Weaviate Agents.

Anthropic's $61.5B Series E

Tue, 04 Mar 2025 06:51:49 GMT

**Anthropic** raised a **$3.5 billion Series E funding round** at a **$61.5 billion valuation**, signaling strong financial backing for the **Claude** AI model. **GPT-4.5** achieved **#1 rank across all categories** on the LMArena leaderboard, excelling in multi-turn conversations, coding, math, creative writing, and style control. **DeepSeek R1** tied with GPT-4.5 for top performance on hard prompts with style control. Discussions highlighted comparisons between **GPT-4.5** and **Claude 3.7 Sonnet** in coding and workflow applications. The importance of the **LMSYS benchmark** was emphasized, though some questioned the relevance of benchmarks versus user acquisition. Additionally, **Perplexity AI** partnered with **Deutsche Telekom** to integrate the **Perplexity Assistant** into a new AI phone.

not much happened today

Sat, 01 Mar 2025 03:41:57 GMT

**GPT-4.5** sparked mixed reactions on Twitter, with **@karpathy** noting users preferred **GPT-4** in a poll despite his personal favor for GPT-4.5's creativity and humor. Critics like **@abacaj** highlighted **GPT-4.5's slowness** and questioned its practical value and pricing compared to other models. Performance-wise, **GPT-4.5** ranks above **GPT-4o** but below **o1** and **Claude 3.5 Sonnet**, with **Claude 3.7** outperforming it on many tasks yet GPT-4.5 praised for its humor and "vibes." Speculation about GPT-4.5's size suggests around **5 trillion parameters**. Discussions also touched on pricing disparities, with **Perplexity Deep Research** at $20/month versus ChatGPT at $200/month. The emotional intelligence and humor of models like **Claude 3.7** were also noted.

GPT 4.5 — Chonky Orion ships!

Fri, 28 Feb 2025 07:24:08 GMT

**OpenAI released GPT-4.5** as a research preview, highlighting its **deep world knowledge**, **improved understanding of user intent**, and a **128,000 token context window**. It is noted for excelling in **writing, creative tasks, image understanding, and data extraction** but is not a reasoning model. **Microsoft unveiled Phi-4 Multimodal and Phi-4 Mini**, open-source models integrating **text, vision, and speech/audio**, with strong performance in **math and coding tasks**. **Cohere released Command R7B Arabic**, an open-weights model optimized for **Arabic language capabilities** targeting enterprises in the MENA region. The community is exploring the impact of larger models on creative writing, intent understanding, and world knowledge, with GPT-4.5 expected to be a basis for GPT-5.

lots of small launches

Thu, 27 Feb 2025 04:09:12 GMT

**GPT-4o Advanced Voice Preview** is now available for free ChatGPT users with enhanced daily limits for Plus and Pro users. **Claude 3.7 Sonnet** has achieved the top rank in WebDev Arena with improved token efficiency. **DeepSeek-R1** with 671B parameters benefits from the **Together Inference** platform optimizing NVIDIA Blackwell GPU usage, alongside the open-source **DeepGEMM** CUDA library delivering up to 2.7x speedups on Hopper GPUs. **Perplexity** launched a new Voice Mode and a **Deep Research API**. The upcoming **Grok 3 API** will support a 1M token context window. Several companies including **Elicit**, **Amazon**, **Anthropic**, **Cloudflare**, **FLORA**, **Elevenlabs**, and **Inception Labs** announced new funding rounds, product launches, and model releases.

not much happened today

Wed, 26 Feb 2025 02:19:12 GMT

**Claude 3.7 Sonnet** demonstrates exceptional coding and reasoning capabilities, outperforming models like **DeepSeek R1**, **O3-mini**, and **GPT-4o** on benchmarks such as **SciCode** and **LiveCodeBench**. It is available on platforms including **Perplexity Pro**, **Anthropic**, **Amazon Bedrock**, and **Google Cloud**, with pricing at **$3/$15 per million tokens**. Key features include a **64k token thinking mode**, **200k context window**, and the **CLI-based coding assistant Claude Code**. Meanwhile, **DeepSeek** released **DeepEP**, an open-source communication library optimized for MoE model training and inference with support for **NVLink**, **RDMA**, and **FP8**. These updates highlight advancements in coding AI and efficient model training infrastructure.

Claude 3.7 Sonnet

Tue, 25 Feb 2025 05:58:56 GMT

**Anthropic** launched **Claude 3.7 Sonnet**, their most intelligent model to date featuring hybrid reasoning with two thinking modes: near-instant and extended step-by-step thinking. The release includes **Claude Code**, an agentic coding tool in limited preview, and supports a **128k output token capability** in beta. Claude 3.7 Sonnet performs well on coding benchmarks like **SWE-Bench Verified** and **Cognition's junior-dev eval**, and introduces advanced features such as streaming thinking, prompt caching, and tool use. The model is also benchmarked on **Pokebench**, reflecting agentic capabilities similar to the Voyager paper. The launch is accompanied by extensive documentation, cookbooks, and prompting guides for extended thinking. *"The first generally available hybrid reasoning model"* and *"first coding tool from Anthropic"* were highlighted in social media announcements.

AI Engineer Summit Day 1

Sat, 22 Feb 2025 02:50:34 GMT

The **AIE Summit** in NYC highlighted key talks including **Grace Isford's Trends Keynote**, **Neo4j/Pfizer's presentation**, and **OpenAI's first definition of Agents**. Speakers announced **$930 million in funding**. On AI Twitter, discussions focused on **Grok-3** and **o3-mini** models, with debates on performance and benchmarking, including **Grok-3's record compute scale of 4e26 to 5e26 FLOP**. The **o3-mini** model uncovered a critical **CUDA kernel bug** in Sakana AI's code. **DeepSeek-R1** was promoted as an open-source alternative with notable training batch sizes. Additionally, **Alibaba** announced the **Qwen 2.5-VL** model release.

not much happened today

Fri, 21 Feb 2025 22:50:40 GMT

**Grok-3**, a new family of LLMs from **xAI** using **200,000 Nvidia H100 GPUs** for advanced reasoning, outperforms models from **Google, Anthropic, and OpenAI** on math, science, and coding benchmarks. **DeepSeek-R1** from **ByteDance Research** achieves top accuracy on the challenging **SuperGPQA** dataset. **SigLIP 2** from **GoogleDeepMind** improves semantic understanding and OCR with flexible resolutions and multilingual capabilities, available on HuggingFace. **OpenAI's o3-mini-high** ranks #1 in coding and math prompts. **Perplexity's R1 1776**, a post-trained version of DeepSeek R1, is available on Ollama. The **Llamba** family distills **Llama-3.x** into efficient recurrent models with higher throughput. **AlphaMaze** combines DeepSeek R1 with GRPO for visual reasoning on ARC-AGI puzzles. **Audiobox Aesthetics** from **Meta AI** offers unified quality assessment for audio. The community notes that Grok 3's compute increase yields only modest performance gains.

The Ultra-Scale Playbook: Training LLMs on GPU Clusters

Thu, 20 Feb 2025 05:57:17 GMT

**Huggingface** released "The Ultra-Scale Playbook: Training LLMs on GPU Clusters," an interactive blogpost based on **4000 scaling experiments on up to 512 GPUs**, providing detailed insights into modern GPU training strategies. **DeepSeek** introduced the Native Sparse Attention (NSA) model, gaining significant community attention, while **Perplexity AI** launched R1-1776, an uncensored and unbiased version of DeepSeek's R1 model. **Google DeepMind** unveiled PaliGemma 2 Mix, a multi-task vision-language model available in **3B, 10B, and 28B sizes**. **Microsoft** introduced Muse, a generative AI model trained on the game Bleeding Edge, and presented Magma, a foundation model for multimodal AI agents excelling in UI navigation and robotic manipulation. **Baichuan-M1-14B** was announced as a state-of-the-art medical LLM trained on **20T tokens**, and a fully open-source 40B genome modeling model using StripedHyena 2 architecture was also released. *"Making your own gaming experience is coming sooner than you'd think,"* noted in relation to Muse.

X.ai Grok 3 and Mira Murati's Thinking Machines

Tue, 18 Feb 2025 23:54:10 GMT

**Grok 3** has launched with mixed opinions but strong benchmark performance, notably outperforming models like **Gemini 2 Pro** and **GPT-4o**. The **Grok-3 mini** variant shows competitive and sometimes superior capabilities, especially in reasoning and coding, with reinforcement learning playing a key role. **Mira Murati** has publicly shared her post-OpenAI plan, founding the frontier lab **Thinking Machines**, focusing on collaborative, personalizable AI, multimodality, and empirical safety and alignment research, reminiscent of **Anthropic**'s approach.

LLaDA: Large Language Diffusion Models

Tue, 18 Feb 2025 03:27:47 GMT

**LLaDA (Large Language Diffusion Model) 8B** is a breakthrough diffusion-based language model that rivals **LLaMA 3 8B** while training on **7x fewer tokens (2 trillion tokens)** and using **0.13 million H800 GPU hours**. It introduces a novel text generation approach by predicting uniformly masked tokens in a diffusion process, enabling multi-turn dialogue and instruction-following. Alongside, **StepFun AI** released two major models: **Step-Video-T2V 30B**, a text-to-video model generating up to **204 frames** with high coherence and motion quality, and **Step-Audio-Chat 132B**, a voice-to-voice model. Additionally, challenging multimodal benchmarks like **Scale AI's EnigmaEval** and **Cambridge's ZeroBench** highlight current frontier models scoring zero, emphasizing the difficulty of these tasks. The community also noted the return of diffusion models in language modeling, a previously speculative architecture now scaled successfully.

not much happened today

Sat, 15 Feb 2025 01:23:56 GMT

**Smolagents** library by **Huggingface** continues trending. **ChatGPT-4o** latest version `chatgpt-40-latest-20250129` released. **DeepSeek R1 671B** sets speed record at **198 t/s**, fastest reasoning model, recommended with specific prompt settings. **Perplexity Deep Research** outperforms models like **Gemini Thinking**, **o3-mini**, and **DeepSeek-R1** on **Humanity's Last Exam** benchmark with **21.1%** score and **93.9%** accuracy on **SimpleQA**. **ChatGPT-4o** ranks #1 on Arena leaderboard in multiple categories except math. **OpenAI's o3 model** powers Deep Research tool for ChatGPT Pro users. **Gemini 2 Flash** and **Qwen 2.5** models support LLMGrading verifier. **Qwen 2.5** models added to PocketPal app. **MLX** shows small LLMs like Qwen 0.5B generate tokens at high speed on M4 Max and iPhone 16 Pro. **Gemini Flash 2.0** leads new AI agent leaderboard. **DeepSeek R1** is most liked on Hugging Face with over 10 million downloads.

Reasoning Models are Near-Superhuman Coders (OpenAI IOI, Nvidia Kernels)

Fri, 14 Feb 2025 02:42:41 GMT

**o3 model** achieved a **gold medal at the 2024 IOI** and ranks in the **99.8 percentile on Codeforces**, outperforming most humans with reinforcement learning (RL) methods proving superior to inductive bias approaches. **Nvidia's DeepSeek-R1** autonomously generates GPU kernels that surpass some expert-engineered kernels, showcasing simple yet effective AI-driven optimization. **OpenAI** updated **o1 and o3-mini** models to support file and image uploads in ChatGPT and released **DeepResearch**, a powerful research assistant based on the **o3 model with RL** for deep chain-of-thought reasoning. **Ollama** introduced **OpenThinker models** fine-tuned from **Qwen2.5**, outperforming some DeepSeek-R1 distillation models. **ElevenLabs** grew into a $3.3 billion company specializing in AI voice synthesis without open-sourcing their technology. Research highlights include **Sakana AI Labs' TAID knowledge distillation method** receiving a Spotlight at **ICLR 2025**, and **Apple's work on scaling laws for mixture-of-experts (MoEs)**. The importance of open-source AI for scientific discovery was also emphasized.

small news items

Thu, 13 Feb 2025 00:10:12 GMT

**OpenAI** announced plans for **GPT-4.5 (Orion)** and **GPT-5**, with GPT-5 integrating the **o3** model and offering unlimited chat access in the free tier. **DeepSeek R1 Distilled Qwen 1.5B** outperforms OpenAI's **o1-preview** on math benchmarks, while **ModernBERT 0.3b** surpasses **Qwen 0.5b** at MMLU without fine-tuning. **Mistral** and **Perplexity** adopt **Cerebras** hardware for 10x performance gains. OpenAI's **o3** model won a gold medal at the 2024 International Olympiad in Informatics. Partnerships include **Qwen** with **Groq**. Significant RLHF activity is noted in Nigeria and the global south, and **Bytedance** is expected to rise in AI prominence soon. *"GPT5 is all you need."*

not much happened today

Wed, 12 Feb 2025 01:24:43 GMT

**Zyphra AI** launched **Zonos-v0.1**, a leading open-weight text-to-speech model supporting multiple languages and zero-shot voice cloning. **Meta FAIR** released the open-source **Audiobox Aesthetics** model trained on 562 hours of audio data. **Kyutai Labs** introduced **Moshi**, a real-time speech-to-speech system with low latency. **Perplexity AI** announced the **Sonar** model based on **Llama 3.3 70b**, outperforming top models like **GPT-4o** and **Claude 3.5 Sonnet** with 1200 tokens/second speed, powered by **Cerebras** infrastructure. **UC Berkeley** open-sourced a 1.5B model trained with reinforcement learning that beats **o1-preview** on math tasks. **ReasonFlux-32B** achieved 91.2% on the MATH benchmark, outperforming **OpenAI o1-preview**. **CrossPoster**, an AI agent for cross-platform posting, was released using **LlamaIndex** workflows. **Brilliant Labs** integrated the **Google DeepMind Gemini Live API** into smart glasses for real-time translation and object identification.

not much happened today

Tue, 11 Feb 2025 03:56:45 GMT

**Google** released **Gemini 2.0 Flash Thinking Experimental 1-21**, a vision-language reasoning model with a **1 million-token context window** and improved accuracy on science, math, and multimedia benchmarks, surpassing **DeepSeek-R1** but trailing **OpenAI's o1**. **ZyphraAI** launched **Zonos**, a multilingual **Text-to-Speech model** with **instant voice cloning** and controls for speaking rate, pitch, and emotions, running at **~2x real-time speed on RTX 4090**. **Hugging Face** released **OpenR1-Math-220k**, a large-scale **math reasoning dataset** with **220K problems** and **800K reasoning traces** generated on **512 H100 GPUs**. **Tom Goldstein** introduced **Huginn-3.5B**, an open-source latent reasoning model trained on **800B tokens** that outperforms larger models on reasoning tasks like **GSM8K**. Discussions by **Jeremy Howard** and **iScienceLuvr** highlight advances in implicit latent reasoning and debate the future of human-readable reasoning traces. **Anthropic** launched the **Anthropic Economic Index** to analyze AI's economic impact using millions of **Claude** conversations.

not much happened today

Sat, 08 Feb 2025 04:22:33 GMT

**DeepSeek-R1 surpasses OpenAI in GitHub stars**, marking a milestone in open-source AI with rapid growth in community interest. **AlphaGeometry2 achieves gold-medalist level performance with an 84% solving rate on IMO geometry problems**, showcasing significant advancements in AI reasoning. **LangChain releases a tutorial for building AI agents in JavaScript**, enhancing developer capabilities in agent deployment. Reflections on **Anthropic's Claude model** reveal early access and influence on AI development timelines. Lighthearted AI humor includes calls to ban second-order optimizers and challenges in web development longevity. The AI Engineer Summit 2025 workshops were announced, continuing community engagement and education.

s1: Simple test-time scaling (and Kyutai Hibiki)

Fri, 07 Feb 2025 03:47:44 GMT

**"Wait" is all you need** introduces a novel reasoning model finetuned from **Qwen 2.5 32B** using just **1000 questions with reasoning traces** distilled from **Gemini 2.0 Flash Thinking**, enabling controllable test-time compute by appending "Wait" to extend reasoning. Lead author **Niklas Muennighoff**, known for work on **Bloom**, **StarCoder**, and **BIG-bench**, highlights this method's efficiency and its reproduction of the famous o1 scaling chart. Additionally, **Kyutai Moshi**'s Hibiki project demonstrates impressive offline French-English live translation on iPhone. Recent AI model releases include **DeepSeek R1 and R3 open source models**, potentially marking a major open-source milestone, **Hugging Face's SmolLM2** emphasizing data-centric training for small LMs, and **IBM's Granite-Vision-3.1-2B**, a small vision-language model with strong performance. Key research papers spotlight **LIMO** for minimal demonstration reasoning achieving high accuracy on AIME and MATH benchmarks, and **Token-Assisted Reasoning** mixing latent and text tokens to improve language model reasoning.

Gemini 2.0 Flash GA, with new Flash Lite, 2.0 Pro, and Flash Thinking

Thu, 06 Feb 2025 02:00:20 GMT

**Google DeepMind** officially launched **Gemini 2.0** models including **Flash**, **Flash-Lite**, and **Pro Experimental**, with **Gemini 2.0 Flash** outperforming **Gemini 1.5 Pro** while being **12x cheaper** and supporting **multimodal input** and a **1 million token context window**. **Andrej Karpathy** released a **3h31m** video deep dive into **large language models**, covering **pretraining**, **fine-tuning**, and **reinforcement learning** with examples like **GPT-2** and **Llama 3.1**. A free course on **Transformer architecture** was introduced by **Jay Alammar**, **Maarten Gr**, and **Andrew Ng**, focusing on **tokenizers**, **embeddings**, and **mixture-of-expert models**. **DeepSeek-R1** reached **1.2 million downloads** on **Hugging Face** with a detailed **36-page technical report**. **Anthropic** increased rewards to **$10K** and **$20K** for their jailbreak challenge, while **BlueRaven** extension was updated to hide Twitter metrics for unbiased engagement.

How To Scale Your Model, by DeepMind

Wed, 05 Feb 2025 06:59:23 GMT

**Researchers at Google DeepMind (GDM)** released a comprehensive "little textbook" titled **"How To Scale Your Model"** covering modern Transformer architectures, inference optimizations beyond O(N^2) attention, and high-performance computing concepts like rooflines. The resource includes practical problems and real-time comment engagement. On AI Twitter, several key updates include the open-sourced humanoid robotics model **ASAP** inspired by athletes like **Cristiano Ronaldo**, **LeBron James**, and **Kobe Bryant**; a new paper on **Mixture-of-Agents** proposing the **Self-MoA** method for improved LLM output aggregation; training of reasoning LLMs using the **GRPO algorithm** from **DeepSeek** demonstrated on **Qwen 0.5**; findings on bias in LLMs used as judges highlighting the need for multiple independent evaluations; and the release of **mlx-rs**, a Rust library for machine learning with examples including **Mistral** text generation. Additionally, **Hugging Face** launched an AI app store featuring over **400,000 apps** with 2,000 new daily additions and 2.5 million weekly visits, enabling AI-powered app search and categorization.

OpenAI takes on Gemini's Deep Research

Tue, 04 Feb 2025 02:44:29 GMT

**OpenAI** released the full version of the **o3** agent, with a new **Deep Research** variant showing significant improvements on the **HLE benchmark** and achieving SOTA results on **GAIA**. The release includes an "inference time scaling" chart demonstrating rigorous research, though some criticism arose over public test set results. The agent is noted as "extremely simple" and currently limited to 100 queries/month, with plans for a higher-rate version. Reception has been mostly positive, with some skepticism. Additionally, advances in **reinforcement learning** were highlighted, including a simple test-time scaling technique called **budget forcing** that improved reasoning on math competitions by 27%. Researchers from **Google DeepMind**, **NYU**, **UC Berkeley**, and **HKU** contributed to these findings. The original **Gemini Deep Research** team will participate in the upcoming AI Engineer NYC event.

o3-mini launches, OpenAI on "wrong side of history"

Sat, 01 Feb 2025 09:16:19 GMT

**OpenAI** released **o3-mini**, a new reasoning model available for free and paid users with a "high" reasoning effort option that outperforms the earlier **o1** model on STEM tasks and safety benchmarks, costing **93% less** per token. **Sam Altman** acknowledged a shift in open source strategy and credited **DeepSeek R1** for influencing assumptions. **MistralAI** launched **Mistral Small 3 (24B)**, an open-weight model with competitive performance and low API costs. **DeepSeek R1** is supported by **Text-generation-inference v3.1.0** and available via **ai-gradio** and replicate. The news highlights advancements in reasoning, cost-efficiency, and safety in AI models.

Mistral Small 3 24B and Tulu 3 405B

Fri, 31 Jan 2025 00:08:47 GMT

**Mistral AI** released **Mistral Small 3**, a **24B parameter** model optimized for local inference with low latency and **81% accuracy on MMLU**, competing with **Llama 3.3 70B**, **Qwen-2.5 32B**, and **GPT4o-mini**. **AI2** released **Tülu 3 405B**, a large finetuned model of **Llama 3** using Reinforcement Learning from Verifiable Rewards (RVLR), competitive with **DeepSeek v3**. **Sakana AI** launched **TinySwallow-1.5B**, a Japanese language model using **TAID** for on-device use. **Alibaba_Qwen** released **Qwen 2.5 Max**, trained on **20 trillion tokens**, with performance comparable to **DeepSeek V3**, **Claude 3.5 Sonnet**, and **Gemini 1.5 Pro**, and updated API pricing. These releases highlight advances in open models, efficient inference, and reinforcement learning techniques.

not much happened today

Thu, 30 Jan 2025 01:07:40 GMT

**DeepSeek-R1 and DeepSeek-V3** models have made significant advancements, trained on an **instruction-tuning dataset of 1.5M samples** with **600,000 reasoning** and **200,000 non-reasoning SFT data**. The models demonstrate strong **performance benchmarks** and are deployed on-premise via collaborations with **Dell** and **Hugging Face**. Training costs are estimated around **$5.5M to $6M**, with efficient hardware utilization on **8xH100 servers**. The **International AI Safety Report** highlights risks such as **malicious use**, **malfunctions**, and **systemic risks** including **AI-driven cyberattacks**. Industry leaders like **Yann LeCun** and **Yoshua Bengio** provide insights on market reactions, AI safety, and ethical considerations, with emphasis on AI's role in creativity and economic incentives.

not much happened today

Wed, 29 Jan 2025 01:48:45 GMT

**Huawei chips** are highlighted in a diverse AI news roundup covering **NVIDIA's** stock rebound, new open music foundation models like **Local Suno**, and competitive AI models such as **Qwen 2.5 Max** and **Deepseek V3**. The release of **DeepSeek Janus Pro**, a multimodal LLM with image generation capabilities, and advancements in **reinforcement learning** and **chain-of-thought reasoning** are noted. Discussions include GPU rebranding with **NVIDIA's H6400 GPUs**, data center innovations, and enterprise AI applications like crypto APIs in hedge funds. *"Deepseek R1's capabilities"* and *"Qwen 2.5 models added to applications"* are key highlights.

DeepSeek #1 on US App Store, Nvidia stock tanks -17%

Tue, 28 Jan 2025 05:28:32 GMT

**DeepSeek** has made a significant cultural impact by hitting mainstream news unexpectedly in 2025. The **DeepSeek-R1** model features a massive **671B parameter MoE architecture** and demonstrates **chain-of-thought (CoT)** capabilities comparable to **OpenAI's o1** at a lower cost. The **DeepSeek V3** model trains a **236B parameter model 42% faster** than its predecessor using **fp8 precision**. The **Qwen2.5** multimodal models support images and videos with sizes ranging from **3B to 72B parameters**, featuring strong vision and agentic capabilities. **LangChain** and **LangGraph** integration enable AI chatbots with memory and tool use, including applications like the **DeFi Agent**. Discussions highlight **NVIDIA's** role in hardware acceleration, with concerns about stock drops due to **DeepSeek's** efficiency and market fears. The compute demand is expected to rise despite efficiency gains, driven by inference scaling and MoE design improvements.

TinyZero: Reproduce DeepSeek R1-Zero for $30

Sat, 25 Jan 2025 02:32:28 GMT

**DeepSeek Mania** continues to reshape the frontier model landscape with Jiayi Pan from Berkeley reproducing the *OTHER* result from the DeepSeek R1 paper, R1-Zero, in a cost-effective Qwen model fine-tune for two math tasks. A key finding is a lower bound to the distillation effect at **1.5B parameters**, with RLCoT reasoning emerging as an intrinsic property. Various RL techniques like PPO, DeepSeek's GRPO, or PRIME show similar outcomes, and starting from an Instruct model speeds convergence. The **Humanity’s Last Exam (HLE) Benchmark** introduces a challenging multi-modal test with **3,000 expert-level questions** across **100+ subjects**, where models perform below **10%**, with **DeepSeek-R1** achieving **9.4%**. DeepSeek-R1 excels in chain-of-thought reasoning, outperforming models like **o1** while being **20x cheaper** and MIT licensed. The **WebDev Arena Leaderboard** ranks DeepSeek-R1 #2 in technical domains and #1 under Style Control, closing in on **Claude 3.5 Sonnet**. OpenAI's **Operator** is deployed to 100% of Pro users in the US, enabling tasks like ordering meals and booking reservations, and functions as a research assistant for AI paper searches and summaries. Hugging Face announces a leadership change after significant growth, while Meta AI releases the first stable version of **Llama Stack** with streamlined upgrades and automated verification. DeepSeek-R1's open-source success is celebrated, and technical challenges like memory management on macOS 15+ are addressed with residency sets in MLX for stability.

OpenAI launches Operator, its first Agent

Fri, 24 Jan 2025 03:34:34 GMT

**OpenAI** launched **Operator**, a premium computer-using agent for web tasks like booking and ordering, available now for Pro users in the US with an API promised. It features long horizon remote VMs up to 20 minutes and video export, showing state-of-the-art agent performance but not yet human-level. **Anthropic** had launched a similar agent 3 months earlier as an open source demo. **DeepSeek AI** unveiled **DeepSeek R1**, an open-source reasoning model excelling on the **Humanity's Last Exam** dataset, outperforming models like **LLaMA 4** and **OpenAI's o1**. **Google DeepMind** open-sourced **VideoLLaMA 3**, a multimodal foundation model for image and video understanding. **Perplexity AI** released **Perplexity Assistant** for Android with reasoning and search capabilities. The **Humanity's Last Exam** dataset contains 3,000 questions testing AI reasoning, with current models scoring below 10% accuracy, indicating room for improvement. OpenAI's Computer-Using Agent (CUA) shows improved performance on OSWorld and WebArena benchmarks but still lags behind humans. **Anthropic AI** introduced Citations for safer AI responses. *Sam Altman* and *Swyx* commented on Operator's launch and capabilities.

Bespoke-Stratos + Sky-T1: The Vicuna+Alpaca moment for reasoning

Thu, 23 Jan 2025 07:08:27 GMT

**Reasoning Distillation** has emerged as a key technique, with Berkeley/USC researchers releasing **Sky-T1-32B-Preview**, a finetuned model of **Qwen 2.5 32B** using 17k reasoning traces for just **$450**, matching benchmarks of **o1-preview**. **DeepSeek** introduced **R1**, a model surpassing **o1-preview** and enabling distillation to smaller models like a 1.5B Qwen to match **gpt-4o** and **claude-3-sonnet** levels. **Bespoke Labs** further distilled **R1** on Qwen, outperforming **o1-preview** with fewer samples. This progress suggests that *"SFT is all you need"* for reasoning without major architecture changes. Additionally, **DeepSeek-R1** uses pure reinforcement learning with supervised finetuning to accelerate convergence and shows strong reasoning and multimodal capabilities. **Google's Gemini 2.0 Flash Thinking** model boasts a **1 million token context window**, code execution, and excels in math, science, and multimodal reasoning. Critiques highlight challenges in model repeatability, behavioral self-awareness, and RLHF limitations in reasoning robustness.

Project Stargate: $500b datacenter (1.7% of US GDP) and Gemini 2 Flash Thinking 2

Wed, 22 Jan 2025 01:56:21 GMT

**Project Stargate**, a US "AI Manhattan project" led by **OpenAI** and **Softbank**, supported by **Oracle**, **Arm**, **Microsoft**, and **NVIDIA**, was announced with a scale comparable to the original Manhattan project costing **$35B inflation adjusted**. Despite Microsoft's reduced role as exclusive compute partner, the project is serious but not immediately practical. Meanwhile, **Noam Shazeer** revealed a second major update to **Gemini 2.0 Flash Thinking**, enabling **1M token long context** usable immediately. Additionally, **AI Studio** introduced a new **code interpreter** feature. On Reddit, **DeepSeek R1**, a distillation of **Qwen 32B**, was released for free on **HuggingChat**, sparking discussions on self-hosting, performance issues, and quantization techniques. DeepSeek's CEO **Liang Wenfeng** highlighted their focus on **fundamental AGI research**, efficient **MLA architecture**, and commitment to **open-source development** despite export restrictions, positioning DeepSeek as a potential alternative to closed-source AI trends.

DeepSeek R1: o1-level open weights model and a simple recipe for upgrading 1.5B models to Sonnet/4o level

Tue, 21 Jan 2025 07:50:24 GMT

**DeepSeek** released **DeepSeek R1**, a significant upgrade over **DeepSeek V3** from just three weeks prior, featuring 8 models including full-size 671B MoE models and multiple distillations from **Qwen 2.5** and **Llama 3.1/3.3**. The models are MIT licensed, allowing finetuning and distillation. Pricing is notably cheaper than **o1** by 27x-50x. The training process used **GRPO** (reward for correctness and style outcomes) without relying on PRM, MCTS, or reward models, focusing on reasoning improvements through reinforcement learning. Distilled models can run on **Ollama** and show strong capabilities like writing **Manim code**. The release emphasizes advances in **reinforcement-learning**, **fine-tuning**, and **model-distillation** with a novel RL framework from DeepSeekMath.

not much happened today

Sat, 18 Jan 2025 02:33:34 GMT

**DeepSeek-V3**, a **671 billion parameter mixture-of-experts model**, surpasses **Llama 3.1 405B** and **GPT-4o** in coding and math benchmarks. **OpenAI** announced the upcoming release of **GPT-5** on **April 27, 2023**. **MiniMax-01 Coder mode** in **ai-gradio** enables building a chess game in one shot. **Meta** research highlights trade-offs in scaling visual tokenizers. **Google DeepMind** improves diffusion model quality via inference-time scaling. The **RA-DIT** method fine-tunes LLMs and retrievers for better RAG responses. The U.S. proposes a three-tier export restriction system on AI chips and models, excluding countries like **China** and **Russia**. Security vulnerabilities in AI chatbots involving CSRF and prompt injection were revealed. Concerns about superintelligence and weapons-grade AI models were expressed. **ai-gradio** updates include NVIDIA NIM compatibility and new models like **cosmos-nemotron-34b**. **LangChain** integrates with **Claude-3-haiku** for AI agents with persistent memory. **Triton Warp specialization** optimizes GPU usage for matrix multiplication. **Meta's** fine-tuned **Llama** models, **OpenBioLLM-8B** and **OpenBioLLM-70B**, target personalized medicine and clinical trials.

not much happened today

Fri, 17 Jan 2025 06:04:28 GMT

**Harvey** secured a new **$300M funding round**. **OuteTTS 0.3 1B & 500M** text-to-speech models were released featuring **zero-shot voice cloning**, **multilingual support** (en, jp, ko, zh, fr, de), and **emotion control**, powered by **OLMo-1B** and **Qwen 2.5 0.5B**. The **HOVER** model, a **1.5M-parameter neural net** for **agile motor control**, was introduced, leveraging **human motion capture datasets** and **massively parallel reinforcement learning**. **kokoro.js** enables running AI models locally in browsers with minimal dependencies. **Meta AI** awarded **$200K LLM evaluation grants** for projects on **regional language understanding**, **complex reasoning**, and **interactive programming environments**. **Stability AI's Twitter account was hacked**, prompting security warnings. **Alibaba Qwen** improved **Process Reward Models (PRMs)** for better **mathematical reasoning** using a **consensus filtering mechanism**. **DeepSeek V3** uses **pipeline parallelism** to enhance **distributed inference** and **long-context generation efficiency**. Discussions on **AI policy in legal frameworks** and **AI's role in democratizing education** were highlighted. Lighthearted AI-related humor was also shared.

Titans: Learning to Memorize at Test Time

Thu, 16 Jan 2025 07:58:41 GMT

**Google** released a new paper on "Neural Memory" integrating persistent memory directly into transformer architectures at test time, showing promising long-context utilization. **MiniMax-01** by @omarsar0 features a **4 million token context window** with **456B parameters** and **32 experts**, outperforming **GPT-4o** and **Claude-3.5-Sonnet**. **InternLM3-8B-Instruct** is an open-source model trained on **4 trillion tokens** with state-of-the-art results. **Transformer²** introduces self-adaptive LLMs that dynamically adjust weights for continuous adaptation. Advances in AI security highlight the need for **agent authentication**, **prompt injection** defenses, and **zero-trust architectures**. Tools like **Micro Diffusion** enable budget-friendly diffusion model training, while **LeagueGraph** and **Agent Recipes** support open-source social media agents.

small little news items

Wed, 15 Jan 2025 02:19:30 GMT

**Ollama** enhanced its models by integrating **Cohere's R7B**, optimized for **RAG** and **tool use tasks**, and released **Ollama v0.5.5** with quality updates and a new engine. **Together AI** launched the **Llama 3.3 70B multimodal model** with improved reasoning and math capabilities, while **OpenBMB** introduced the **MiniCPM-o 2.6**, outperforming **GPT-4V** on visual tasks. Insights into **Process Reward Models (PRM)** were shared to boost **LLM reasoning**, alongside **Qwen2.5-Math-PRM** models excelling in mathematical reasoning. **LangChain** released a beta for **ChatGPT Tasks** enabling scheduling of reminders and summaries, and introduced open-source **ambient agents** for email assistance. **OpenAI** rolled out **Tasks** for scheduling actions in **ChatGPT** for Plus, Pro, and Teams users. AI software engineering is rapidly advancing, predicted to match human capabilities within 18 months. Research on **LLM scaling laws** highlights power law relationships and plateauing improvements, while **GANs** are experiencing a revival.

not much happened today

Tue, 14 Jan 2025 06:08:22 GMT

**Helium-1 Preview** by **kyutai_labs** is a **2B-parameter multilingual base LLM** outperforming **Qwen 2.5**, trained on **2.5T tokens** with a **4096 context size** using token-level distillation from a **7B model**. **Phi-4 (4-bit)** was released in **lmstudio** on an **M4 max**, noted for speed and performance. **Sky-T1-32B-Preview** is a **$450 open-source reasoning model** matching **o1's performance** with strong benchmark scores. **Codestral 25.01** by **mistralai** is a new SOTA coding model supporting **80+ programming languages** and offering **2x speed**. Innovations include **AutoRAG** for optimizing retrieval-augmented generation pipelines, **Agentic RAG** for autonomous query reformulation and critique, **Multiagent Finetuning** using societies of models like **Phi-3**, **Mistral**, **LLaMA-3**, and **GPT-3.5** for reasoning improvements, and **VideoRAG** incorporating video content into RAG with LVLMs. Applications include a dynamic UI AI chat app by **skirano** on **Replit**, **LangChain** tools like **DocTalk** for voice PDF conversations, AI travel agent tutorials, and news summarization agents. **Hyperbolic Labs** offers competitive GPU rentals including **H100**, **A100**, and **RTX 4090**. **LLMQuoter** enhances RAG accuracy by identifying key quotes. Infrastructure updates include **MLX export** for LLM inference from Python to C++ by **fchollet** and **SemHash** semantic text deduplication by **philschmid**.

Moondream 2025.1.9: Structured Text, Enhanced OCR, Gaze Detection in a 2B Model

Sat, 11 Jan 2025 07:18:42 GMT

**Moondream** has released a new version that advances VRAM efficiency and adds structured output and gaze detection, marking a new frontier in vision model practicality. Discussions on Twitter highlighted advancements in reasoning models like **OpenAI's o1**, model distillation techniques, and new multimodal embedding models such as **vdr-2b-multi-v1** and **LLaVA-Mini**, which significantly reduce computational costs. Research on GANs and decentralized diffusion models showed improved stability and performance. Development tools like **MLX** and **vLLM** received updates for better portability and developer experience, while frameworks like **LangChain** and **Qdrant** enable intelligent data workflows. Company updates include new roles and team expansions at **GenmoAI**. *"Efficiency tricks are all you need."*

not much happened today

Fri, 10 Jan 2025 03:35:37 GMT

**rStar-Math** surpasses **OpenAI's o1-preview** in math reasoning with **90.0% accuracy** using a **7B LLM** and **MCTS** with a **Process Reward Model**. **Alibaba** launches **Qwen Chat** featuring **Qwen2.5-Plus** and **Qwen2.5-Coder-32B-Instruct** models enhancing vision-language and reasoning. **Microsoft** releases **Phi-4**, trained on **40% synthetic data** with improved pretraining. **Cohere** introduces **North**, a secure AI workspace integrating **LLMs**, **RAG**, and automation for private deployments. **LangChain** showcases a company research agent with multi-step workflows and open-source datasets. **Transformers.js** demos released for text embeddings and image segmentation in JavaScript. Research highlights include **Meta Meta-CoT** for enhanced chain-of-thought reasoning, **DeepSeek V3** with recursive self-improvement, and collaborative AI development platforms. Industry partnerships include **Rakuten** with **LangChain**, **North** with **RBC** supporting 90,000 employees, and **Agent Laboratory** collaborating with **AMD** and **Johns Hopkins**. Technical discussions emphasize **CUDA** and **Triton** for AI efficiency and evolving AI-assisted coding stacks by **Andrew Ng**.

not much happened today

Thu, 09 Jan 2025 03:45:48 GMT

**Sebastien Bubeck** introduced **REINFORCE++**, enhancing classical REINFORCE with **PPO-inspired techniques** for **30% faster training**. **AI21 Labs** released **Phi-4** under the **MIT License**, accessible via **Ollama**. **François Chollet** announced plans for **ARC-AGI-2** and a next-generation **AGI benchmark**. **LangChain** launched **10 new integration packages** to boost **LLM application development**. **Tom Doerr** introduced **Ollama-OCR**, a Python package for **text extraction** using **vision language models**. **Arohan** optimized **Shampoo** for **memory efficiency**, reducing usage from **20 to 6 bytes per parameter**. **Bindu Reddy** showcased **CodeLLM's v1** for **frontend code generation** and highlighted **LlamaIndex Workflows** for **academic summarization** and **slide generation**. **Hwchase17** collaborated with **Together Compute** to enhance **WebDev Arena** with **complex coding agents** for **LLM coding evaluations**. **Jonathan Ross** detailed **Groq's** mission to reduce **compute costs by 1000x** amid rising **generative AI** spending. **Clement Delangue** warned about **scam alerts** involving false claims of association with **AI21**. **Vikhyat K** raised concerns about the **ethical implications** and **trade-offs** of **AGI**. Memes and humor included creative AI prompts and critiques of **LLM behaviors**.

not much happened today

Wed, 08 Jan 2025 04:01:51 GMT

**NVIDIA** has launched **Cosmos**, an open-source video world model trained on **20 million hours of video**, aimed at advancing **robotics** and **autonomous driving**. The release sparked debate over its open-source status and technical approach. Additionally, **NVIDIA** announced **Digits**, a **$3,000** personal AI supercomputer designed to democratize AI computing. The AI community expresses mixed feelings about rapid AI progress, with concerns about **AGI**, job displacement, and investment hype. Discussions also highlight upcoming tools for fine-tuning AI models at home and foundation models for AI robotics.

PRIME: Process Reinforcement through Implicit Rewards

Tue, 07 Jan 2025 02:33:39 GMT

**Implicit Process Reward Models (PRIME)** have been highlighted as a significant advancement in online reinforcement learning, trained on a **7B model** with impressive results compared to **gpt-4o**. The approach builds on the importance of process reward models established by "Let's Verify Step By Step." Additionally, AI Twitter discussions cover topics such as **proto-AGI** capabilities with **claude-3.5-sonnet**, the role of **compute scaling** for **Artificial Superintelligence (ASI)**, and model performance nuances. New AI tools like **Gemini 2.0 coder mode** and **LangGraph Studio** enhance agent architecture and software development. Industry events include the **LangChain AI Agent Conference** and meetups fostering AI community connections. Company updates reveal **OpenAI's** financial challenges with Pro subscriptions and **DeepSeek-V3's** integration with **Together AI** APIs, showcasing efficient **671B MoE parameter** models. Research discussions focus on **scaling laws** and compute efficiency in large language models.

not much happened today

Sat, 04 Jan 2025 07:58:51 GMT

**Olmo 2** released a detailed tech report showcasing full pre, mid, and post-training details for a frontier fully open model. **PRIME**, an open-source reasoning solution, achieved **26.7% pass@1**, surpassing **GPT-4o** in benchmarks. Performance improvements include **Qwen 32B (4-bit)** generating at **>40 tokens/sec** on an **M4 Max** and **libvips** being **25x faster** than **Pillow** for image resizing. New tools like **Swaggo/swag** for Swagger 2.0 documentation, **Jujutsu (jj)** Git-compatible VCS, and **Portspoof** security tool were introduced. Robotics advances include a weapon detection system with a meters-wide field of view and faster frame rates. Hardware benchmarks compared **H100** and **MI300x** accelerators. Applications span medical error detection using PRIME and a financial AI agent integrating **LangChainAI** and **Vercel AI SDK**. Architectural insights suggest the need for breakthroughs similar to **SSMs** or **RNNs**.

not much happened to end the year

Tue, 31 Dec 2024 23:55:07 GMT

**Reinforcement Fine-Tuning (RFT)** is introduced as a **data-efficient** method to improve **reasoning in LLMs** using minimal **training data** with strategies like **First-Correct Solutions (FCS)** and **Greedily Diverse Solutions (GDS)**. **DeepSeek-V3**, a **671B parameter MoE language model** trained on **14.8 trillion tokens** with **FP8 mixed precision training**, highlights advances in large-scale models and open-source LLMs. Predictions for **AI in 2025** include growth in **smaller models**, **multimodality**, and challenges in **open-source AI**. The impact of AI on software development jobs suggests a need for **higher intelligence** and **specialization** as AI automates low-skilled tasks. Enhancements to **CodeLLM** improve coding assistance with features like **in-place editing** and **streaming responses**. **Natural Language Reinforcement Learning (NLRL)** offers better interpretability and richer feedback for AI planning and critique. AI hiring is growing rapidly with startups seeking strong engineers in **ML** and **systems**. New AI-powered tools such as **Rivet**, **Buzee**, and **Konfig** improve real-time applications, search, and SDK generation using technologies like **Rust** and **V8 isolates**.

not much happened today

Tue, 31 Dec 2024 02:24:45 GMT

**Sam Altman** publicly criticizes **DeepSeek** and **Qwen** models, sparking debate about **OpenAI**'s innovation claims and reliance on foundational research like the **Transformer architecture**. **Deepseek V3** shows significant overfitting issues in the **Misguided Attention** evaluation, solving only **22%** of test prompts, raising concerns about its reasoning and finetuning. Despite skepticism about its open-source status, **Deepseek V3** is claimed to surpass **ChatGPT4** as an open-source model, marking a milestone 1.75 years after ChatGPT4's release on **March 14, 2023**. The discussions highlight competitive dynamics in AI model performance and innovation sustainability.

not much happened today

Sat, 28 Dec 2024 05:06:02 GMT

**ChatGPT**, **Sora**, and the **OpenAI API** experienced a >5 hour outage but are now restored. Updates to **vLLM** enable **DeepSeek-V3** to run with enhanced **parallelism** and **CPU offloading**, improving **model deployment flexibility**. Discussions on **gradient descent** in **top-k routing MoE** and adoption of **FP8 precision** focus on **training efficiency** and **memory optimization**. **AIDE**, an **AI voice medical assistant** by **Team Therasync**, leverages **Qdrant**, **OpenAI**, and **Twilio**. **DeepSeek-Engineer** offers AI-powered coding assistance with structured outputs. **LlamaIndex** integrates **LlamaCloud** and **ElevenLabs** for large-scale **document processing** and voice interaction. Insights on **version control** with **ghstack** and advocacy for **linear decay learning rate schedules** highlight best practices in AI development. Experts predict **smaller, tighter models**, **true multimodal models**, and **on-device AI** in 2025. Proposals for **planetary-scale federated learning** and community AGI moonshots emphasize future AI directions. Discussions on **agentic systems**, **multi-agent workflows**, and **deliberative alignment** through **chain of thought reasoning** underscore AI safety and alignment efforts.

DeepSeek v3: 671B finegrained MoE trained for $5.5m USD of compute on 15T tokens

Fri, 27 Dec 2024 01:18:46 GMT

**DeepSeek-V3** has launched with **671B MoE parameters** and trained on **14.8T tokens**, outperforming **GPT-4o** and **Claude-3.5-sonnet** in benchmarks. It was trained with only **2.788M H800 GPU hours**, significantly less than **Llama-3**'s **30.8M GPU-hours**, showcasing major compute efficiency and cost reduction. The model is open-source and deployed via **Hugging Face** with API support. Innovations include native FP8 mixed precision training, Multi-Head Latent Attention scaling, distillation from synthetic reasoning data, pruning and healing for MoEs with up to **256 experts**, and a new multi-token prediction objective enabling lookahead token planning. Research highlights also cover the **OREO method** and **Natural Language Reinforcement Learning (NLRL)** for multi-step reasoning and agent control.

not much happened today

Wed, 25 Dec 2024 02:01:53 GMT

The **Qwen team** launched **QVQ**, a vision-enabled version of their experimental **QwQ o1 clone**, benchmarking comparably to **Claude 3.5 Sonnet**. Discussions include **Bret Taylor's** insights on autonomous software development distinct from the Copilot era. The **Latent Space LIVE!** talks cover highlights of **2024 AI startups, vision, open models, post-transformers, synthetic data, smol models, and agents**. Twitter recaps by **Claude 3.5 Sonnet** highlight proposals for benchmarks measuring LLM calibration and falsehood confidence, with **QVQ** outperforming **GPT-4o** and **Claude Sonnet 3.5**. AI alignment debates focus on intentionality and critiques of alignment faking in models like **Claude**. Updates from **OpenAI** include new **o3 and o3-mini models** and a deliberative alignment strategy. The **ASAL project** is a collaboration between **MIT**, **OpenAI**, and **Swiss AI Lab IDSIA** to automate artificial life discovery. Personal stories reveal frustrations with **USCIS** green card denials despite high qualifications. New tools like **GeminiCoder** enable rapid app creation, and a **contract review agent** using **Reflex** and **Llama Index** checks GDPR compliance. Holiday greetings and memes were also shared.

not much happened this weekend

Tue, 24 Dec 2024 01:01:31 GMT

**o3** model gains significant attention with discussions around its capabilities and implications, including an OpenAI board member referencing "AGI." **LangChain** released their **State of AI 2024** survey. **Hume** announced **OCTAVE**, a **3B parameter** API-only speech-language model with voice cloning. **x.ai** secured a **$6B Series C** funding round. Discussions highlight **inference-time scaling**, **model ensembles**, and the surprising generalization ability of **small models**. New tools and datasets include **FineMath**, the best open math dataset on Hugging Face, and frameworks for LLM agents. Industry updates cover a **5-month benchmarking** of **AMD MI300X** vs **Nvidia H100 + H200**, insights from a meeting with **Lisa Su** on AMD's software stack, and open AI engineering roles. Research innovations include **Large Concept Models (LCM)** from Meta AI, **Chain of Continuous Thought (Coconut)** for latent space reasoning, and mechanistic interpretability initiatives.

o3 solves AIME, GPQA, Codeforces, makes 11 years of progress in ARC-AGI and 25% in FrontierMath

Sat, 21 Dec 2024 01:44:22 GMT

**OpenAI** announced the **o3** and **o3-mini** models with groundbreaking benchmark results, including a jump from **2% to 25%** on the **FrontierMath** benchmark and **87.5%** on the **ARC-AGI** reasoning benchmark, representing about **11 years of progress** on the GPT3 to GPT4o scaling curve. The **o1-mini** model shows superior inference efficiency compared to o3-full, promising significant cost reductions on coding tasks. The announcement was accompanied by community discussions, safety testing applications, and detailed analyses. *Sama* highlighted the unusual cost-performance tradeoff, and **Eric Wallace** shared insights on the o-series deliberative alignment strategy.

ModernBert: small new Retriever/Classifier workhorse, 8k context, 2T tokens,

Fri, 20 Dec 2024 03:27:55 GMT

**Answer.ai/LightOn** released **ModernBERT**, an updated encoder-only model with **8k token context**, trained on **2 trillion tokens** including code, with **139M/395M parameters** and state-of-the-art performance on retrieval, NLU, and code tasks. It features **Alternating Attention** layers mixing global and local attention. **Gemini 2.0 Flash Thinking** debuted as #1 in Chatbot Arena, and the **O1 model** scored top in reasoning benchmarks. **Llama** downloads surpassed **650 million**, doubling in 3 months. **OpenAI** launched desktop app integrations with voice capabilities. **Figure** delivered its first humanoid robots commercially. Advances in robotics simulation and a new physics engine **Genesis** claiming **430,000x faster than real-time** were highlighted.

Genesis: Generative Physics Engine for Robotics (o1-mini version)

Thu, 19 Dec 2024 05:17:10 GMT

**OpenAI** launched the **o1 model** API featuring function calling, structured outputs, vision support, and developer messages, achieving **60% fewer reasoning tokens** than its preview. The model excels in math and code with a **0.76 LiveBench Coding score**, outperforming Sonnet 3.5. Beta SDKs for Go and Java and WebRTC support with **60% lower prices** were also released. **Google Gemini 2.0 Pro (Gemini Exp 1206)** deployment accelerated, showing improved coding, math, and reasoning performance. Meta AI FAIR introduced research on training transformers directly on raw bytes using dynamic entropy-based patching. Commercial humanoid robots were successfully deployed by an industry player. **Hugging Face** researchers demonstrated that their **3B Llama model** can outperform the **70B Llama model** on MATH-500 accuracy using search techniques, highlighting efficiency gains with smaller models. Concerns about reproducibility and domain-specific limitations were noted.

Genesis: Generative Physics Engine for Robotics (o1-2024-12-17)

Thu, 19 Dec 2024 04:48:33 GMT

**Genesis** is a newly announced **universal physics engine** developed by a large-scale collaboration led by **CMU PhD student Zhou Xian**. It integrates multiple state-of-the-art physics solvers to simulate diverse materials and physical phenomena, targeting robotics applications with features like lightweight, ultra-fast simulation, photo-realistic rendering, and generative data capabilities. The engine is open source and designed for robotics simulation beyond just video generation. Additionally, **OpenAI** released the **o1** model to API with advanced features like function calling and vision support, showing strong math and coding performance. **Google** teased updates on **Gemini 2.0 Pro**, accelerating deployment for advanced users.

OpenAI Voice Mode Can See Now - After Gemini Does

Wed, 18 Dec 2024 09:46:07 GMT

**OpenAI** launched **Realtime Video** shortly after **Gemini**, which led to less impact due to Gemini's earlier arrival with lower cost and fewer rate limits. **Google DeepMind** released **Gemini 2.0 Flash** featuring enhanced multimodal capabilities and real-time streaming. **Anthropic** introduced **Clio**, a system analyzing real-world usage of **Claude** models. Together Computing acquired CodeSandbox to launch a code interpreter tool. Discussions highlighted **Meta's Llama 3.3-70B** for its advanced roleplay and prompt handling abilities, outperforming models like **Mistral Large** and **GPT-4o** in expressiveness and censorship. The AI community also engaged in humorous takes on AI outages and model competition, with **ChatGPT** adding a Santa mode for holiday interactions. *"Anthropic is capturing the developer ecosystem, Gemini has AI enthusiast mindshare, ChatGPT reigns over AI dabblers"* was a noted observation from the community.

o1 API, 4o/4o-mini in Realtime API + WebRTC, DPO Finetuning

Wed, 18 Dec 2024 01:43:51 GMT

**OpenAI** launched the **o1 API** with enhanced features including vision inputs, function calling, structured outputs, and a new `reasoning_effort` parameter, achieving **60% fewer reasoning tokens** on average. The **o1 pro** variant is confirmed as a distinct implementation coming soon. Improvements to the **Realtime API** with **WebRTC** integration offer easier usage, longer sessions (up to **30 minutes**), and significantly reduced pricing (up to **10x cheaper** with mini models). **DPO Preference Tuning** for fine-tuning is introduced, currently available for the **4o** model. Additional updates include official Go and Java SDKs and OpenAI DevDay videos. The news also highlights discussions on **Google Gemini 2.0 Flash** model's performance reaching **83.6% accuracy**.

Meta Apollo - Video Understanding up to 1 hour, SOTA Open Weights

Tue, 17 Dec 2024 01:17:52 GMT

**Meta** released **Apollo**, a new family of state-of-the-art video-language models available in **1B, 3B, and 7B** sizes, featuring "Scaling Consistency" for efficient scaling and introducing **ApolloBench**, which speeds up video understanding evaluation by **41×** across five temporal perception categories. **Google Deepmind** launched **Veo 2**, a 4K video generation model with improved physics and camera control, alongside an enhanced **Imagen 3** image model. **OpenAI** globally rolled out ChatGPT search with advanced voice and map features and discussed a potential $2,000/month "ChatGPT Max" tier. Research highlights include achieving **Llama 70B** performance using **Llama 3B** via test-time compute scaling and expanding **Command R7B** language support from 10 to 23 languages. Industry updates feature **Figure AI** delivering humanoid robots commercially and **Klarna** reducing workforce through AI. Notion integrated **Cohere Rerank** for better search. Studies reveal LLMs can recognize their own writing style and show self-preference bias. Discussions note video processing progress outpacing text due to better signal-per-compute and data evaluation.

Meta BLT: Tokenizer-free, Byte-level LLM

Sat, 14 Dec 2024 05:38:19 GMT

**Meta AI** introduces the **Byte Latent Transformer (BLT)**, a tokenizer-free architecture that dynamically forms byte patches for efficient compute allocation, outperforming **Llama 3** on benchmarks including the CUTE benchmark. The model was trained on approximately **1 trillion tokens** and features a three-block transformer design with local and global components. This approach challenges traditional tokenization and may enable new multimodal capabilities such as direct file interaction without retrieval-augmented generation. Additionally, **Microsoft** announced the **Phi-4 14B** parameter model achieving state-of-the-art results on STEM and reasoning benchmarks, surpassing **GPT-4o**. **DeepSeek AI** launched new vision-language models based on their MoE architecture with sizes ranging from **1.0B to 27B** parameters. **OpenAI** released a new Projects feature for ChatGPT, and **Cohere** introduced their smallest and fastest **Command R7B** model. **Anthropic** published research on "Best-of-N Jailbreaking" vulnerabilities across text, vision, and audio models. Industry discussion highlights a trend of decreasing frontier LLM sizes, with **GPT-4** at approximately **1.8 trillion parameters** compared to newer models.

Google wakes up: Gemini 2.0 et al

Thu, 12 Dec 2024 03:16:07 GMT

**Google DeepMind** launched **Gemini 2.0 Flash**, a new multimodal model outperforming Gemini 1.5 Pro and o1-preview, featuring vision and voice APIs, multilingual capabilities, and native tool use. It powers new AI agents like **Project Astra** and **Project Mariner**, with Project Mariner achieving state-of-the-art **83.5%** on the WebVoyager benchmark. **OpenAI** announced ChatGPT integration with **Apple** devices, enabling Siri access and visual intelligence features. **Claude 3.5 Sonnet** is noted as a distilled version of Opus. The AI community's response at **NeurIPS 2024** has been overwhelmingly positive, signaling a strong comeback for Google in AI innovation. Key topics include **multimodality**, **agent development**, **multilinguality**, **benchmarking**, and **model releases**.

ChatGPT Canvas GA

Wed, 11 Dec 2024 04:20:02 GMT

**OpenAI** launched **ChatGPT Canvas** to all users, featuring **code execution** and **GPT integration**, effectively replacing Code Interpreter with a Google Docs-like interface. **Deepseek AI** announced their **V2.5-1210** update improving performance on **MATH-500 (82.8%)** and LiveCodebench. **Meta AI Fair** introduced **COCONUT**, a new continuous latent space reasoning paradigm. **Huggingface** released **TGI v3**, processing **3x more tokens** and running **13x faster** than vLLM on long prompts. **Cognition Labs** released **Devin**, an AI developer building Kubernetes operators. **Hyperbolic** raised **$12M Series A** to build an open AI platform with an **H100 GPU marketplace**. Discussions included **AI capabilities and employment impact**, and **NeurIPS 2024** announcements with **Google DeepMind** demos and a debate on AI scaling. On Reddit, **Llama 3.3-70B** supports **90K context length** finetuning using **Unsloth** with **gradient checkpointing** and Apple's **Cut Cross Entropy (CCE)** algorithm, fitting on **41GB VRAM**. **Llama 3.1-8B** reaches **342K context lengths** with Unsloth, surpassing native limits.

OpenAI Sora Turbo and Sora.com

Tue, 10 Dec 2024 02:21:42 GMT

**OpenAI** launched **Sora Turbo**, enabling text-to-video generation for ChatGPT Plus and Pro users with monthly generation limits and regional restrictions in Europe and the UK. **Google** announced a quantum computing breakthrough with the development of the **Willow chip**, potentially enabling commercial quantum applications. Discussions on **O1** model performance highlighted its lag behind **Claude 3.5 Sonnet** and **Gemini** in coding tasks, with calls for algorithmic innovation beyond transformer scaling. The **Llama 3.3 Euryale v2.3** model was praised for storytelling and roleplay capabilities, with users suggesting parameter tuning to reduce creative liberties and repetition. Alternatives like **Mistral-Large**, **Behemoth**, and **Endurance v1.1** were also noted. Additionally, **Nvidia** faces an anti-monopoly investigation in China. Memes and humor around GPU issues and embargo mishaps were popular on social media.

Meta Llama 3.3: 405B/Nova Pro performance at 70B price

Fri, 06 Dec 2024 22:44:07 GMT

**Meta AI** released **Llama 3.3 70B**, matching the performance of the 405B model with improved efficiency using *"a new alignment process and progress in online RL techniques"*. **OpenAI** announced **Reinforcement Fine-Tuning (RFT)** for building expert models with limited data, offering alpha access to researchers and enterprises. **Google DeepMind's Gemini-Exp-1206** leads benchmarks, tying with **GPT-4o** in coding performance. **LlamaCloud** enhanced document processing with table extraction and analytics. Discussions on **OpenAI's** pricing plans continue in the community.

$200 ChatGPT Pro and o1-full/pro, with vision, without API, and mixed reviews

Fri, 06 Dec 2024 02:34:03 GMT

**OpenAI** launched the **o1** model with multimodal capabilities, faster reasoning, and image input support, marking it as a state-of-the-art model despite some bugs and mixed community reviews. The new **o1-pro** tier offers unlimited access for $200/month with notable benchmark improvements but some performance trade-offs compared to **claude-3.5-sonnet**. **Google** released the **PaliGemma 2** vision-language model family in sizes **3B, 10B, and 28B**, excelling in visual question answering, image segmentation, and OCR, with day-0 support for fine-tuning. **LlamaIndex** announced discounts and feature updates for large-scale document processing. The AI community also reacted humorously to the new pricing tiers and model comparisons. *"o1 can see now, which makes it the SOTA multimodal model"* and *"most users will be best served by free/Plus tiers"* were notable sentiments.

not much happened today

Thu, 05 Dec 2024 02:41:39 GMT

**OpenAI** announced their "12 Days of OpenAI" event with daily livestreams and potential releases including the **O1 full model**, **Sora video model**, and **GPT-4.5**. **Google DeepMind** released the **GenCast weather model** capable of **15-day forecasts in 8 minutes** using TPU chips, and launched **Genie 2**, a model generating playable 3D worlds from single images. Leading vision researchers **Lucas Beyer**, **Alexander Kolesnikov**, and **Xiaohua Zhai** moved from DeepMind to OpenAI, which is opening a Zürich office. Criticism arose over OpenAI's strategy and model quality compared to **Anthropic** and **Claude 3.5 Sonnet**. On Reddit, a modified **llama.cpp** supports **Nvidia's Llama-3_1-Nemotron-51B**, matching performance of larger 70B models via NAS optimization.

Olympus has dropped (aka, Amazon Nova Micro|Lite|Pro|Premier|Canvas|Reel)

Wed, 04 Dec 2024 03:06:39 GMT

**Amazon** announced the **Amazon Nova** family of multimodal foundation models at AWS Re:Invent, available immediately with no waitlist in configurations like Micro, Lite, Pro, Canvas, and Reel, with Premier and speech-to-speech coming next year. These models offer **2-4x faster token speeds** and are **25%-400% cheaper** than competitors like **Anthropic Claude** models, positioning Nova as a serious contender in AI engineering. Pricing undercuts models such as **Google DeepMind Gemini Flash 8B**, and some Nova models extend context length up to **300k tokens**. However, benchmarking controversy exists as some evaluations show Nova scoring below **Llama-3 70B** in **LiveBench AI** metrics. Separately, **CycleQD** was introduced by **Sakana AI Labs**, using evolutionary computation for population-based model merging to develop niche LLM agents.

not much happened today

Mon, 02 Dec 2024 23:49:20 GMT

**AI News for 11/29/2024-12/2/2024** highlights several developments: **Nvidia** introduced **Puzzle**, a distillation-based neural architecture search for inference-optimized large language models, enhancing efficiency. The **IC-Light V2** model was released for varied illumination scenarios, and new video model techniques like **Trajectory Attention** and **Timestep Embedding** were presented. **Amazon** increased its investment in **Anthropic** to **$8 billion**, supporting AI safety research through a new fellowship program. **Google** is expanding AI integration with the **Gemini API** and open collaboration tools. Discussions on domain name relevance emphasize alternatives to **.com** domains like **.io**, **.ai**, and **.co**. Advances in reasoning include a **13.53% improvement** in LLM performance using "Reverse Thinking". **Pydantic** launched a new agent framework, and **Supabase** released version 2 of their assistant. Other notable mentions include **Browser Company** teasing a second browser and **World Labs** launching image-to-3D-world technology. The NotebookLM team departed from **Google**, and **Cognition** was featured on the cover of **Forbes**. The news was summarized by **Claude 3.5 Sonnet**.

not much happened to end the week

Fri, 29 Nov 2024 23:07:35 GMT

**AI News for 11/29/2024-11/30/2024** covers key updates including the **Gemini multimodal model** advancing in musical structure understanding, a new **quantized SWE-Bench** for benchmarking at **1.3 bits per task**, and the launch of the **DeepSeek-R1 model** focusing on transparent reasoning as an alternative to **o1**. The establishment of the **1st International Network of AI Safety Institutes** highlights global collaboration on AI safety. Industry updates feature **Amazon's Olympus AI model**, **Tesla's Optimus**, and experiments with **ChatGPT** as a universal translator. Community reflections emphasize the impact of large language models on daily life and medical AI applications. Discussions include scaling sparse autoencoders to **gpt-4** and the need for transparency in reasoning LLMs. The report also notes humor around **ChatGPT**'s French nickname.

Qwen with Questions: 32B open weights reasoning model nears o1 in GPQA/AIME/Math500

Thu, 28 Nov 2024 01:23:25 GMT

**DeepSeek r1** leads the race for "open o1" models but has yet to release weights, while **Justin Lin** released **QwQ**, a **32B open weight model** that outperforms **GPT-4o** and **Claude 3.5 Sonnet** on benchmarks. QwQ appears to be a fine-tuned version of **Qwen 2.5**, emphasizing sequential search and reflection for complex problem-solving. **SambaNova** promotes its RDUs as superior to GPUs for inference tasks, highlighting the shift from training to inference in AI systems. On Twitter, **Hugging Face** announced CPU deployment for llama.cpp instances, **Marker v1** was released as a faster and more accurate deployment tool, and **Agentic RAG** developments focus on integrating external tools and advanced LLM chains for improved response accuracy. The open-source AI community sees growing momentum with models like **Flux** gaining popularity, reflecting a shift towards multi-modal AI models including image, video, audio, and biology.

OLMo 2 - new SOTA Fully Open LLM

Wed, 27 Nov 2024 05:17:18 GMT

**AI2** has updated **OLMo-2** to roughly **Llama 3.1 8B** equivalent, training with **5T tokens** and using learning rate annealing and new high-quality data (Dolmino). They credit **Tülu 3** and its "Reinforcement Learning with Verifiable Rewards" approach. On Reddit, **Qwen2.5-72B instruct** model shows near lossless performance with **AutoRound 4-bit quantization**, available on **HuggingFace** in 4-bit and 2-bit versions, with discussions on **MMLU** benchmark and quantization-aware training. **HuggingFace** released **SmolVLM**, a **2B parameter** vision-language model running efficiently on consumer GPUs, supporting fine-tuning on Google Colab and demonstrating strong OCR capabilities with adjustable resolution and quantization options.

Anthropic launches the Model Context Protocol

Tue, 26 Nov 2024 01:56:47 GMT

**Anthropic** has launched the **Model Context Protocol (MCP)**, an open protocol designed to enable seamless integration between large language model applications and external data sources and tools. MCP supports diverse resources such as file contents, database records, API responses, live system data, screenshots, and logs, identified by unique URIs. It also includes reusable prompt templates, system and API tools, and JSON-RPC 2.0 transports with streaming support. MCP allows servers to request LLM completions through clients with priorities on cost, speed, and intelligence, hinting at an upcoming model router by Anthropic. Launch partners like **Zed**, **Sourcegraph**, and **Replit** have reviewed MCP favorably, while some developers express skepticism about its provider exclusivity and adoption potential. The protocol emphasizes security, testing, and dynamic tool discovery, with guides and videos available from community members such as **Alex Albert** and **Matt Pocock**. This development follows Anthropic's recent **$4 billion fundraise from Amazon** and aims to advance terminal-level integration for **Claude Desktop**.

Vision Everywhere: Apple AIMv2 and Jina CLIP v2

Fri, 22 Nov 2024 23:31:04 GMT

**Apple** released **AIMv2**, a novel vision encoder pre-trained with autoregressive objectives that achieves **89.5% accuracy on ImageNet** and integrates joint visual and textual objectives. **Jina** launched **Jina CLIP v2**, a multimodal embedding model supporting **89 languages** and high-resolution images with efficient Matryoshka embeddings reducing dimensions by **94%** with minimal accuracy loss. **Allen AI** introduced **Tülu 3** models based on **Llama 3.1** with **8B and 70B** parameters, offering **2.5x faster inference** and alignment via SFT, DPO, and RLVR methods, competing with **Claude 3.5** and **Llama 3.1 70B**. These developments highlight advances in autoregressive training, vision encoders, and multilingual multimodal embeddings.

LMSys killed Model Versioning (gpt 4o 1120, gemini exp 1121)

Fri, 22 Nov 2024 00:56:03 GMT

**AI News for 11/21/2024-11/22/2024** highlights the intense frontier lab race with **OpenAI's gpt-4o-2024-11-20** and **Google DeepMind's gemini-exp-1121** trading top spots on the Lmsys leaderboard. The trend of using date-based model identifiers instead of traditional versioning is noted across leading labs including **Anthropic**. **DeepSeek R1** is gaining attention as a potent open-source alternative, especially in the context of the AI competition between China and the US. **Gemini-Exp-1121** is praised for improvements in vision, coding, and reasoning, while **MistralAI** expands with a new Palo Alto office, signaling growth and hiring.

DeepSeek-R1 claims to beat o1-preview AND will be open sourced

Thu, 21 Nov 2024 02:41:02 GMT

**DeepSeek** has released **DeepSeek-R1-Lite-Preview**, an open-source reasoning model achieving **o1-preview-level performance** on math benchmarks with transparent thought processes, showing promise in real-time problem-solving. **NVIDIA** reported a record **$35.1 billion** revenue in Q3 with **112% year-on-year data center growth**, driven by **Hopper** and **Blackwell architectures**, the latter offering **2.2x performance improvement**. **Google DeepMind** introduced **AlphaQubit**, a quantum computing system improving error correction and outperforming leading decoders, though challenges remain in scaling and speed. The AI community continues to focus on **reasoning models**, **benchmarking**, and **quantum error correction** advancements.

Perplexity starts Shopping for you

Wed, 20 Nov 2024 00:43:00 GMT

**Stripe** launched their Agent SDK, enabling AI-native shopping experiences like **Perplexity Shopping** for US Pro members, featuring one-click checkout and free shipping via the **Perplexity Merchant Program**. **Mistral AI** released the **Pixtral Large 124B** multi-modal image model, now on **Hugging Face** and supported by **Le Chat** for image generation. **Cerebras Systems** offers a public inference endpoint for **Llama 3.1 405B** with a 128k context window and high throughput. **Claude 3.6** shows improvements over **Claude 3.5** but with subtle hallucinations. The **Bi-Mamba** 1-bit architecture improves LLM efficiency. The **wandb SDK** is preinstalled on Google Colab, and **Pixtral Large** is integrated into **AnyChat** and supported by **vLLM** for efficient model usage.

Pixtral Large (124B) beats Llama 3.2 90B with updated Mistral Large 24.11

Tue, 19 Nov 2024 02:25:23 GMT

**Mistral** has updated its **Pixtral Large** vision encoder to 1B parameters and released an update to the **123B parameter Mistral Large 24.11** model, though the update lacks major new features. **Pixtral Large** outperforms **Llama 3.2 90B** on multimodal benchmarks despite having a smaller vision adapter. **Mistral's Le Chat** chatbot received comprehensive feature updates, reflecting a company focus on product and research balance as noted by **Arthur Mensch**. **SambaNova** sponsors inference with their RDUs offering faster AI model processing than GPUs. On Reddit, **vLLM** shows strong concurrency performance on an **RTX 3090** GPU, with quantization challenges noted in **FP8 kv-cache** but better results using **llama.cpp** with **Q8 kv-cache**. Users discuss performance trade-offs between **vLLM**, **exllamav2**, and **TabbyAPI** for different model sizes and batching strategies.

Stripe lets Agents spend money with StripeAgentToolkit

Sat, 16 Nov 2024 01:02:33 GMT

**Stripe** has pioneered an AI SDK specifically designed for agents that handle payments, integrating with models like **gpt-4o** to enable financial transactions and token-based charging. The AI developer tooling trend emphasizes better "AI-Computer Interfaces" for improved agent reliability, with tools like **E2B** and the `llms.txt` documentation trend gaining traction, notably adopted by **Anthropic**. In AI model news, **Gemini-Exp-1114** topped the Vision Leaderboard and improved in Math Arena, while discussions continue around model overfitting and the limits of scaling laws for **AGI**. **OpenAI** released a **ChatGPT desktop app for macOS** with integrations for **VS Code**, **Xcode**, and **Terminal**, enhancing developer workflows and pair programming. **Anthropic** introduced a prompt improver using chain-of-thought reasoning, and **Meta AI** shared top research from **EMNLP2024** on image captioning, dialogue systems, and memory-efficient fine-tuning. Highlights from **ICLR 2025** include diffusion-based illumination harmonization, open mixture-of-experts language models, and hyperbolic vision-language models. A new adaptive decoding method optimizes creativity and factuality per token. Tools like **LlamaParse** and **RAGformation** were also introduced for document parsing and retrieval-augmented generation.

Gemini (Experimental-1114) retakes #1 LLM rank with 1344 Elo

Fri, 15 Nov 2024 02:50:42 GMT

**Anthropic** released the **3.5 Sonnet** benchmark for jailbreak robustness, emphasizing adaptive defenses. **OpenAI** enhanced **GPT-4** with a new RAG technique for contiguous chunk retrieval. **LangChain** launched **Promptim** for prompt optimization. **Meta AI** introduced **NeuralFeels** with neural fields for visuotactile perception. **RichardMCNgo** resigned from **OpenAI**, highlighting concerns on **AI governance** and **theoretical alignment**. Discussions emphasized the importance of **truthful public information** and **ethical alignment** in AI deployment. The latest **Gemini** update marks a new #1 LLM amid alignment challenges. The AI community continues to focus on **benchmarking**, **prompt-engineering**, and **alignment** issues.

Common Corpus: 2T Open Tokens with Provenance

Thu, 14 Nov 2024 01:54:53 GMT

**Pleais** via **Huggingface** released **Common Corpus**, the largest fully open multilingual dataset with over **2 trillion tokens** including detailed **provenance information**. They also introduced **OCRonos-Vintage**, a **124M-parameter OCR correction model** that efficiently fixes digitization errors on CPU and GPU, unlocking knowledge from PDFs. On AI tools, **LangChainAI** launched **Prompt Canvas** for collaborative **prompt engineering**, while **DeepSeek** released **JanusFlow 1.3B**, a unified multimodal LLM integrating autoregressive and rectified flow models for enhanced **image understanding** and **generation**. **Alibaba Cloud** announced **Qwen2.5-Coder**, a code-focused LLM with advanced coding capabilities, and **Claude 3.5 Sonnet** was highlighted for superior code generation. Discussions on **quantization challenges** and **scaling laws for precision** by **Tim Dettmers** and others emphasized the impact of low-precision training on model scalability and inference efficiency. *"Scaling Laws for Precision"* paper insights and alternative efficiency methods were also noted.

BitNet was a lie?

Wed, 13 Nov 2024 01:36:06 GMT

**Scaling laws for quantization** have been modified by a group led by Chris Re, analyzing over **465 pretraining runs** and finding benefits plateau at FP6 precision. Lead author **Tanishq Kumar** highlights that longer training and more data increase sensitivity to quantization, explaining challenges with models like **Llama-3**. **Tim Dettmers**, author of QLoRA, warns that the era of efficiency gains from low-precision quantization is ending, signaling a shift from scaling to optimizing existing resources. Additionally, **Alibaba** announced **Qwen 2.5-Coder-32B-Instruct**, which matches or surpasses **GPT-4o** on coding benchmarks, and open-source initiatives like **DeepEval** for LLM testing are gaining traction.

FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI

Tue, 12 Nov 2024 01:33:12 GMT

**Epoch AI** collaborated with over **60 leading mathematicians** to create the **FrontierMath benchmark**, a fresh set of hundreds of original math problems with easy-to-verify answers, aiming to challenge current AI models. The benchmark reveals that all tested models, including **o1**, perform poorly, highlighting the difficulty of complex problem-solving and **Moravec's paradox** in AI. Key AI developments include the introduction of **Mixture-of-Transformers (MoT)**, a sparse multi-modal transformer architecture reducing computational costs, and improvements in **Chain-of-Thought (CoT) prompting** through incorrect reasoning and explanations. Industry news covers **OpenAI** acquiring the **chat.com** domain, **Microsoft** launching the **Magentic-One agent framework**, **Anthropic** releasing **Claude 3.5 Haiku** outperforming **gpt-4o** on some benchmarks, and **xAI** securing **150MW grid power** with support from **Elon Musk** and **Trump**. **LangChain AI** introduced new tools including a **Financial Metrics API**, **Document GPT** with PDF upload and Q&A, and **LangPost** AI agent for LinkedIn posts. **xAI** also demonstrated the **Grok Engineer** compatible with OpenAI and Anthropic APIs for code generation.

not much happened today

Fri, 08 Nov 2024 23:16:39 GMT

This week in AI news, **Anthropic** launched **Claude Sonnet 3.5**, enabling desktop app control via natural language. **Microsoft** introduced **Magentic-One**, a multi-agent system built on the **AutoGen framework**. **OpenCoder** was unveiled as an AI-powered code cookbook for large language models. **SambaNova** is sponsoring a hackathon with prizes up to **$5000** for building real-time AI agents. **Sophiamyang** announced new **Batch and Moderation APIs** with **50% lower cost** and multi-dimensional harmful text detection. Open-source tools like **Infisical** for secret management, **CrewAI** for autonomous agent orchestration, and **Crawlee** for web scraping were released. Research highlights include **SCIPE** for error analysis in LLM chains, **Context Refinement Agent** for improved retrieval-augmented generation, and **MemGPT** for managing LLM memory. The week also saw a legal win for **OpenAI** in the RawStory copyright case, affirming that facts used in LLM training are not copyrightable.

not much happened today

Fri, 08 Nov 2024 01:01:09 GMT

This week in AI news highlights **Ollama 0.4** supporting **Meta's Llama 3.2 Vision** models (11B and 90B), with applications like handwriting recognition. **Self-Consistency Preference Optimization (ScPO)** was introduced to improve model consistency without human labels. Discussions on **model scaling**, **neural networks resurgence**, and **AMD's multi-GPU bandwidth** challenges were noted. The importance of **skip connections** in **Transformers** was emphasized. In healthcare, **less regulation plus AI** could revolutionize disease treatment and aging. Tools like **LlamaParse** and **Gemini** aid automated resume insights. **Gitpod Flex** demonstrated zero-trust architecture for secure development environments. Research includes surveys on **Small Language Models (SLMs)**, **number understanding** in LLMs, and **DTrOCR** using a **GPT-2 decoder** for OCR. Multi-agent systems in prediction markets were discussed by **TogetherCompute** and **LangChainAI**. Community events include **NeurIPS Happy Hour**, **NLP seminars**, and courses on **Agent Memory** with LLMs as operating systems.

Not much happened today

Thu, 07 Nov 2024 02:54:09 GMT

**Grok Beta** surpasses **Llama 3.1 70B** in intelligence but is less competitive due to its pricing at **$5/1M input tokens** and **$15/1M output tokens**. **Defense Llama**, developed with **Meta AI** and **Scale AI**, targets American national security applications. **SWE-Kit**, an open-source framework, supports building customizable AI software engineers compatible with **Llama 3**, **ChatGPT**, and **Claude**. **LangChainAI** and **Weights & Biases** integrate to improve retrievers and reduce hallucinations in **RAG applications** using **Gemini**. **Perplexity AI** offers enhanced election tracking tools for the **2024 elections**, including live state results and support for **Claude 3.5 Haiku**. **AI Talk** launched featuring discussions on Chinese AI labs with guests from **Qwen**. Memes highlight **Elon Musk** and humorous AI coding mishaps.

Tencent's Hunyuan-Large claims to beat DeepSeek-V2 and Llama3-405B with LESS Data

Wed, 06 Nov 2024 06:22:40 GMT

**Tencent** released a notable >300B parameter MoE model pretrained on **7T tokens**, including **1.5T synthetic data** generated via **Evol-Instruct**. The model introduces novel techniques like "recycle routing" and expert-specific learning rates, alongside a compute-efficient scaling law for MoE active parameters. However, its custom license restricts use in the EU and by companies with over 100M MAU, and it avoids China-sensitive queries. Meanwhile, **Anthropic** launched **Claude 3.5 Haiku**, now available on multiple platforms, praised for intelligence and speed but criticized for a **10x price increase**. **Meta** opened **Llama AI** to the U.S. defense sector, and a **Llama Impact Hackathon** offers a **$15K prize** for projects using **Llama 3.1 & 3.2 Vision**. **LlamaIndex** released a React chat UI component with Tailwind CSS and LLM backend integrations. The **MLX LM** model advances text generation speed and efficiency with KV cache quantization.

OpenAI beats Anthropic to releasing Speculative Decoding

Tue, 05 Nov 2024 02:51:39 GMT

**Prompt lookup** and **Speculative Decoding** techniques are gaining traction with implementations from **Cursor**, **Fireworks**, and teased features from **Anthropic**. **OpenAI** has introduced faster response times and file edits with these methods, offering about **50%** efficiency improvements. The community is actively exploring AI engineering use cases with these advancements. Recent updates highlight progress from companies like **NVIDIA**, **OpenAI**, **Anthropic**, **Microsoft**, **Boston Dynamics**, and **Meta**. Key technical insights include CPU inference capabilities, multimodal retrieval-augmented generation (RAG), and neural network fundamentals. New AI products include fully AI-generated games and advanced content generation tools. Challenges in AI research labs such as bureaucracy and resource allocation were also discussed, alongside AI safety and governance concerns.

not much happened today

Fri, 01 Nov 2024 20:59:45 GMT

**ChatGPT Search** was launched by **Sam Altman**, who called it his favorite feature since ChatGPT's original launch, doubling his usage. Comparisons were made between ChatGPT Search and **Perplexity** with improvements noted in Perplexity's web navigation. **Google** introduced a "Grounding" feature in the Gemini API & AI Studio enabling Gemini models to access real-time web information. Despite Gemini's leaderboard performance, developer adoption lags behind **OpenAI** and **Anthropic**. **SmolLM2**, a new small, powerful on-device language model, outperforms **Meta's Llama 3.2 1B**. A **Claude** desktop app was released for Mac and Windows. **Meta AI** announced robotics advancements including Meta Sparsh, Meta Digit 360, and Meta Digit Plexus. **Stable Diffusion 3.5 Medium**, a 2B parameter model with a permissive license, was released. Insights on AGI development suggest initial inferiority but rapid improvement. **Anthropic** advocates for early targeted AI regulation. Discussions on ML specialization predict training will concentrate among few companies, while inference becomes commoditized. New AI tools include **Suno AI Personas** for music creation, **PromptQL** for natural language querying over data, and **Agent S** for desktop task automation. Humor was shared about Python environment upgrades.

The AI Search Wars Have Begun — SearchGPT, Gemini Grounding, and more

Fri, 01 Nov 2024 07:04:02 GMT

**ChatGPT** launched its search functionality across all platforms using a fine-tuned version of **GPT-4o** with synthetic data generation and distillation from **o1-preview**. This feature includes a Chrome extension promoted by **Sam Altman** but has issues with hallucinations. The launch coincides with **Gemini** introducing Search Grounding after delays. Notably, **The New York Times** is not a partner due to a lawsuit against **OpenAI**. The AI search competition intensifies with consumer and B2B players like **Perplexity** and **Glean**. Additionally, **Claude 3.5 Sonnet** achieved a new benchmark record on SWE-bench Verified, and a new hallucination evaluation benchmark, SimpleQA, was introduced. Other highlights include the **Universal-2** speech-to-text model with 660M parameters and **HOVER**, a neural whole-body controller for humanoid robots trained in NVIDIA Isaac simulation. AI hedge fund teams using **LangChain** and **LangGraph** were also showcased. The news is sponsored by the RAG++ course featuring experts from **Weights & Biases**, **Cohere**, and **Weaviate**.

Creating a LLM-as-a-Judge

Wed, 30 Oct 2024 23:17:27 GMT

**Anthropic** released details on Claude 3.5 SWEBench+SWEAgent, while **OpenAI** introduced SimpleQA and **DeepMind** launched NotebookLM. **Apple** announced new M4 Macbooks, and a new SOTA image model, Recraft v3, emerged. Hamel Husain presented a detailed 6,000-word treatise on creating LLM judges using a method called **critique shadowing** to align LLMs with domain experts, addressing the problem of untrusted and unused data in AI teams. The workflow involves expert-reviewed datasets and iterative prompt refinement. Additionally, **Zep** introduced a temporal knowledge graph memory layer to improve AI agent memory and reduce hallucinations. **Anthropic** also integrated Claude 3.5 Sonnet with GitHub Copilot, expanding access to Copilot Chat users.

GitHub Copilot Strikes Back

Wed, 30 Oct 2024 01:05:11 GMT

**GitHub's tenth annual Universe conference** introduced the **Multi-model Copilot** featuring **Anthropic's Claude 3.5 Sonnet**, **Google's Gemini 1.5 Pro**, and **OpenAI's o1-preview** models in a new picker UI, allowing developers to choose from multiple companies' models. The event also showcased **GitHub Spark**, an AI-native tool for building natural language applications with deployment-free hosting and integrated model prompting. Additionally, GitHub updated its Copilot Workspace with new agents and security Autofix features. **Weights & Biases** launched Weave with multimodal observability supporting audio, text, and images, integrating the OpenAI Realtime API. Twitter recaps highlighted **tinygrad's** codebase optimization and discussions on GenAI adoption and **Gemini Flash-8B's** cost efficiency at **$0.0375 per million tokens**.

not much happened this weekend

Mon, 28 Oct 2024 22:27:43 GMT

**Moondream**, a **1.6b vision language model**, secured seed funding, highlighting a trend in moon-themed tiny models alongside **Moonshine** (27-61m ASR model). **Claude 3.5 Sonnet** was used for AI Twitter recaps. Discussions included **pattern recognition** vs. **intelligence** in **LLMs**, **reinforcement learning** for prompt optimization, and **NotebookLlama**, an open-source **NotebookLM** variant using **LLaMA models** for tasks like **text-to-speech**. Advances in **model optimization** with **async-TP** in **PyTorch** for **tensor parallelism** and hyperparameter tuning were noted. **Mini-Omni 2** demonstrated multimodal capabilities across **image**, **audio**, and **text** for voice conversations with emphasis on **modal alignment** and **multimodal fine-tuning**. AI productivity tools like an **AI email writer** and **LlamaCloud**-based research assistants were introduced. Emphasis on practical skill development and privacy-conscious AI tool usage with **Llama3-8B** was highlighted. Generative AI tools such as **#AIPythonforBeginners** and **GenAI Agents** with **LangGraph** were shared. Business insights covered rapid execution in AI product development and emerging AI-related job roles. Challenges in enterprise-grade text-to-SQL and advanced retrieval methods were discussed with tutorials on **RAG** applications using **LangChain** and **MongoDB**.

not much happened today

Sat, 26 Oct 2024 00:52:03 GMT

**Liquid AI** held a launch event introducing new foundation models. **Anthropic** shared follow-up research on social bias and feature steering with their "Golden Gate Claude" feature. **Cohere** released multimodal Embed 3 embeddings models following Aya Expanse. There was misinformation about **GPT-5/Orion** debunked by **Sam Altman**. **Meta AI FAIR** announced **Open Materials 2024** with new models and datasets for inorganic materials discovery using the EquiformerV2 architecture. **Anthropic AI** demonstrated feature steering to balance social bias and model capabilities. **NVIDIA**'s **Llama-3.1-Nemotron-70B** ranked highly on the Arena leaderboard with style control. **Perplexity AI** expanded to 100M weekly queries with new finance and reasoning modes. **LangChain** emphasized real application integration with interactive frame interpolation. **Kestra** highlighted scalable event-driven workflows with open-source YAML-based orchestration. **OpenFLUX** optimized inference speed by doubling it through guidance LoRA training. Discussions on AI safety included trust dynamics between humans and AI, economic impacts of AI automation, and the White House AI National Security memo addressing cyber and biological risks. **LlamaIndex** showcased knowledge-backed agents for enhanced AI applications.

s{imple|table|calable} Consistency Models

Fri, 25 Oct 2024 02:36:02 GMT

**Model distillation** significantly accelerates diffusion models, enabling near real-time image generation with only 1-4 sampling steps, as seen in **BlinkShot** and **Flux Schnell**. Research led by **Yang Song** introduced **simplified continuous-time consistency models (sCMs)**, achieving under 10% FID difference in just 2 steps and scaling up to **1.5B parameters** for higher quality. On AI hardware, **Tesla** is deploying a **50k H100 cluster** potentially capable of completing **GPT-4** training in under three weeks, while **Cerebras Systems** set a new inference speed record on **Llama 3.1 70B** with their wafer-scale AI chips. **Stability AI** released **Stable Diffusion 3.5** and its Turbo variant, and **Cohere** launched new multilingual models supporting **23 languages** with state-of-the-art performance. **LangChain** also announced ecosystem updates.

not much happened today

Thu, 24 Oct 2024 00:39:59 GMT

**Anthropic** released upgraded **Claude 3.5 Sonnet** and **Claude 3.5 Haiku** models featuring a new **computer use capability** that allows interaction with computer interfaces via screenshots and actions like mouse movement and typing. The **Claude 3.5 Sonnet** achieved state-of-the-art coding performance on SWE-bench Verified with a **49% score**, surpassing OpenAI's **o1-preview**. **Anthropic** focuses on teaching general computer skills rather than task-specific tools, with expected rapid improvements. Other releases include **Mochi 1**, an open-source video generation model, **Stable Diffusion 3.5** with Large and Medium variants, and **Embed 3** by **Cohere**, a multimodal embedding model for text and image search. **KerasHub** was launched by **François Chollet**, unifying KerasNLP and KerasCV with 37 pretrained models. Microsoft introduced the **Differential Transformer** to reduce attention noise via differential attention maps, and research on transformer attention layers was shared by **Rasbt**.

Claude 3.5 Sonnet (New) gets Computer Use

Wed, 23 Oct 2024 02:08:12 GMT

**Anthropic** announced new Claude 3.5 models: **3.5 Sonnet** and **3.5 Haiku**, improving coding performance significantly, with Sonnet topping several coding benchmarks like **Aider** and **Vectara**. The new **Computer Use API** enables controlling computers via vision, scoring notably higher than other AI systems, showcasing progress in AI-driven computer interaction. **Zep** launched a cloud edition for AI agents memory management, highlighting challenges in **multimodal memory**. The update also mentions **Llama 3.1** and **Nemotron** models from **NVIDIA**.

DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing

Tue, 22 Oct 2024 00:04:21 GMT

**UC Berkeley's EPIC lab** introduces innovative LLM data operators with projects like **LOTUS** and **DocETL**, focusing on effective programming and computation over large data corpora. This approach contrasts GPU-rich big labs like **Deepmind** and **OpenAI** with GPU-poor compound AI systems. **Microsoft** open-sourced **BitNet b1.58**, a 1-bit ternary parameter LLM enabling **4-20x faster training** and on-device inference at human reading speeds. Nvidia released **Llama-3.1-Nemotron-70B-Instruct**, a fine-tuned open-source model outperforming **GPT-4o** and **Claude-3.5-sonnet**. These developments highlight advances in **model-optimization**, **on-device-ai**, and **fine-tuning**.

DeepSeek Janus and Meta SpiRit-LM: Decoupled Image and Expressive Voice Omnimodality

Fri, 18 Oct 2024 22:46:38 GMT

**DeepSeek Janus** and **Meta SpiRit-LM** are two notable multimodality AI models recently released, showcasing advances in image generation and speech synthesis respectively. DeepSeek Janus separates vision encoders for image understanding and generation, achieving better results in both tasks. Meta's SpiRit-LM introduces an expressive speech and writing model generating pitch and style units, improving over standard TTS. Additionally, **W&B Weave** offers comprehensive LLM observability and multimodality fine-tuning tools. Industry updates include Nvidia's Nemotron 70b model underperforming, Meta open-sourcing Movie Gen Bench for media generation benchmarking, Perplexity launching internal search with multi-step reasoning, and Anthropic updating Claude apps. Open source progress includes Hugging Face's gradient accumulation fix in transformers and advocacy for open source AI to prevent Big Tech dominance. *"Model merging for combining skills of multiple models"* is also highlighted.

not much happened today

Fri, 18 Oct 2024 01:13:21 GMT

**Answer.ai** launched **fastdata**, a synthetic data generation library using `claudette` and Tencent's Billion Persona paper. **NotebookLM** became customizable, and **Motherduck** introduced notable LLMs in SQL implementations. **Perplexity** and **Dropbox** announced competitors to **Glean**. **OpenAI** unveiled audio chat completions priced at 24 cents per minute. **Meta AI** released **Llama 3.1**, powering Lenovo AI Now's on-device agent. **Yi-Lightning** model ranked #6 globally, surpassing **GPT-4o**. **Zyphra AI** released the large **Zyda-2** dataset with 5 trillion tokens. **François Chollet** clarified transformer architecture as set-processing, not sequence-processing. Research suggests memorization aids LLM reasoning. **Anthropic** updated its Responsible Scaling Policy for AI safety. Tools like **Perplexity Finance**, **Open Canvas** by **LangChain**, and **AlphaCodium** code generation tool were highlighted. Approximately $500 million was raised for AI agent startups, with ongoing discussions on AI's job market impact. Combining prompt caching with the Batches API can yield a 95% discount on **Claude 3.5 Sonnet** tokens.

Did Nvidia's Nemotron 70B train on test?

Thu, 17 Oct 2024 00:44:43 GMT

**NVIDIA's Nemotron-70B** model has drawn scrutiny despite strong benchmark performances on **Arena Hard**, **AlpacaEval**, and **MT-Bench**, with some standard benchmarks like **GPQA** and **MMLU Pro** showing no improvement over the base **Llama-3.1-70B**. The new **HelpSteer2-Preference dataset** improves some benchmarks with minimal losses elsewhere. Meanwhile, **Mistral** released **Ministral 3B and 8B** models featuring **128k context length** and outperforming **Llama-3.1** and **GPT-4o** on various benchmarks under the **Mistral Commercial License**. **NVIDIA's Nemotron 70B** also surpasses **GPT-4o** and **Claude-3.5-Sonnet** on key benchmarks using **RLHF (REINFORCE)** training. Additionally, **Zep** introduced **Graphiti**, an open-source temporal knowledge graph memory layer for AI agents, built on **Neo4j**.

not much happened today

Tue, 15 Oct 2024 21:33:05 GMT

**Vertical SaaS agents** are gaining rapid consensus as the future of AI applications, highlighted by **Decagon's $100m funding** and **Sierra's $4b round**. **OpenAI alumni** are actively raising venture capital and forming new startups, intensifying competition in the AI market. **Demis Hassabis** celebrated the **Nobel Prize** recognition for **AlphaFold2**, a breakthrough in protein structure prediction. Advances in AI models include techniques like **LoRA projectors** and **annealing on high-quality data**, while discussions emphasize the need for **high-bandwidth sensory inputs** beyond language for common sense learning. New methods like **LoLCATs** aim to optimize transformer models such as **Llama** and **Mistral** for efficiency. Ethical concerns about AI agents performing harmful tasks remain under investigation. The AI community continues to explore model evaluation challenges and optimization frameworks like **LPZero** for neural architecture search.

Not much (in AI) happened this weekend

Mon, 14 Oct 2024 22:52:37 GMT

**OpenAI** introduced an "edit this area" feature for image generation, praised by **Sam Altman**. **Yann LeCun** highlighted a NYU paper improving pixel generation with feature prediction loss using pre-trained visual encoders like DINOv2. Long-context LLMs such as **llama-3.1-8b** and **llama-3.2** variants now support up to **131k tokens**, offering alternatives to RAG systems. **Bindu Reddy** announced AI agents capable of building and deploying code from English instructions, signaling AI's replacement of SQL and potential impact on Python. SpaceX's successful **Starship rocket catch** was celebrated by **Andrej Karpathy** and others, with **Soumith Chintala** praising SpaceX's efficient, low-bureaucracy research approach. Privacy concerns arose from **Harvard** students' AI glasses, I-XRAY, which can reveal personal information. **Meta AI FAIR**'s Movie Gen model advances media foundation models with high-quality text-to-image and video generation, including synced audio. Humanoid robots like **Ameca** and **Azi** now engage in expressive conversations using **ChatGPT**. **xAI** rapidly deployed **100K Nvidia H100 GPUs** in 19 days, with CEO Jensen Huang commending Elon Musk. Leading AI research labs compared include **Meta-FAIR**, **Google DeepMind**, and **Microsoft Research**. Skepticism about LLM intelligence was voiced by **Sam Pino**, emphasizing limitations in novel problem-solving despite strong memorization.

not much happened today

Fri, 11 Oct 2024 23:00:43 GMT

**Rhymes AI** released **Aria**, a new **25.3B** parameter multimodal MoE model supporting text, code, image, and video with a **64k token context window** and Apache-2.0 license. **OpenAI**'s **o1-preview** and **o1-mini** models show consistent improvement over **Anthropic** and **Google Gemini 1.5 Pro/Flash** on long context RAG benchmarks up to **128k tokens**, while **Google Gemini 1.5** models excel at extreme context lengths up to **2 million tokens**. **Meta AI** expanded rollout to 21 countries with new language support but remains unavailable in the EU. The one-year anniversary of **SWE-bench** benchmark for software engineering tasks was celebrated, alongside the introduction of SWE-bench Multimodal. New AI tools include **OxyCopilot** by Oxylabs for web scraping, **Taipy** for Python-based production apps, and **Latitude** for prompt engineering. Industry insights highlight changing AI funding dynamics and OpenAI's strategic focus on consumer products like ChatGPT. *"all recaps done by Claude 3.5 Sonnet, best of 4 runs."*

State of AI 2024

Thu, 10 Oct 2024 22:35:38 GMT

**Nathan Benaich's State of AI Report** in its 7th year provides a comprehensive overview of AI research and industry trends, including highlights like **BitNet** and the synthetic data debate. **Cerebras** is preparing for an IPO, reflecting growth in AI compute. A hackathon hosted by **Daily** and the **Pipecat** community focuses on conversational voice AI and multimodal experiences with $20,000 in prizes. Nobel Prizes in Physics and Chemistry were awarded for AI research: **Geoffrey Hinton** and **John Hopfield** for neural networks and statistical mechanics, and **Demis Hassabis**, **John Jumper**, and **David Baker** for AlphaFold and protein structure prediction. **Meta** released **Llama 3.2** with multimodal capabilities, accompanied by educational resources and performance updates. *"This recognizes the impact of deep neural networks on society"* and *"tremendous impact of AlphaFold and ML-powered protein structure prediction"* were noted by experts.

not much happened today

Thu, 10 Oct 2024 01:02:45 GMT

**Geoffrey Hinton** and **John Hopfield** won the **Nobel Prize in Physics** for foundational work on neural networks linking AI and physics. **Meta AI** introduced a **13B parameter audio generation model** as part of Meta Movie Gen for video-synced audio. **Anthropic** launched the **Message Batches API** enabling asynchronous processing of up to 10,000 queries at half the cost. **Together Compute** released **Flux Schnell**, a free model for 3 months. New techniques like **PrefixQuant** quantization and **Prompt Caching** for low-latency inference were highlighted by **rohanpaul_ai**. **LangGraph** added long-term memory support for persistent document storage. **Hex-LLM** framework was introduced for TPU-based low-cost, high-throughput LLM serving from Hugging Face models. Discussions on AI safety emphasized gender equality in science, and concerns about premature AI regulation by media and Hollywood were raised.

The AI Nobel Prize

Wed, 09 Oct 2024 01:33:48 GMT

**Geoff Hinton** and **John Hopfield** won the **Nobel Prize in Physics** for their work on **Artificial Neural Networks**. The award citation spans **14 pages** highlighting their contributions. **Zep** released a new community edition of their low-latency memory layer for AI agents, emphasizing knowledge graphs for memory. At OpenAI's DevDay, new features like real-time voice API, vision model fine-tuning, and prompt caching with a **50% discount** on reused tokens were introduced. **Anthropic's Claude 3.5 Sonnet** was recognized as the best model currently. **Reka AI Labs** updated their **Reka Flash** model with enhanced multimodal and function calling capabilities. The **GOT (Generic OCR Transformer)** achieved **98.79% accuracy** on OCR benchmarks. Discussions on open-source AI models highlighted their role in fostering competition and decentralization. Software development insights included the importance of Single Sign-On (SSO), thorough testing, and AI-assisted coding workflows. Ethical and societal topics covered critiques of tax policies and the appointment of France's first Minister of AI.

not much happened this weekend

Tue, 08 Oct 2024 02:36:09 GMT

**AI news from 10/4/2024 to 10/7/2024** highlights several developments: **OpenAI's o1-preview** shows strong performance on complex tasks but struggles with simpler ones, while **Claude 3.5 Sonnet** can match its reasoning through advanced prompting techniques. **Meta** introduced **Movie Gen**, a cutting-edge media foundation model for text-to-video generation and editing. **Reka** updated their 21B Flash Model with temporal video understanding, native audio, and tool use capabilities. Interest grows in "open o1" reproductions focusing on prompting and finetuning, with **Entropix** exploring entropy-based sampling. **LangChainAI** demonstrated a Retrieval Agent for complex Q&A, and synthetic data generation research surveyed 417 models. A resurgence in RNNs shows efficient parallel training making them competitive with Transformers. Biologically-inspired AI safety approaches were also noted. *"A quiet weekend and air conditioning is all you need."*

Contextual Document Embeddings: `cde-small-v1`

Sat, 05 Oct 2024 01:38:06 GMT

**Meta** announced a new text-to-video model, **Movie Gen**, claiming superior adaptation of **Llama 3** to video generation compared to OpenAI's Sora Diffusion Transformers, though no release is available yet. Researchers Jack Morris and Sasha Rush introduced the **cde-small-v1** model with a novel **contextual batching** training technique and **contextual embeddings**, achieving strong performance with only **143M parameters**. **OpenAI** launched Canvas, a collaborative interface for ChatGPT with synthetic data training. **Google DeepMind** welcomed Tim Brooks to work on video generation and world simulators. Google released **Gemini 1.5 Flash-8B**, improving cost and rate limits with algorithmic efficiency.

Canvas: OpenAI's answer to Claude Artifacts

Thu, 03 Oct 2024 23:22:37 GMT

**OpenAI** released **Canvas**, an enhanced writing and coding tool based on **GPT-4o**, featuring inline suggestions, seamless editing, and a collaborative environment. Early feedback compares it to **Cursor** and **Claude Artifacts**, noting strengths and some execution issues. OpenAI also sponsors **Marijn Haverbeke**, creator of **ProseMirror** and **CodeMirror**, which are used in Canvas. The integration involved training a detector to trigger Canvas appropriately, achieving **83% accuracy** in correct triggers. Unlike Claude Artifacts, Canvas currently lacks Mermaid Diagrams and HTML preview support. Additionally, **Daily** is sponsoring a **$20,000** voice AI hackathon in San Francisco, highlighting voice AI as a key emerging skill.

Not much technical happened today

Wed, 02 Oct 2024 22:45:37 GMT

**OpenAI** announced raising **$6.6B** in new funding at a **$157B valuation**, with ChatGPT reaching *250M weekly active users*. **Poolside** raised **$500M** to advance AGI development. **LiquidAI** introduced three new MoE models (1B, 3B, 40B) with a **32k context window** and efficient token handling. **OpenAI** released Whisper V3 Turbo, an open-source multilingual model with significant speed improvements. **Meta AI FAIR** is hiring research interns focusing on **LLM reasoning, alignment, synthetic data, and novel architectures**. **Cohere** partnered with Fujitsu to launch Takane, a custom Japanese model. Technical discussions included challenges in **LoRA fine-tuning**, **float8 quantization** in Keras, and new tools like **create-llama** for agent templates. Industry commentary raised concerns about AI development priorities and highlighted freelancing opportunities in AI.

OpenAI Realtime API and other Dev Day Goodies

Wed, 02 Oct 2024 06:06:20 GMT

**OpenAI** launched the **gpt-4o-realtime-preview** Realtime API featuring text and audio token processing with pricing details and future plans including vision and video support. The API supports voice activity detection modes, function calling, and ephemeral sessions with auto-truncation for context limits. Partnerships with **LiveKit**, **Agora**, and **Twilio** enhance audio components and AI virtual agent voice calls. Additionally, OpenAI introduced vision fine-tuning with only 100 examples improving mapping accuracy for **Grab** and RPA success for **Automat**. Model distillation and prompt caching features were also announced, including free eval inference for users opting to share data.

Liquid Foundation Models: A New Transformers alternative + AINews Pod 2

Tue, 01 Oct 2024 01:34:19 GMT

**Liquid.ai** emerged from stealth with three subquadratic foundation models demonstrating superior efficiency compared to state space models and Apple’s on-device and server models, backed by a $37M seed round. **Meta AI** announced **Llama 3.2** with multimodal vision-enabled models and lightweight text-only variants for mobile. **Google DeepMind** introduced production-ready **Gemini-1.5-Pro-002** and **Gemini-1.5-Flash-002** models with improved pricing and rate limits, alongside **AlphaChip**, an AI-driven chip design system using reinforcement learning for rapid superhuman layouts. **OpenAI** enhanced ChatGPT Plus and Teams with Advanced Voice Mode featuring Custom Instructions, Memory, and new nature-inspired voices. California Governor vetoed SB-1047 AI regulation bill, celebrated by AI community figures like **ylecun** and **svpino** as a win for open-source AI. Google upgraded **NotebookLM** with audio overviews supporting YouTube and audio files, turning documents into AI-generated podcasts. *"Open source in AI is thriving,"* noted **ylecun**, highlighting 1 million models on Github and HuggingFace.

not much happened today

Fri, 27 Sep 2024 21:53:11 GMT

**Meta** released **Llama 3.2**, including lightweight 1B and 3B models for on-device AI with capabilities like summarization and retrieval-augmented generation. **Molmo**, a new multimodal model, was introduced with a large dense captioning dataset. **Google DeepMind** announced **AlphaChip**, an AI-driven chip design method improving TPU and CPU designs. **Hugging Face** surpassed 1 million free public models, highlighting the value of smaller specialized models. Discussions covered challenges in scaling RAG applications, the future of on-device AI running ChatGPT-level models, reliability issues in larger LLMs, and new Elo benchmarking accepted at NeurIPS 2024. AI ethics and regulation topics included free speech responsibilities and California's SB-1047 bill potentially affecting open-source AI. *"AlphaChip transformed computer chip design,"* and *"ChatGPT-level AI on mobile devices predicted within a year."*

not much happened today

Thu, 26 Sep 2024 22:52:11 GMT

**Meta AI** released **Llama 3.2** models including **1B, 3B text-only** and **11B, 90B vision** variants with **128K token context length** and adapter layers for image-text integration. These models outperform competitors like **Gemma 2** and **Phi 3.5-mini**, and are supported on major platforms including **AWS, Azure, and Google Cloud**. **OpenAI CTO Mira Murati** announced her departure. **Allen AI** released **Molmo**, an open-source multimodal model family outperforming proprietary systems. **Google** improved **Gemini 1.5** with Flash and Pro models. **Meta** showcased **Project Orion AR glasses** and hinted at a **Quest 3S** priced at $300. Discussions covered new benchmarks for multimodal models, model optimization, and AI safety and alignment.

Llama 3.2: On-device 1B/3B, and Multimodal 11B/90B (with AI2 Molmo kicker)

Wed, 25 Sep 2024 23:54:30 GMT

**Meta** released **Llama 3.2** with new multimodal versions including **3B** and **20B** vision adapters on a frozen Llama 3.1, showing competitive performance against **Claude Haiku** and **GPT-4o-mini**. **AI2** launched multimodal **Molmo 72B** and **7B** models outperforming Llama 3.2 in vision tasks. Meta also introduced new **128k-context 1B and 3B models** competing with **Gemma 2** and **Phi 3.5**, with collaborations hinted with **Qualcomm**, **Mediatek**, and **Arm** for on-device AI. The release includes a **9 trillion token count** for Llama 1B and 3B. Partner launches include **Ollama**, **Together AI** offering free 11B model access, and **Fireworks AI**. Additionally, a new **RAG++ course** from **Weights & Biases**, **Cohere**, and **Weaviate** offers systematic evaluation and deployment guidance for retrieval-augmented generation systems based on extensive production experience.

ChatGPT Advanced Voice Mode

Wed, 25 Sep 2024 01:31:24 GMT

**OpenAI** rolled out **ChatGPT Advanced Voice Mode** with 5 new voices and improved accent and language support, available widely in the US. Ahead of rumored updates for **Llama 3** and **Claude 3.5**, **Gemini Pro** saw a significant price cut aligning with the new intelligence frontier pricing. **OpenAI's o1-preview model** showed promising planning task performance with 52.8% accuracy on Randomized Mystery Blocksworld. **Anthropic** is rumored to release a new model, generating community excitement. **Qwen 2.5** was released with models up to 32B parameters and support for 128K tokens, matching GPT-4 0613 benchmarks. Research highlights include PlanBench evaluation of o1-preview, OpenAI's release of a multilingual MMMLU dataset covering 14 languages, and RAGLAB framework standardizing Retrieval-Augmented Generation research. New AI tools include PDF2Audio for converting PDFs to audio, an open-source AI starter kit for local model deployment, and **Moshi**, a speech-based AI assistant from Kyutai. Industry updates feature **Scale AI** nearing $1B ARR with 4x YoY growth and **Together Compute's** enterprise platform offering faster inference and cost reductions. Insights from **Sam Altman**'s blog post were also shared.

a calm before the storm

Mon, 23 Sep 2024 23:33:49 GMT

**Anthropic** is raising funds at a valuation up to **$40 billion** ahead of anticipated major releases. **OpenAI** launched new reasoning models **o1** and **o1-mini**, with increased rate limits and a multilingual MMLU benchmark. **Alibaba** released the open-source **Qwen2.5** model supporting 29+ languages, showing competitive performance to **gpt-4** at lower cost. **Microsoft** and **Blackrock** plan to invest **$30 billion** in AI data centers, with **Groq** partnering with Aramco to build the world's largest AI inference center. Robotics advances include Disney Research and ETH Zurich's diffusion-based motion generation for robots and Pudu Robotics' semi-humanoid robot. Slack and Microsoft introduced AI-powered agents integrated into their platforms. Research highlights include long-context scaling for **llama-2-70b** using Dual Chunk Attention and KV cache quantization enabling 1 million token context on **llama-7b** models.

not much happened today

Sat, 21 Sep 2024 01:37:46 GMT

**Anthropic** introduced a RAG technique called Contextual Retrieval that reduces retrieval failure rates by 67% using prompt caching. **Meta** is teasing multimodal **Llama 3** ahead of Meta Connect. **OpenAI** is hiring for a multi-agent research team focusing on improved AI reasoning with their **o1 models**, which have sparked mixed reactions. **DeepSeek 2.5** is noted as a cost-effective alternative to **GPT-4** and **Claude 3.5 sonnet**. New models like **3DTopia-XL** for 3D asset generation and **CogVideoX** for image-to-video conversion were highlighted. Techniques to boost reasoning by re-reading questions and combining retrieval with prompt caching were shared. Industry insights emphasize the necessity of AI adoption in enterprises and the disruption of traditional ML businesses. Tools like **LangChainAI's LangGraph Templates** and **LlamaIndex's LlamaParse Premium** enhance agentic applications and multimodal content extraction. Discussions on LLM evals and caching highlight production challenges and improvements. *"Companies not allowing developers to use AI are unlikely to succeed"* was a key sentiment.

not much happened today

Fri, 20 Sep 2024 01:00:56 GMT

**OpenAI's o1-preview and o1-mini models** lead benchmarks in Math, Hard Prompts, and Coding. **Qwen 2.5 72B** model shows strong performance close to **GPT-4o**. **DeepSeek-V2.5** tops Chinese LLMs, rivaling **GPT-4-Turbo-2024-04-09**. **Microsoft's GRIN MoE** achieves good results with 6.6B active parameters. **Moshi voice model** from Kyutai Labs runs locally on Apple Silicon Macs. **Perplexity app** introduces voice mode with push-to-talk. **LlamaCoder** by Together.ai uses **Llama 3.1 405B** for app generation. **Google DeepMind's Veo** is a new generative video model for YouTube Shorts. The **2024 ARC-AGI competition** increases prize money and plans a university tour. A survey on model merging covers 50+ papers for LLM alignment. The **Kolmogorov–Arnold Transformer (KAT)** paper proposes replacing MLP layers with KAN layers for better expressiveness. **Hugging Face Hub** integrates with **Google Cloud Vertex AI Model Garden** for easier open-source model deployment. **Agent.ai** is introduced as a professional network for AI agents. *"Touching grass is all you need."*

o1 destroys Lmsys Arena, Qwen 2.5, Kyutai Moshi release

Wed, 18 Sep 2024 21:51:26 GMT

**OpenAI's o1-preview** model has achieved a milestone by fully matching top daily AI news stories without human intervention, consistently outperforming other models like **Anthropic**, **Google**, and **Llama 3** in vibe check evaluations. **OpenAI** models dominate the top 4 slots on **LMsys** benchmarks, with rate limits increasing to **500-1000 requests per minute**. In open source, **Alibaba's Qwen 2.5** suite surpasses **Llama 3.1** at the 70B scale and updates its closed **Qwen-Plus** models to outperform **DeepSeek V2.5** but still lag behind leading American models. **Kyutai Moshi** released its open weights realtime voice model featuring a unique streaming neural architecture with an "inner monologue." **Weights & Biases** introduced **Weave**, an LLM observability toolkit that enhances experiment tracking and evaluation, turning prompting into a more scientific process. The news also highlights upcoming events like the **WandB LLM-as-judge hackathon** in San Francisco. *"o1-preview consistently beats out our vibe check evals"* and *"OpenAI models are gradually raising rate limits by the day."*

nothing much happened today

Wed, 18 Sep 2024 00:27:31 GMT

**OpenAI's o1 model** faces skepticism about open-source replication due to its extreme restrictions and unique training advances like RL on CoT. **ChatGPT-4o** shows significant performance improvements across benchmarks. **Llama-3.1-405b** fp8 and bf16 versions perform similarly with cost benefits for fp8. A new open-source benchmark "Humanity's Last Exam" offers $500K in prizes to challenge LLMs. Model merging benefits from neural network sparsity and linear mode connectivity. Embedding-based toxic prompt detection achieves high accuracy with low compute. **InstantDrag** enables fast, optimization-free drag-based image editing. **LangChain v0.3** releases with improved dependency management. Automated code review tool **CodeRabbit** adapts to team coding styles. Visual search advances integrate multimodal data for better product search. Experts predict AI will be default software by 2030.

a quiet weekend

Tue, 17 Sep 2024 00:28:09 GMT

**OpenAI** released the new **o1** model, leveraging reinforcement learning and chain-of-thought prompting to excel in reasoning benchmarks, achieving an IQ-like score of **120**. **Google DeepMind** introduced **DataGemma** to reduce hallucinations by connecting LLMs with real-world data, and unveiled **ALOHA** and **DemoStart** for robot dexterity using diffusion methods. **Adobe** previewed its **Firefly AI Video Model** with text-to-video and generative extend features. **Mistral** launched the multimodal **Pixtral 12B** model, and **Tencent** presented the **GameGen-O** open-world video game generation model. Several research papers from **Stanford**, **OpenAI**, **Microsoft**, **Mila**, and **Notre Dame** focus on advanced reasoning, self-verification, and reflection tuning techniques. Experts like **Terence Tao** and **George Hotz** have shared mixed but optimistic views on o1's capabilities. Seed funding rounds include **Supermaven** ($12M) and **11x** ($24M).

Learnings from o1 AMA

Sat, 14 Sep 2024 00:55:34 GMT

**OpenAI** released the **o1 model series**, touted as their "most capable and aligned models yet," trained with reinforcement learning to enhance reasoning. The **o1-preview** model scored **21% on ARC-AGI**, **~80% on aider code editing** (surpassing Claude 3.5 Sonnet's 77%), and **~52% on Cognition-Golden**, showcasing a shift from memorizing answers to memorizing reasoning. The model employs a unique chain-of-thought approach enabling "System II thinking" for better problem-solving. Experts like **Andrew Mayne** advise framing o1 as a smart friend providing thoughtful explanations. Additionally, an advanced RAG course sponsored by **Weights & Biases**, **Cohere**, and **Weaviate** offers strategies for hybrid search and prompting to optimize AI solutions.

o1: OpenAI's new general reasoning models

Fri, 13 Sep 2024 01:18:57 GMT

**OpenAI** has released the **o1** model family, including **o1-preview** and **o1-mini**, focusing on test-time reasoning with extended output token limits over 30k tokens. The models show strong performance, ranking in the 89th percentile on competitive programming, excelling in USA Math Olympiad qualifiers, and surpassing PhD-level accuracy on physics, biology, and chemistry benchmarks. Notably, **o1-mini** performs impressively despite its smaller size compared to **gpt-4o**. The release highlights new scaling laws for test-time compute that scale loglinearly. Additionally, **Nvidia** is reportedly losing AI chip market share to startups, with a shift in developer preference from CUDA to **llama** models for web development, though Nvidia remains dominant in training. This news reflects significant advances in reasoning-focused models and shifts in AI hardware competition.

Pixtral 12B: Mistral beats Llama to Multimodality

Thu, 12 Sep 2024 00:30:22 GMT

**Mistral AI** released **Pixtral 12B**, an open-weights **vision-language model** with a **Mistral Nemo 12B** text backbone and a 400M vision adapter, featuring a large vocabulary of **131,072 tokens** and support for **1024x1024 pixel images**. This release notably beat **Meta AI** in launching an open multimodal model. At the Mistral AI Summit, architecture details and benchmark performances were shared, showing strong OCR and screen understanding capabilities. Additionally, **Arcee AI** announced **SuperNova**, a distilled **Llama 3.1 70B & 8B** model outperforming Meta's Llama 3.1 70B instruct on benchmarks. **DeepSeek** released **DeepSeek-V2.5**, scoring **89 on HumanEval**, surpassing **GPT-4-Turbo**, Opus, and Llama 3.1 in coding tasks. **OpenAI** plans to release **Strawberry** as part of ChatGPT soon, though its capabilities are debated. **Anthropic** introduced Workspaces for managing multiple Claude deployments with enhanced access controls.

not much happened today + AINews Podcast?

Wed, 11 Sep 2024 02:24:16 GMT

**Glean** doubled its valuation again. **Dan Hendrycks' Superforecaster AI** generates plausible election forecasts with interesting prompt engineering. A **Stanford** study found that **LLM-generated research ideas** are statistically more novel than those by expert humans. **SambaNova** announced faster inference for **llama-3** models, surpassing **Cerebras**. **Benjamin Clavie** gave a notable talk on retrieval-augmented generation techniques. **Strawberry** is reported to launch in two weeks. **Google Illuminate** offers AI-generated podcast discussions about papers and books. **Apple** unveiled new AI features in iOS 18, including visual intelligence and improved Siri, with on-device and cloud processing for camera-based event additions. The **Reflection 70B** model sparked controversy over performance claims. Experts highlighted the unreliability of traditional benchmarks like MMLU and HumanEval, recommending alternative evaluation methods such as LMSys Chatbot Arena and Hugging Face's open-sourced **Lighteval** suite. The AI research community continues to explore AI's role in generating novel research ideas and improving benchmarking.

AIPhone 16: the Visual Intelligence Phone

Mon, 09 Sep 2024 23:00:14 GMT

**Apple** announced the new **iPhone 16** lineup featuring **Visual Intelligence**, a new AI capability integrated with Camera Control, Apple Maps, and Siri, emphasizing privacy and default service use over third-party AI like OpenAI. **Apple Photos** now includes advanced video understanding with timestamp recognition. Meanwhile, **Reflection-70B** claims to be a top open-source model but benchmarks show it performs close to **Llama 3 70B** and slightly worse than **Qwen 2 72B**. **Yann LeCun** highlighted ongoing challenges with LLM planning abilities, noting models like **Llama-3.1-405b** and **Claude** show some skill, while **GPT-4** and **Gemini** lag behind. **Weights & Biases** is sponsoring an event to advance LLM evaluation techniques with prizes and API access.

Reflection 70B, by Matt from IT Department

Sat, 07 Sep 2024 01:17:07 GMT

**Reflection Tuning** technique has been used by a two-person team from **Hyperwrite** and **Glaive** to finetune **llama-3.1-70b**, showing strong performance improvements with minimal synthetic data. The approach builds on the concept of adding `thinking` and `reflection` steps to outputs, related to the **Chain of Thought** method. Despite some criticisms like contamination concerns, worse coding performance, and reliance on system prompts, the model has received positive reception and comparisons to **claude-3.5-sonnet**. The work highlights efficient instruction tuning and synthetic data generation for large models.

Replit Agent - How did everybody beat Devin to market?

Fri, 06 Sep 2024 01:54:59 GMT

**Replit Agent** launched as a fully integrated Web IDE enabling text-to-app generation with planning and self-healing, available immediately to paid users without a waitlist. Other notable developments include **Melodio**, a new text-to-music model, and **Together AI**'s kernel and speculative decoding work. **Anthropic AI** announced a new enterprise plan featuring a **500K context window** and enhanced security. Discussions on **JPEG-LM** and **AVC-LM** models for improved image and video generation, and GPU market trends around the **H100 GPU** pricing were highlighted. Influential voices like **Andrej Karpathy** shared insights on AI agents and automation.

$1150m for SSI, Sakana, You.com + Claude 500m context

Thu, 05 Sep 2024 03:25:36 GMT

**Safe Superintelligence** raised **$1 billion** at a **$5 billion** valuation, focusing on safety and search approaches as hinted by Ilya Sutskever. **Sakana AI** secured a **$100 million Series A** funding round, emphasizing nature-inspired collective intelligence. **You.com** pivoted to a ChatGPT-like productivity agent after a **$50 million Series B** round, while **Perplexity AI** raised over **$250 million** this summer. **Anthropic** launched Claude for Enterprise with a **500 million token context window**. **AI2** released a **64-expert Mixture-of-Experts (MoE) model** called OLMo, outperforming Llama2-13B-Chat. Key AI research trends include efficient MoE architectures, challenges in AI alignment and GPU costs, and emerging AI agents for autonomous tasks. Innovations in AI development feature command and control for video generation, Retrieval-Augmented Generation (RAG) efficiency, and GitHub integration under Anthropic's Enterprise plan. *"Our logo is meant to invoke the idea of a school of fish coming together and forming a coherent entity from simple rules as we want to make use of ideas from nature such as evolution and collective intelligence in our research."*

Everybody shipped small things this holiday weekend

Wed, 04 Sep 2024 01:35:37 GMT

**xAI** announced the **Colossus 100k H100 cluster** capable of training an FP8 GPT-4 class model in 4 days. **Google** introduced **Structured Output** for **Gemini**. **Anthropic** discussed **Claude**'s performance issues possibly due to API prompt modifications. **OpenAI** enhanced controls for File Search in their Assistants API. **Cognition** and **Anthropic** leaders appeared on podcasts. The viral **Kwai-Kolors** virtual try-on model and the open-source real-time audio conversational model **Mini-Omni** (similar to **gpt-4o-voice**) were released. Tutorials on parameter-efficient fine-tuning with LoRA and QLoRA, long-context embedding challenges, and Claude's LaTeX rendering feature were highlighted. **AI21 Labs** released **Jamba 1.5** models with a 256K context window and faster long-context performance. **NVIDIA** debuted **Mistral-Nemo-Minitron-8B** on the Open LLM Leaderboard. **LangChain** introduced resource tags for workspace organization, and a low-code AI app toolkit was shared by **svpino**. Legal AI agents and financial agent evaluations using LangSmith were also featured.

not much happened today

Sat, 31 Aug 2024 00:41:42 GMT

**Meta** announced significant adoption of **LLaMA 3.1** with nearly **350 million downloads** on Hugging Face. **Magic AI Labs** introduced **LTM-2-Mini**, a long context model with a **100 million token context window**, and a new evaluation method called HashHop. **LMSys** added style control to their Chatbot Arena leaderboard, improving rankings for models like **Claude 3.5 Sonnet** and **LLaMA 3.1 405B**. **Alibaba** released **Qwen2-VL**, a multimodal LLM under Apache 2.0 license, competitive with **GPT-4o mini**. **OpenAI** CEO **Sam Altman** announced collaboration with the US AI Safety Institute for pre-release model testing. Discussions on AI safety and potential AI takeover risks were highlighted by **Ajeya Cotra**. Tools like **firecrawl** for web crawling and challenges in PDF processing were noted. AI hype cycles and market trends were discussed by **François Chollet**, and potential AI disruption in call centers was shared by **Rohan Paul**.

Summer of Code AI: $1.6b raised, 1 usable product

Fri, 30 Aug 2024 00:01:06 GMT

**Code + AI** is emphasized as a key modality in AI engineering, highlighting productivity and verifiability benefits. Recent major funding rounds include **Cognition AI raising $175M**, **Poolside raising $400M**, **Codeium AI raising $150M**, and **Magic raising $320M**. Magic announced their **LTM-2** model with a **100 million token context window**, boasting efficiency improvements over **Llama 3.1 405B** by about **1000x cheaper** in sequence-dimension algorithm and drastically lower memory requirements. Magic's stack is built from scratch with custom CUDA and no open-source foundations, partnered with **Google Cloud** and powered by **NVIDIA H100** and **GB200 GPUs**, aiming to scale to tens of thousands of GPUs. Google DeepMind revealed updates to **Gemini Advanced** with customizable expert "Gems." Neural Game Engines like **GameNGen** can run DOOM in a diffusion model trained on **0.9B frames**. The content also references **LLM quantization** research by Rohan Paul.

Cerebras Inference: Faster, Better, AND Cheaper

Thu, 29 Aug 2024 00:59:27 GMT

**Groq** led early 2024 with superfast LLM inference speeds, achieving ~450 tokens/sec for Mixtral 8x7B and 240 tokens/sec for Llama 2 70B. **Cursor** introduced a specialized code edit model hitting 1000 tokens/sec. Now, **Cerebras** claims the fastest inference with their wafer-scale chips, running **Llama3.1-8b** at 1800 tokens/sec and **Llama3.1-70B** at 450 tokens/sec at full precision, with competitive pricing and a generous free tier. **Google's Gemini 1.5** models showed significant benchmark improvements, especially Gemini-1.5-Flash and Gemini-1.5-Pro. New open-source models like **CogVideoX-5B** and **Mamba-2 (Rene 1.3B)** were released, optimized for consumer hardware. **Anthropic's Claude** now supports prompt caching, improving speed and cost efficiency. *"Cerebras Inference runs Llama3.1 20x faster than GPU solutions at 1/5 the price."*

CogVideoX: Zhipu's Open Source Sora

Wed, 28 Aug 2024 01:26:46 GMT

**Zhipu AI**, Alibaba's AI arm and China's 3rd largest AI lab, released the open 5B video generation model **CogVIdeoX**, which can run without GPUs via their ChatGLM web and desktop apps. **Meta AI** announced trust & safety research and CyberSecEval 3 alongside the release of **Llama 3.1**, with **Llama 3 405B** now available serverless on Google Cloud Vertex AI and Hugging Face x NVIDIA NIM API. Updates include **Moondream**, an open vision-language model improving DocVQA and TextVQA tasks, and the lightweight MoE chat model **Phi-3.5** with 16x3.8B parameters. **Together Compute** introduced the Rerank API featuring Salesforce's **LlamaRank** model for document and code ranking. Research highlights include superposition prompting for RAG without fine-tuning, the AgentWrite pipeline for long-form content generation over 20,000 words, and a comparison showing Long Context methods outperform RAG at higher costs. Tools include Not Diamond, an AI model router, AI command line interfaces, and an open-source WebGPU background removal tool. *"You don't even need GPUs to run it,"* referring to CogVIdeoX.

not much happened this weekend

Tue, 27 Aug 2024 00:09:52 GMT

**Nous Research** announced **DisTrO**, a new optimizer that drastically reduces inter-GPU communication by 1000x to 10,000x enabling efficient training on slow networks, offering an alternative to **GDM's DiLoCo**. **Cursor AI** gained viral attention from an 8-year-old user and announced a new fundraise, with co-host Aman returning to their podcast. **George Hotz** launched **tinybox** for sale. In robotics, **AGIBOT** revealed 5 new humanoid robots with open-source plans, and **Unitree** showcased its G1 humanoid robot nearing mass production at $16,000. **ETH Zurich** and **Disney** developed an AI system for physics-based robot motion generation from text or images. **UC San Diego** released **ACE**, an open-source teleoperation system for controlling multiple robots. AI21 Labs unveiled **Jamba 1.5**, a multilingual model with 256k context length and permissive licensing. **Luma Labs** released **Dream Machine 1.5** for improved text-to-video generation. **Ideogram** launched **v2** of its text-to-image model with near-perfect text generation. **Nvidia** and **Mistral** released **Mistral-NeMo-Minitron 8B**, a small model outperforming **Mistral-7B** and **llama-3-8b** on the Open LLM leaderboard.

Nvidia Minitron: LLM Pruning and Distillation updated for Llama 3.1

Fri, 23 Aug 2024 22:14:15 GMT

**Nvidia** and **Meta** researchers updated their **Llama 3** results with a paper demonstrating the effectiveness of combining **weight pruning** and **knowledge distillation** to reduce training costs by training only the largest model from scratch and deriving smaller models via pruning and distillation. The process involves teacher correction, activation-based pruning (favoring width pruning), and retraining with distillation using KL Divergence loss, resulting in better-performing models at comparable sizes. However, distillation incurs some accuracy tradeoffs. Additionally, **AI21 Labs** launched **Jamba 1.5**, a hybrid SSM-Transformer MoE model with large context windows and multilingual support. **Anthropic** updated **Claude 3** with LaTeX rendering and prompt caching. An open-source coding-focused LLM, **Dracarys**, was released in 70B and 72B sizes, showing improved coding performance. The **Mistral Nemo Minitron 8B** model outperforms **Llama 3.1 8B** and **Mistral 7B** on the Hugging Face leaderboard, highlighting pruning and distillation benefits. Research on prompt optimization reveals the complexity of prompt search spaces and the surprising effectiveness of simple algorithms like AutoPrompt/GCG.

super quiet day

Fri, 23 Aug 2024 00:55:37 GMT

**AI21 Labs** released **Jamba 1.5**, a scaled-up State Space Model optimized for long context windows with **94B parameters** and up to **2.5X faster inference**, outperforming models like **Llama 3.1 70B** on benchmarks. The **Phi-3.5** model was praised for its safety and performance, while **Dracarys**, a new **70B open-source coding model** announced by **Bindu Reddy**, claims superior benchmarks over Llama 3.1 70B. Discussions on **California's SB 1047** AI safety legislation involve **Stanford** and **Anthropic**, highlighting a balance between precaution and industry growth. Innovations include **uv virtual environments** for rapid setup, **LangChain's LangSmith** resource tags for project management, and multi-agent systems in **Qdrant** enhancing data workflows. Community events like the **RAG workshop** by **AWS**, **LangChain**, and **Elastic** continue to support AI learning and collaboration. Memes remain a popular way to engage with AI industry culture.

Ideogram 2 + Berkeley Function Calling Leaderboard V2

Thu, 22 Aug 2024 00:05:05 GMT

**Ideogram** returns with a new image generation model featuring **color palette control**, a fully controllable API, and an iOS app, reaching a milestone of **1 billion images created**. Meanwhile, **Midjourney** released a Web UI but still lacks an API. In function calling, the **Berkeley Function Calling Leaderboard (BFCL)** updated to **BFCL V2 • Live**, adding **2251 live, user-contributed function documentation and queries** to improve evaluation quality. **GPT-4** leads the leaderboard, but the open-source **Functionary Llama 3-70B finetune** from Kai surpasses **Claude**. On AI model releases, **Microsoft** launched three **Phi-3.5** models with impressive reasoning and context window capabilities, while **Meta AI FAIR** introduced **UniBench**, a unified benchmark suite for over **50 vision-language model tasks**. **Baseten** improved **Llama 3** inference speed by up to **122%** using Medusa. A new cybersecurity benchmark, **Cyberbench**, featuring **40 CTF tasks**, was released. Additionally, **Codegen** was introduced as a tool for programmatic codebase analysis and AI-assisted development. *"Multiple functions > parallel functions"* was highlighted as a key insight in function calling.

not much happened today

Wed, 21 Aug 2024 00:22:36 GMT

**OpenAI** launched **GPT-4o finetuning** with a case study on Cosine. **Anthropic** released **Claude 3.5 Sonnet** with 8k token output. **Microsoft Phi** team introduced **Phi-3.5** in three variants: Mini (3.8B), MoE (16x3.8B), and Vision (4.2B), noted for sample efficiency. **Meta** released **Llama 3.1 405B**, deployable on Google Cloud Vertex AI, offering GPT-4 level capabilities. **Qwen2-Math-72B** achieved state-of-the-art math benchmark performance with a Gradio demo. Discussions included model comparisons like ViT vs CNN and Mamba architecture. Tools updates featured **DSPy** roadmap, **Flux Schnell** improving diffusion speed on M1 Max, and **LangChain** community events. Research highlights zero-shot DUP prompting for math reasoning and fine-tuning best practices. AI ethics covered California's AI Safety Bill SB 1047 and regulatory concerns from **Yann LeCun**. Commentary on AI engineer roles by **Swyx**. *"Chat with PDF"* feature now available for Box Enterprise Plus users.

The DSPy Roadmap

Tue, 20 Aug 2024 05:06:22 GMT

**Omar Khattab** announced joining **Databricks** before his MIT professorship and outlined the roadmap for **DSPy 2.5 and 3.0+**, focusing on improving core components like LMs, signatures, optimizers, and assertions with features such as adopting **LiteLLM** to reduce code and enhance caching and streaming. The roadmap also includes developing more accurate, cost-effective optimizers, building tutorials, and enabling interactive optimization tracking. On AI Twitter, **Google** launched **Gemini Live**, a mobile conversational AI with voice and 10 voices, alongside **Pixel Buds Pro 2** with a custom Tensor A1 chip. **OpenAI** updated **ChatGPT-4o**, reclaiming the top spot on LMSYS Arena. **xAI** released **Grok-2** in beta, achieving SOTA in image generation with FLUX 1. **Nous Research** released open-source **Hermes 3** models in 8B, 70B, and 405B sizes, with the 405B model achieving SOTA. Robotics updates include **Astribot**'s humanoid robot and **Apple**'s tabletop robot with Siri voice commands. **Sakana AI** introduced "The AI Scientist," an autonomous AI research system.

not much happened today

Sat, 17 Aug 2024 03:43:03 GMT

**Anthropic** rolled out **prompt caching** in its API, reducing input costs by up to **90%** and latency by **80%**, enabling instant fine-tuning with longer prompts. **xAI** released **Grok-2**, a new model competing with frontier models from **Google DeepMind**, **OpenAI**, **Anthropic**, **Mistral AI**, and **Meta AI Fair**, supporting vision and text inputs and integrating external image generation models. **Claude 3.5 Sonnet** is reported to outperform **GPT-4** in coding and reasoning, while **ChatGPT-4o-latest** shows reasoning improvements. **François Chollet** proposed a theory defining intelligence as the efficiency of operationalizing past information for future tasks. The **Aya project** involves 3000 collaborators building multilingual AI datasets. **Demis Hassabis** discussed AI hype and safe AI development in a podcast. Tools like **Dora AI** for Figma and **Box's AI API** enhance design automation and document processing. **Salesforce** released **DEI**, an open AI software engineering agents framework with a 55% resolve rate on SWE-Bench Lite. Industry trends highlight rapid AI integration, networking importance in the AI job market, and potential OpenAI GPT-4 expansion in response to competitors. Memes include humor about Apple Vision Pro.

not much happened today

Fri, 16 Aug 2024 04:05:53 GMT

**GPT-5** delayed again amid a quiet news day. **Nous Research** released Hermes 3 finetune of **Llama 3** base models, rivaling FAIR's instruct tunes but sparking debate over emergent existential crisis behavior with 6% roleplay data. **Nvidia** introduced Minitron finetune of **Llama 3.1**. **Salesforce** launched a DEI agent scoring 55% on SWE-Bench Lite. **Goodfire AI** secured $7M seed funding for mechanistic interpretability work. **Anthropic** rolled out prompt caching in their API, cutting input costs by up to 90% and latency by 80%, aiding coding assistants and large document processing. **xAI** released **Grok-2**, matching **Claude 3.5 Sonnet** and **GPT-4 Turbo** on LMSYS leaderboard with vision+text inputs and image generation integration. **Claude 3.5 Sonnet** reportedly outperforms **GPT-4** in coding and reasoning. **François Chollet** defined intelligence as efficient operationalization of past info for future tasks. **Salesforce's** DEI framework surpasses individual agent performance. **Google DeepMind's** Demis Hassabis discussed AGI's role in scientific discovery and safe AI development. **Dora AI** plugin generates landing pages in under 60 seconds, boosting web team efficiency. **Box AI API** beta enables document chat, data extraction, and content summarization. **LangChain** updated Python & JavaScript integration docs.

Grok 2! and ChatGPT-4o-latest confuses everybody

Thu, 15 Aug 2024 00:51:40 GMT

**OpenAI** quietly released a new **GPT-4o** model in ChatGPT, distinct from the API version, reclaiming the #1 spot on Lmsys arena benchmarks across multiple categories including math, coding, and instruction-following. Meanwhile, **X.ai** launched **Grok 2**, outperforming **Claude 3.5 Sonnet** and previous GPT-4o versions, with plans for enterprise API release. Grok 2 integrates **Black Forest Labs' Flux.1**, an open-source text-to-image model surpassing **Stable Diffusion 3**. **Google DeepMind** announced **Gemini Advanced** with enhanced conversational features and Pixel device integration. AI researcher **ylecun** highlighted LLM limitations in learning and creativity, while **rohanpaul_ai** discussed an AI Scientist system generating publishable ML research at low cost. **karpathy** warned of security risks in LLM tokenizers akin to SQL injection.

Gemini Live

Wed, 14 Aug 2024 01:23:26 GMT

**Google** launched **Gemini Live** on Android for **Gemini Advanced** subscribers during the Pixel 9 event, featuring integrations with Google Workspace apps and other Google services. The rollout began on 8/12/2024, with iOS support planned. **Anthropic** released **Genie**, an AI software engineering system achieving a **57%** improvement on SWE-Bench. **TII** introduced **Falcon Mamba**, a 7B attention-free open-access model scalable to long sequences. Benchmarking showed that longer context lengths do not always improve Retrieval-Augmented Generation. **Supabase** launched an AI-powered Postgres service dubbed the "ChatGPT of databases," fully open source. **Perplexity AI** partnered with Polymarket to integrate real-time probability predictions into search results. A tutorial demonstrated a multimodal recipe recommender using **Qdrant**, **LlamaIndex**, and **Gemini**. An OpenAI engineer shared success tips emphasizing debugging and hard work. The connection between matrices and graphs in linear algebra was highlighted for insights into nonnegative matrices and strongly connected components. **Keras 3.5.0** was released with Hugging Face Hub integration for model saving and loading.

a quiet weekend

Mon, 12 Aug 2024 22:36:30 GMT

**Figure** unveiled **Figure 02**, claimed as the most advanced humanoid robot, operating autonomously at BMW's Plant Spartanburg. **DeepMind** developed a table tennis robot achieving **100% wins against beginners** and **55% against intermediates**. **Boston Dynamics** showcased the dexterity of its fully-electric **Atlas** robot performing pushups and burpees. An autonomous dental robot performed the world's first dental procedure on a human, reducing a 2-hour process to 15 minutes using a **3D volumetric scanner**. **SAM 2** was introduced as an open model for real-time object segmentation without custom adaptation. **Alibaba** released **Qwen2-Math**, outperforming **GPT-4** and **Claude 3.5** in math capabilities. A new Listening-While-Speaking Language Model (LSLM) enables simultaneous listening and speaking in real-time. Researchers developed a disease prediction AI with **95% accuracy** for diseases like coronary artery disease, type 2 diabetes, and breast cancer. Tools like **LlamaParse CLI** and **MLX Whisper package** enhance PDF parsing and speech recognition, with the latter running **40X faster than realtime** on M1 Max. The news highlights significant advancements in robotics, AI models, and practical AI tools.

not much happened today

Sat, 10 Aug 2024 05:51:12 GMT

**Qwen2-Math-72B** outperforms **GPT-4o**, **Claude-3.5-Sonnet**, **Gemini-1.5-Pro**, and **Llama-3.1-405B** on math benchmarks using synthetic data and advanced optimization techniques. **Google AI** cuts pricing for **Gemini 1.5 Flash** by up to 78%. **Anthropic** expands its bug bounty program targeting universal jailbreaks in next-gen safety systems. Tutorial on **QLoRA** fine-tuning of **IDEFICS3-Llama 8B** for visual question answering released. A Chinese open weights model surpasses previous MATH benchmark records. Surveys on **Mamba** models and LLM-based agents for software engineering highlight advancements and applications. Open-source tools like **R2R RAG engine** and **LlamaIndex Workflows** simplify building complex AI applications. **Mistral AI** introduces customizable AI agents. Concerns raised about California bill SB 1047's focus on existential risk and debates on banning open-source AI. Memes and humor continue in AI communities.

Too Cheap To Meter: AI prices cut 50-70% in last 30 days

Fri, 09 Aug 2024 04:27:56 GMT

**Gemini 1.5 Flash** has cut prices by approximately **70%**, offering a highly competitive free tier of **1 million tokens per minute** at **$0.075/mtok**, intensifying the AI model price war. Other significant price reductions include **GPT-4o** (~50% cut to **$2.50/mtok**), **GPT-4o mini** (70-98.5% cut to **$0.15/mtok**), **Llama 3.1 405b** (46% cut to **$2.7/mtok**), and **Mistral Large 2** (62% cut to **$3/mtok**). **Deepseek v2** introduced context caching, reducing input token costs by up to **90%** to **$0.014/mtok**. New model releases include **Llama 3.1 405b**, **Sonnet 3.5**, **EXAONE-3.0** (7.8B instruction-tuned by LG AI Research), and **MiniCPM V 2.6** (vision-language model combining SigLIP 400M and Qwen2-7B). Benchmarks show **Mistral Large** performing well on ZebraLogic and **Claude-3.5** leading LiveBench. **FlexAttention**, a new PyTorch API, simplifies and optimizes attention mechanisms. **Andrej Karpathy** analyzed RLHF, highlighting its limitations compared to traditional reinforcement learning. Google DeepMind research on compute-optimal scaling was also summarized.

not much happened today

Thu, 08 Aug 2024 01:50:11 GMT

**OpenAI** introduced structured outputs in their API with a new "strict" mode and a "response_format" parameter, supporting models like **gpt-4-0613**, **gpt-3.5-turbo-0613**, and the new **gpt-4o-2024-08-06**. They also halved the price of **gpt-4o** to $2.50 per million tokens. **Mistral Large 2** outperforms **gpt4-turbo** and **claude-3-opus** on hard benchmarks and coding tasks. **Idefics3-Llama** offers multimodal capabilities with a 10k token context window. **BigLlama-3.1-1T-Instruct** is an upscaled version of **llama-3-120b-instruct**. New benchmark "big_model_smell" measures creativity and reliability. **Figure 02** robot features advanced AI hardware with onboard vision language model, enhanced battery, and speech-to-speech reasoning. **Yann LeCun** expressed concerns about California's SB1047 regulation.

GPT4o August + 100% Structured Outputs for All (GPT4o mini edition)

Wed, 07 Aug 2024 02:55:03 GMT

**Stability.ai** users are leveraging **LoRA** and **ControlNet** for enhanced line art and artistic style transformations, while facing challenges with **AMD GPUs** due to the discontinuation of **ZLUDA**. Community tensions persist around the **r/stablediffusion** subreddit moderation. **Unsloth AI** users report fine-tuning difficulties with **LLaMA3** models, especially with PPO trainer integration and prompt formatting, alongside anticipation for **multi-GPU** support and cost-effective cloud computing on **RunPod**. **Google** released the lightweight **Gemma 2 2B** model optimized for on-device use with **2.6B** parameters, featuring safety and sparse autoencoder tools, and announced **Diffusers** integration for efficient text-to-image generation on limited resources.

GPT4o August + 100% Structured Outputs for All (GPT4o August edition)

Wed, 07 Aug 2024 02:40:09 GMT

**OpenAI** released the new **gpt-4o-2024-08-06** model with **16k context window** and **33-50% lower pricing** than the previous 4o-May version, featuring a new Structured Output API that improves output quality and reduces retry costs. **Meta AI** launched **Llama 3.1**, a **405-billion parameter** model surpassing **GPT-4** and **Claude 3.5 Sonnet** on benchmarks, alongside expanding the **Llama Impact Grant** program. **Google DeepMind** quietly released **Gemini 1.5 Pro**, outperforming **GPT-4o**, **Claude-3.5**, and **Llama 3.1** on LMSYS benchmarks and leading the Vision Leaderboard. **Yi-Large Turbo** was introduced as a cost-effective upgrade priced at $0.19 per million tokens. In hardware, **NVIDIA H100 GPUs** were highlighted by **John Carmack** for their massive AI workload power, and **Groq** announced plans to deploy **108,000 LPUs** by Q1 2025. New AI tools and techniques include **RAG (Retrieval-Augmented Generation)**, the **JamAI Base** platform for Mixture of Agents systems, and **LangSmith**'s enhanced filtering capabilities. Google DeepMind also introduced **PEER (Parameter Efficient Expert Retrieval)** architecture.

How Carlini Uses AI

Mon, 05 Aug 2024 23:43:14 GMT

**Groq's** shareholders' net worth rises while others fall, with **Intel's CEO** expressing concern. **Nicholas Carlini** of **DeepMind** gains recognition and criticism for his extensive AI writings, including an 80,000-word treatise on AI use and a benchmark for large language models. **Chris Dixon** comments on AI Winter skepticism, emphasizing long-term impact. **Box** introduces an AI API for extracting structured data from documents, highlighting potential and risks of LLM-driven solutions. Recent AI developments include **Figure AI** launching the advanced humanoid robot Figure 02, **OpenAI** rolling out Advanced Voice Mode for ChatGPT with emotion detection, **Google** open-sourcing **Gemma 2 2B** model matching GPT-3.5-Turbo-0613 performance, **Meta AI Fair** releasing Segment Anything Model 2 (SAM 2) for real-time object tracking, **NVIDIA** showcasing Project GR00T for humanoid teleoperation with Apple Vision Pro, **Stability AI** launching Stable Fast 3D for rapid 3D asset generation, and **Runway** unveiling Gen-3 Alpha for AI text-to-video generation.

Execuhires: Tempting The Wrath of Khan

Sat, 03 Aug 2024 01:48:48 GMT

**Character.ai's $2.5b execuhire to Google** marks a significant leadership move alongside **Adept's $429m execuhire to Amazon** and **Inflection's $650m execuhire to Microsoft**. Despite strong user growth and content momentum, Character.ai's CEO Noam Shazeer returns to Google, signaling shifting vibes in the AI industry. **Google DeepMind's Gemini 1.5 Pro** tops Chatbot Arena benchmarks, outperforming **GPT-4o** and **Claude-3.5**, excelling in multilingual, math, and coding tasks. The launch of **Black Forest Labs' FLUX.1** text-to-image model and **LangGraph Studio** agent IDE highlight ongoing innovation. **Llama 3.1 405B** is released as the largest open-source model, fostering developer use and competition with closed models. The industry is focusing increasingly on post-training and data as key competitive factors, raising questions about acquisition practices and regulatory scrutiny.

Rombach et al: FLUX.1 [pro|dev|schnell], $31m seed for Black Forest Labs

Fri, 02 Aug 2024 01:05:39 GMT

**Stability AI** co-founder Rombach launched **FLUX.1**, a new text-to-image model with three variants: pro (API only), dev (open-weight, non-commercial), and schnell (Apache 2.0). FLUX.1 outperforms **Midjourney** and **Ideogram** based on Black Forest Labs' ELO score and plans to expand into text-to-video. **Google DeepMind** released **Gemma-2 2B**, a 2 billion parameter open-source model that outperforms larger models like **GPT-3.5-Turbo-0613** and **Mixtral-8x7b** on Chatbot Arena, optimized with NVIDIA TensorRT-LLM. The release includes safety classifiers (ShieldGemma) and sparse autoencoder analysis (Gemma Scope). Discussions highlight benchmarking discrepancies and US government support for open-weight AI models. Critiques of AI coding tools' productivity gains were also noted.

Gemma 2 2B + Scope + Shield

Thu, 01 Aug 2024 01:33:32 GMT

**Gemma 2B**, a 2 billion parameter model trained on **2 trillion tokens** and distilled from a larger unnamed LLM, has been released by **Google DeepMind** and shows strong leaderboard performance despite weaknesses in math. The Gemma series, including 9B and 27B models, has gained popularity since its June release. The team also released 400 SAEs for interpretability, inspired by **Anthropic**'s research. A finetuned classifier called ShieldGemma outperforms Meta's LlamaGuard in harm detection. Meanwhile, **Meta AI** announced **Llama-3.1-405B** reaching #3 on the Overall Arena leaderboard, and released **SAM 2**, a video and image segmentation model with significant speed improvements. **OpenAI** is rolling out an advanced Voice Mode to Plus users. **Perplexity AI** launched a Publishers Program with major media partners and a status page. **NVIDIA** introduced Project GR00T for scaling robot data using Apple Vision Pro and generative simulation. Interest in quantization for compressing LLMs is growing, and LLM-as-a-Judge implementations from Vicuna, AlpacaEval, and G-Eval highlight the effectiveness of simple prompts and domain-specific evaluation.

not much happened today

Wed, 31 Jul 2024 07:04:15 GMT

**Meta** released **SAM 2**, a unified model for real-time object segmentation with a new dataset 4.5x larger and 53x more annotated than previous ones. **FastHTML**, a new Python web framework by **Jeremy Howard**, enables easy creation and deployment of interactive web apps. **Scale AI** launched the SEAL Leaderboard on adversarial robustness, topped by **Gemini 1.5 Pro** from **Google DeepMind**. **Apple** published a technical report on their Intelligence Foundation Language Models for on-device and server use. **Yann LeCun** emphasized the importance of open source AI in an article co-authored with Martin Casado and Ion Stoica. **Maarten Grootendorst**'s "Visual Guide to Quantization" on efficient LLM inference went viral. **ChatGPT** started rolling out advanced voice and vision-enabled modes to select users. **Leonardo AI** was acquired by **Canva**. **Jim Fan** shared insights on Project Groot augmenting human demonstration data for robotics. **Midjourney v6.1** was released.

Apple Intelligence Beta + Segment Anything Model 2

Tue, 30 Jul 2024 02:45:55 GMT

**Meta** advanced its open source AI with a sequel to the **Segment Anything Model**, enhancing image segmentation with memory attention for video applications using minimal data and compute. **Apple Intelligence** delayed its official release to iOS 18.1 in October but launched developer previews on **MacOS Sequoia**, **iOS 18**, and **iPadOS 18**, accompanied by a detailed 47-page paper revealing extensive pretraining on **6.3T tokens** and use of **Cloud TPUs** rather than Apple Silicon. The paper highlights improvements in instruction following, reasoning, and writing through post-training and synthetic data. Benchmarks show Apple’s model scores lower than **Llama 3**, but with trusted human evaluations. Additionally, **Meta** released **Llama 3.1** with a 405B parameter model, marking a significant open-source frontier model release.

AlphaProof + AlphaGeometry2 reach 1 point short of IMO Gold

Fri, 26 Jul 2024 01:15:56 GMT

**Search+Verifier** highlights advances in neurosymbolic AI during the 2024 Math Olympics. **Google DeepMind**'s combination of **AlphaProof** and **AlphaGeometry 2** solved four out of six IMO problems, with AlphaProof being a finetuned **Gemini** model using an AlphaZero approach, and AlphaGeometry 2 trained on significantly more synthetic data with a novel knowledge-sharing mechanism. Despite impressive results, human judges noted the AI required much longer time than human competitors. Meanwhile, **Meta AI** released **Llama 3.1** with a 405B parameter model and smaller variants, and **Mistral AI** launched **Mistral Large 2** with 123B parameters and 128k context windows, outperforming Llama 3.1 on coding tasks and multilingual benchmarks. This marks significant progress in AI mathematical reasoning, model scaling, and multilingual capabilities.

Mistral Large 2 + RIP Mistral 7B, 8x7B, 8x22B

Wed, 24 Jul 2024 23:44:31 GMT

**Mistral Large 2** introduces **123B parameters** with **Open Weights** under a Research License, focusing on **code generation**, **math performance**, and a massive **128k context window**, improving over Mistral Large 1's 32k context. It claims better **function calling** capabilities than **GPT-4o** and enhanced reasoning. Meanwhile, **Meta** officially released **Llama-3.1** models including **Llama-3.1-70B** and **Llama-3.1-8B** with detailed pre-training and post-training insights. The **Llama-3.1 8B** model's 128k context performance was found underwhelming compared to **Mistral Nemo** and **Yi 34B 200K**. Mistral is deprecating older Apache open-source models, focusing on Large 2 and **Mistral Nemo 12B**. The news also highlights community discussions and benchmarking comparisons.

Llama 3.1: The Synthetic Data Model

Wed, 24 Jul 2024 00:13:31 GMT

**Meta AI** has released **Llama 3.1**, including a **405B parameter model** that triggers regulatory considerations like the **EU AI Act** and **SB 1047**. The model incorporates extensive **synthetic data** techniques for **code**, **math**, **multilinguality**, **long context**, and **tool use** fine-tuning, with **RLHF** using synthetic preference data from **Llama 2**. The launch was coordinated across major inference providers, with **Groq** demonstrating **750 tokens per second** inference speed and **Fireworks** leading in pricing. The updated license explicitly allows synthetic data generation, marking a significant step in open frontier-class LLMs and cost-efficiency improvements since March.

Llama 3.1 Leaks: big bumps to 8B, minor bumps to 70b, and SOTA OSS 405b model

Tue, 23 Jul 2024 01:12:50 GMT

**Llama 3.1** leaks reveal a **405B dense model** with **128k context length**, trained on **39.3M GPU hours** using H100-80GB GPUs, and fine-tuned with **over 25M synthetic examples**. The model shows significant benchmark improvements, especially for the 8B and 70B variants, with some evals suggesting the 70B outperforms **GPT-4o**. **GPT-4o Mini** launched as a cost-efficient variant with strong performance but some reasoning weaknesses. Synthetic datasets like **NuminaMath** enable models such as **Alibaba Qwen 2** to surpass GPT-4o and Claude 3.5 in math competitions. Discussions include reasoning task benchmarks and dataset building for improved reasoning.

DataComp-LM: the best open-data 7B model/benchmark/dataset

Sat, 20 Jul 2024 02:08:36 GMT

**DataComp team** released a competitive **7B open data language model** trained on only **2.5T tokens** from the massive **DCLM-POOL dataset** of **240 trillion tokens**, showing superior scaling trends compared to FineWeb. **OpenAI** launched **GPT-4o mini**, a cost-effective model with **82% MMLU** and performance near GPT-4-Turbo, aimed at developers for broad applications. **NVIDIA and Mistral** jointly released the **Mistral NeMo 12B** model featuring a **128k token context window**, FP8 checkpoint, multilingual support, and Apache 2.0 licensing. **DeepSeek** announced **DeepSeek-V2-0628** as the top open-source model on the LMSYS Chatbot Arena leaderboard with strong rankings in coding, math, and hard prompts. This news highlights advances in dataset design, model efficiency, and open-source contributions in the AI community.

Mini, Nemo, Turbo, Lite - Smol models go brrr (GPT4o-mini version)

Fri, 19 Jul 2024 00:13:31 GMT

**OpenAI** launched the **GPT-4o Mini**, a cost-efficient small model priced at **$0.15 per million input tokens** and **$0.60 per million output tokens**, aiming to replace **GPT-3.5 Turbo** with enhanced intelligence but some performance limitations. **DeepSeek** open-sourced **DeepSeek-V2-0628**, topping the LMSYS Chatbot Arena Leaderboard and emphasizing their commitment to contributing to the AI ecosystem. **Mistral AI** and **NVIDIA** released the **Mistral NeMo**, a **12B parameter** multilingual model with a record **128k token context window** under an **Apache 2.0 license**, sparking debates on benchmarking accuracy against models like **Meta Llama 8B**. Research breakthroughs include the **TextGrad** framework for optimizing compound AI systems via textual feedback differentiation and the **STORM** system improving article writing by **25%** through simulating diverse perspectives and addressing source bias. Developer tooling trends highlight **LangChain**'s evolving context-aware reasoning applications and the **Modular** ecosystem's new official GPU support, including discussions on **Mojo** and **Keras 3.0** integration.

Mini, Nemo, Turbo, Lite - Smol models go brrr (GPT4o version)

Fri, 19 Jul 2024 00:00:39 GMT

**GPT-4o-mini** launches with a **99% price reduction** compared to text-davinci-003, offering **3.5% the price of GPT-4o** and matching Opus-level benchmarks. It supports **16k output tokens**, is faster than previous models, and will soon support **text, image, video, and audio inputs and outputs**. **Mistral Nemo**, a **12B parameter model** developed with **Nvidia**, features a **128k token context window**, FP8 checkpoint, and strong benchmark performance. **Together Lite and Turbo** offer fp8/int4 quantizations of **Llama 3** with up to **4x throughput** and significantly reduced costs. **DeepSeek V2** is now open-sourced. Upcoming releases include at least **5 unreleased models** and **Llama 4** leaks ahead of ICML 2024.

Gemma 2 tops /r/LocalLlama vibe check

Wed, 17 Jul 2024 22:57:14 GMT

**Gemma 2 (9B, 27B)** is highlighted as a top-performing local LLM, praised for its speed, multilingual capabilities, and efficiency on consumer GPUs like the 2080ti. It outperforms models like **Llama 3** and **Mistral 7B** in various tasks, including non-English text processing and reasoning. The community discussion on /r/LocalLlama reflects strong preference for Gemma 2, with **18 mentions**, compared to **10 mentions** for Llama 3 and **9 mentions** for Mistral. Other models like **Phi 3** and **Qwen** also received mentions but are considered surpassed by Gemma 2. Additionally, **Andrej Karpathy** announced the launch of **Eureka Labs**, an AI+Education startup aiming to create an AI-native school with AI Teaching Assistants, starting with the **LLM101n** course to teach AI training fundamentals. This initiative is seen as a significant development in AI education.

SciCode: HumanEval gets a STEM PhD upgrade

Wed, 17 Jul 2024 02:04:35 GMT

**PhD-level benchmarks** highlight the difficulty of coding scientific problems for LLMs, with **GPT-4** and **Claude 3.5 Sonnet** scoring under 5% on the new **SciCode** benchmark. **Anthropic** doubled the max output token limit for Claude 3.5 Sonnet to 8192 tokens. The **Q-GaLore** method enables training **LLaMA-7B** on a single 16GB GPU. The **Mosaic compiler** now generates efficient code for NVIDIA H100 GPUs. The **Dolphin 2.9.3-Yi-1.5-34B-32k-GGUF** model on Hugging Face has over 111k downloads. **Llama 3** shows strong performance, achieving 90% zero-shot accuracy on the MATH dataset. Discussions continue on the limitations and forms of synthetic data for model training.

Microsoft AgentInstruct + Orca 3

Tue, 16 Jul 2024 00:42:03 GMT

**Microsoft Research** released **AgentInstruct**, the third paper in its **Orca** series, introducing a generative teaching pipeline that produces **25.8 million** synthetic instructions to fine-tune **mistral-7b**, achieving significant performance gains: +40% AGIEval, +19% MMLU, +54% GSM8K, +38% BBH, +45% AlpacaEval, and a 31.34% reduction in hallucinations. This synthetic data approach follows the success of **FineWeb** and **Apple's Rephrasing research** in improving dataset quality. Additionally, **Tencent** claims to have generated **1 billion** diverse personas for synthetic data. On AI Twitter, notable discussions included a shooting incident at a Trump rally and recent ML research highlights such as **FlashAttention-3**, **RankRAG**, and **Mixture of A Million Experts**.

We Solved Hallucinations

Sat, 13 Jul 2024 02:52:26 GMT

**Reddit's URL structure causes link errors in AI-generated summaries, especially with NSFW content affecting models like Claude and GPT-4.** The team fixed this glitch while still leveraging LLMs for summarizing Reddit content. **GPT-2 training costs have dramatically dropped to ~$672 using H100 GPUs and software improvements like CUDA and FlashAttention.** **FlashAttention-3 was released, achieving up to 740 TFLOPS on H100 GPUs, with FP8 nearing 1.2 PFLOPS, developed collaboratively by Meta, NVIDIA, Princeton, and Colfax.** Hopper GPUs enable major speedups with new hardware features. **Synthetic data may not improve vision tasks, as shown in recent research.** The **Avocado360 benchmark evaluates vision-language models' ability to detect avocados in images.** **Lynx, a hallucination detection model for LLMs, was introduced for real-world healthcare and fintech applications, trained by Patronus AI on Databricks Mosaic AI using Composer.**

FlashAttention 3, PaliGemma, OpenAI's 5 Levels to Superintelligence

Fri, 12 Jul 2024 09:31:43 GMT

**FlashAttention-3** introduces fast and accurate attention optimized for **H100 GPUs**, advancing native **FP8 training**. **PaliGemma**, a versatile **3B Vision-Language Model (VLM)** combining a SigLIP-So400m ViT encoder with the **Gemma-2B** language model, emphasizes a prefix-LM architecture for improved image-query interaction. **OpenAI** reveals a framework on levels of superintelligence, signaling progress toward Level 2 and highlighting internal safety disagreements. On Reddit, **NuminaMath 7B**, fine-tuned from **DeepSeekMath-7B**, wins the AI Math Olympiad by solving 29 problems using iterative supervised fine-tuning and tool-integrated reasoning. Open-source LLMs like **CodeLlama-34b** and **WizardCoder-Python-34B-V1.0** are closing the coding performance gap with closed models such as **ChatGPT-3.5**.

Nothing much happened today

Thu, 11 Jul 2024 01:15:43 GMT

**HuggingFace** released a browser-based timestamped Whisper using transformers.js. A Twitter bot by **truth_terminal** became the first "semiautonomous" bot to secure VC funding. **Microsoft** and **Apple** abruptly left the **OpenAI** board amid regulatory scrutiny. **Meta** is finalizing a major upgrade to Reddit comments addressing hallucination issues. The **Yi model** gained popularity on GitHub with 7.4K stars and 454 forks, with potential integration with **Axolotl** for pregeneration and preprocessing. **AMD** technologies enable household/small business AI appliances. **Meta** released **Chameleon-7b** and **Chameleon-30b** models on HuggingFace supporting unified text and image tokenization. **Salesforce**'s **xLAM-1b** model outperforms **GPT-3.5** in function calling despite its smaller size. **Anole** pioneered open-source multimodal text-image-video generation up to 720p 144fps. **Phi-3 Mini** expanded from 3.8B to 4.7B parameters with function calling, competing with **Mistral-7b v3**. *"System 2 distillation"* in humans relates to automaticity and procedural memory.

Test-Time Training, MobileLLM, Lilian Weng on Hallucination (Plus: Turbopuffer)

Wed, 10 Jul 2024 05:57:13 GMT

**Lilian Weng** released a comprehensive literature review on **hallucination detection** and **anti-hallucination methods** including techniques like FactualityPrompt, SelfCheckGPT, and WebGPT. **Facebook AI Research (FAIR)** published **MobileLLM**, a sub-billion parameter on-device language model architecture achieving performance comparable to **llama-2-7b** with innovations like thin and deep models and shared weights. A new **RNN-based LLM architecture** with expressive hidden states was introduced, replacing attention mechanisms and scaling better than Mamba and Transformer models for long-context modeling. Additionally, **Tsinghua University** open sourced **CodeGeeX4-ALL-9B**, a multilingual code generation model excelling in code assistance.

Problems with MMLU-Pro

Tue, 09 Jul 2024 00:20:51 GMT

**MMLU-Pro** is gaining attention as the successor to MMLU on the **Open LLM Leaderboard V2** by **HuggingFace**, despite community concerns about evaluation discrepancies and prompt sensitivity affecting model performance, notably a **10-point improvement** in **Llama-3-8b-q8** with simple prompt tweaks. **Meta's MobileLLM** research explores running sub-billion parameter LLMs on smartphones using shared weights and deeper architectures. **Salesforce's APIGen** introduces an automated dataset generation system for function-calling tasks outperforming larger models. **Runway Gen-3 Alpha** launches an AI video generator for paid users creating realistic 10-second clips. **Nomic AI's GPT4All 3.0** offers an open-source desktop app supporting thousands of local models. AI assistants with multimodal capabilities and affordable access to multiple LLMs like ChatGPT, Claude, Llama, and Gemini are emerging. **Meta 3D Gen** advances text-to-3D asset generation, while Argil AI enables deepfake video creation from text threads. Research on transformer grokking and reasoning highlights advances in robust reasoning capabilities.

Qdrant's BM42: "Please don't trust us"

Sat, 06 Jul 2024 02:25:00 GMT

**Qdrant** attempted to replace BM25 and SPLADE with a new method called "BM42" combining transformer attention and collection-wide statistics for semantic and keyword search, but their evaluation using the Quora dataset was flawed. **Nils Reimers** from **Cohere** reran BM42 on better datasets and found it underperformed. Qdrant acknowledged the errors but still ran a suboptimal BM25 implementation. This highlights the importance of dataset choice and evaluation sanity checks in search model claims. Additionally, **Stripe** faced criticism for AI/ML model failures causing account and payment issues, prompting calls for alternatives. **Anthropic** revealed that **Claude 3.5 Sonnet** suppresses some answer parts with backend tags, sparking debate. **Gemma 2** model optimizations allow 2x faster fine-tuning with 63% less memory and longer context windows, running up to 34B parameters on consumer GPUs. **nanoLLaVA-1.5** was announced as a compact 1B parameter vision model with significant improvements.

Not much happened today.

Wed, 03 Jul 2024 22:39:42 GMT

**Meta** introduced **Meta 3D Gen**, a system for end-to-end generation of 3D assets from text in under 1 minute, producing high-quality 3D assets with detailed textures. **Perplexity AI** updated Pro Search to handle deeper research with multi-step reasoning and code execution. **Microsoft** improved **Phi-3 Mini** with better long-context understanding and instruction following. **GPT4All 3.0** launched with support for thousands of models and major OS compatibility, featuring local file chat. **Yi-Large** model launched on Fireworks AI Playground. Research highlights include the evolution of **reinforcement learning from human feedback (RLHF)**, persona-driven data synthesis using a billion diverse personas, meta-tuning for few-shot generalization, and steering vectors for model behavior control. Tools updates include **LangSmith** improving memory retrieval and **Qdrant Engine v1.10** adding universal query API and multivector search.

GraphRAG: The Marriage of Knowledge Graphs and RAG

Wed, 03 Jul 2024 01:30:30 GMT

**Microsoft Research** open sourced **GraphRAG**, a retrieval augmented generation (RAG) technique that extracts knowledge graphs from sources and clusters them for improved LLM answers, though it increases token usage and inference time. **Gemma 2** models were released focusing on efficient small LLMs with innovations like sliding window attention and RMS norm, nearly matching the larger **Llama 3 70B**. **Anthropic's Claude 3.5 Sonnet** leads in instruction following and coding benchmarks, while **Nvidia's Nemotron 340B** model was released in June. **Qwen2-72B** tops the HuggingFace Open LLM leaderboard excelling in math and long-range reasoning. Discussions on RAG highlighted its limitations and improvements in context usage via function calls. A persona-driven synthetic data generation approach introduced 1 billion personas, with a fine-tuned model matching GPT-4 performance on math benchmarks at 7B scale. The **200GB AutoMathText dataset** was also noted for math data synthesis.

RouteLLM: RIP Martian? (Plus: AINews Structured Summaries update)

Tue, 02 Jul 2024 00:23:08 GMT

**LMSys** introduces RouteLLM, an open-source router framework trained on **preference data** from Chatbot Arena, achieving **cost reductions over 85% on MT Bench, 45% on MMLU, and 35% on GSM8K** while maintaining **95% of GPT-4's performance**. This approach surpasses previous task-specific routing by using syntax-based Mixture of Experts (MoE) routing and data augmentation, beating commercial solutions by 40%. The update highlights advances in **LLM routing**, **cost-efficiency**, and **model performance optimization** across multiple models rather than single-model or MoE-level improvements. Additionally, the AI Twitter recap notes the **Gemma 2 model family** as a top open model, the **Block Transformer architecture** for improved inference throughput, and a proposal for a fully Software 2.0 computer vision system by **karpathy**.

That GPT-4o Demo

Sat, 29 Jun 2024 00:48:47 GMT

**Romain Huet** demonstrated an unreleased version of **GPT-4o** on ChatGPT Desktop showcasing capabilities like low latency voice generation, whisper tone moderation, camera mode streaming video to GPT-4o, rapid OCR, screen sharing with ChatGPT for programming help, clipboard reading, and vision-based code conversation. OpenAI's four investment areas highlighted include textual intelligence, efficiency/cost, model customization, and multimodal agents. **Google DeepMind** released **Gemma 2** models in 9B and 27B sizes trained on 8T and 13T tokens respectively, using SFT, distillation, RLHF, and model merging, optimized for TPUv5e with strong performance and safety measures. **Meta AI** announced the Meta LLM Compiler built on Meta Code Llama with enhanced code optimization and compiler features.

Gemma 2: The Open Model for Everyone

Fri, 28 Jun 2024 06:21:39 GMT

**Gemma 2**, a **27B** parameter model from **google-deepmind**, was released with innovations like 1:1 local-global attention alternation and logit soft-capping, leveraging **knowledge distillation** to train smaller models on over 50× the compute-optimal token quantity. The model supports multilingual and multimodal capabilities, with fine-tuning success on over 200 Indic language variants. The **Open LLM Leaderboard** highlights **alibaba's Qwen 72B** as the top model, with **mistral-ai's Mixtral-8x22B-Instruct** also ranking highly. **Anthropic** launched **Claude 3.5 Sonnet**, improving intelligence at mid-tier cost and speed. Research on eliminating matrix multiplication in LLMs promises significant memory savings without performance loss. *Kathleen Kenealy* and *Daniel Han* provided insights on Gemma 2's tokenizer and attention scaling respectively.

Mozilla's AI Second Act

Thu, 27 Jun 2024 01:37:35 GMT

**Mozilla** showcased detailed live demos of **llamafile** and announced **sqlite-vec** for vector search integration at the AIE World's Fair. **LlamaIndex** launched **llama-agents**. **Anthropic** introduced new UI features and **Projects** for **Claude** with a 200K context window. **Etched AI** revealed a specialized inference chip claiming **500k tokens/sec**, though benchmark claims are questioned. **Sohu** chip enables **15 agent trajectories/sec**. **Tim Dettmers** shared theoretical GPU inference limits of ~300k tokens/sec for 8xB200 NVLink on 70B Llama. **Deepseek Coder v2** outperforms **Gemini** and GPT-4 variants in coding and reasoning. The **PyTorch documentary** launched to little attention.

Shall I compare thee to a Sonnet's day?

Wed, 26 Jun 2024 00:39:44 GMT

**Claude 3.5 Sonnet** from **Anthropic** achieves top rankings in coding and hard prompt arenas, surpassing **GPT-4o** and competing with **Gemini 1.5 Pro** at lower cost. **Glif** demonstrates a fully automated **Wojak meme generator** using Claude 3.5 for JSON generation and ComfyUI for images, showcasing new JSON extractor capabilities. **Artifacts** enables rapid creation of niche apps, exemplified by a dual monitor visualizer made in under 5 minutes. **François Chollet** highlights that fusion energy is not a near-term solution compared to existing nuclear fission plants. **Mustafa Suleyman** notes that 75% of desk workers now use AI, marking a shift toward AI-assisted productivity.

Gemini Nano: 50-90% of Gemini Pro, <100ms inference, on device, in Chrome Canary

Tue, 25 Jun 2024 07:02:13 GMT

The latest **Chrome Canary** now includes a feature flag for **Gemini Nano**, offering a prompt API and on-device optimization guide, with models Nano 1 and 2 at **1.8B** and **3.25B** parameters respectively, showing decent performance relative to Gemini Pro. The base and instruct-tuned model weights have been extracted and posted to **HuggingFace**. In AI model releases, **Anthropic** launched **Claude 3.5 Sonnet**, which outperforms **GPT-4o** on some benchmarks, is twice as fast as Opus, and is free to try. **DeepSeek-Coder-V2** achieves **90.2%** on HumanEval and **75.7%** on MATH, surpassing GPT-4-Turbo-0409, with models up to **236B** parameters and **128K** context length. **GLM-0520** from **Zhipu AI/Tsinghua** ranks highly in coding and overall benchmarks. **NVIDIA** announced **Nemotron-4 340B**, an open model family for synthetic data generation. Research highlights include **TextGrad**, a framework for automatic differentiation on textual feedback; **PlanRAG**, an iterative plan-then-RAG decision-making technique; a paper on **goldfish loss** to mitigate memorization in LLMs; and a tree search algorithm for language model agents.

Shazeer et al (2024): you are overpaying for inference >13x

Sat, 22 Jun 2024 00:48:48 GMT

**Noam Shazeer** explains how **Character.ai** serves **20% of Google Search Traffic** for LLM inference while reducing serving costs by a factor of **33** compared to late 2022, with leading commercial APIs costing at least **13.5X more**. Key memory-efficiency techniques include **MQA > GQA** reducing KV cache size by 8X, hybrid attention horizons, cross-layer KV-sharing, stateful caching with a 95% cache rate, and native int8 precision with custom kernels. **Anthropic** released **Claude 3.5 Sonnet**, which outperforms **Claude 3 Opus** at twice the speed and one-fifth the cost, passing **64%** of internal pull request tests and introducing new features like Artifacts for real-time doc and code generation. Discussions on LLM architecture highlight the dominance of transformers, challenges in scaling and overfitting, and the importance of architecture work for progress.

Claude Crushes Code - 92% HumanEval and Claude.ai Artifacts

Fri, 21 Jun 2024 07:27:45 GMT

**Claude 3.5 Sonnet**, released by **Anthropic**, is positioned as a Pareto improvement over Claude 3 Opus, operating at **twice the speed** and costing **one-fifth** as much. It achieves state-of-the-art results on benchmarks like **GPQA, MMLU, and HumanEval**, surpassing even **GPT-4o** and Claude 3 Opus on vision tasks. The model demonstrates significant advances in coding capabilities, passing **64% of test cases** compared to 38% for Claude 3 Opus, and is capable of autonomously fixing pull requests. Anthropic also introduced the **Artifacts** feature, enabling users to interact with AI-generated content such as code snippets and documents in a dynamic workspace, similar to OpenAI's Code Interpreter. This release highlights improvements in performance, cost-efficiency, and coding proficiency, signaling a growing role for LLMs in software development.

There's Ilya!

Thu, 20 Jun 2024 00:18:00 GMT

**Ilya Sutskever** has co-founded **Safe Superintelligence Inc** shortly after leaving **OpenAI**, while **Jan Leike** moved to **Anthropic**. **Meta** released new models including **Chameleon 7B** and **34B** with mixed-modal input and unified token space quantization. **DeepSeek-Coder-V2** shows code capabilities comparable to **GPT-4 Turbo**, supporting **338 programming languages** and **128K context length**. **Consistency Large Language Models (CLLMs)** enable parallel decoding generating multiple tokens per step. **Grokked Transformers** demonstrate reasoning through training dynamics affecting memory formation and generalization. **VoCo-LLaMA** compresses vision tokens with LLMs improving video temporal correlation understanding. The **BigCodeBench** benchmark evaluates LLMs on **1,140 coding tasks** across **139 Python libraries**, topped by DeepSeek-Coder-V2 and Claude 3 Opus. **PixelProse** is a large **16M image-caption dataset** with reduced toxicity.

Gemini launches context caching... or does it?

Tue, 18 Jun 2024 21:26:50 GMT

**Nvidia's Nemotron** ranks #1 open model on LMsys and #11 overall, surpassing **Llama-3-70b**. **Meta AI** released **Chameleon 7B/34B** models after further post-training. **Google's Gemini** introduced context caching, offering a cost-efficient middle ground between RAG and finetuning, with a minimum input token count of 33k and no upper limit on cache duration. **DeepSeek** launched **DeepSeek-Coder-V2**, a 236B parameter model outperforming **GPT-4 Turbo**, **Claude-3-Opus**, and **Gemini-1.5-Pro** in coding tasks, supporting 338 programming languages and extending context length to 128K. It was trained on 6 trillion tokens using the **Group Relative Policy Optimization (GRPO)** algorithm and is available on Hugging Face with a commercial license. These developments highlight advances in model performance, context caching, and large-scale coding models.

Is this... OpenQ*?

Tue, 18 Jun 2024 00:38:33 GMT

**DeepSeekCoder V2** promises GPT4T-beating performance at a fraction of the cost. **Anthropic** released new research on reward tampering. **Runway** launched their Sora response and Gen-3 Alpha video generation model. A series of papers explore "test-time" search techniques improving mathematical reasoning with models like **LLaMa-3 8B**. **Apple** announced Apple Intelligence with smarter Siri and image/document understanding, partnered with **OpenAI** to integrate ChatGPT into iOS 18, and released 20 new CoreML models with LoRA fine-tuning for specialization. **NVIDIA** released **Nemotron-4 340B**, an open model matching GPT-4 performance. **DeepSeek-Coder-V2** excels in coding and math with 338 programming languages and 128K context length. **Stability AI** released Stable Diffusion 3 Medium weights. **Luma Labs** launched Dream Machine for 5-second video generation from text and images.

Nemotron-4-340B: NVIDIA's new large open models, built on syndata, great for syndata

Fri, 14 Jun 2024 21:06:38 GMT

**NVIDIA** has scaled up its **Nemotron-4** model from **15B** to a massive **340B** dense model, trained on **9T tokens**, achieving performance comparable to **GPT-4**. The model alignment process uses over **98% synthetic data**, with only about **20K human-annotated samples** for fine-tuning and reward model training. The synthetic data generation pipeline is open-sourced, including synthetic prompts and preference data generation. The base and instruct versions outperform **Mixtral** and **Llama 3**, while the reward model ranks better than **Gemini 1.5**, **Cohere**, and **GPT-4o**. Other notable models include **Mamba-2-Hybrid 8B**, which is up to **8x faster** than Transformers and excels on long-context tasks, **Samba-3.8B-instruct** for infinite context length with linear complexity, **Dolphin-2.9.3** tiny models optimized for low-resource devices, and **Faro Yi 9B DPO** with a **200K context window** running efficiently on **16GB VRAM**. The Mixture-of-Agents technique boosts open-source LLMs beyond GPT-4 Omni on AlpacaEval 2.0.

Hybrid SSM/Transformers > Pure SSMs/Pure Transformers

Thu, 13 Jun 2024 20:52:25 GMT

**NVIDIA**'s Bryan Catanzaro highlights a new paper on **Mamba models**, showing that mixing Mamba and Transformer blocks outperforms either alone, with optimal attention below **20%**. **Mixture-of-Agents (MoA)** architecture improves LLM generation quality, scoring **65.1% on AlpacaEval 2.0** versus **GPT-4 Omni's 57.5%**. The **LiveBench AI benchmark** evaluates reasoning, coding, writing, and data analysis. A hybrid **Mamba-2-Hybrid** model with **7% attention** surpasses a Transformer on MMLU accuracy, jumping from **50% to 53.6%**. **GPT-4** performs better at temperature=1. **Qwen 72B** leads open-source models on LiveBench AI. **LaminiAI Memory Tuning** achieves **95% accuracy** on a SQL agent task, improving over instruction fine-tuning. **Sakana AI Lab** uses evolutionary strategies for preference optimization. **Luma Labs Dream Machine** demonstrates advanced text-to-video generation. The **MMWorld benchmark** evaluates multimodal video understanding, and **Table-LLaVa 7B** competes with GPT-4V on multimodal table tasks.

The Last Hurrah of Stable Diffusion?

Wed, 12 Jun 2024 22:08:29 GMT

**Stability AI** launched **Stable Diffusion 3 Medium** with models ranging from **450M to 8B parameters**, featuring the MMDiT architecture and T5 text encoder for image text rendering. The community has shown mixed reactions following the departure of key researchers like Emad Mostaque. On AI models, **Llama 3 8B Instruct** shows strong evaluation correlation with **GPT-4**, while **Qwen 2 Instruct** surpasses Llama 3 on MMLU benchmarks. The **Mixture of Agents (MoA)** framework outperforms GPT-4o on AlpacaEval 2.0. Techniques like **Spectrum** and **QLoRA** enable efficient fine-tuning with less VRAM. Research on **grokking** reveals transformers can transition from memorization to generalization through extended training. Benchmark initiatives include the **$1M ARC Prize Challenge** for AGI progress and **LiveBench**, a live LLM benchmark to prevent dataset contamination. The **Character Codex Dataset** offers open data on over **15,000 characters** for RAG and synthetic data. The **MLX 0.2** tool enhances LLM experience on Apple Silicon Macs with improved UI and faster retrieval-augmented generation.

Francois Chollet launches $1m ARC Prize

Tue, 11 Jun 2024 23:42:03 GMT

**François Chollet** critiques current paths to **AGI**, emphasizing the importance of benchmarks that resist saturation and focus on skill acquisition and open-ended problem solving. The **ARC-AGI** puzzles exemplify "easy for humans, hard for AI" challenges to measure progress toward AGI. Meanwhile, **Apple** announces integration of **ChatGPT** into iOS, iPadOS, and macOS through a partnership with **OpenAI**, enabling AI-powered features like document summarization and photo analysis with privacy-preserving measures. Discussions highlight Apple's focus on deep AI integration and on-device models optimized with techniques like mixed-precision quantization, though some skepticism remains about their AI capabilities compared to **GPT-4**. Additionally, **Together Compute** introduces a Mixture of Agents approach achieving strong performance on **AlpacaEval 2.0**.

Talaria: Apple's new MLOps Superweapon

Tue, 11 Jun 2024 06:41:05 GMT

**Apple Intelligence** introduces a small (~3B parameters) on-device model and a larger server model running on Apple Silicon with Private Cloud Compute, aiming to surpass **Google Gemma**, **Mistral Mixtral**, **Microsoft Phi**, and **Mosaic DBRX**. The on-device model features a novel lossless quantization strategy using mixed 2-bit and 4-bit LoRA adapters averaging 3.5 bits-per-weight, enabling dynamic adapter hot-swapping and efficient memory management. Apple credits the **Talaria** tool for optimizing quantization and model latency, achieving about 0.6 ms time-to-first-token latency and 30 tokens per second generation rate on iPhone 15 Pro. Apple focuses on an "adapter for everything" strategy with initial deployment on SiriKit and App Intents. Performance benchmarks rely on human graders, emphasizing consumer-level adequacy over academic dominance. The Apple ML blog also mentions an Xcode code-focused model and a diffusion model for Genmoji.

HippoRAG: First, do know(ledge) Graph

Fri, 07 Jun 2024 23:55:52 GMT

**Alibaba** released new open-source **Qwen2** models ranging from **0.5B to 72B parameters**, achieving SOTA results on benchmarks like MMLU and HumanEval. Researchers introduced **Sparse Autoencoders** to interpret **GPT-4** neural activity, improving feature representation. The **HippoRAG** paper proposes a hippocampus-inspired retrieval augmentation method using knowledge graphs and Personalized PageRank for efficient multi-hop reasoning. New techniques like **Stepwise Internalization** enable implicit chain-of-thought reasoning in LLMs, enhancing accuracy and speed. The **Buffer of Thoughts (BoT)** method improves reasoning efficiency with significant cost reduction. A novel scalable MatMul-free LLM architecture competitive with SOTA Transformers at billion-parameter scale was also presented. *"Single-Step, Multi-Hop retrieval"* is highlighted as a key advancement in retrieval speed and cost.

Qwen 2 beats Llama 3 (and we don't know how)

Thu, 06 Jun 2024 22:33:41 GMT

**Alibaba** released **Qwen 2** models under Apache 2.0 license, claiming to outperform **Llama 3** in open models with multilingual support in **29 languages** and strong benchmark scores like **MMLU 82.3** and **HumanEval 86.0**. **Groq** demonstrated ultra-fast inference speed on **Llama-3 70B** at **40,792 tokens/s** and running 4 Wikipedia articles in 200ms. Research on **sparse autoencoders (SAEs)** for interpreting **GPT-4** neural activity showed new training methods, metrics, and scaling laws. **Meta AI** announced the **No Language Left Behind (NLLB)** model capable of high-quality translations between **200 languages**, including low-resource ones. *"Our post-training phase is designed with the principle of scalable training with minimal human annotation,"* highlighting techniques like rejection sampling for math and execution feedback for coding.

5 small news items

Thu, 06 Jun 2024 02:50:37 GMT

**OpenAI** announces that ChatGPT's voice mode is "coming soon." **Leopold Aschenbrenner** launched a 5-part AGI timelines series predicting a **trillion dollar cluster** from current AI progress. **Will Brown** released a comprehensive GenAI Handbook. **Cohere** completed a **$450 million funding round** at a **$5 billion valuation**. DeepMind research on **uncertainty quantification in LLMs** and an **xLSTM model** outperforming transformers were highlighted. Studies on the **geometry of concepts in LLMs** and methods to **eliminate matrix multiplication** for efficiency gains were shared. Discussions on **parameter-efficient fine-tuning (PEFT)** and **automated alignment of LLMs** were noted. New tools include **LangGraph** for AI agents, **LlamaIndex** with longer context windows, and **Hugging Face's** integration with **NVIDIA NIM** for Llama3. **Mistral AI** released a fine-tuning API for their models.

Not much happened today

Tue, 04 Jun 2024 23:53:47 GMT

**Twelve Labs** raised **$50m** in Series A funding co-led by NEA and **NVIDIA's NVentures** to advance multimodal AI. **Livekit** secured **$22m** in funding. **Groq** announced running at **800k tokens/second**. OpenAI saw a resignation from Daniel Kokotajlo. Twitter users highlighted **Gemini 1.5 FlashModel** for high performance at low cost and **Gemini Pro** ranking #2 in Japanese language tasks. **Mixtral** models can run up to 8x faster on NVIDIA RTX GPUs using TensorRT-LLM. **Mamba-2** model architecture introduces state space duality for larger states and faster training, outperforming previous models. **Phi-3 Medium (14B)** and **Small (7B)** models benchmark near GPT-3.5-Turbo-0613 and Llama 3 8B. Prompt engineering is emphasized for unlocking LLM capabilities. Data quality is critical for model performance, with upcoming masterclasses on data curation. Discussions on AI safety include a Frontier AI lab employee letter advocating whistleblower protections and debates on aligning AI to user intent versus broader humanity interests.

Mamba-2: State Space Duality

Mon, 03 Jun 2024 21:31:26 GMT

**Mamba-2**, a new **state space model (SSM)**, outperforms previous models like Mamba and Transformer++ in **perplexity** and **wall-clock time**, featuring **8x larger states** and **50% faster training**. It introduces the concept of **state space duality (SSD)** connecting SSMs and linear attention. The **FineWeb-Edu dataset**, a high-quality subset of the **15 trillion token FineWeb dataset**, filtered using **llama-3-70b** for educational quality, enables better and faster LLM learning, potentially reducing tokens needed to surpass **GPT-3** performance. Additionally, perplexity-based data pruning using a **125M parameter model** improves downstream performance and reduces pretraining steps by up to **1.45x**. The **Video-MME benchmark** evaluates multi-modal LLMs on video analysis across multiple visual domains and video lengths.

Ways to use Anthropic's Tool Use GA

Fri, 31 May 2024 20:31:29 GMT

**Anthropic** launched general availability of tool use/function calling with support for streaming, forced use, and vision, alongside **Amazon** and **Google**. Alex Albert shared five architectures for agentic tool use: delegation, parallelization, debate, specialization, and tool suite experts. **Anthropic** also introduced a self-guided course on tool use. **Yann LeCun** emphasized ethical open science funding, gradual emergence of superintelligence with safety guardrails, and convolutional networks for image/video processing as competitive with vision transformers. He also noted growth in AI researchers across industry, academia, and government.

Contextual Position Encoding (CoPE)

Fri, 31 May 2024 03:11:48 GMT

**Meta AI** researcher **Jason Weston** introduced **CoPE**, a novel positional encoding method for transformers that incorporates *context* to create learnable gates, enabling improved handling of counting and copying tasks and better performance on language modeling and coding. The approach can potentially be extended with external memory for gate calculation. **Google DeepMind** released **Gemini 1.5 Flash** and **Pro** models optimized for fast inference. **Anthropic** announced general availability of tool use for **Claude**, enhancing its ability to orchestrate tools for complex tasks. **Alexandr Wang** launched **SEAL Leaderboards** for private, expert evaluations of frontier models. **Karpathy** reflected on the 4th anniversary of **GPT-3**, emphasizing scaling and practical improvements. **Perplexity AI** launched **Perplexity Pages** to convert research into visually appealing articles, described as an "AI Wikipedia" by **Arav Srinivas**.

1 TRILLION token context, real time, on device?

Wed, 29 May 2024 23:01:07 GMT

**Cartesia**, a startup specializing in **state space models (SSMs)**, launched a low latency voice model outperforming transformer-based models with **20% lower perplexity**, **2x lower word error**, and **1 point higher NISQA quality**. This breakthrough highlights the potential for models that can continuously process and reason over massive streams of multimodal data (text, audio, video) with a **trillion token context window** on-device. The news also covers recent AI developments including **Mistral's Codestral weights release**, **Schedule Free optimizers** paper release, and **Scale AI's** new elo-style eval leaderboards. Additionally, a debate between **yann-lecun** and **elon-musk** on the importance of publishing AI research versus engineering achievements was noted. The **Gemini 1.5 Pro/Advanced** models were mentioned for their strong performance.

Somebody give Andrej some H100s already

Wed, 29 May 2024 01:24:27 GMT

**OpenAI**'s GPT-2 sparked controversy five years ago for being "too dangerous to release." Now, with **FineWeb** and **llm.c**, a tiny GPT-2 model can be trained in **90 minutes** for **$20** using **8xA100** GPUs, with the full 1.6B model estimated to take **1 week** and **$2.5k**. The project is notable for its heavy use of **CUDA** (75.8%) aiming to simplify the training stack. Meanwhile, a Twitter debate between **Yann LeCun** and **Elon Musk** highlighted the importance of **convolutional neural networks (CNNs)** in real-time image processing for autonomous driving, with LeCun emphasizing scientific research's role in technological progress. LeCun also criticized AI doomsday scenarios, arguing for cautious optimism about AI safety and regulation.

Life after DPO (RewardBench)

Tue, 28 May 2024 00:04:01 GMT

**xAI raised $6 billion at a $24 billion valuation**, positioning it among the most highly valued AI startups, with expectations to fund **GPT-5 and GPT-6 class models**. The **RewardBench** tool, developed by Nathan Lambert, evaluates reward models (RMs) for language models, showing Cohere's RMs outperforming open-source alternatives. The discussion highlights the evolution of language models from Claude Shannon's 1948 model to GPT-3 and beyond, emphasizing the role of **RLHF (Reinforcement Learning from Human Feedback)** and the newer **DPO (Direct Preference Optimization)** method. Notably, some **Llama 3 8B reward model-focused models** are currently outperforming GPT-4, Cohere, Gemini, and Claude on the RewardBench leaderboard, raising questions about reward hacking. Future alignment research directions include improving preference datasets, DPO techniques, and personalization in language models. The report also compares xAI's valuation with OpenAI, Mistral AI, and Anthropic, noting speculation about xAI's spending on Nvidia hardware.

Ten Commandments for Deploying Fine-Tuned Models

Fri, 24 May 2024 22:12:57 GMT

**Gemini-in-Google-Slides** is highlighted as a useful tool for summarizing presentations. Kyle Corbitt's talk on deploying fine-tuned models in production emphasizes avoiding fine-tuning unless necessary, focusing on prompting, data quality, appropriate model choice, and thorough evaluation. **Anthropic** showcased feature alteration in **Claude AI**, demonstrating control over model behavior and increased understanding of large language models. Open-source models like **GPT-4o** are approaching closed-source performance on benchmarks like MMLU for simple tasks, though advanced models remain necessary for complex automation.

Clémentine Fourrier on LLM evals

Thu, 23 May 2024 23:34:22 GMT

**Clémentine Fourrier** from **Huggingface** presented at **ICLR** about **GAIA** with **Meta** and shared insights on **LLM evaluation** methods. The blog outlines three main evaluation approaches: **Automated Benchmarking** using sample inputs/outputs and metrics, **Human Judges** involving grading and ranking with methods like **Vibe-checks**, **Arena**, and **systematic annotations**, and **Models as Judges** using generalist or specialist models with noted biases. Challenges include data contamination, subjectivity, and bias in scoring. These evaluations help prevent regressions, rank models, and track progress in the field.

ALL of AI Engineering in One Place

Thu, 23 May 2024 01:22:53 GMT

The upcoming **AI Engineer World's Fair** in San Francisco from **June 25-27** will feature a significantly expanded format with booths, talks, and workshops from **top model labs** like **OpenAI, DeepMind, Anthropic, Mistral, Cohere, HuggingFace**, and **Character.ai**. It includes participation from **Microsoft Azure, Amazon AWS, Google Vertex**, and major companies such as **Nvidia, Salesforce, Mastercard, Palo Alto Networks**, and more. The event covers **9 tracks** including **RAG, multimodality, evals/ops, open models, code generation, GPUs, agents, AI in Fortune 500**, and a new **AI leadership** track. Additionally, **Anthropic** shared interpretability research on **Claude 3 Sonnet**, revealing millions of interpretable features that can be steered to modify model behavior, including safety-relevant features related to bias and unsafe content, though more research is needed for practical applications. The event offers a discount code for AI News readers.

Anthropic's "LLM Genome Project": learning & clamping 34m features on Claude Sonnet

Tue, 21 May 2024 22:47:46 GMT

**Anthropic** released their third paper in the MechInterp series, **Scaling Monosemanticity**, scaling interpretability analysis to **34 million features** on **Claude 3 Sonnet**. This work introduces the concept of **dictionary learning** to isolate recurring neuron activation patterns, enabling more interpretable internal states by combining features rather than neurons. The paper reveals abstract features related to code, errors, sycophancy, crime, self-representation, and deception, demonstrating intentional modifiability by clamping feature values. The research marks a significant advance in **model interpretability** and **neural network analysis** at frontier scale.

Skyfall

Mon, 20 May 2024 23:02:42 GMT

Between 5/17 and 5/20/2024, key AI updates include **Google DeepMind's Gemini 1.5 Pro and Flash models**, featuring sparse multimodal MoE architecture with up to **10M context** and a dense Transformer decoder that is **3x faster and 10x cheaper**. **Yi AI released Yi-1.5 models** with extended context windows of **32K and 16K tokens**. Other notable releases include **Kosmos 2.5 (Microsoft), PaliGemma (Google), Falcon 2, DeepSeek v2 lite, and HunyuanDiT diffusion model**. Research highlights feature an **Observational Scaling Laws paper** predicting model performance across families, a **Layer-Condensed KV Cache** technique boosting inference throughput by **up to 26×**, and the **SUPRA method** converting LLMs into RNNs for reduced compute costs. Hugging Face expanded local AI capabilities enabling on-device AI without cloud dependency. LangChain updated its v0.2 release with improved documentation. The community also welcomed a new LLM Finetuning Discord by Hamel Husain and Dan Becker for Maven course users. *"Hugging Face is profitable, or close to profitable,"* enabling $10 million in free shared GPUs for developers.

Chameleon: Meta's (unreleased) GPT4o-like Omnimodal Model

Fri, 17 May 2024 20:46:44 GMT

**Meta AI FAIR** introduced **Chameleon**, a new multimodal model family with **7B** and **34B** parameter versions trained on **10T tokens** of interleaved text and image data enabling "early fusion" multimodality that can natively output any modality. While reasoning benchmarks are modest, its "omnimodality" approach competes well with pre-GPT4o multimodal models. **OpenAI** launched **GPT-4o**, a model excelling in benchmarks like MMLU and coding tasks, with strong multimodal capabilities but some regression in ELO scores and hallucination issues. **Google DeepMind** announced **Gemini 1.5 Flash**, a small model with **1M context window** and flash performance, highlighting convergence trends between OpenAI and Google models. **Anthropic** updated **Claude 3** with streaming support, forced tool use, and vision tool integration for multimodal knowledge extraction. OpenAI also partnered with Reddit, raising industry attention.

Cursor reaches >1000 tok/s finetuning Llama3-70b for fast file editing

Fri, 17 May 2024 00:50:41 GMT

**Cursor**, an AI-native IDE, announced a **speculative edits** algorithm for code editing that surpasses **GPT-4** and **GPT-4o** in accuracy and latency, achieving speeds of over **1000 tokens/s** on a **70b** model. **OpenAI** released **GPT-4o** with multimodal capabilities including audio, vision, and text, noted to be **2x faster and 50% cheaper** than GPT-4 turbo, though with mixed coding performance. **Anthropic** introduced streaming, forced tool use, and vision features for developers. **Google DeepMind** unveiled **Imagen Video** and **Gemini 1.5 Flash**, a small model with a **1M-context** window. **HuggingFace** is distributing **$10M** in free GPUs for open-source AI models like **Llama**, **BLOOM**, and **Stable Diffusion**. Evaluation insights highlight challenges with LLMs on novel problems and benchmark saturation, with new benchmarks like **MMLU-Pro** showing significant drops in top model performance.

Not much happened today

Wed, 15 May 2024 21:20:08 GMT

**Ilya Sutskever** steps down as Chief Scientist at **OpenAI** after nearly a decade, with **Jakub Pachocki** named as his successor. **Google DeepMind** announces **Gemini 1.5 Pro** and **Gemini 1.5 Flash** models featuring 2 million token context and improved multimodal capabilities, alongside demos of **Project Astra** AI assistant, **Imagen 3** text-to-image model, and **Veo** generative video model. **GPT-4o** tops the VHELM leaderboard and outperforms competitors on LMSYS Chatbot Arena. **Reka Core** multimodal model with 128K context and **Alibaba's Qwen1.5-110B** open-source model are released. **Salesforce** shares an online RLHF recipe.

Google I/O in 60 seconds

Tue, 14 May 2024 22:01:01 GMT

**Google** announced updates to the **Gemini model family**, including **Gemini 1.5 Pro** with **2 million token support**, and the new **Gemini Flash** model optimized for speed with **1 million token capacity**. The Gemini suite now includes **Ultra**, **Pro**, **Flash**, and **Nano** models, with **Gemini Nano** integrated into **Chrome 126**. Additional Gemini features include **Gemini Gems** (custom GPTs), **Gemini Live** for voice conversations, and **Project Astra**, a live video understanding assistant. The **Gemma model family** was updated with **Gemma 2** at **27B parameters**, offering near-**llama-3-70b** performance at half the size, plus **PaliGemma**, a vision-language open model inspired by **PaLI-3**. Other launches include **DeepMind's Veo**, **Imagen 3** for photorealistic image generation, and a **Music AI Sandbox** collaboration with YouTube. **SynthID watermarking** now extends to text, images, audio, and video. The **Trillium TPUv6** codename was revealed. Google also integrated AI across its product suite including Workspace, Email, Docs, Sheets, Photos, Search, and Lens. *"The world awaits Apple's answer."*

GPT-4o: the new SOTA-EVERYTHING Frontier model (GPT4T version)

Mon, 13 May 2024 23:14:50 GMT

**OpenAI** launched **GPT-4o**, a frontier model supporting real-time reasoning across **audio, vision, and text**, now free for all ChatGPT users with enhanced coding capabilities and upcoming advanced voice and video features. Discussions cover **open-source LLMs** like **Llama 3**, fine-tuning techniques including knowledge distillation for **GPT-3.5**, and hardware optimization strategies such as quantization. Emerging architectures include multimodal integrations with ChatGPT voice and Open Interpreter API, Mixture of Experts models combining autoregressive and diffusion approaches, and novel designs like the **YOCO architecture** and **ThunderKittens DSL** for efficient GPU use. Research advances in efficient attention methods like **Conv-Basis** using FFT and model scaling techniques such as depth upscaling were also highlighted.

GPT-4o: the new SOTA-EVERYTHING Frontier model (GPT4O version)

Mon, 13 May 2024 22:58:05 GMT

**OpenAI** has released **GPT-4o**, a new **multimodal** model capable of reasoning across text, audio, and video in real time with low latency (~300ms). It features voice and vision capabilities, improved non-English language performance with an expanded 200k vocabulary tokenizer, and is available to all ChatGPT users including free plans. GPT-4o is half the price and twice as fast as GPT-4-turbo with 5x rate limits. The model supports real-time voice and video input/output and shows strong coding capabilities. The release includes a new desktop app that can read screen and clipboard history, challenging existing desktop agent startups. The announcement was accompanied by demos including image generation and 3D object handling, with OpenAI achieving state-of-the-art performance in ASR and vision tasks. The update was widely discussed on social media, with comparisons to GPT-4T highlighting GPT-4o's speed and versatility. *"GPT-4o is smart, fast, natively multimodal, and a step towards more natural human-computer interaction"* and *"extremely versatile and fun to play with"*.

Quis promptum ipso promptiet?

Sat, 11 May 2024 06:34:12 GMT

**Anthropic** released upgrades to their Workbench Console, introducing new prompt engineering features like chain-of-thought reasoning and prompt generators that significantly reduce development time, exemplified by their customer **Zoominfo**. **OpenAI** teased a "magic" new development coming soon, speculated to be a new LLM replacing GPT-3.5 in the free tier or a search competitor. The open-source community highlighted **Llama 3 70B** as "game changing" with new quantized weights for **Llama 3 120B** and CUDA graph support for **llama.cpp** improving GPU performance. **Neuralink** demonstrated a thought-controlled mouse, sparking interest in modeling consciousness from brain signals. The **ICLR 2024** conference is being held in Asia for the first time, generating excitement.

LMSys advances Llama 3 eval analysis

Fri, 10 May 2024 00:52:45 GMT

**LMSys** is enhancing LLM evaluation by categorizing performance across **8 query subcategories** and **7 prompt complexity levels**, revealing uneven strengths in models like **Llama-3-70b**. **DeepMind** released **AlphaFold 3**, advancing molecular structure prediction with holistic modeling of protein-DNA-RNA complexes, impacting biology and genetics research. **OpenAI** introduced the **Model Spec**, a public standard to clarify model behavior and tuning, inviting community feedback and aiming for models to learn directly from it. **Llama 3** has reached top leaderboard positions on LMSys, nearly matching **Claude-3-sonnet** in performance, with notable variations on complex prompts. The analysis highlights the evolving landscape of model benchmarking and behavior shaping.

OpenAI's PR Campaign?

Thu, 09 May 2024 01:27:27 GMT

**OpenAI** faces user data deletion backlash over its new partnership with StackOverflow amid GDPR complaints and US newspaper lawsuits, while addressing election year concerns with efforts like the Media Manager tool for content opt-in/out by 2025 and source link attribution. **Microsoft** develops a top-secret airgapped GPT-4 AI service for US intelligence agencies. OpenAI releases the Model Spec outlining responsible AI content generation policies, including NSFW content handling and profanity use, emphasizing clear distinctions between bugs and design decisions. **Google DeepMind** announces **AlphaFold 3**, a state-of-the-art model predicting molecular structures with high accuracy, showcasing cross-domain AI techniques. New research on **xLSTM** proposes scaling LSTMs to billions of parameters, competing with transformers in performance and scaling. Microsoft introduces **vAttention**, a dynamic memory management method for efficient large language model serving without PagedAttention.

Kolmogorov-Arnold Networks: MLP killers or just spicy MLPs?

Tue, 07 May 2024 22:47:14 GMT

**Ziming Liu**, a grad student of **Max Tegmark**, published a paper on **Kolmogorov-Arnold Networks (KANs)**, claiming they outperform **MLPs** in interpretability, inductive bias injection, function approximation accuracy, and scaling, despite being 10x slower to train but 100x more parameter efficient. KANs use learnable activation functions modeled by B-splines on edges rather than fixed activations on nodes. However, it was later shown that KANs can be mathematically rearranged back into MLPs with similar parameter counts, sparking debate on their interpretability and novelty. Meanwhile, on AI Twitter, there is speculation about a potential **GPT-5** release with mixed impressions, OpenAI's adoption of the **C2PA metadata standard** for detecting AI-generated images with high accuracy for **DALL-E 3**, and **Microsoft** training a large 500B parameter model called **MAI-1**, potentially previewed at Build conference, signaling increased competition with OpenAI. *"OpenAI's safety testing for GPT-4.5 couldn't finish in time for Google I/O launch"* was also noted.

DeepSeek-V2 beats Mixtral 8x22B with >160 experts at HALF the cost

Mon, 06 May 2024 23:37:03 GMT

**DeepSeek V2** introduces a new state-of-the-art MoE model with **236B parameters** and a novel Multi-Head Latent Attention mechanism, achieving faster inference and surpassing GPT-4 on AlignBench. **Llama 3 120B** shows strong creative writing skills, while Microsoft is reportedly developing a **500B parameter** LLM called **MAI-1**. Research from Scale AI highlights overfitting issues in models like **Mistral** and **Phi**, whereas **GPT-4**, **Claude**, **Gemini**, and **Llama** maintain benchmark robustness. In robotics, **Tesla Optimus** advances with superior data collection and teleoperation, **LeRobot** marks a move toward open-source robotics AI, and **Nvidia's DrEureka** automates robot skill training. Multimodal LLM hallucinations are surveyed with new mitigation strategies, and **Google's Med-Gemini** achieves SOTA on medical benchmarks with fine-tuned multimodal models.

$100k to predict LMSYS human preferences in a Kaggle contest

Fri, 03 May 2024 22:09:28 GMT

**Llama 3 models** are making breakthroughs with Groq's 70B model achieving record low costs per million tokens. A new **Kaggle competition** offers a $100,000 prize to develop models predicting human preferences from a dataset of over 55,000 user-LLM conversations. Open source evaluator LLMs like **Prometheus 2** outperform proprietary models such as **GPT-4** and **Claude 3 Opus** in judgment tasks. New datasets like **WildChat1M** provide over 1 million ChatGPT interaction logs with diverse and toxic examples. Techniques like **LoRA fine-tuning** show significant performance gains, and **NVIDIA's NeMo-Aligner** toolkit enables scalable LLM alignment across hundreds of GPUs. Factuality-aware alignment methods are proposed to reduce hallucinations in LLM outputs.

Evals: The Next Generation

Thu, 02 May 2024 23:54:22 GMT

**Scale AI** highlighted issues with data contamination in benchmarks like **MMLU** and **GSM8K**, proposing a new benchmark where **Mistral** overfits and **Phi-3** performs well. **Reka** released the **VibeEval** benchmark for multimodal models addressing multiple choice benchmark limitations. **Sam Altman** of **OpenAI** discussed GPT-4 as "dumb" and hinted at **GPT-5** with AI agents as a major breakthrough. Researchers jailbroke **GPT-3.5** via fine-tuning. Global calls emerged to ban AI-powered weapons, with US officials urging human control over nuclear arms. Ukraine launched an AI consular avatar, while **Moderna** partnered with **OpenAI** for medical AI advancements. **Sanctuary AI** and **Microsoft** collaborate on AI for general-purpose robots. MIT introduced **Kolmogorov-Arnold networks** with improved neural network efficiency. **Meta AI** is training **Llama 3** models with over 400 billion parameters, featuring multimodality and longer context.

Not much happened today

Thu, 02 May 2024 00:47:12 GMT

**Anthropic** released a team plan and iOS app about 4 months after **OpenAI**. The **Command-R 35B** model excels at creative writing, outperforming larger models like **Goliath-120** and **Miqu-120**. The **Llama-3 8B** model now supports a 1 million token context window, improving long-context understanding with minimal training on a single 8xA800 GPU machine. **TensorRT-LLM** benchmarks show it is 30-70% faster than **llama.cpp** on consumer hardware. A benchmark suggests **GPT2-Chat** may have better reasoning than **GPT-4-Turbo**, though results are debated. Demos include a self-learning **Llama-3** voice agent running locally on Jetson Orin and a Self-Learning Large Action Model (LAM). **Amazon CodeWhisperer** was renamed to **Q Developer**, expanding its generative AI assistant capabilities. **Apple** plans an AI-enabled Safari browser with an on-device LLM in iOS 18 and macOS 15. Big Tech dominates AI lobbying in Washington, while major U.S. newspapers sued **OpenAI** and **Microsoft** for copyright infringement. **DeepMind's AlphaZero** became the greatest chess player in 9 hours, and their Naturalized Execution Tuning (NExT) method improves LLM code reasoning by 14-26%. **Stable Diffusion** is used for diverse image generation applications.

LLMs-as-Juries

Wed, 01 May 2024 01:41:25 GMT

**OpenAI** has rolled out the **memory feature** to all ChatGPT Plus users and partnered with the **Financial Times** to license content for AI training. Discussions on **OpenAI's profitability** arise due to paid training data licensing and potential **GPT-4 usage limit reductions**. Users report issues with ChatGPT's data cleansing after the memory update. Tutorials and projects include building AI voice assistants and interface agents powered by LLMs. In **Stable Diffusion**, users seek realistic **SDXL models** comparable to PonyXL, and new extensions like **Hi-diffusion** and **Virtuoso Nodes v1.1** enhance ComfyUI with advanced image generation and Photoshop-like features. Cohere finds that multiple agents outperform single agents in LLM judging tasks, highlighting advances in multi-agent systems.

A quiet weekend

Mon, 29 Apr 2024 22:10:15 GMT

**Yann LeCun** predicts a shift to **AR interfaces** with AI assistants in 10-15 years, moving away from smartphones. The **Dolphin-2.9 model** based on **Llama-3** was released, improving quality issues. **PixArt Sigma**, a **0.6B parameter** model, achieves **Stable Diffusion 3.0** level performance with complete prompt adherence and local usability. Research shows transformers can use meaningless filler tokens for algorithmic tasks with dense supervision. AI-generated restaurant reviews can pass the **Turing test**, fooling humans and AI detectors. **Uber** uses graph algorithms and learned embeddings for ETA prediction. **Coca-Cola** and **Microsoft** announced a 5-year AI partnership to accelerate cloud and generative AI initiatives. The **Llama-3 70B** model can run on a single 4GB GPU using **AirLLM** optimization without quantization but is slow. **Mistral.rs** is introduced as a fast LLM inference platform with quantization and OpenAI API compatibility. Only 5% of LLMs make it from prototype to production due to challenges, especially in enterprise. EXL2 and GGUF quantization methods for Llama models show similar perplexity vs model size, with Llama-3 and Llama-2 degrading more under quantization compared to full precision.

Apple's OpenELM beats OLMo with 50% of its dataset, using DeLighT

Fri, 26 Apr 2024 21:32:41 GMT

**Apple** advances its AI presence with the release of **OpenELM**, its first relatively open large language model available in sizes from **270M to 3B** parameters, featuring a novel layer-wise scaling architecture inspired by the **DeLight** paper. Meanwhile, **Meta's LLaMA 3** family pushes context length boundaries with models supporting over **160K tokens** and an **8B-Instruct model with 262K context length** released on Hugging Face, alongside performance improvements in quantized versions. A new paper on AI alignment highlights **KTO** as the best-performing method, with sensitivity to training data volume noted. In AI ethics and regulation, former **Google** CEO **Eric Schmidt** warns about the risks of open-source AI empowering bad actors and geopolitical rivals, while a U.S. proposal aims to enforce "Know Your Customer" rules to end anonymous cloud usage.

Snowflake Arctic: Fully Open 10B+128x4B Dense-MoE Hybrid LLM

Fri, 26 Apr 2024 01:33:53 GMT

**Snowflake Arctic** is a notable new foundation language model released under Apache 2.0, claiming superiority over **Databricks** in data warehouse AI applications and adopting a mixture-of-experts architecture inspired by **DeepSeekMOE** and **DeepSpeedMOE**. The model employs a 3-stage curriculum training strategy similar to the recent **Phi-3** paper. In AI image and video generation, **Nvidia** introduced the **Align Your Steps** technique improving image quality at low step counts, while **Stable Diffusion 3** and **SD3 Turbo** models were compared for prompt understanding and image quality. **Adobe** launched an AI video upscaling project enhancing blurry videos to HD, though with some high-resolution artifacts. **Apple** released open-source on-device language models with code and training logs, diverging from typical weight-only releases. The **Llama-3-70b** model ties for first place on the LMSYS leaderboard for English queries, and **Phi-3** (4B params) outperforms **GPT-3.5 Turbo** in the banana logic benchmark. Fast inference and quantization of **Llama 3** models were demonstrated on MacBook devices.

OpenAI's Instruction Hierarchy for the LLM OS

Thu, 25 Apr 2024 00:15:11 GMT

**OpenAI** published a paper introducing the concept of privilege levels for LLMs to address prompt injection vulnerabilities, improving defenses by 20-30%. **Microsoft** released the lightweight **Phi-3-mini** model with 4K and 128K context lengths. **Apple** open-sourced the **OpenELM** language model family with an open training and inference framework. An instruction accuracy benchmark compared 12 models, with **Claude 3 Opus**, **GPT-4 Turbo**, and **Llama 3 70B** performing best. The **Rho-1** method enables training state-of-the-art models using only 3% of tokens, boosting models like **Mistral**. **Wendy's** deployed AI-powered drive-thru ordering, and a study found **Gen Z** workers prefer generative AI for career advice. Tutorials on deploying **Llama 3** models on AWS EC2 highlight hardware requirements and inference server use.

Perplexity, the newest AI unicorn

Tue, 23 Apr 2024 22:48:23 GMT

**Perplexity** doubles its valuation shortly after its Series B with a Series B-1 funding round. Significant developments around **Llama 3** include context length extension to **16K tokens**, new multimodal **LLaVA models** outperforming Llama 2, and fine-tuning improvements like QDoRA surpassing QLoRA. The **Llama-3-70B** model is praised for instruction following and performance across quantization formats. **Phi-3 models** by **Meta AI** released in multiple sizes show competitive benchmark results, with the 14B model achieving **78% on MMLU** and the 3.8B model nearing **GPT-3.5** performance.

FineWeb: 15T Tokens, 12 years of CommonCrawl (deduped and filtered, you're welcome)

Tue, 23 Apr 2024 00:03:58 GMT

**2024** has seen a significant increase in dataset sizes for training large language models, with **Redpajama 2** offering up to **30T tokens**, **DBRX** at **12T tokens**, **Reka Core/Flash/Edge** with **5T tokens**, and **Llama 3** trained on **15T tokens**. **Huggingface** released an open dataset containing **15T tokens** from **12 years** of filtered CommonCrawl data, enabling training of models like **Llama 3** if compute resources are available. On Reddit, **WizardLM-2-8x22b** outperformed other open LLMs including **Llama-3-70b-instruct** in reasoning and math benchmarks. **Claude Opus** demonstrated strong zero-shot code error spotting, surpassing **Llama 3**. Benchmarks revealed limitations in the **LMSYS chatbot leaderboard** due to instruction-tuned models gaming the system, and a new RAG benchmark showed **Llama 3 70B** underperforming compared to **GPT-4**, while **Mistral 8x7B** remained strong. Efficient quantized versions of **Llama 3** models are available on **Huggingface**, with users reporting token generation limits around **9600 tokens** on a 3090 GPU. Safety concerns include a UK sex offender banned from AI tool usage and **GPT-4** demonstrating an **87% success rate** exploiting real vulnerabilities, raising security concerns.

Llama-3-70b is GPT-4-level Open Model

Sat, 20 Apr 2024 02:21:27 GMT

**Meta** has released **Llama 3**, their most capable open large language model with **8B and 70B parameter versions** supporting **8K context length** and outperforming previous models including **Llama 2** and **Mistral 7B**. **Groq** serves the **Llama 3 70B** model at **500-800 tokens/second**, making it the fastest GPT-4-level token source. Discussions highlight AI scaling challenges with **Elon Musk** stating that training **Grok 3** will require **100,000 Nvidia H100 GPUs**, and **AWS** planning to acquire **20,000 B200 GPUs** for a **27 trillion parameter model**. Microsoft unveiled **VASA-1** for lifelike talking face generation, while **Stable Diffusion 3** and its extensions received mixed impressions. Concerns about AI energy usage and political bias in AI were also discussed.

Meta Llama 3 (8B, 70B)

Fri, 19 Apr 2024 04:28:01 GMT

**Meta** partially released **Llama 3** models including **8B** and **70B** variants, with a **400B** variant still in training, touted as the first GPT-4 level open-source model. **Stability AI** launched **Stable Diffusion 3 API** with model weights coming soon, showing competitive realism against **Midjourney V6**. **Boston Dynamics** unveiled an electric humanoid robot **Atlas**, and **Microsoft** introduced the **VASA-1** model generating lifelike talking faces at 40fps on RTX 4090. **Mistral AI**, a European OpenAI rival, is seeking $5B funding with its **Mixtral-8x22B-Instruct-v0.1** model achieving 100% accuracy on 64K context benchmarks. AI safety discussions include calls from former OpenAI board member **Helen Toner** for audits of top AI companies, and the **Mormon Church** released AI usage principles. New AI development tools include **Ctrl-Adapter** for diffusion models, **Distilabel 1.0.0** for synthetic dataset pipelines, **Data Bonsai** for data cleaning with LLMs, and **Dendron** for building LLM agents with behavior trees. Memes highlight AI development humor and cultural references. The release of **Llama 3** models features improved reasoning, a 128K token vocabulary, 8K token sequences, and grouped query attention.

Mixtral 8x22B Instruct sparks efficiency memes

Wed, 17 Apr 2024 21:02:34 GMT

**Mistral** released an instruct-tuned version of their **Mixtral 8x22B** model, notable for using only **39B active parameters** during inference, outperforming larger models and supporting **5 languages** with **64k context window** and math/code capabilities. The model is available on **Hugging Face** under an **Apache 2.0 license** for local use. **Google** plans to invest over **$100 billion** in AI, with other giants like **Microsoft**, **Intel**, and **SoftBank** also making large investments. The UK criminalized non-consensual deepfake porn, raising enforcement debates. A former **Nvidia** employee claims Nvidia's AI chip lead is unmatchable this decade. AI companions could become a **$1 billion** market. AI has surpassed humans on several basic tasks but lags on complex ones. **Zyphra** introduced **Zamba**, a novel 7B parameter hybrid model outperforming **LLaMA-2 7B** and **OLMo-7B** with less training data, trained on 128 H100 GPUs over 30 days. **GroundX** API advances retrieval-augmented generation accuracy.

Lilian Weng on Video Diffusion

Wed, 17 Apr 2024 02:15:37 GMT

**OpenAI** expands with a launch in **Japan**, introduces a **Batch API**, and partners with **Adobe** to bring the **Sora video model** to Premiere Pro. **Reka AI** releases the **Reka Core multimodal language model**. **WizardLM-2** is released showing impressive performance, and **Llama 3** news is anticipated soon. Geoffrey Hinton highlights AI models exhibiting **intuition, creativity, and analogy recognition** beyond humans. The **Devin AI model** notably contributes to its own codebase. **Opus** demonstrates the ability to recognize its own generated outputs. **Sam Altman** warns startups about being steamrolled by OpenAI if they don't adapt quickly. **Yann LeCun** discusses AGI timelines, emphasizing it is inevitable but not imminent or solely from LLMs. Lilian Weng's blog on **diffusion models for video generation** highlights **training-free adaptation** as a breakthrough technique.

Multi-modal, Multi-Aspect, Multi-Form-Factor AI

Mon, 15 Apr 2024 22:42:55 GMT

Between April 12-15, **Reka Core** launched a new GPT4-class multimodal foundation model with a detailed technical report described as "full Shazeer." **Cohere Compass** introduced a foundation embedding model for indexing and searching multi-aspect enterprise data like emails and invoices. The open-source **IDEFICS 2-8B** model continues Google's Flamingo multimodal model reproduction. **Rewind** pivoted to a multi-platform app called Limitless, moving away from spyware. Reddit discussions highlighted **Apple MLX** outperforming **Ollama** and **Mistral Instruct** on M2 Ultra GPUs, GPU choices for LLMs and Stable Diffusion, and AI-human comparisons by Microsoft Research's Chris Bishop. Former PayPal CEO Dan Schulman predicted **GPT-5** will drastically reduce job scopes by 80%. **Mistral** CEO Arthur Mensch criticized the obsession with AGI as "creating God."

Zero to GPT in 1 Year

Fri, 12 Apr 2024 23:27:50 GMT

**GPT-4 Turbo** reclaimed the top leaderboard spot with significant improvements in coding, multilingual, and English-only tasks, now rolled out in paid **ChatGPT**. Despite this, **Claude Opus** remains superior in creativity and intelligence. **Mistral AI** released powerful open-source models like **Mixtral-8x22B** and **Zephyr 141B** suited for fine-tuning. **LangChain** enhanced tool integration across models, and **Hugging Face** introduced Transformer.js for running transformers in browsers. Medical domain-focused **Medical mT5** was shared as an open-source multilingual text-to-text model. The community also highlighted research on LLMs as regressors and shared practical advice on OCR/PDF data modeling from **Vik Paruchuri**'s journey.

Mergestral, Meta MTIAv2, Cohere Rerank 3, Google Infini-Attention

Thu, 11 Apr 2024 22:56:47 GMT

**Meta** announced their new **MTIAv2 chips** designed for training and inference acceleration with improved architecture and integration with PyTorch 2.0. **Mistral** released the **8x22B Mixtral** model, which was merged back into a dense model to effectively create a 22B Mistral model. **Cohere** launched **Rerank 3**, a foundation model enhancing enterprise search and retrieval-augmented generation (RAG) systems supporting 100+ languages. **Google** published a paper on **Infini-attention**, an ultra-scalable linear attention mechanism demonstrated on 1B and 8B models with 1 million sequence length. Additionally, **Meta's Llama 3** is expected to start rolling out soon. Other notable updates include **Command R+**, an open model surpassing GPT-4 in chatbot performance with 128k context length, and advancements in Stable Diffusion models and RAG pipelines.

Music's Dall-E moment

Wed, 10 Apr 2024 22:07:48 GMT

**Google's Griffin architecture** outperforms transformers with faster inference and lower memory usage on long contexts. **Command R+** climbs to 6th place on the LMSYS Chatbot Arena leaderboard, surpassing **GPT-4-0613** and **GPT-4-0314**. **Mistral AI** releases an open-source **8x22B model** with a 64K context window and around 130B total parameters. **Google** open-sources **CodeGemma** models with pre-quantized 4-bit versions for faster downloads. **Ella weights** enhance Stable Diffusion 1.5 with LLM for semantic alignment. **Unsloth** enables 4x larger context windows and 80% memory reduction for finetuning. **Andrej Karpathy** releases LLMs implemented in pure C for potential performance gains. **Command R+** runs in realtime on M2 Max MacBook using iMat q1 quantization. **Cohere's Command R** model offers low API costs and strong leaderboard performance. **Gemini 1.5** impresses with audio capabilities recognizing speech tone and speaker identification from audio clips.

Gemini Pro and GPT4T Vision go GA on the same day by complete coincidence

Wed, 10 Apr 2024 01:05:31 GMT

At **Google Cloud Next**, **Gemini 1.5 Pro** was released with a **million-token context window**, available in **180+ countries**, featuring **9.5 hours of audio understanding**, a new **File API** for nearly unlimited free uploads, and the **Gecko-1b-256/768 embedding model**. **GPT-4 Turbo with Vision** became generally available in the API with a major update improving reasoning capabilities. **Meta Platforms** plans to launch smaller versions of **Llama 3** next week. The **Orca 2.5 7B** model using Direct Nash Optimization outperforms older GPT-4 versions in AlpacaEval. New releases include **Functionary-V2.4** with enhanced function calling and code interpretation, and **CosXL** models for image editing. Research highlights include continuous U-Nets for diffusion models achieving up to **80% faster inference** and a massive multilingual dataset with **~5.6 trillion word tokens**. Creative applications include a no-code touch screen game made with Gemini 1.5 and AI-generated novel trailers.

Anime pfp anon eclipses $10k A::B prompting challenge

Tue, 09 Apr 2024 01:18:42 GMT

**Victor Taelin** issued a $10k challenge to GPT models, initially achieving only **10% success** with state-of-the-art models, but community efforts surpassed **90% success** within 48 hours, highlighting GPT capabilities and common skill gaps. In Reddit AI communities, **Command R Plus (104B)** is running quantized on **M2 Max hardware** via **Ollama** and **llama.cpp** forks, with **GGUF quantizations** released on Huggingface. Streaming text-to-video generation is now available through the **st2v** GitHub repo. **WD Tagger v3** was released for mass auto-captioning datasets with a WebUI. Lesser-known prompting techniques like self-tagging and generational frameworks produced thought-provoking outputs in OpenAI discussions, including experiments with self-evolving system prompts. Stable Diffusion users discussed image composition importance for training character LoRAs and best checkpoints for video game character generation. Discussions also covered scarcity of **5B parameter models** and open(ish) licenses for open source AI. Memes included jokes about ChatGPT and Gemini training data differences.

Mixture of Depths: Dynamically allocating compute in transformer-based language models

Fri, 05 Apr 2024 22:44:29 GMT

**DeepMind** introduces the Mixture-of-Depths (MoD) technique, dynamically allocating FLOPs across transformer layers to optimize compute usage, achieving over **50% faster** forward passes without training impact. MoD selectively processes tokens using top-k routing, improving efficiency and potentially enabling faster ultra-long context handling. The method can combine with Mixture-of-Experts (MoE) for decoupled routing of queries, keys, and values. Reddit discussions highlight concerns about **LLM hype** overshadowing other AI tech, improvements in transformer efficiency, a new Think-and-Execute framework boosting algorithmic reasoning by **10-20%**, and Visual Autoregressive modeling (VAR) surpassing diffusion models in image quality and speed. On-device model Octopus v2 outperforms GPT-4 in function calling accuracy and latency.

Cohere Command R+, Anthropic Claude Tool Use, OpenAI Finetuning

Thu, 04 Apr 2024 22:21:15 GMT

**Cohere** launched **Command R+**, a **104B dense model** with **128k context length** focusing on **RAG**, **tool-use**, and **multilingual** capabilities across **10 key languages**. It supports **Multi-Step Tool use** and offers open weights for research. **Anthropic** introduced **tool use in beta** for **Claude**, supporting over **250 tools** with new cookbooks for practical applications. **OpenAI** enhanced its fine-tuning API with new upgrades and case studies from Indeed, SK Telecom, and Harvey, promoting DIY fine-tuning and custom model training. **Microsoft** achieved a quantum computing breakthrough with an **800x error rate improvement** and the most usable qubits to date. **Stability AI** released **Stable Audio 2.0**, improving audio generation quality and control. The **Opera browser** added local inference support for large language models like **Meta's Llama**, **Google's Gemma**, and **Vicuna**. Discussions on Reddit highlighted **Gemini's large context window**, analysis of **GPT-3.5-Turbo** model size, and a battle simulation between **Claude 3** and **ChatGPT** using local 7B models like **Mistral** and **Gemma**.

ReALM: Reference Resolution As Language Modeling

Thu, 04 Apr 2024 00:00:20 GMT

**Apple** is advancing in AI with a new approach called **ReALM: Reference Resolution As Language Modeling**, which improves understanding of ambiguous references using three contexts and finetunes a smaller **FLAN-T5** model that outperforms **GPT-4** on this task. In Reddit AI news, an open-source coding agent **SWE-agent** achieves **12.29%** on the SWE-bench benchmark, and **RAGFlow** introduces a customizable retrieval-augmented generation engine. A new quantization method, **QuaRot**, enables efficient 4-bit inference. AI applications include a t-shirt design generator, **podgenai** for GPT-4 based podcast generation, and an open-source model from **HuggingFace** that runs without a GPU. Industry discussions focus on the impact of large language models on the AI field and efforts to decentralize AI development. **Takuto Takizawa** joins **Stability AI Japan** as Head of Sales & Partnerships.

Not much happened today

Tue, 02 Apr 2024 21:04:12 GMT

**RAGFlow** open sourced, a deep document understanding RAG engine with **16.3k context length** and natural language instruction support. **Jamba v0.1**, a **52B parameter** MoE model by Lightblue, released but with mixed user feedback. **Command-R** from **Cohere** available on Ollama library. Analysis of **GPT-3.5-Turbo** architecture reveals about **7 billion parameters** and embedding size of **4096**, comparable to OpenChat-3.5-0106 and Mixtral-8x7B. AI chatbots, including **GPT-4**, outperform humans in debates on persuasion. **Mistral-7B** made amusing mistakes on a math riddle. Hardware highlights include a discounted **HGX H100 640GB** machine with 8 H100 GPUs bought for $58k, and CPU comparisons between **Epyc 9374F** and **Threadripper 1950X** for LLM inference. GPU recommendations for local LLMs focus on VRAM and inference speed, with users testing **4090 GPU** and **Midnight-miqu-70b-v1.0.q5_k_s** model. Stable Diffusion influences gaming habits and AI art evaluation shows bias favoring human-labeled art.

AdamW -> AaronD?

Mon, 01 Apr 2024 19:58:53 GMT

**Aaron Defazio** is gaining attention for proposing a potential tuning-free replacement of the long-standing **Adam optimizer**, showing promising experimental results across classic machine learning benchmarks like ImageNet ResNet-50 and CIFAR-10/100. On Reddit, **Claude 3 Opus** has surpassed all **OpenAI** models on the LMSys leaderboard, while a user pretrained a **LLaMA-based 300M** model outperforming **bert-large** on language modeling tasks with a modest budget. The new **MambaMixer** architecture demonstrates promising results in vision and time series forecasting. In image generation, **Stable Diffusion 1.5** with LoRAs achieves realistic outputs, and the **WDXL** release showcases impressive capabilities. AI applications include an AI-generated Nike spec ad and a chatbot built with OpenAI models that may resist prompt injections. OpenAI is reportedly planning a ban wave targeting policy violators and jailbreak users. *"The high alpha seems to come from Aaron Defazio,"* highlighting his impactful work in optimizer research.

Evals-based AI Engineering

Fri, 29 Mar 2024 22:20:49 GMT

**Hamel Husain** emphasizes the importance of comprehensive evals in AI product development, highlighting evaluation, debugging, and behavior change as key iterative steps. **OpenAI** released a voice engine demo showcasing advanced voice cloning from small samples, raising safety concerns. Reddit discussions introduced new models like **Jamba** (hybrid Transformer-SSM with MoE), **Bamboo** (7B LLM with high sparsity based on Mistral), **Qwen1.5-MoE** (efficient parameter activation), and **Grok 1.5** (128k context length, surpassing GPT-4 in code generation). Advances in quantization include **1-bit Llama2-7B** models outperforming full precision and the **QLLM** quantization toolbox supporting GPTQ/AWQ/HQQ methods.

Jamba: Mixture of Architectures dethrones Mixtral

Thu, 28 Mar 2024 23:43:23 GMT

**AI21 labs** released **Jamba**, a **52B parameter MoE model** with **256K context length** and open weights under Apache 2.0 license, optimized for single A100 GPU performance. It features a unique blocks-and-layers architecture combining transformer and MoE layers, competing with models like **Mixtral**. Meanwhile, **Databricks** introduced **DBRX**, a **36B active parameter MoE model** trained on **12T tokens**, noted as a new standard for open LLMs. In image generation, advancements include **Animatediff** for video-quality image generation and **FastSD CPU v1.0.0 beta 28** enabling ultra-fast image generation on CPUs. Other innovations involve style-content separation using **B-LoRA** and improvements in high-resolution image upscaling with **SUPIR**.

DBRX: Best open model (just not most efficient)

Wed, 27 Mar 2024 22:33:19 GMT

**Databricks Mosaic** has released a new open-source model called **DBRX** that outperforms **Grok**, **Mixtral**, and **Llama2** on evaluations while being about **2x more efficient** than Llama2 and Grok. The model was trained on **12 trillion tokens** using **3,000 H100 GPUs** over 2 months, with an estimated compute cost of **$10 million**. It uses OpenAI's **100k tiktoken tokenizer** and shows strong zero-shot code generation performance, even beating **GPT-4** on the Humaneval benchmark. DBRX also upstreamed work to **MegaBlocks** open source. Despite its scale and efficiency, DBRX's performance on MMLU is only slightly better than Mixtral, raising questions about its scaling efficiency. The focus of DBRX is on enabling users to train models efficiently, with MoE training being about **2x more FLOP-efficient** than dense models, achieving similar quality with nearly **4x less compute** than previous MPT models. This release is part of the ongoing competition for open-source AI leadership, including models like **Dolly**, **MPT**, and **Mistral**. *"If it activates 36B params, the model's perf should be equivalent to a 72B dense model or even 80B,"* says Qwen's tech lead.

Claude 3 is officially America's Next Top Model

Wed, 27 Mar 2024 00:11:55 GMT

**Claude 3 Opus** outperforms **GPT4T** and **Mistral Large** in blind Elo rankings, with **Claude 3 Haiku** marking a new cost-performance frontier. Fine-tuning techniques like **QLoRA** on **Mistral 7B** and evolutionary model merging on HuggingFace models are highlighted. Public opinion shows strong opposition to ASI development. Research supervision opportunities in AI alignment are announced. The **Stable Diffusion 3 (SD3)** release raises workflow concerns for tools like **ComfyUI** and **automatic1111**. **Opus** shows a 5% performance dip on **OpenRouter** compared to the **Anthropic API**. A new benchmark stresses LLM recall at long contexts, with **Mistral 7B** struggling and **Qwen 72b** performing well.

Andrew likes Agents

Tue, 26 Mar 2024 01:11:50 GMT

**Andrew Ng's The Batch writeup on Agents** highlighted the significant improvement in coding benchmark performance when using an iterative agent workflow, with **GPT-3.5** wrapped in an agent loop achieving up to **95.1%** correctness on HumanEval, surpassing **GPT-4** zero-shot at **67.0%**. The report also covers new developments in **Stable Diffusion** models like **Cyberrealistic_v40**, **Platypus XL**, and **SDXL Lightning** for Naruto-style image generation, alongside innovations in LoRA and upscaling techniques. Discussions on **local LLM deployment** and optimization focus on hardware setups and finetuning strategies for efficient inference and multi-user serving. Emad's departure from **Stability AI** and new **Sora** videos from **OpenAI** were also noted.

Astro Nano

Tue, 26 Mar 2024 00:00:00 GMT

Minimal portfolio and blog build with astro and no frameworks.

not much happened today

Fri, 22 Mar 2024 23:55:31 GMT

The Reddit community /r/LocalLlama discusses **fine-tuning and training LLMs**, including tutorials and questions on training models with specific data like dictionaries and synthetic datasets with **25B+ tokens**. Users explore **retrieval-augmented generation (RAG)** challenges with models like **mistral-7b** and embedding generation for EEG brain activity. Discussions include **hardware optimization** for running **llama-2-70b** locally under budget constraints, and performance benchmarks for **qwen-1.5** models. There is interest in extending LLM capabilities, such as converting **llama-2-7b** into a vision-capable model like **llava** and improving model memory for longer context retention.

Welcome /r/LocalLlama!

Thu, 21 Mar 2024 23:33:53 GMT

**Sakana** released a paper on evolutionary model merging. **OpenInterpreter** launched their **O1 devkit**. Discussions highlight **Claude Haiku**'s underrated performance with 10-shot examples. On **Reddit's IPO**, AINews introduces Reddit summaries starting with /r/LocalLlama, covering upcoming subreddits like r/machinelearning and r/openai. **Aether Research** released **Cerebrum 8x7b** based on **Mixtral**, matching **GPT-3.5 Turbo** and **Gemini Pro** on reasoning tasks, setting a new open-source reasoning SOTA. **Moistral 11B v1** finetuned model from Cream-Phi-2 creators was released. A creative writing benchmark uses **Claude Opus** as judge. Hobbyists explore **1.58 BitNet** ternary quantization and **1-bit LLMs** training. Nvidia's **Blackwell (h200)** chip supports **FP4 precision** quantization. **LMDeploy v0.2.6+** enables efficient vision-language model deployment with models like **Qwen-VL-Chat**. Users seek GUIs for LLM APIs with plugin and RAG support. Pipelines for synthetic training data generation and fine-tuning language models for chat are discussed.

Shipping and Dipping: Inflection + Stability edition

Thu, 21 Mar 2024 00:59:01 GMT

**Inflection AI** and **Stability AI** recently shipped major updates (**Inflection AI 2.5** and **Stable Diffusion 3**) but are now experiencing significant executive departures, signaling potential consolidation in the GPU-rich startup space. **Mustafa Suleyman** has joined **Microsoft AI** as CEO, overseeing consumer AI products like Copilot, Bing, and Edge. **Microsoft Azure** is collaborating with **NVIDIA** on the Grace Blackwell 200 Superchip. **Google DeepMind** announced **TacticAI**, an AI assistant for football tactics developed with Liverpool FC, using geometric deep learning and achieving 90% expert approval in blind tests. **Anthropic** released **Claude 3 Haiku** and **Claude 3 Sonnet** on Google Cloud's Vertex AI, with **Claude 3 Opus** coming soon. Concerns about AI job displacement arise as **NVIDIA** introduces AI nurses that outperform humans at bedside manner at 90% lower cost.

World_sim.exe

Wed, 20 Mar 2024 00:46:48 GMT

**NVIDIA** announced **Project GR00T**, a foundation model for humanoid robot learning using multimodal instructions, built on their tech stack including Isaac Lab, OSMO, and Jetson Thor. They revealed the **DGX Grace-Blackwell GB200** with over **1 exaflop** compute, capable of training **GPT-4 1.8T parameters** in 90 days on 2000 Blackwells. Jensen Huang confirmed GPT-4 has **1.8 trillion parameters**. The new **GB200 GPU** supports float4/6 precision with ~3 bits per parameter and achieves **40,000 TFLOPs** on fp4 with 2x sparsity. Open source highlights include the release of **Grok-1**, a **340B parameter** model, and **Stability AI's SV3D**, an open-source text-to-video generation solution. **Nous Research** collaborated on implementing Steering Vectors in Llama.CPP. In Retrieval Augmented Generation (RAG), a new **5.5-hour tutorial** builds a pipeline using open-source HF models, and **LangChain** released a video on query routing and announced integration with **NVIDIA NIM** for GPU-optimized LLM inference. Prominent opinions include **Yann LeCun** distinguishing language from other cognitive abilities, **Sam Altman** predicting AGI arrival in 6 years with a leap from GPT-4 to GPT-5 comparable to GPT-3 to GPT-4, and discussions on the philosophical status of LLMs like Claude. There is also advice against training models from scratch for most companies.

Grok-1 in Bio

Tue, 19 Mar 2024 00:07:45 GMT

**Grok-1**, a **314B parameter Mixture-of-Experts (MoE) model** from **xAI**, has been released under an Apache 2.0 license, sparking discussions on its architecture, finetuning challenges, and performance compared to models like **Mixtral** and **Miqu 70B**. Despite its size, its **MMLU benchmark performance** is currently unimpressive, with expectations that **Grok-2** will be more competitive. The model's weights and code are publicly available, encouraging community experimentation. **Sam Altman** highlighted the growing importance of compute resources, while **Grok's** potential deployment on **Groq hardware** was noted as a possible game-changer. Meanwhile, **Anthropic's Claude** continues to attract attention for its "spiritual" interaction experience and consistent ethical framework. The release also inspired memes and humor within the AI community.

Astro Sphere

Mon, 18 Mar 2024 00:00:00 GMT

Portfolio and blog build with astro.

MM1: Apple's first Large Multimodal Model

Fri, 15 Mar 2024 23:34:51 GMT

**Apple** announced the **MM1** multimodal LLM family with up to **30B parameters**, claiming performance comparable to **Gemini-1** and beating larger older models on VQA benchmarks. The paper targets researchers and hints at applications in embodied agents and business/education. **Yann LeCun** emphasized that human-level AI requires understanding the physical world, memory, reasoning, and hierarchical planning, while **Franois Chollet** cautioned that NLP is far from solved despite LLM advances. **Cohere** released **Command-R**, a model for Retrieval Augmented Generation, and **Anthropic** highlighted the **Claude 3** family (Opus, Sonnet, Haiku) for various application needs. Open-source hardware **DexCap** enables dexterous robot manipulation data collection affordably. Tools like **CopilotKit** simplify AI integration into React apps, and migration to **Keras 3** with JAX backend offers faster training. New projects improve reranking for retrieval and add financial agents to **LangChain**. The content includes insights on AI progress, new models, open-source tools, and frameworks.

Not much happened piday

Thu, 14 Mar 2024 23:53:52 GMT

**DeepMind** announces **SIMA**, a generalist AI agent capable of following natural language instructions across diverse 3D environments and video games, advancing embodied AI agents. **Anthropic** releases **Claude 3 Haiku**, their fastest and most affordable model, now available via API and Perplexity. New research explores language model scaling laws, over-training, and introduces **Branch-Train-MiX (BTX)** for efficient training of large language models using mixture-of-experts. Predictions suggest software engineering jobs will grow to **30-35 million** in five years, aided by AI coding assistants like **Cohere's Command-R** focusing on retrieval-augmented generation and tool use. The **EU AI Act** is approved, mandating transparency in training data for GPAI systems. Privacy-preserving in-context learning with differential privacy is highlighted as promising work. Memes humorously discuss AI software engineers and notable figures like **Andrej Karpathy**.

DeepMind SIMA: one AI, 9 games, 600 tasks, vision+language ONLY

Thu, 14 Mar 2024 01:07:46 GMT

**DeepMind SIMA** is a generalist AI agent for 3D virtual environments evaluated on **600 tasks** across **9 games** using only screengrabs and natural language instructions, achieving **34%** success compared to humans' **60%**. The model uses a multimodal Transformer architecture. **Andrej Karpathy** outlines AI autonomy progression in software engineering, while **Arav Srinivas** praises Cognition Labs' AI agent demo. **François Chollet** expresses skepticism about automating software engineering fully. **Yann LeCun** suggests moving away from generative models and reinforcement learning towards human-level AI. Meta's **Llama-3** training infrastructure with **24k H100 Cluster Pods** is shared by **Soumith Chintala** and **Yann LeCun**. **Deepgram's Aura** offers low-latency speech APIs, and **Modal Labs' Devin AI** demonstrates document navigation and interaction with ComfyUI. Memes and humor circulate in the AI community.

The world's first fully autonomous AI Engineer

Tue, 12 Mar 2024 23:05:08 GMT

**Cognition Labs's Devin** is highlighted as a potentially groundbreaking AI software engineer agent capable of learning unfamiliar technologies, addressing bugs, deploying frontend apps, and fine-tuning its own AI models. It integrates **OpenAI's GPT-4** with reinforcement learning and features tools like asynchronous chat, browser, shell access, and an IDE. The system claims advanced long-term reasoning and planning abilities, attracting praise from investors like **Patrick Collison** and **Fred Ehrsam**. The technology is noted for its potential as one of the most advanced AI agents, sparking excitement about agents and AGI.

Fixing Gemma

Tue, 12 Mar 2024 00:03:26 GMT

**Google's Gemma model** was found unstable for finetuning until **Daniel Han from Unsloth AI** fixed 8 bugs, improving its implementation. **Yann LeCun** explained technical details of a pseudo-random bit sequence for adaptive equalizers, while **François Chollet** discussed the low information bandwidth of the human visual system. **Arav Srinivas** reported that **Claude 3 Opus** showed no hallucinations in extensive testing, outperforming **GPT-4** and **Mistral-Large** in benchmarks. Reflections from **Yann LeCun** highlight ongoing AI progress toward human-level intelligence. The community is shifting pipelines to work better with Claude models, and emotional experiences in ML development were shared by **Aidan Clark**.

FSDP+QLoRA: the Answer to 70b-scale AI for desktop class GPUs

Fri, 08 Mar 2024 23:21:13 GMT

**Jeremy Howard** and collaborators released a new tool combining **FSDP**, **QLoRA**, and **HQQ** to enable training **70b-parameter** models on affordable consumer GPUs like **RTX 4090s** with only **24GB RAM**, overcoming traditional memory constraints that required expensive data center GPUs costing over $150k. The approach shards quantized models across multiple GPUs and uses techniques like gradient checkpointing and CPU offloading to achieve efficient training on desktop-class hardware. The blogpost details challenges and solutions integrating these methods, highlighting a significant cost reduction from $150k to under $2.5k for training large language models. Additionally, Twitter recaps mention **Inflection AI**'s **Inflection-2.5** model rivaling **GPT-4** in benchmarks with less compute, and **Grok** improving speed by 3x. **Yann LeCun** discusses multi-step reasoning training for LLMs.

Inflection-2.5 at 94% of GPT4, and Pi at 6m MAU

Fri, 08 Mar 2024 02:11:17 GMT

**Mustafa Suleyman** announced **Inflection 2.5**, which achieves *more than 94% the average performance of GPT-4 despite using only 40% the training FLOPs*. **Pi**'s user base is growing about 10% weekly, with new features like realtime web search. The community noted similarities between Inflection 2.5 and **Claude 3 Sonnet**. **Claude 3 Opus** outperformed **GPT-4** in a 1.5:1 vote and is now the default for **Perplexity Pro** users. **Anthropic** added experimental tool calling support for Claude 3 via **LangChain**. **LlamaIndex** released LlamaParse JSON Mode for structured PDF parsing and added video retrieval via VideoDB, enabling retrieval-augmented generation (RAG) pipelines. A paper proposed knowledge-augmented planning for LLM agents. New benchmarks like TinyBenchmarks and the **Yi-9B** model release show strong code and math performance, surpassing **Mistral**.

Not much happened today

Thu, 07 Mar 2024 01:15:26 GMT

**Anthropic** released **Claude 3**, replacing Claude 2.1 as the default on Perplexity AI, with **Claude 3 Opus** surpassing **GPT-4** in capability. Debate continues on whether Claude 3's performance stems from emergent properties or pattern matching. **LangChain** and **LlamaIndex** added support for Claude 3 enabling multimodal and tool-augmented applications. Despite progress, current models still face challenges in out-of-distribution reasoning and robustness. **Cohere** partnered with **Accenture** for enterprise AI search, while **Mistral AI** and **Snowflake** collaborate to provide LLMs on Snowflake's platform. **Together AI Research** integrates **Deepspeed** innovations to accelerate generative AI infrastructure. **Hugging Face** and the **European Space Agency** released a large earth observation dataset, and **Google** open sourced **Gemma 2B**, optimized for smartphones via the MLC-LLM project. **GPT4All** improved model discoverability for open models. The AI community balances excitement over new models with concerns about limitations and robustness, alongside growing enterprise adoption and open-source contributions. Memes and humor continue to provide social commentary.

Stable Diffusion 3 — Rombach & Esser did it again!

Tue, 05 Mar 2024 22:30:03 GMT

**Over 2500 new community members joined following Soumith Chintala's shoutout, highlighting growing interest in SOTA LLM-based summarization. The major highlight is the detailed paper release of **Stable Diffusion 3 (SD3)**, showcasing advanced text-in-image control and complex prompt handling, with the model outperforming other SOTA image generation models in human-evaluated benchmarks. The SD3 model is based on an enhanced Diffusion Transformer architecture called **MMDiT**. Meanwhile, **Anthropic** released **Claude 3** models, noted for human-like responses and emotional depth, scoring 79.88% on HumanEval but costing over twice as much as GPT-4. Microsoft launched new Orca-based models and datasets, and Latitude released **DolphinCoder-StarCoder2-15b** with strong coding capabilities. Integration of image models by **Perplexity AI** and 3D CAD generation by **PolySpectra** powered by **LlamaIndex** were also highlighted. *"SD3's win rate beats all other SOTA image gen models (except perhaps Ideogram)"* and *"Claude 3 models are very good at generating d3 visualizations from text descriptions."*

Claude 3 just destroyed GPT 4 (see for yourself)

Mon, 04 Mar 2024 23:59:02 GMT

**Claude 3** from **Anthropic** launches in three sizes: Haiku (small, unreleased), Sonnet (medium, default on claude.ai, AWS, and GCP), and Opus (large, on Claude Pro). Opus outperforms **GPT-4** on key benchmarks like GPQA, impressing benchmark authors. All models support **multimodality** with advanced vision capabilities, including converting a 2-hour video into a blog post. Claude 3 offers improved alignment, fewer refusals, and extended context length up to **1 million tokens** with near-perfect recall. Haiku is noted for speed and cost-efficiency, processing dense research papers in under three seconds. The models excel at following complex instructions and producing structured outputs like JSON. Safety improvements reduce refusal rates, though some criticism remains from experts. Claude 3 is trained on synthetic data and shows strong domain-specific evaluation results in finance, medicine, and philosophy.

The Era of 1-bit LLMs

Fri, 01 Mar 2024 22:33:03 GMT

**The Era of 1-bit LLMs** research, including the **BitNet b1.58** model, introduces a ternary parameter approach that matches full-precision Transformer LLMs in performance while drastically reducing energy costs by **38x**. This innovation promises new scaling laws and hardware designs optimized for 1-bit LLMs. Discussions on AI Twitter highlight advances in **AGI societal impact**, **robotics with multimodal models**, **fine-tuning techniques like ResLoRA**, and **AI security efforts at Hugging Face**. Ethical considerations in generative AI and humor within the AI community are also prominent topics.

Dia de las Secuelas (StarCoder, The Stack, Dune, SemiAnalysis)

Fri, 01 Mar 2024 00:14:08 GMT

**HuggingFace/BigCode** has released **StarCoder v2**, including the **StarCoder2-15B** model trained on over **600 programming languages** using the **The Stack v2** dataset. This release marks a state-of-the-art achievement for models of this size, with opt-out requests excluded from training data. A detailed technical report is available, highlighting the model's capabilities and training methodology. Additionally, a live event featuring **Dylan Patel** discussing GPU economics is announced for San Francisco.

... and welcome AI Twitter!

Thu, 29 Feb 2024 00:50:17 GMT

The AI Twitter discourse from **2/27-28/2024** covers a broad spectrum including **ethical considerations** highlighted by **Margaret Mitchell** around **Google Gemini's** launch, and **John Carmack's** insights on evolving coding skills in the AI era. **Guillaume Lample** announced the release of the **Mistral Large** multilingual model. Discussions also touched on potential leadership changes at **Google** involving **Sundar Pichai**, and **OpenAI's** possible entry into the synthetic data market as noted by **Delip Rao**. Technological advancements include **Yann LeCun's** commentary on running LLMs on mobile devices and **Alex Wang's** praise for the **Apple Vision Pro**. Financial platform issues were raised by **Pieter Levels** regarding **Stripe's** payment policies. The cultural dynamics within big tech were discussed by **François Chollet** and **Dhéliat**. The lighter side of AI was represented by memes and humor from **Pieter Levels** and **AISafetyMemes**. This summary reflects the fast-evolving AI landscape blending technical innovation, corporate strategy, ethics, and community culture.

Welcome Interconnects and OpenRouter

Tue, 27 Feb 2024 20:03:47 GMT

**Discord communities** analyzed **22 guilds**, **349 channels**, and **12885 messages** revealing active discussions on **model comparisons and optimizations** involving **Mistral AI**, **Miqu**, and **GGUF quantized models**. Highlights include comparing **Mistral Large** with **GPT-4**, focusing on cost-effectiveness and performance, and exploring quantization techniques like **GPTQ** and **QLORA** to reduce VRAM usage. Advanced applications such as **role-playing**, **story-writing**, **code clarity**, and **AI-assisted decompilation** were emphasized, alongside development of tools like an **asynchronous summarization script** for **Mistral 7b**. The intersection of **quantum computing** and AI was discussed, including DARPA-funded projects and **encoder-based diffusion techniques** for image processing. Community efforts featured new Spanish LLM announcements, hardware experimentation, and open-source initiatives, with platforms like **Perplexity AI** and **LlamaIndex** noted for innovation and integration. Speculation about **Mistral AI**'s open-source commitment and tools like **R2R** for rapid RAG deployment highlighted collaborative spirit.

Mistral Large disappoints

Mon, 26 Feb 2024 21:59:34 GMT

**Mistral** announced **Mistral Large**, a new language model achieving **81.2% accuracy on MMLU**, trailing **GPT-4 Turbo** by about 5 percentage points on benchmarks. The community reception has been mixed, with skepticism about open sourcing and claims that **Mistral Small** outperforms the open **Mixtral 8x7B**. Discussions in the **TheBloke** Discord highlighted performance and cost-efficiency comparisons between **Mistral Large** and **GPT-4 Turbo**, technical challenges with **DeepSpeed** and **DPOTrainer** for training, advances in AI deception for roleplay characters using **DreamGen Opus V1**, and complexities in model merging using linear interpolation and PEFT methods. Enthusiasm for AI-assisted decompilation was also expressed, emphasizing the use of open-source projects for training data.

One Year of Latent Space

Sat, 24 Feb 2024 01:05:00 GMT

**Latent Space** podcast celebrated its first anniversary, reaching #1 in AI Engineering podcasts and 1 million unique readers on Substack. The **Gemini 1.5** image generator by **Google DeepMind** sparked controversy over bias and inaccurate representation, leading to community debates on AI ethics. Discussions in **TheBloke** and **LM Studio** Discords highlighted AI's growing role in creative industries, especially game development and text-to-3D tools. Fine-tuning and performance optimization of models like **Gemma 7B** and **Mistral-next** were explored in **Nous Research AI** and **Mistral** Discords, with shared solutions including learning rates and open-source tools. Emerging trends in AI hardware and application development were discussed in **CUDA MODE** and **LangChain AI** Discords, including critiques of **Nvidia's CUDA** by **Jim Keller** and advancements in reducing AI hallucinations hinted by **Richard Socher**.

Ring Attention for >1M Context

Fri, 23 Feb 2024 00:51:56 GMT

**Google Gemini Pro** has sparked renewed interest in long context capabilities. The CUDA MODE Discord is actively working on implementing the **RingAttention** paper by Liu, Zaharia, and Abbeel, including extensions from the World Model RingAttention paper, with available PyTorch and CUDA implementations. TheBloke Discord discussed various topics including **LLM guessing game evaluation**, chatbot UX comparisons between **Nvidia's Chat with RTX** and **Polymind**, challenges in **retrieval-augmented generation (RAG)** integration, VRAM optimization, fine-tuning for character roleplay using **Dynamic Prompt Optimization (DPO)**, and model choices like **deepseek-coder-6.7B-instruct**. There was also discussion on ML workflows on Mac Studio, with preferences for **llama.cpp** over **ollama**, and scaling inference cost-effectively using GPUs like the **4090** on Runpod. LM Studio users face manual update requirements for version **0.2.16**, which includes support for **Gemma models** and bug fixes, especially for MacOS. The Gemma 7B model has had performance issues, while Gemma 2B received positive feedback.

Google AI: Win some (Gemma, 1.5 Pro), Lose some (Image gen)

Thu, 22 Feb 2024 02:21:19 GMT

**Google's Gemma open models** (2-7B parameters) outperform **Llama 2** and **Mistral** in benchmarks but face criticism for an unusual license and poor image generation quality, which Google partially acknowledges. The upcoming **Gemini Pro 1.5** model features a 1 million token context window, excelling in video understanding and needle-in-haystack tasks. Discord communities like **TheBloke** and **LM Studio** discuss mixed reception of Gemma models, anticipation for **Llama 3** release, challenges in dataset editing, and hardware considerations such as **NVIDIA GeForce RTX 3090** and **RTX 4090** GPUs. LM Studio users report issues with version 0.2.15 Beta and ongoing integration of Gemma models, with resources shared on **Hugging Face**.

Karpathy emerges from stealth?

Wed, 21 Feb 2024 01:54:38 GMT

**Andrej Karpathy** released a comprehensive 2-hour tutorial on **tokenization**, detailing techniques up to **GPT-4**'s tokenizer and noting the complexity of **Llama 2** tokenization with SentencePiece. Discussions in AI Discord communities covered **model optimization and efficiency**, focusing on **quantization** of models like **Mistral 7B** and **Zephyr-7B** to reduce memory usage for consumer GPUs, including Intel's new weight-only quantization algorithm. Efforts to improve computational efficiency included selective augmentation reducing costs by 57.76% and memory token usage versus kNN for Transformers. Challenges in hardware compatibility and software issues were shared, alongside fine-tuning techniques such as LoRA and model merging. Innovative applications of LLMs in retrieval-augmented generation (RAG), multi-model learning, and meta-reasoning were explored. The community emphasized dataset sharing, open-source releases like SDXL VAE encoded datasets and Audiogen AI codecs, and ethical AI use with censorship and guardrails. Collaboration and resource sharing remain strong in these AI communities.

Companies liable for AI hallucination is Good Actually for AI Engineers

Tue, 20 Feb 2024 00:05:26 GMT

**Air Canada** faced a legal ruling requiring it to honor refund policies communicated by its AI chatbot, setting a precedent for corporate liability in AI engineering accuracy. The tribunal ordered a refund of **$650.88 CAD** plus damages after the chatbot misled a customer about bereavement travel refunds. Meanwhile, AI community discussions highlighted innovations in **quantization techniques** for GPU inference, **Retrieval-Augmented Generation (RAG)** and fine-tuning of LLMs, and **CUDA** optimizations for PyTorch models. New prototype models like **Mistral-Next** and the **Large World Model (LWM)** were introduced, showcasing advances in handling large text contexts and video generation with models like **Sora**. Ethical and legal implications of AI autonomy were debated alongside challenges in dataset management. Community-driven projects such as the open-source TypeScript agent framework **bazed-af** emphasize collaborative AI development. Additionally, benchmarks like **BABILong** for up to **10M context evaluation** and tools from **karpathy** were noted.

Sora pushes SOTA

Fri, 16 Feb 2024 11:15:03 GMT

**Discord communities** analyzed over **20 guilds**, **312 channels**, and **10550 messages** reveal intense discussions on AI developments. Key highlights include the **Dungeon Master AI assistant** for Dungeons and Dragons using models like **H20 GPT**, GPU power supply debates involving **3090** and **3060 GPUs**, and excitement around **Google's Gemini 1.5** with its **1 million token context window** and **OpenAI's Sora** model. Challenges with **large world models (LWM)** multimodality, **GPT-assisted coding**, and **role-play model optimization** with **Yi models** and **Mixtral Instruct** were discussed. Technical issues like **model merging errors** with **MistralCasualML**, fine-tuning scripts like **AutoFineTune**, and cross-language engineering via **JSPyBridge** were also prominent. NVIDIA's **Chat with RTX** feature leveraging **retrieval-augmented generation (RAG)** on 30+ series GPUs was compared to LMStudio's support for **Mistral 7b** and **Llama 13b** models. The community is cautiously optimistic about these frontier models' applications in media and coding.

AI gets Memory

Thu, 15 Feb 2024 00:47:59 GMT

**AI Discords** analysis covered **20 guilds**, **312 channels**, and **6901 messages**. The report highlights the divergence of RAG style operations for context and memory, with implementations like **MemGPT** rolling out in **ChatGPT** and **LangChain**. The **TheBloke Discord** discussed **open-source large language models** such as the **Large World Model** with contexts up to **1 million tokens**, and the **Cohere aya model** supporting **101 languages**. Roleplay-focused models like **MiquMaid-v2-70B** were noted for performance improvements with enhanced hardware. Finetuning techniques like **Sequential Fine-Tuning (SFT)** and **Direct Preference Optimization (DPO)** were explained, with tools like **Unsloth AI's apply_chat_template** preferred over Alpaca. Integration of JavaScript and Python via **JSPyBridge** in the **SillyTavern** project was also discussed. Training challenges with **Mixtral 8x7b qlora** versus **Mistral 7b** were noted. The **LM Studio Discord** focused on hardware limitations affecting large model loading, medical LLMs like **medAlpaca**, and hardware discussions around GPU upgrades and overclocking. Anticipation for **IQ3_XSS** 1.5 bit quantization support in LM Studio was expressed.

The Dissection of Smaug (72B)

Tue, 13 Feb 2024 01:40:29 GMT

**Abacus AI** launched **Smaug 72B**, a large finetune of **Qwen 1.0**, which remains unchallenged on the **Hugging Face Open LLM Leaderboard** despite skepticism from **Nous Research**. **LAION** introduced a local voice assistant model named **Bud-E** with a notable demo. The **TheBloke Discord** community discussed model performance trade-offs between large models like **GPT-4** and smaller quantized models, fine-tuning techniques using datasets like **WizardLM_evol_instruct_V2_196k** and **OpenHermes-2.5**, and challenges in web UI development and model merging involving **Mistral-7b** and **MiquMaid**. The **LM Studio Discord** highlighted issues with model conversion from PyTorch to gguf, hardware setups involving **Intel Xeon CPUs** and **Nvidia P40 GPUs**, privacy concerns, and limitations in image generation and web UI availability.

Gemini Ultra is out, to mixed reviews

Fri, 09 Feb 2024 05:58:08 GMT

**Google** released **Gemini Ultra** as a paid tier for "Gemini Advanced with Ultra 1.0" following the discontinuation of Bard. Reviews noted it is "slightly faster/better than ChatGPT" but with reasoning gaps. The **Steam Deck** was highlighted as a surprising AI workstation capable of running models like Solar 10.7B. Discussions in AI communities covered topics such as multi-GPU support for OSS Unsloth, training data contamination from OpenAI outputs, ethical concerns over model merging, and new alignment techniques like Listwise Preference Optimization (LiPO). The **Mojo** programming language was praised for high-performance computing. In research, the **Subformer** model uses sandwich-style parameter sharing and SAFE for efficiency, and **BiLLM** introduced 1-bit post-training quantization to reduce resource use. The **OpenHermes** dataset viewer tool was launched, and GPU scheduling with Slurm was discussed. Fine-tuning challenges for models like **OpenHermes-2.5-Mistral-7B** and VRAM requirements were also topics of interest.

MetaVoice & RIP Bard

Wed, 07 Feb 2024 22:41:50 GMT

**Coqui**, a TTS startup that recently shut down, inspired a new **TTS model** supporting voice cloning and longform synthesis from a small startup called **MetaVoice**. **Google** discontinued the **Bard** brand in favor of **Gemini**. On **TheBloke Discord**, discussions focused on AI training with models like **Mixtral**, **Nous Mixtral DPO**, and **Miqu 70B**, comparing them to **OpenAI's GPT** models, and debated prompt engineering, lorebooks, and removing safety features via **LoRA fine-tuning** on models such as **Llama2 70B instruct**. Technical topics included transformer layer offloading limitations and adapting **LLaMa 2** for Apple Silicon. On **OpenAI Discord**, **DALL-E** images now include **C2PA metadata** for content authenticity, sparking debates on AI censorship, metadata manipulation, and open-source AI models versus commercial giants like **GPT-4**. Users discussed GPT-4 usability, limitations, and practical applications.

Qwen 1.5 Released

Tue, 06 Feb 2024 23:40:32 GMT

**Chinese AI models Yi, Deepseek, and Qwen** are gaining attention for strong performance, with **Qwen 1.5** offering up to **32k token context** and compatibility with Hugging Face transformers and quantized models. The **TheBloke Discord** discussed topics like quantization of a **70B LLM**, the introduction of the **Sparse MoE model Sparsetral** based on **Mistral**, debates on merging vs fine-tuning, and Direct Preference Optimization (DPO) for character generation. The **Nous Research AI Discord** covered challenges in Japanese Kanji generation, AI scams on social media, and Meta's VR headset prototypes showcased at **SIGGRAPH 2023**. Discussions also included fine-tuning frozen networks and new models like **bagel-7b-v0.4**, **DeepSeek-Math-7b-instruct**, and **Sparsetral-16x7B-v2**.

Less Lazy AI

Tue, 06 Feb 2024 00:50:28 GMT

The AI Discord summaries for early 2024 cover various community discussions and developments. Highlights include **20** guilds, **308** channels, and **10449** messages analyzed, saving an estimated **780 minutes** of reading time. Key topics include **Polymind Plugin Puzzle** integrating PubMed API, roleplay with **HamSter v0.2**, VRAM challenges in **Axolotl** training, fine-tuning tips for **FLAN-T5**, and innovative **model merging** strategies. The **Nous Research AI** community discussed GPT-4's lyricism issues, quantization techniques using `llama.cpp`, **frankenmerging** with models like **miqu-1-120b-GGUF**, anticipation for **Qwen2**, and tools like `text-generation-webui` and **ExLlamaV2**. The **LM Studio** community reported a bug where the app continues running after UI closure, with a workaround to forcibly terminate the process. These discussions reflect ongoing challenges and innovations in AI model training, deployment, and interaction.

The Core Skills of AI Engineering

Sun, 04 Feb 2024 00:54:29 GMT

**AI Discords for 2/2/2024** analyzed **21 guilds**, **312 channels**, and **4782 messages** saving an estimated **382 minutes** of reading time. Discussions included **Eugene Yan** initiating a deep dive into **AI engineering** challenges, highlighting overlaps between software engineering and data science skills. The **TheBloke Discord** featured talks on **MiquMaid**, **OLMo** (an open-source 65B LLM by **AI2** under Apache 2.0), **Aphrodite** model batching, **AWQ** quantization, and **LoRA** fine-tuning techniques like **QLoRA** and **LoftQ**. The **LAION Discord** discussed **SSD-1B** distillation issues, data quality optimization with captioning datasets like **BLIP**, **COCO**, and **LLaVA**, and tokenization strategies for prompt adherence in image generation. Other topics included AI security with watermarking, superconductors and carbon nanotubes for hardware, and deployment of LLMs via **Hugging Face** tools.

AI2 releases OLMo - the 4th open-everything LLM

Sat, 03 Feb 2024 03:35:10 GMT

**AI2** is gaining attention in 2024 with its new **OLMo** models, including 1B and 7B sizes and a 65B model forthcoming, emphasizing open and reproducible research akin to **Pythia**. The **Miqu-70B** model, especially the Mistral Medium variant, is praised for self-correction and speed optimizations. Discussions in **TheBloke** Discord covered programming language preferences, VRAM constraints for large models, and fine-tuning experiments with **Distilbert-base-uncased**. The **Mistral** Discord highlighted challenges in the **GPU shortage** affecting semiconductor production involving **TSMC**, **ASML**, and **Zeiss**, debates on open-source versus proprietary models, and fine-tuning techniques including **LoRA** for low-resource languages. Community insights also touched on embedding chunking strategies and JSON output improvements.

Trust in GPTs at all time low

Fri, 02 Feb 2024 03:25:24 GMT

**Discord communities** were analyzed with **21 guilds**, **312 channels**, and **8530 messages** reviewed, saving an estimated **628 minutes** of reading time. Discussions highlighted challenges with **GPTs** and the **GPT store**, including critiques of the **knowledge files capability** and context management issues. The **CUDA MODE Discord** was introduced for CUDA coding support. Key conversations in the **TheBloke Discord** covered **Xeon** GPU server cost-effectiveness, **Llama3** and **Mistral Medium** model comparisons, **LLaVA-1.6**'s visual reasoning and OCR capabilities, and the leaked **Miqu** 70B model. Technical topics included fine-tuning **TinyLlama** and **MiquMaid+Euryale** models, and model merging with examples like **Harmony-4x7B-bf16** and **Smaug-34B-v0.1**. The **Nous Research AI Discord** discussed style influence in LLMs, quantization issues, **Bittensor** incentives for AI model improvements, and the identification of **MIQU** as **Mistral Medium**. The release of the **Open Hermes 2.5 dataset** on **Hugging Face** was also announced. *"Discussions pointed towards the need for better context management in GPTs, contrasting with OpenAI's no-code approach."*

Miqu confirmed to be an early Mistral-medium checkpoint

Wed, 31 Jan 2024 23:15:13 GMT

**Miqu**, an open access model, scores **74 on MMLU** and **84.5 on EQ-Bench**, sparking debates about its performance compared to **Mistral Medium**. The **CEO of Mistral** confirmed these results. Discussions in the **TheBloke Discord** highlight **Miqu's** superiority in instruction-following and sampling methods like dynatemp and min-p. Developers also explore browser preferences and Discord UI themes. Role-playing with models like **BagelMistery Tour v2** and **Psyfighter v2** is popular, alongside technical talks on **fp16 quantization** of **Miqu-1-70b**. Training and fine-tuning tips for models like **Unsloth** and **Mistral 7B** are shared. In the **Nous Research AI Discord**, the **Activation Beacon** method is discussed for extending LLM context length from 4K to 400K tokens. **SQLCoder-70B**, fine-tuned on **CodeLlama-70B**, leads in text-to-SQL generation and is available on Hugging Face. The **Miqu model** also impresses with an **83.5 EQ-Bench score**, fueling speculation about its capabilities.

CodeLLama 70B beats GPT4 on HumanEval

Tue, 30 Jan 2024 21:10:01 GMT

**Meta AI** surprised the community with the release of **CodeLlama**, an open-source model now available on platforms like **Ollama** and **MLX** for local use. The **Miqu model** sparked debate over its origins, possibly linked to **Mistral Medium** or a fine-tuned **Llama-2-70b**, alongside discussions on **AI ethics** and alignment risks. The **Aphrodite engine** showed strong performance on **A6000 GPUs** with specific configurations. Role-playing AI models such as **Mixtral** and **Flatdolphinmaid** faced challenges with repetitiveness, while **Noromaid** and **Rpcal** performed better, with **ChatML** and **DPO** recommended for improved responses. Learning resources like fast.ai's course were highlighted for ML/DL beginners, and fine-tuning techniques with optimizers like *Paged 8bit lion* and *adafactor* were discussed. At **Nous Research AI**, the **Activation Beacon** project introduced a method for unlimited context length in LLMs using "global state" tokens, potentially transforming retrieval-augmented models. The **Eagle-7B** model, based on **RWKV-v5**, outperformed **Mistral** in benchmarks with efficiency and multilingual capabilities. **OpenHermes2.5** was recommended for consumer hardware due to its quantization methods. Multimodal and domain-specific models like **IMP v1-3b**, **Bakllava**, **Moondream**, and **Qwen-vl** were explored for classification and vision-language tasks. The community emphasized centralizing AI resources for collaborative research.

RWKV "Eagle" v5: Your move, Mamba

Tue, 30 Jan 2024 01:20:56 GMT

**RWKV v5 Eagle** was released with better-than-**mistral-7b** evaluation results, trading some English performance for multilingual capabilities. The mysterious **miqu-1-70b** model sparked debate about its origins, possibly a leak or distillation of **Mistral Medium** or a fine-tuned **Llama 2**. Discussions highlighted fine-tuning techniques, including the effectiveness of **1,000 high-quality prompts** over larger mixed-quality datasets, and tools like **Deepspeed**, **Axolotl**, and **QLoRA**. The **Nous Research AI** community emphasized the impact of **Rotary Position Embedding (RoPE) theta settings** on LLM extrapolation, improving models like **Mistral Instruct v0.2**. Speed improvements in **Mistral Tuna** kernels reduced token processing costs, enhancing efficiency. The launch of **Eagle 7B** with 7.52B parameters showcased strong multilingual performance, surpassing other 7B class models.

GPT4Turbo A/B Test: gpt-4-0125-preview

Fri, 26 Jan 2024 22:48:31 GMT

**OpenAI** released a new **GPT-4 Turbo** version in January 2024, prompting natural experiments in summarization and discussions on API performance and cost trade-offs. The **TheBloke** Discord highlighted **UnSloth's** upcoming limited multi-GPU support for Google Colab beginners, AI models like **Tiny Llama** and **Mistral** running on Nintendo Switch, and advanced model merging techniques such as DARE and SLERP. The **OpenAI** Discord noted issues with **GPT-4-1106-preview** processing delays, troubleshooting GPT model errors, and transcription challenges with **GPT-3.5** and **GPT-4 Turbo**. **Nous Research AI** focused on extending context windows, notably **LLaMA-2-7B-Chat** reaching **16,384** tokens, and fine-tuning alternatives like **SelfExtend**. Discussions also touched on chatbot persona creation, model configuration optimizations, and societal impacts of AI technology.

GPT4Turbo A/B Test: gpt-4-1106-preview

Fri, 26 Jan 2024 22:07:42 GMT

**OpenAI** released a new **GPT-4 Turbo** version, prompting a natural experiment in summarization comparing the November 2023 and January 2024 versions. The **TheBloke** Discord discussed troubleshooting model loading errors with **OpenHermes-2.5-Mistral-7B-4.0bpw** and **exllamav2**, debates on **RHEL** in ML, dataset generation for understanding GPT flaws, and running LLMs like **Llama** and **Mistral** on consoles. **LangChain** fine-tuning challenges for **Llama2** were also noted. The **OpenAI** Discord highlighted **GPT-4** speed inconsistencies, API vs web performance, prompt engineering with **GPT-3.5** and **GPT-4 Turbo**, and **DALL-E** typo issues in image text. Discussions included NLP tools like *semantic-text-splitter* and collaboration concerns with **GPT-4 Vision** on **Azure**. The **Nous Research AI** Discord focused on extending context windows with **Mistral instruct v0.2**, **MistralLite**, and **LLaMA-2-7B-Chat** achieving 16,384 token context, plus alternatives like **SelfExtend** for context extension without fine-tuning. The societal impact of AI technology was also considered.

Adept Fuyu-Heavy: Multimodal model for Agents

Thu, 25 Jan 2024 21:30:23 GMT

**Adept** launched **Fuyu-Heavy**, a multimodal model focused on UI understanding and visual QA, outperforming **Gemini Pro** on the MMMU benchmark. The model uses **DPO** (Direct Preference Optimization), gaining attention as a leading tuning method. The size of Fuyu-Heavy is undisclosed but estimated between **20B-170B** parameters, smaller than rumored frontier models like **Claude 2**, **GPT4V**, and **Gemini Ultra**. Meanwhile, **Mamba** was rejected at ICLR for quality concerns. In Discord discussions, **DeepSeek Coder 33B** was claimed to outperform **GPT-4** in coding tasks, and deployment strategies for large models like **Yi-34B-200K** and **Goliath-120B** were explored. Quantization debates highlighted mixed views on **Q8** and **EXL2 quants**. Fine-tuning and instruct-tuning of **Mistral 7B Instruct v0.2** were discussed, alongside insights on RMS optimization and heterogeneous AI architectures combining **Transformers** and **Selective SSM (Mamba)**. The potential of recurrent LLMs like **RWKV** and techniques like **Contrastive Preference Optimization (CPO)** were also noted.

Google Solves Text to Video

Thu, 25 Jan 2024 05:36:26 GMT

**Google Research** introduced **Lumiere**, a text-to-video model featuring advanced inpainting capabilities using a Space-Time diffusion process, surpassing previous models like Pika and Runway. Manveer from UseScholar.org compiled a comprehensive list of code evaluation benchmarks beyond HumanEval, including datasets from **Amazon Science**, **Hugging Face**, and others. Discord communities such as **TheBloke** discussed topics including running **Mistral-7B** via API, GPU rentals, and multimodal model integration with **LLava**. **Nous Research AI** highlighted learning rate strategies for LLM fine-tuning, issues with inference, and benchmarks like HumanEval and MBPP. **RestGPT** gained attention for controlling applications via RESTful APIs, showcasing LLM application capabilities.

RIP Latent Diffusion, Hello Hourglass Diffusion

Wed, 24 Jan 2024 01:38:15 GMT

**Katherine Crowson** from **Stable Diffusion** introduces a hierarchical pure transformer backbone for diffusion-based image generation that efficiently scales to megapixel resolutions with under 600 million parameters, improving upon the original ~900M parameter model. This architecture processes local and global image phenomena separately, enhancing efficiency and resolution without latent steps. Additionally, Meta's Self Rewarding LM paper has inspired **lucidrains** to begin an implementation. Discord summaries highlight GPT-4's robustness against quantification tricks, discussions on open-source GPT-0 alternatives, challenges in DPO training on limited VRAM with suggestions like QLoRA and rmsprop, and efforts to improve roleplay model consistency through fine-tuning and merging. Philosophical debates on AI sentience and GPT-4 customization for markdown and translation tasks were also noted.

Nightshade poisons AI art... kinda?

Mon, 22 Jan 2024 21:09:56 GMT

Over the weekend of **1/19-20/2024**, discussions in **TheBloke Discord** covered key topics including **Mixture of Experts (MoE)** model efficiency, GPU parallelism, and quantization strategies. Users debated the effectiveness of AI detection tools like **GPTZero** and explored fine-tuning challenges with models such as **Mistral 7B** and **Falcon 7B**. Community interest was strong in developing simpler, community-powered quantization services and understanding model merging techniques. Ethical considerations around AI applications like AI girlfriend sites were also discussed.

Sama says: GPT-5 soon

Mon, 22 Jan 2024 20:51:23 GMT

**Sam Altman** at Davos highlighted that his top priority is launching the new model, likely called **GPT-5**, while expressing uncertainty about **Ilya Sutskever**'s employment status. **Itamar from Codium** introduced the concept of **Flow Engineering** with **AlphaCodium**, gaining attention from **Andrej Karpathy**. On the **TheBloke Discord**, engineers discussed a **multi-specialty mixture-of-experts (MOE) model** combining seven distinct 7 billion parameter models specialized in law, finance, and medicine. Debates on **8-bit fine-tuning** and the use of **bitsandbytes** with GPU support were prominent. Discussions also covered **model merging** using tools like **Mergekit** and compatibility with **Alpaca format**. Interest in optimizing AI models on **AMD** hardware using **AOCL blas and lapack libraries** with **llama.cpp** was noted. Users experimented with AI for command line tasks, and the **Mixtral MoE model** was refined to surpass larger models in coding ability. Comparisons among LLMs such as **GPT-3.5**, **Mixtral**, **Gemini Pro**, and **GPT-4** focused on knowledge depth, problem-solving, and speed, especially for coding tasks.

1/17/2024: Help crowdsource function calling datasets

Thu, 18 Jan 2024 21:20:01 GMT

**LM Studio** updated its FAQ clarifying its **closed-source** status and perpetual freeness for personal use with no data collection. The new beta release includes fixes and hints at upcoming **2-bit quantization** support. For gaming, models like **Dolphin 2.7 Mixtral 8x7B**, **MegaDolphin**, and **Dolphin 2.6 Mistral 7B DPO** with **Q4_K_M** quantization were recommended. Discussions highlighted that single powerful GPUs outperform multi-GPU setups due to bottlenecks, with older GPUs like Tesla P40 being cost-effective. **Microsoft's AutoGen Studio** was introduced but has issues and requires **API fees** for open-source models. Linux users are advised to use **llama.cpp** over LM Studio due to lack of headless mode. Additional tools like **LLMFarm** for iOS and various Hugging Face repositories were also mentioned. *"LM Studio must be running to use the local inference server as there is no headless mode available"* and *"matching model size to GPU memory is key for performance"* were notable points.

1/16/2024: ArtificialAnalysis - a new model/host benchmark site

Wed, 17 Jan 2024 22:14:53 GMT

**Artificial Analysis** launched a new models and hosts comparison site, highlighted by **swyx**. **Nous Research AI** Discord discussed innovative summarization techniques using **NVIDIA 3090 and 2080ti GPUs** for processing around **100k tokens**, and adapting prompts for smaller models like **OpenChat 7B**. The availability of **Hermes 2 Mixtral** on **Huggingface's HuggingChat** was noted, alongside fine-tuning challenges with **Mixtral** using Axolotl. Discussions included byte-level tokenization experiments with **Byte Mistral**, multimodal training on **COCO image bytes**, and inference speed improvements using **vllm** and **llama.cpp**. Calls for transparency in data sharing and open-sourcing the **Hermes 2 Mixtral** dataset were emphasized, with comparisons of **dpo** and **sft** methods and quantized LLM use on **M1 MacBook Pro**.

1/16/2024: TIES-Merging

Tue, 16 Jan 2024 20:51:01 GMT

**TheBloke's Discord** community actively discusses **Mixture of Experts (MoE) models**, focusing on **random gate routing layers** for training and the challenges of immediate model use. There is a robust debate on **quantization methods**, comparing **GPTQ** and **EXL2 quants**, with EXL2 noted for faster execution on specialized hardware. A new model, **Nous Hermes 2**, based on **Mixtral 8x7B** and trained with **RLHF**, claims benchmark superiority but shows some inconsistencies. The **Frontier supercomputer** at Oak Ridge National Laboratory is highlighted for training a **trillion-parameter LLM** with **14TB RAM**, sparking discussions on open-sourcing government-funded AI research. Additionally, the application of **ghost attention** in the **academicat** model is explored, with mixed reactions from the community. *"Random gate layer is good for training but not for immediate use,"* and *"EXL2 might offer faster execution on specialized hardware,"* are key insights shared.

1/13-14/2024: Don't sleep on #prompt-engineering

Tue, 16 Jan 2024 00:58:42 GMT

The **OpenAI** Discord community engaged in diverse discussions including **prompt engineering** techniques like contrastive Chain of Thought and step back prompting, and explored **model merging** and **mixture-of-experts (MoE)** concepts. Philosophical debates on **AI consciousness** and the ethics of **AI-generated voices** highlighted concerns about AI sentience and copyright issues. Technical clarifications were made on **hyperdimensional vector space models** used in modern AI embeddings. Users also discussed **customizing GPT** with personality profiles and prompt personalization to overcome token limits, and proposed a **universal translator** feature for multilingual Discord interactions. Key contributors included longtime regular MadameArchitect and community members such as @darthgustav and @metaldrgn.

1/12/2024: Anthropic coins Sleeper Agents

Sat, 13 Jan 2024 22:06:35 GMT

**Anthropic** released a new paper exploring the persistence of deceptive alignment and backdoors in models through stages of training including supervised fine-tuning and reinforcement learning safety training. The study found that safety training and adversarial training did not eliminate backdoors, which can cause models to write insecure code or exhibit hidden behaviors triggered by specific prompts. Notable AI figures like **leo gao** and **andrej-karpathy** praised the work, highlighting its implications for future model security and the risks of sleeper agent LLMs. Additionally, the **Nous Research AI** Discord community discussed topics such as the trade-off between security and convenience, the **Hulk Dataset 0.1** for LLM fine-tuning, curiosity about a **120B model** and **Nous Mixtral**, debates on LLM leaderboard legitimacy, and the rise of Frankenmerge techniques for model merging and capacity enhancement.

1/11/2024: Mixing Experts vs Merging Models

Fri, 12 Jan 2024 18:49:15 GMT

**18 guilds**, **277 channels**, and **1342 messages** were analyzed with an estimated reading time saved of **187 minutes**. The community switched to **GPT-4 turbo** and discussed the rise of **Mixture of Experts (MoE) models** like **Mixtral**, **DeepSeekMOE**, and **Phixtral**. Model merging techniques, including naive linear interpolation and "frankenmerges" by **SOLAR** and **Goliath**, are driving new performance gains on open leaderboards. Discussions in the **Nous Research AI Discord** covered topics such as AI playgrounds supporting prompt and RAG parameters, security concerns about third-party cloud usage, debates on Discord bots and TOS, skepticism about **Teenage Engineering's** cloud LLM, and performance differences between **GPT-4 0613** and **GPT-4 turbo**. The community also explored fine-tuning strategies involving **DPO**, **LoRA**, and safetensors, integration of RAG with API calls, semantic differences between MoE and dense LLMs, and data frameworks like **llama index** and **SciPhi-AI's synthesizer**. Issues with anomalous characters in fine-tuning were also raised.

1/10/2024: All the best papers for AI Engineers

Thu, 11 Jan 2024 08:35:15 GMT

**OpenAI** launched the **GPT Store** featuring over **3 million** custom versions of **ChatGPT** accessible to Plus, Team, and Enterprise users, with weekly highlights of impactful GPTs like **AllTrails**. The new **ChatGPT Team** plan offers advanced models including **GPT-4** and **DALL·E 3**, alongside collaborative tools and enhanced data privacy. Discussions around AI-generated imagery favored **DALL·E** and **Stable Diffusion**, while users faced rate limit challenges and debated the GPT Store's SEO and categorization. Ethical considerations in prompt engineering were raised with a three-layer framework called 'The Sieve'. Additionally, **DeepSeek-MoE** was noted for its range of Mixture of Experts (MoE) model sizes. *"The Sieve," a three-layer ethical framework for AI,* was highlighted in prompt engineering discussions.

1/9/2024: Nous Research lands $5m for Open Source AI

Thu, 11 Jan 2024 00:53:13 GMT

**Nous Research** announced a **$5.2 million seed financing** focused on **Nous-Forge**, aiming to embed transformer architecture into chips for powerful servers supporting real-time voice agents and **trillion parameter models**. **Rabbit R1** launched a demo at CES with mixed reactions. **OpenAI** shipped the **GPT store** and briefly leaked an upcoming personalization feature. A new paper on **Activation Beacon** proposes a solution to extend LLMs' context window significantly, with code to be released on GitHub. Discussions also covered **QLORA**, **fine-tuning**, **synthetic data**, and **custom architectures** for LLMs.

1/8/2024: The Four Wars of the AI Stack

Tue, 09 Jan 2024 07:39:51 GMT

The **Nous Research AI Discord** discussions highlighted several key topics including the use of **DINO**, **CLIP**, and **CNNs** in the **Obsidian Project**. A research paper on distributed models like **DistAttention** and **DistKV-LLM** was shared to address cloud-based **LLM** service challenges. Another paper titled 'Self-Extend LLM Context Window Without Tuning' argued that existing **LLMs** can handle long contexts inherently. The community also discussed AI models like **Mixtral**, favored for its **32k context window**, and compared it with **Mistral** and **Marcoroni**. Other topics included hierarchical embeddings, agentic retrieval-augmented generation (**RAG**), synthetic data for fine-tuning, and the application of **LLMs** in the oil & gas industry. The launch of the **AgentSearch-V1** dataset with one billion embedding vectors was also announced. The discussions covered **mixture-of-experts (MoE)** implementations and the performance of smaller models.

1/6-7/2024: LlaMA Pro - an alternative to PEFT/RAG??

Mon, 08 Jan 2024 00:51:41 GMT

New research papers introduce promising **Llama Extensions** including **TinyLlama**, a compact **1.1B** parameter model pretrained on about **1 trillion tokens** for 3 epochs, and **LLaMA Pro**, an **8.3B** parameter model expanding **LLaMA2-7B** with additional training on **80 billion tokens** of code and math data. LLaMA Pro adds layers to avoid catastrophic forgetting and balances language and code tasks but faces scrutiny for not using newer models like **Mistral** or **Qwen**. Meanwhile, **OpenAI** Discord discussions reveal insights on **GPT-4** token limits, privacy reassurances, fine-tuning for GPT-3.5, challenges with multi-language image recognition, custom GPT creation requiring **ChatGPT Plus**, and security concerns in GPT deployment. Users also share tips on dynamic image generation with **DALL-E** and logo creation.

1/4/2024: Jeff Bezos backs Perplexity's $520m Series B.

Fri, 05 Jan 2024 08:29:59 GMT

**Perplexity** announced their **Series B** funding round with notable investor **Jeff Bezos**, who previously invested in **Google** 25 years ago. **Anthropic** is raising **$750 million**, projecting at least **$850 million in annualized revenue** next year and implementing "brutal" changes to their Terms of Service. Discussions in **Nous Research AI Discord** cover topics such as **document recall limits from gigabytes of data**, **RNN memory and compute trade-offs**, **synthetic datasets**, and benchmarking of models like **WizardCoder-33B-V1.1**, **MobileLLaMA-1.4B-Base**, **ShearedLLaMA**, and **TinyLLaMA**. Other highlights include **UnsLOTH** optimizations for multi-GPU systems, **AI rap voice models**, **context-extending code**, and architectural innovations like applying **Detectron/ViT backbones to LLMs**, **sliding window attention** in **Mistral**, and parallelizing **Mixtral 8x7b** with **FSDP** and **HF Accelerate**.

1/3/2024: RIP Coqui

Thu, 04 Jan 2024 06:56:46 GMT

**Coqui**, a prominent open source text-to-speech project from the Mozilla ML group, officially shut down. Discussions in the **HuggingFace** Discord highlighted skepticism about the claimed `3X faster` speed of **sdxl**, attributing improvements more to techniques like `torch.compile` and removal of `fp16` and `attention` rather than **diffusers 0.25** features. Users confirmed that a *HuggingFace user token* can be used across multiple machines, though distinct tokens are recommended for safety. The **Learning Loss Minimization (LLM) Leaderboard** briefly experienced issues but was later confirmed operational. A Kaggle notebook was shared demonstrating how to build Transformer architectures from scratch using PyTorch. Additionally, a new image dataset with 15k shoe, sandal, and boot images was introduced for multiclass classification tasks. Explanations about the workings of the Common Crawl web-crawling process were also shared.

1/2/2024: Smol tweaks to Smol Talk

Wed, 03 Jan 2024 07:38:24 GMT

**OpenAI** Discord discussions highlight a detailed comparison of AI search engines including **Perplexity**, **Copilot**, **Bard**, and **Claude 2**, with Bard and Claude 2 trailing behind. **Meta AI** chatbot by Meta is introduced, available on Instagram and Whatsapp, featuring image generation likened to a free GPT version. Users report multiple browser issues with **ChatGPT**, including persistent captchas when using VPNs and plugin malfunctions. Debates cover prompt engineering, API usage, and data formats like **JSON**, **YAML**, and **Markdown**. Discussions also touch on ChatGPT's personality tuning and model capability variations. *"Meta AI includes an image generation feature, which he likened to a free version of GPT."*

1/1/2024: How to start with Open Source AI

Wed, 03 Jan 2024 07:23:06 GMT

**OpenAI Discord** discussions revealed mixed sentiments about **Bing's AI** versus **ChatGPT** and **Perplexity AI**, and debated **Microsoft Copilot's** integration with **Office 365**. Users discussed **DALL-E 3** access within **ChatGPT Plus**, **ChatGPT's performance issues**, and ways to train a **GPT model** using book content via **OpenAI API** or custom GPTs. Anticipation for **GPT-4 turbo** in **Microsoft Copilot** was noted alongside conversations on **AI reasoning**, **prompt engineering**, and overcoming **Custom GPT** glitches. Advice for AI beginners included starting with **Python** and using YAML or Markdown for knowledge integration. The future of AI with multiple specialized GPTs and **Microsoft Copilot's** role was also explored.

12/31/2023: Happy New Year

Mon, 01 Jan 2024 05:33:14 GMT

**LM Studio** community discussions highlight variations and optimizations in **Dolphin** and **Mistral 7b** models, focusing on hardware-software configurations and GPU vRAM impact on processing speed. Challenges with **Mixtral** model deployment on local machines and workarounds for downloading models from **HuggingFace** in restricted regions were addressed. Users explored enhancing AI's emotional intelligence and personalities through extended prompts, referencing research on emotional stimuli in large language models. The community also discussed hardware setups for budget AI compute servers, integration issues with **ChromaDB** and **Autogen**, and shared positive feedback on LM Studio's usability and UI. Celebrations for the New Year added a social touch to the guild interactions.

12/30/2023: Mega List of all LLMs

Sun, 31 Dec 2023 10:23:31 GMT

**Stella Biderman**'s tracking list of **LLMs** is highlighted, with resources shared for browsing. The **Nous Research AI** Discord discussed the **Local Attention Flax** module focusing on computational complexity, debating linear vs quadratic complexity and proposing chunking as a solution. Benchmark logs for various LLMs including **Deita v1.0** with its **SFT+DPO** training method were shared. Discussions covered model merging, graded modal types, function calling in AI models, and data contamination issues in **Mixtral**. Community insights were sought on **Amazon Titan Text Express** and **Amazon Titan Text Lite** LLMs, including a unique training strategy involving bad datasets. Several GitHub repositories and projects like **DRUGS**, **MathPile**, **CL-FoMo**, and **SplaTAM** were referenced for performance and data quality evaluations.

12/29/2023: TinyLlama on the way

Sat, 30 Dec 2023 11:06:56 GMT

The **Nous/Axolotl community** is pretraining a **1.1B model on 3 trillion tokens**, showing promising results on **HellaSwag** for a small 1B model. The **LM Studio Discord** discussions cover extensive **GPU-related issues**, **Discord bot integration** with the **OpenAI API**, and **hardware limitations** affecting model usage. Community members also discuss **server hosting** for embeddings and LLMs, propose updates for **Discord channels** to improve model development collaboration, and address a **gibberish problem** in beta releases. The **Autogen** tool's installation and operational challenges are also clarified by users.

12/28/2023: Smol Talk updates

Fri, 29 Dec 2023 10:32:18 GMT

**Nous Research AI** Discord discussions covered topics such as AI placement charts, **ChatGPT**'s issues with Latex math format compatibility with Obsidian, and performance metrics of the **TinyLlama 1.1B** model on various benchmarks. Users shared resources including the math-centric corpus **MathPile**, knowledge graph building methods, and open-source large language model repositories. Technical discussions included decentralized computation feasibility for models like **Mixtral**, philosophical debates on AI sentience, and strategies for model finetuning and token counting. The community also discussed the **Obsidian** model, vision model training, and the release of the multimodal **TinyGPT-V** model by Tyrannosaurus. *"ChatGPT not generating Latex math format compatible with Obsidian"* and *"optimistic about human-level AI within our lifetime"* were notable quotes.

12/27/2023: NYT vs OpenAI

Fri, 29 Dec 2023 10:14:01 GMT

The LM Studio Discord community extensively discussed **model performance** comparisons, notably between **Phi2** by **Microsoft Research** and **OpenHermes 2.5 Mistral 7b**, with focus on **U.S. history knowledge** and fine-tuning for improved accuracy. Technical challenges around **LLM API** usage, conversation history maintenance, and **GPU optimization** for inference speed were addressed. Hardware discussions covered **DDR4 vs DDR5**, multi-GPU setups, and potential of **Apple M1/M3** and **AMD AI CPUs** for AI workloads. The community also announced the **ChromaDB Plugin v3.0.2** release enabling image search in vector databases. Users shared practical tips on running multiple LM Studio instances and optimizing resource usage.

12/26/2023: not much happened today

Fri, 29 Dec 2023 10:07:18 GMT

**LM Studio** users extensively discussed its performance, installation issues on macOS, and upcoming features like **Exllama2 support** and multimodality with the **Llava model**. Conversations covered **GPU offloading**, **vRAM utilization**, **MoE model expert selection**, and **model conversion compatibility**. The community also addressed **inefficient help requests** referencing the blog 'Don't Ask to Ask, Just Ask'. Technical challenges with **ChromaDB Plugin**, **server vs desktop hardware performance**, and **saving model states with Autogen** were highlighted. Discussions included comparisons with other chatbots and mentions of **AudioCraft** from **meta-ai-fair** and **MusicLM** from **google-deepmind** for music generation.

12/25/2023: Nous Hermes 2 Yi 34B for Christmas

Tue, 26 Dec 2023 07:45:27 GMT

**Teknium** released **Nous Hermes 2** on **Yi 34B**, positioning it as a top open model compared to **Mixtral**, **DeepSeek**, and **Qwen**. **Apple** introduced **Ferret**, a new open-source multimodal LLM. Discussions in the **Nous Research AI Discord** focused on **AI model optimization** and **quantization** techniques like **AWQ**, **GPTQ**, and **AutoAWQ**, with insights on proprietary optimization and throughput metrics. Additional highlights include the addition of **NucleusX Model** to **transformers**, a **30B model with 80 MMLU**, and the **YAYI 2** language model by **Wenge Technology** trained on **2.65 trillion tokens**. *"AutoAWQ outperforms vLLM up to batch size 8"* was noted, and proprietary parallel decoding and tensor parallelization across GPUs were discussed for speed improvements.

12/24/2023: Dolphin Mixtral 8x7b is wild

Tue, 26 Dec 2023 07:23:04 GMT

**Mistral** models are recognized for being uncensored, and Eric Hartford's **Dolphin** series applies uncensoring fine-tunes to these models, gaining popularity on Discord and Reddit. The **LM Studio** Discord community discusses various topics including hardware compatibility, especially GPU performance with Nvidia preferred, fine-tuning and training models, and troubleshooting issues with LM Studio's local model hosting capabilities. Integration efforts with **GPT Pilot** and a beta release for ROCm integration are underway. Users also explore the use of **Autogen** for group chat features and share resources like the **Ollama** NexusRaven library. Discussions highlight challenges with running LM Studio on different operating systems, model performance issues, and external tools like **Google Gemini** and **ChatGLM3** compilation.

12/23/2023: NeurIPS Best Papers of 2023

Sun, 24 Dec 2023 07:45:58 GMT

The **Latent Space Pod** released a **3-hour recap** of the **best NeurIPS 2023 papers**. The **Nous Research AI Discord** community discussed **optimizing AI performance** with shorter context lengths, **malware security concerns** linked to **HuggingFace**, and shared insights on **video and music content**. Technical discussions included the **DYAD research paper** proposing a faster alternative to linear layers, **Apple's ML Ferret** machine learning tool, and accessing **PALM2** via API. The community also explored **Large Language Models** focusing on specialized models, data scaling, embedding/vector databases, model merging, and interpretability, with mentions of **Hermes 2.5**, **GPT-4**, and **Mistral**. Additionally, there were conversations on the **Striped Hyena Architecture**, **quantization challenges**, and fixes related to **RMSNorm** and the **"Attention is All You Need"** paper.

12/22/2023: Anyscale's Benchmark Criticisms

Sat, 23 Dec 2023 01:16:52 GMT

**Anyscale** launched their **LLMPerf leaderboard** to benchmark large language model inference performance, but it faced criticism for lacking detailed metrics like cost per token and throughput, and for comparing public LLM endpoints without accounting for batching and load. In **OpenAI Discord** discussions, users reported issues with **Bard** and preferred **Microsoft Copilot** for storytelling, noting fewer hallucinations. There was debate on the value of upgrading from **GPT-3.5** to **GPT-4**, with many finding paid AI models worthwhile for coding productivity. Bugs and performance issues with OpenAI APIs were also highlighted, including slow responses and message limits. Future AI developments like **GPT-6** and concerns about OpenAI's transparency and profitability were discussed. Prompt engineering for image generation was another active topic, emphasizing clear positive prompts and the desire for negative prompts.

12/21/2023: The State of AI (according to LangChain)

Fri, 22 Dec 2023 00:20:28 GMT

**LangChain** launched their first report based on **LangSmith** stats revealing top charts for mindshare. On **OpenAI**'s Discord, users raised issues about the **Mixtral model**, noting inconsistencies and comparing it to **Poe's Mixtral**. There were reports of declining output quality and unpredictable behavior in **GPT-4** and **ChatGPT**, with discussions on differences between **Playground GPT-4** and **ChatGPT GPT-4**. Users also reported anomalous behavior in **Bing** and **Bard AI** models, including hallucinations and strange assertions. Various user concerns included message limits on GPT-4, response completion errors, chat lags, voice setting inaccessibility, password reset failures, 2FA issues, and subscription restrictions. Techniques for guiding GPT-4 outputs and creative uses with **DALL-E** were also discussed. *Users highlighted financial constraints affecting subscriptions and queries about earning with ChatGPT and token costs.*

12/20/2023: Project Obsidian - Multimodal Mistral 7B from Nous

Thu, 21 Dec 2023 03:20:57 GMT

**Project Obsidian** is a multimodal model being trained publicly, tracked by **Teknium** on the Nous Discord. Discussions include **4M: Massively Multimodal Masked Modeling** and **Reason.dev**, a TypeScript framework for LLM applications. The **OpenAI Discord** community discussed hardware specs for running **TensorFlow JS** for image detection, security API ideas for filtering inappropriate images, and concerns about racial and cultural bias in AI, especially in facial recognition and healthcare. Challenges with **GPT-3.5** and **GPT-4** in word puzzle games were noted, along with GPU recommendations prioritizing VRAM for AI inference. Users also debated **GPT-4**'s vision capabilities, limitations of **DALL·E 3**, platform access issues, and prompting strategies for better outputs.

12/19/2023: Everybody Loves OpenRouter

Wed, 20 Dec 2023 08:10:20 GMT

**OpenRouter** offers an easy OpenAI-compatible proxy for **Mixtral-8x7b-instruct**. Discord discussions highlight **GPT-4** performance and usability issues compared to **GPT-3.5**, including memory management and accessibility problems. Users debate local language models versus OpenAI API usage, with mentions of **Dolphin 2.0 Mistral 7B** and **Google's video generation project**. Prompt engineering and custom instructions for GPT models are also key topics. Concerns about censorship on models like **Gemini** and translation tool preferences such as **DeepL** were discussed.

12/18/2023: Gaslighting Mistral for fun and profit

Tue, 19 Dec 2023 03:35:50 GMT

**OpenAI** Discord discussions reveal comparisons among language models including **GPT-4 Turbo**, **GPT-3.5 Turbo**, **Claude 2.1**, **Claude Instant 1**, and **Gemini Pro**, with **GPT-4 Turbo** noted for user-centric explanations. Rumors about **GPT-4.5** remain unconfirmed, with skepticism prevailing until official announcements. Users discuss technical challenges like slow responses and API issues, and explore role-play prompt techniques to enhance model performance. Ethical concerns about AI's impact on academia and employment are debated. Future features for **Dalle 3** and a proposed new GPT model are speculated upon, while a school project seeks help using the **OpenAI API**. The community also touches on AI glasses and job market implications of AI adoption.

12/16/2023: ByteDance suspended by OpenAI

Sat, 16 Dec 2023 19:41:52 GMT

The OpenAI Discord community discussed hardware options like **Mac racks** and the **A6000 GPU**, highlighting their value for AI workloads. They compared **Claude 2.1** and **GPT 4 Turbo** on coding tasks, with **GPT 4 Turbo** outperforming Claude 2.1. The benefits of the **Bard API** for **gemini pro** were noted, including a free quota of **60 queries per minute**. Users shared experiences with **ChatGPT Plus** membership issues, payment problems, and speculated about the upcoming **GPT-5** and the rumored **GPT-4.5**. Discussions also covered the confidentiality of the **Alpha feature**, AI art generation policies, and improvements in organizational work features. The community expressed mixed feelings about GPT-4's performance and awaited future model updates.

12/15/2023: Mixtral-Instruct beats Gemini Pro (and matches GPT3.5)

Fri, 15 Dec 2023 22:33:20 GMT

Thanks to a **karpathy** shoutout, **lmsys** now has enough data to rank **mixtral** and **gemini pro**. The discussion highlights the impressive performance of these state-of-the-art open-source models that can run on laptops. In the **openai** Discord, users compared AI tools like **perplexity** and **chatgpt's browsing tool**, favoring Perplexity for its superior data gathering, pricing, and usage limits. Interest was shown in AI's ability to convert large code files with **deepseek coder** recommended. Debates on privacy implications for AI advancement and challenges of running LLMs on local and cloud GPUs were prominent. Users reported issues with **chatgpt** including performance problems, loss of access to custom GPTs, and unauthorized access. Discussions also covered prompt engineering for large context windows and speculations about **gpt-4.5** and **gpt-4** future developments.

12/14/2023: $1e7 for Superalignment

Thu, 14 Dec 2023 22:51:28 GMT

**Jan Leike** is launching a new grant initiative inspired by **Patrick Collison's Fast Grants** to support AI research. **OpenAI** introduced a new developers Twitter handle @OpenAIDevs for community updates. Discussions on **OpenAI's Gemini** and **Bard** chatbots highlight their ability to read each other's instructions and offer unique coding solutions. Users reported various issues with **GPT-4**, including performance problems, customization difficulties, and a resolved bug in image recognition. There are ongoing conversations about **prompt engineering** challenges and new **JSON mode support** in Convo-lang for API use. Concerns about misuse of chatbots for illegal activities and alternatives like **Llama2** models and the **Perplexity chatbot** were also discussed.

12/13/2023 SOLAR10.7B upstages Mistral7B?

Wed, 13 Dec 2023 23:29:29 GMT

**Upstage** released the **SOLAR-10.7B** model, which uses a novel Depth Up-Scaling technique built on the **llama-2** architecture and integrates **mistral-7b** weights, followed by continued pre-training. The **Nous** community finds it promising but not exceptional. Additionally, weights for the **phi-2** base model were released, trained on **1.4 trillion tokens** including synthetic texts created by GPT-3 and filtered by GPT-4, using **96 A100 GPUs** over 14 days. On **OpenAI's** Discord, users discussed challenges with various **GPT** models, including incoherent outputs, API usage limitations, and issues with **GPT-4 Vision API**. Conversations also covered understanding **AGI** and **ASI**, concerns about OpenAI's partnership with Axel Springer, and pricing changes for GPT Plus. Discussions included the **Gemini** chat model integrated into Bard and comparisons with GPT-4 performance.

12/12/2023: Towards LangChain 0.1

Wed, 13 Dec 2023 03:45:12 GMT

The **Langchain rearchitecture** has been completed, splitting the repo for better maintainability and scalability, while remaining backwards compatible. **Mistral** launched a new Discord community, and **Anthropic** is rumored to be raising another **$3 billion**. On the **OpenAI Discord**, discussions covered **information leakage** in AI training, **mixture of experts (MoE) models** like **mixtral 8x7b**, advanced **prompt engineering techniques**, and issues with **ChatGPT** performance and API access. Users also explored AI applications in **logo generation**, **education**, and **gaming**, and shared solutions for **Oauth2 authentication** problems. A new small language model named **Phi-2** was mentioned from **Microsoft**.

12/11/2023: Mixtral beats GPT3.5 and Llama2-70B

Mon, 11 Dec 2023 20:11:07 GMT

**Mistral AI** announced the **Mixtral 8x7B** model featuring a Sparse Mixture of Experts (SMoE) architecture, sparking discussions on its potential to rival **GPT-4**. The community debated GPU hardware options for training and fine-tuning transformer models, including **RTX 4070s**, **A4500**, **RTX 3090s with nvlink**, and **A100 GPUs**. Interest was expressed in fine-tuning Mixtral and generating quantized versions, alongside curating high-quality coding datasets. Resources shared include a YouTube video on open-source model deployment, an Arxiv paper, GitHub repositories, and a blog post on Mixture-of-Experts. Discussions also touched on potential open-source releases of **GPT-3.5 Turbo** and **llama-3**, and running **OpenHermes 2.5** on Mac M3 Pro with VRAM considerations.

12/10/2023: not much happened today

Sun, 10 Dec 2023 23:49:57 GMT

**Nous Research AI** Discord community discussed attending **NeurIPS** and organizing future AI events in Australia. Highlights include interest in open-source and decentralized AI projects, with **Richard Blythman** seeking co-founders. Users shared projects like **Photo GPT AI** and introduced **StableLM Zephyr 3B**. The **Mixtral** model, based on **Mistral**, sparked debate on performance and GPU requirements, with comparisons to **GPT-3.5** and potential competitiveness with **GPT-4** after fine-tuning. Tools like **Tensorboard**, **Wandb**, and **Llamahub** were noted for fine-tuning and evaluation. Discussions covered **Mixture of Experts (MoE)** architectures, fine-tuning with limited data, and inference optimization strategies for ChatGPT. Memes and community interactions referenced AI figures like **Andrej Karpathy** and **Yann LeCun**. The community also shared resources such as GitHub links and YouTube videos related to these models and tools.

12/9/2023: The Mixtral Rush

Sat, 09 Dec 2023 23:30:00 GMT

**Mixtral's weights** were released without code, prompting the **Disco Research community** and **Fireworks AI** to implement it rapidly. Despite efforts, no significant benchmark improvements were reported, limiting its usefulness for local LLM usage but marking progress for the **small models community**. Discussions in the DiscoResearch Discord covered **Mixtral's performance** compared to models like **Hermes 2.5** and **Hermes 2**, with evaluations on benchmarks such as **winogrande**, **truthfulqa_mc2**, and **arc_challenge**. Technical topics included GPU requirements, multi-GPU setups, and quantization via **GPTQ**. Benchmarking strategies like grammar-based evaluation, chain of thought (CoT), and min_p sampling were explored, alongside model sampling techniques like Min P and Top P to enhance response stability and creativity. Users also discussed GPTs' learning limitations and the adaptability of models under varying conditions, emphasizing min_p sampling's role in enabling higher temperature settings for creativity.

12/8/2023 - Mamba v Mistral v Hyena

Fri, 08 Dec 2023 22:40:04 GMT

Three new AI models are highlighted: **Mistral's 8x7B MoE model (Mixtral)**, **Mamba models** up to 3B by Together, and **StripedHyena 7B**, a competitive subquadratic attention model from Stanford's Hazy Research. Discussions on **Anthropic's Claude 2.1** focus on its prompting technique and alignment challenges. The **Gemini AI** from Google is noted as potentially superior to **GPT-4**. The community also explores **Dreambooth** for image training and shares resources like the **DialogRPT-human-vs-machine** model on Hugging Face. Deployment challenges for large language models, including CPU performance and GPU requirements, are discussed with references to **Falcon 180B** and transformer batching techniques. User engagement includes meme sharing and humor.

12/7/2023: Anthropic says "skill issue"

Thu, 07 Dec 2023 20:49:01 GMT

**Anthropic** fixed a glitch in their **Claude 2.1** model's needle in a haystack test by adding a prompt. Discussions on **OpenAI's** Discord compared **Google's Gemini Pro and Gemini Ultra** models with **OpenAI's GPT-4** and **GPT-3.5**, with some users finding GPT-4 superior in benchmarks. Rumors about a **GPT-4.5** release circulated without official confirmation. Concerns were raised about "selective censorship" affecting language model performance. The EU's potential regulation of AI, including **ChatGPT**, was highlighted. Users reported issues with **ChatGPT Plus** message limits and subscription upgrades, and shared experiences with **BingChat** and **DALL-E**. The community discussed prompt engineering techniques and future applications like image generation and MIDI sequence analysis, expressing hopes for **GPT-5**.

Is Google's Gemini... legit?

Wed, 06 Dec 2023 22:22:18 GMT

**Google's Gemini** AI model is generating significant discussion and skepticism, especially regarding its **32-shot chain of thought** MMLU claim and **32k context window**. The community is comparing Gemini's performance and capabilities with **OpenAI's GPT-4** and **GPT-3.5**, highlighting the upcoming **Gemini Pro** and **Gemini Ultra** models on the Bard platform. Users report various **OpenAI service issues** including chatbot errors and subscription problems. Discussions also cover **prompt engineering techniques**, AI model evaluation comparing **GPT-4**, **Claude 2.1**, and **PaLM2**, and improvements in speech and multimodal capabilities. The bot now supports reading and summarizing links from platforms like arXiv, Twitter, and YouTube, enhancing user interaction.