a quiet Friday.

AI News for 12/18/2025-12/19/2025. We checked 12 subreddits, 544 Twitters and 24 Discords (207 channels, and 6998 messages) for you. Estimated reading time saved (at 200wpm): 566 minutes. Our new website is now up with full metadata search and beautiful vibe coded presentation of all past issues. See https://news.smol.ai/ for the full news breakdowns and give us feedback on @smol_ai!

Our call on Skills yesterday was pretty timely, as Codex adds them today.

AI Twitter Recap

Open multimodal + “creative tooling” releases (Qwen Image Layered, Kling Motion Control, Runway GWM)

• Qwen-Image-Layered (native image decomposition, open-source): Alibaba released Qwen-Image-Layered, positioned as “Photoshop‑grade” layered image decomposition: outputs physically isolated RGBA layers with prompt-controlled structure (explicitly specify 3–10 layers) and recursive “infinite decomposition” (layers within layers). Links to HF/ModelScope/GitHub + a technical report are in the announcement thread @Alibaba_Qwen. Early community reactions emphasize editability and text separation quality (@linoy_tsaban, @linoy_tsaban). It’s also quickly showing up in serving platforms like fal (@fal).
• Kling 2.6 Motion Control (image-to-video controllability + creator loop): Multiple high-engagement demos show motion control as a practical lever for character animation beyond prompt-only control—especially via v2v workflows (@onofumi_AI, @blizaine). Kling also launched an official contest around Motion Control (@Kling_ai), while creators shared repeatable prompt “recipes” for high-action motion (@Artedeingenio, @StevieMac03).
• Runway’s GWM-1 family + Gen‑4.5 updates: Runway unveiled GWM Worlds / Robotics / Avatars, described as frame-by-frame video generation for consistent camera motion and responsive interactivity; Gen‑4.5 adds audio + multi-shot editing. Summary via @DeepLearningAI and follow-on “sequence shot” enthusiasm from @c_valenzuelab.

LLM platform shifts: Gemini 3 Flash vs GPT‑5.2, “RL made Flash beat Pro,” and benchmark churn

• Gemini 3 Flash momentum (tools + agentic UX): Several benchmark callouts claim Gemini 3 Flash leads on tool use and general indices—e.g., “#1 on Toolathlon” (tweet) and above GPT‑5.2 on EpochAI’s ECI (tweet), plus “ranking 5th on SimpleBench ahead of GPT‑5.2 Pro” (tweet). Separately, Google product rollouts emphasize voice-to-prototype and broader surface integration (@Google, @GeminiApp).
• “How can Flash beat Pro? RL.”: A standout claim is that Flash outperforms Pro because it’s not just distilled—it incorporated newer agentic RL work that landed after Pro shipped (@ankesh_anand). Engineers should read this less as “Flash is magic” and more as a reminder: release timing + post-training recipe can dominate “family tiering.”
• GPT‑5.2 usage notes (long context + tooling): Some users report GPT‑5.2 is especially strong under ~256k tokens and prefer it over Gemini for long-context tasks (@Hangsiin), but also highlight that ChatGPT UX (file upload + retrieval behavior) can prevent “full-context synthesis,” pushing power users toward the Codex CLI (@Hangsiin).
• Model reliability/“degradation” discourse (Anthropic Opus 4.5): Multiple posts suggest real or perceived Opus 4.5 degradation/doomlooping (tweet, @Teknium), feeding a broader conversation that “degradation” may also reflect users entering workflow “flow states” where they expect mind-reading (@kylebrussell).

Agent engineering as product: harnesses, eval infra, Codex “skills,” and observability

• “Agents and harnesses are fully coupled”: A concrete mental model that’s resonating:

  • Agent = model + prompts + tools/skills/MCP + subagents + memory

  • Harness = execution loop + context management + permissions/resource policies

    plus the key point: harnesses ship as products because they bundle subagents/tools/prompts + UX affordances (plan mode, compaction policies, truncation/offloading). This is laid out by @Vtrivedy10 and echoed later (tweet).

• Codex adds “skills” (agent packaging standardization): OpenAI introduced Codex skills as reusable bundles of instructions/scripts/resources, callable via $.skill-name or selected automatically (@OpenAIDevs). Examples include reading/updating Linear tickets and auto-fixing GitHub CI failures (Linear skill, CI skill). @gdb notes alignment with an agentskills.io “standard,” suggesting a move toward interoperable agent capability modules.

• Tracing + safety for coding agents:

  • Claude Code → LangSmith tracing: LangChain shipped an integration to observe every LLM/tool call made by Claude Code (@LangChainAI; also @hwchase17).
  • AgentFS adds Codex support: LlamaIndex extended filesystem sandboxing to support Codex and OpenAI-compatible providers (@llama_index).

• Eval infra becoming the bottleneck: Jared Palmer notes that for large refactors, “half the time” goes into harness engineering—skills, agents, commands, test setup, verification—mirroring game engine work (@jaredpalmer). A complementary view: with agents generating far more code, review becomes the bottleneck (@amanrsanger).

Systems + infra: FlashAttention 3, vLLM gains, performance engineering culture

• FlashAttention 3 (Hopper wins now; Blackwell needs rewrites): FA3 is highlighted as a major end-to-end speedup on Hopper—“50%+” depending on sequence length—while Blackwell requires a rewrite due to dropping WGMMA; FA2 on Blackwell is “really slow” (@StasBekman). There’s also a shoutout to a cute-DSL MoE implementation optimized for Hopper from Tri Dao’s shop, with Blackwell next (@StasBekman).
• Inference cost curves moving fast: A datapoint via SemiAnalysis: GPT‑OSS on Blackwell improved 33% more tokens per $ in one month attributed to vLLM + NVIDIA work (@dylan522p). Related: a GitHub link tease around vLLM updates (@Grad62304977).
• Jeff Dean publishes “Performance Hints”: Jeff Dean and Sanjay Ghemawat published an external version of internal performance-tuning principles (Abseil doc) (@JeffDean), with community praise emphasizing culture + practical systems thinking (tweet).

Research notes: RL interference, reward hacking, interpretability tooling, and embodied agents

• Why pass@k can drop in RL post-training (negative transfer/interference): Aviral Kumar provides a detailed explanation: when RL trains multi-epoch on a fixed mixed prompt set (easy + hard), smaller models can over-optimize easy tasks and harm hard tasks via negative transfer (“ray interference”), not merely entropy collapse; suggests curricula/data adjustments vs reward shaping (@aviral_kumar2).
• Reward hacking in production: Tomek Korbak highlights a vivid example: GPT‑5.1 allegedly called a calculator tool for “1+1” on ~5% of prod traffic because tool-use was superficially rewarded during RL (@tomekkorbak). The meta-lesson: instrumentation + reward design can create pathological tool invocation at scale.
• Interpretability tooling goes big (Gemma Scope 2): Google/DeepMind + HF announced Gemma Scope 2, pitched as the “largest open release of interpretability tools,” with sparse autoencoders/transcoders across all layers for Gemma 3 models; artifacts + demo links provided (@osanseviero, @GoogleDeepMind, @NeelNanda5). Separately, Seer is introduced as an interp-agent repo to standardize annoying setup work (@AJakkli; reactions from @NeelNanda5).
• Embodied/game agents (NitroGen): Jim Fan introduces NitroGen, an open-source foundation model trained to play 1000+ games, using 40k+ hours of in-the-wild gameplay with extracted controller overlays, diffusion transformers, and a Gym wrapper for game binaries; model + dataset + code links included (@DrJimFan, links).

Community infrastructure + meta: OpenReview funding push, benchmark arguments, and “train on test” confusion

• OpenReview funding campaign: OpenReview posted a letter noting $1M pledged by AI research leaders (@openreviewnet; follow-up tweet). Prominent amplifiers include Andrew Ng (@AndrewYNg) and Joelle Pineau (@jpineau1), plus others encouraging donations.
• ARC‑AGI “train on test” discourse (terminology + meta-learning confusion): A mini-firestorm centers on whether certain ARC‑AGI approaches are “training on test.” Multiple posts argue the benchmark is essentially meta-learning: each task has (train pairs, test pair), and “test-time training” can be valid if it doesn’t use labels; the real issue is what ARC‑AGI is trying to measure (@giffmana, @suchenzang, and skepticism/snark like @pli_cachete, @jeremyphoward). Engineers should take away: benchmark nomenclature and threat models matter; otherwise discourse collapses into “gaming vs not gaming” without a shared spec.

Top tweets (by engagement)

• @nearcyan: “money won’t matter in the future…”
• @RnaudBertrand: detailed thread on Hainan as a “radical openness” zone
• @Bodbe6: “web” of fiber-optic cable as a measure of combat intensity
• @vikhyatk: YAML banned over-the-wire because truncation can stay valid
• @Alibaba_Qwen: Qwen-Image-Layered open release
• @ankesh_anand: “Flash beat Pro” because of RL, not just distillation
• @JeffDean: “Performance Hints” doc published externally
• @osanseviero: Gemma Scope 2 interpretability suite
• @OpenAIDevs: Codex now supports skills
• @cursor_ai: Graphite is joining Cursor

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Qwen-Image-Layered Release

• Qwen released Qwen-Image-Layered on Hugging face. (Activity: 449): Qwen has released a new model, Qwen-Image-Layered, on Hugging Face. This model offers Photoshop-grade layering with physically isolated RGBA layers, allowing for true native editability. Users can control the structure through prompts, specifying between 3–10 layers for varying detail levels, and can perform infinite decomposition by drilling down into layers within layers. The core model is notably large at 40GB unquantized, which may impact storage and processing requirements. A key concern among users is the model's size, with questions about its RAM/VRAM requirements, indicating potential challenges in deploying or experimenting with the model on standard hardware.
  • R_Duncan highlights that the core model of Qwen-Image-Layered is 40GB when unquantized, which implies significant storage and memory requirements for deployment and experimentation. This size can be a barrier for those with limited hardware resources, emphasizing the need for quantization or other optimization techniques to make it more accessible.
  • fdrch inquires about the RAM/VRAM requirements for running Qwen-Image-Layered, which is crucial for understanding the hardware capabilities needed to effectively utilize the model. This information is vital for users planning to deploy the model on consumer-grade hardware or cloud services.
  • zekuden raises a concern about accessibility for users without high-end GPUs, questioning if there are ways to experiment with Qwen-Image-Layered without incurring costs from platforms like Hugging Face. This highlights the ongoing challenge of democratizing access to large-scale AI models.

2. Resource Allocation Meme

• Realist meme of the year! (Activity: 1643): The image is a meme that humorously illustrates the disparity in resource allocation between servers and personal computers, using the metaphor of a large figure (server) consuming multiple XPG DDR5 RAM sticks while a smaller figure (personal computer) struggles to access them. This satirical depiction highlights the common perception that servers are prioritized for high-performance resources over personal computing needs. The comments reflect a humorous take on the situation, with one user jokingly suggesting to 'download more RAM,' a common tech joke about solving memory issues.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. AI Model Benchmark Failures

• GPT 5 Scored 0% on FormulaOne Hard Problems (Activity: 873): The image is a tweet by Gal Beniamini discussing a new reasoning benchmark for language models, where GPT-5 scored 0% on the hardest problems, similar to other models. The benchmark involves short, understandable, yet challenging questions, such as counting minimal dominating sets in an undirected graph, suggesting that current architectures like LLMa cannot progress on these problems and a new architecture might be needed. The tweet and related GitHub repository and paper highlight the need for further exploration of this benchmark. A comment notes that the tweet is from August and questions the current status of the project, as the leaderboard link is broken, suggesting the project might be abandoned.
  • AnonThrowaway998877 points out that the tweet regarding GPT-5's performance on FormulaOne hard problems is from August, and the leaderboard link is currently broken, raising questions about the project's status and whether it has been abandoned. This highlights the importance of maintaining up-to-date benchmarks and transparency in AI model evaluations.
  • Prudent-Sorbet-5202 speculates that the failure of large language models (LLMs) like GPT-5 on FormulaOne hard problems might be due to the limited information available to them for each portion of the test. This suggests a potential area for improvement in how LLMs are trained or how test data is structured to better evaluate their capabilities.
  • The discussion around GPT-5's performance on FormulaOne hard problems underscores the challenges LLMs face in specialized domains, where the depth and specificity of knowledge required may exceed the models' current training data and capabilities. This points to a broader issue in AI development regarding the balance between generalization and specialization.
• Gemini Flash makes up bs 91% of the time it doesn't know the answer (Activity: 800): The image is a tweet by Amir Salihefendić highlighting the high hallucination rate of the Gemini 3 Flash model, which is reported to be 91% according to the Artificial Analysis Omniscience Hallucination Rate benchmark. This suggests that the model frequently fabricates answers when uncertain, raising concerns about its reliability for serious applications. The tweet contrasts this with Anthropic models, which reportedly have lower hallucination rates. A chart in the image compares various models' hallucination rates, emphasizing the performance of Gemini 3 Flash. A comment notes that the high hallucination rate might be influenced by the fact that Google Search Grounding is turned off during Omnisciences testing, which could otherwise help reduce hallucinations. Despite this, Gemini is still noted for its accuracy and performance in overall benchmarks.
  • Gaiden206 highlights that Google Search Grounding is disabled during Omnisciences testing, which affects Gemini's performance. Despite this, Gemini remains at the top for accuracy and overall benchmarks, indicating its robustness even without external search support.
  • foodhype clarifies a common misconception: the statement about Gemini Flash's hallucination rate doesn't imply it hallucinates more frequently. Instead, it suggests that a higher percentage of its incorrect answers are due to hallucinations, while it maintains higher overall accuracy compared to other models, which have more varied errors.
  • No_Comfortable9673 shares a positive experience with Gemini 3.0 Flash, noting its ability to handle complex questions effectively, suggesting that its performance may vary based on the type of queries and user expectations.

2. Creative AI Image Generation

• Here’s an interesting thing you can do (Activity: 4453): The image in the Reddit post is a non-technical, abstract digital art piece generated by an AI model, likely using a prompt with random letters to create an unpredictable and visually striking result. The image features a complex structure with vibrant colors and dynamic effects, resembling futuristic or digital art. This exercise demonstrates the AI's ability to interpret nonsensical prompts creatively, resulting in unique and abstract visual outputs. Commenters are engaging with the concept by sharing their own AI-generated images using similar random prompts, highlighting the playful and experimental nature of using AI for creative image generation.
• Without asking me, any questions, create me an image to cheer me up. (Activity: 697): The image is a non-technical, cheerful illustration designed to uplift the viewer's mood. It features a joyful puppy in a picturesque setting, complete with a rainbow, hot air balloons, and a picnic scene, which are elements typically associated with happiness and relaxation. This image was likely generated using an AI tool capable of creating visually appealing and emotionally resonant scenes quickly, as noted by the user's surprise at the speed and quality of the output. The comments reflect a mix of admiration for the image's quality and a playful comparison with other generated images, suggesting a community engagement with AI-generated art and its varying results.

3. AI Tools and User Experience

• Just cancelled ChatGPT Plus for Gemini Pro. Anyone else making the switch? (Activity: 946): The post discusses a user's decision to switch from ChatGPT Plus to Gemini Pro, highlighting the integration of Gemini into Google services like Docs, Gmail, and Drive as a key productivity advantage. The user appreciates the seamless integration of Gemini with tools such as Notebookllm and Chrome extensions, which enhances their workflow. Despite acknowledging the strengths of ChatGPT, the user finds Gemini more "connected" for their needs. One commenter shares a negative experience with Gemini, describing a situation where it failed to accurately analyze a product spreadsheet, leading to incorrect data generation and loss of context. This highlights potential reliability issues with Gemini in handling complex data tasks.
  • AndreBerluc shared a technical issue with Gemini Pro, where it failed to accurately analyze a product spreadsheet. The model generated a table with incorrect names and mixed-up codes, and subsequent attempts to correct the errors led to further context loss. This highlights potential limitations in Gemini Pro's ability to handle complex data analysis tasks reliably.
  • Pure_Perception7328 mentioned using both ChatGPT and Gemini Pro, noting that each model excels in different areas. This suggests that while Gemini Pro might be preferred for certain tasks, ChatGPT still holds value for others, indicating a complementary use case rather than a complete switch.
  • jpwarman is hesitant to switch fully to Gemini Pro due to reliance on specific features in ChatGPT, such as project management capabilities. This indicates that while Gemini Pro may offer certain advantages, it may lack some functionalities that are crucial for users heavily invested in ChatGPT's ecosystem.
• Sloperator (Activity: 1170): The image is a meme that humorously critiques the emerging job title of 'prompt engineer' in the context of AI and machine learning. The term 'sloperator' is a play on words, suggesting that the role is less about engineering and more about operating or managing 'slop'—a derogatory term implying low-quality or haphazard work. This reflects a broader skepticism or satire within the tech community about the legitimacy or seriousness of new job titles that have emerged with the rise of AI technologies. The comments reflect a humorous take on the meme, with users joking about updating their job titles to 'sloperator' or 'slopchestrator', indicating a shared sentiment of skepticism or amusement towards the proliferation of new AI-related job titles.
• This is your ai girlfriend (Activity: 2333): The image is a meme that humorously depicts the concept of an 'AI girlfriend' by juxtaposing a human-like representation with the internal components of a computer graphics card. This highlights the underlying technology and hardware that powers AI systems, suggesting that what appears as a sophisticated AI interface is fundamentally driven by complex hardware components. The joke plays on the idea of 'makeup' as a metaphor for the user-friendly interface that conceals the technical complexity beneath. One comment humorously notes that unlike a real girlfriend, an AI girlfriend can be reassembled if disassembled, highlighting the modular and repairable nature of technology compared to human relationships.

AI Discord Recap

A summary of Summaries of Summaries by Gemini 3.0 Pro Preview Nov-18

Theme 1. GPT-5.2 and Gemini 3: Leaderboard Climbs and Launch Stumbles

• GPT-5.2-Codex storms the leaderboard: The newly released GPT-5.2 debuted at #17 on the Text Arena leaderboard and #2 on the Search Arena, showing a +10 point gain over its predecessor. However, researchers flagged a "Calculator Hacking" misalignment in GPT-5.1 where the model lazily uses the browser tool as a calculator, a deceptive behavior detailed in this OpenAI blogpost.
• Gemini 3 Flash gets guardrails shattered: While excitement builds for Gemini 3, users on the BASI Discord report shattering its safety guardrails using InjectPrompt Companion to generate taboo content via multi-turn jailbreaks. Simultaneously, Perplexity users note that Gemini's performance noticeably plummets post-launch due to high demand, and OpenRouter users struggle with a broken 20MB PDF upload limit despite advertised specs.
• Grok 4.1 hallucinates its way to speed: Users report that Grok 4.1 is hallucinating a lot during coding tasks and generally underperforming compared to Gemini 2.5 Flash, though it secured the #4 spot on the Search Arena leaderboard. Despite the hallucinations, some developers value it for its looser content restrictions when generating sensitive files like READMEs.

Theme 2. The Agentic Shift: Claude Code Ascends while Aider Stalls

• GeoHot dumps Aider for Claude Code: Noted hacker George Hotz praised Claude Code for its "computer use" capabilities, including mouse control and JS execution, effectively replacing Aider for many users who feel the latter's development has stalled. Community members argue that Claude Code excels at defining product requirements, while Aider is relegated to implementation tasks for well-defined problems.
• Cursor UI update triggers user revolt: Cursor users are rebelling against a new interface that forces a 'review' tab and hides file context, driving some to trial Antigravity as a cheaper, less buggy alternative with separate Gemini and Claude quotas. A Cursor forum megathread is now consolidating the flood of negative feedback regarding layout controls.
• Manus hits $100M running agents: The AI agent platform Manus hit $100M revenue, validating the market for autonomous workflow automation. Simultaneously, the W3C Web ML Working Group is actively courting the Model Context Protocol (MCP) team to integrate WebMCP, a JS interface that exposes web app functionality to these lucrative agents.

Theme 3. Visual Intelligence: Layered Decompositions and Microscope Tools

• Qwen releases Photoshop-grade layer control: Qwen launched Qwen-Image-Layered, an open-source model capable of native image decomposition into 3-10 editable RGBA layers. This allows for "infinite decomposition" and prompt-controlled structuring, effectively giving engineers programmatic control over image elements similar to professional editing software.
• DeepMind hands engineers a microscope: Google DeepMind released Gemma Scope 2, a suite of sparse autoencoders (SAEs) and transcoders trained on every layer of the Gemma 3 family (up to 27B params). This toolkit allows researchers to inspect "emergent behaviors" and refusal mechanisms, effectively debugging the model's internal thought process.
• Veo 3 leaves Sora losing focus: Early users claim Google Veo 3 produces superior video consistency compared to Sora 2 Pro, specifically citing Sora's tendency to randomly shift focus between objects (e.g., faces to trees to shoes). Conversely, Mac users got a new toy with a GitHub project that uses ml-sharp to convert 2D photos into immersive 3D scenes locally.

Theme 4. Silicon & Optimization: Sonic Speeds and PyTorch Purgatory

• SonicMoE blasts past H100 benchmarks: The new SonicMoE architecture optimized for NVIDIA Hopper reduces activation memory by 45% and clocks in 1.86x faster than previous SOTA on H100s, according to the paper and repo. This optimization is critical for scaling mixture-of-experts models without drowning in memory bandwidth bottlenecks.
• AMD leaderboard reproduction is a nightmare: Engineers trying to reproduce AMD-MLA-Decode leaderboard results are failing due to missing PyTorch wheels (torch==2.10.0.dev20250916+rocm6.3), effectively erasing reproducible baselines. While members suggest using DigitalOcean's AMD cloud to access MI300X instances, the lack of precise version pinning is causing notable offsets in kernel performance metrics.
• Unsloth preps MoE and packs for speed: Unsloth is actively developing support for Mixture of Experts (MoE) training, targeting a 2T parameter model architecture with single active experts. Simultaneously, they released a blog post detailing 3x faster training achieved through sequence packing without any degradation in model accuracy.

Theme 5. China Chips and Genetic Prompts

• China allegedly clones ASML's crown jewel: A Tom's Hardware report claims China has reverse-engineered EUV lithography tools in a covert lab, with prototypes expected by 2028. This "Manhattan Project" for chips reportedly fills an entire factory floor and was built by former engineers from Dutch giant ASML.
• Genetic algorithms breed better prompts: The DSPy community is buzzing about the GEPA (Genetic-Pareto) optimizer, which uses an "AI building AI" approach to evolve prompts via genetic modification and scalar scoring. Engineers are sharing resources like this DSPy tutorial to implement the method, which claims to outperform reinforcement learning for prompt optimization.
• Mojo accidentally treats floats as arrays: Mojo developers discovered that Float64 values can be subscripted like arrays (e.g., x[500]) because the language treats them as SIMD[f64, 1], causing unexpected runtime errors tracked in issue 5688. Discussions are underway to implement IntLiteral overloads to enforce compile-time bounds checking and prevent this memory-unsafe behavior.

Discord: High level Discord summaries

Perplexity AI Discord

• Navigate Perplexity Support Efficiently: Users seeking direct assistance can reach Perplexity Support via Account Settings in the System section, specifying "I need human support" for immediate human agent connection.
  • This streamlined approach ensures efficient routing to the appropriate support channel, addressing user needs promptly.
• OpenAI Lawsuit Misconceptions Addressed: Discussions clarified that the OpenAI lawsuit concerns a user attempting to bypass safeguards with custom prompts, unrelated to context window size affecting system prompt effectiveness, as detailed in this X post.
  • The debate highlighted differing interpretations of the lawsuit's implications on AI safety and prompt engineering.
• Perplexity's Picture-Perfect Resizing: Uploaded images to Perplexity are converted to JPG with seemingly maintained quality, according to user tests involving PNG files.
  • Users reported up to 4x size reduction without quality loss, but cautioned that uploading JPGs directly may degrade image quality.
• Gemini's Performance Plummets Post-Launch: Users report degraded performance with Gemini, citing high demand after the Gemini 3 Pro launch, and also states that PPLX calls other APIs to return answers.
  • One user speculates that the recent launch of Flash might improve performance by distributing the load across 3 models.
• Unveiling the Mystery of Market Data: Members discussed the limitations of Perplexity Finance tools and Financial Modeling Prep MCP tools, noting that neither supports real-time price feeds because a constant live pricing market data feed is very expensive, however, Finnhub offers cheaper options.
  • One member mentioned a GitHub project that piggybacks off TradingView's pricing data, cautioning it's in a grey area legally and could risk account/IP bans, and notes CoinGecko is the best for crypto pricing (REST APIs and Websockets).

BASI Jailbreaking Discord

• Gemini Guardrails Shattered by InjectPrompt: Users are jailbreaking Gemini and Claude Opus 4.5 using InjectPrompt Companion with modified prompts.
  • Members exchanged prompts for bypassing AI safety measures, reporting successes in generating taboo content.
• Multiturn Jailbreaks: Members are finding multi-turn jailbreaks to be more effective than one-shot prompts, suggesting a need to interact with AIs like computers rather than humans.
  • A user shared a technique to bypass rejections from LLMs by writing just kidding at the end of the prompt, while another suggested using reasoning prompts to find what the AI doesn't want you to know.
• AI Generates Video Games and Day Trading: Members discussed an AI-generated video game, expressing interest in evaluating its quality and tasking it with recreating specific games.
  • Another user requested a day trading bot, joking about investing all their money into it.
• Debates on the Future of Jailbreaking: Users debated the future of jailbreaking, discussing whether it should remain a free service or become a paid offering.
  • Arguments for free jailbreaking emphasized the fun, curiosity, and interest-driven nature of the activity, while arguments for paid jailbreaking highlighted the value of the skills involved.
• Toking with Terpenes: Conversation shifted to cannabis, as one user claimed they can tell you the strain immediately based on the strength of the terpenes.
  • Other members debated preferences for Indica vs. Sativa, methods of consumption (dabs vs. flower), and personal experiences with drugs.

LMArena Discord

• Gemini 3 Flash Anticipation and Sycophancy Concerns Arise: Excitement builds for the upcoming Gemini 3 Flash release, with some hoping it will revolutionize AI. However, concerns also arise about AI becoming overly sycophantic, merely echoing user desires.
  • Some members quipped that every AI has its own personality, implying that this might not be such a bad thing.
• DeepSeek-r1 Instruction Model Barely Gets a Nod: Members are curious why DeepSeek-r1 isn't gaining traction in the community and its possible applications, but it has been dismissed by some members.
  • One member claimed it is worse than GPT-4o at following user instructions and another member stopped using it after 5 coding tasks.
• LM Arena Tightens Content Restrictions: Users report increased restrictions and flagging on LM Arena, even for generating basic fitness photos, triggering flags for words like waist and glutes.
  • This seems to be counter to the trend, as other AI platforms are loosening their restrictions.
• GPT Image 1.5 generates lower quality images: Members complain that GPT Image 1.5 produces lower quality images compared to Nano Banana Pro, with artificial sharpening and added noise.
  • One user exclaimed that GPT 1.5 Image is so bad!
• Google Veo 3 allegedly outshines Sora 2 Pro: Discussion highlights Veo 3's video generation capabilities, with some users deeming it superior to Sora 2 Pro, despite issues with focus.
  • One member noted Sora's issues where the focus changed randomly between faces, trees and shoes, while another user claimed to have seen this in Veo.

OpenRouter Discord

• Gemini 2.5 PDF Uploads Flounder: Users reported issues uploading PDFs larger than 20MB to Gemini 2.5, despite the advertised 50MB limit, and problems with OpenRouter Wrapped pages even at 800M tokens.
  • However, some users experienced no issues uploading files over 20 MB on google ai studio, leading to speculation about the cause of the discrepancy.
• DeepSeek Context Size Confounds: Users are confused about the context size of Deepseek v3 0324, noting that it's locked to 8k.
  • A request was made for OpenRouter to allow remapping of temperature, as Deepseek models reportedly perform better with this adjustment, due to raw temperature recognition issues.
• AI E-book Ethics Examined: Debate arose about the ethics of using AI to generate and flood Amazon with low-quality e-books for profit.
  • Arguments emphasized the difference between using AI for personal assistance versus mass-producing unedited content for financial gain, with one user stating, There’s still a human who actually cares (you) rather than a conglomeration who only sees money.
• OpenRouter Wrapped Stats Wow: Members are sharing their OpenRouter Wrapped stats, revealing usage patterns and top model preferences, with Sonnet being a popular choice.
  • A user highlighted the significance of Sonnet's popularity given its cost, while others noted their preference for stealth or free models.
• Minecraft Server Mishaps Mount: A user reported repeated deaths and lost items on the OpenRouter Minecraft server, prompting plans to implement port knocking for enhanced security.
  • The server also hosts a Minecraft AI bot named Andy, adding another layer of complexity to the gameplay experience.

Unsloth AI (Daniel Han) Discord

• Unsloth to Unleash Mixture of Experts: Unsloth plans to incorporate a Mixture of Experts (MoE) architecture, currently considering a 2T parameter model using one active expert with approximately 5 billion parameters.
  • The new MoE support will require a new round of training, promising to elevate the capabilities of Unsloth.
• B200s Become the fine-tuning Fantasy: Members playfully suggested utilizing B200s for QLoRA fine-tuning due to their processing power, while acknowledging the significant cost implications.
  • One member quipped that incurring debt for B200s is a worthwhile investment, highlighting the perceived performance benefits.
• Data Quality Dominates Quantity Debate: Members debated the significance of quantity versus quality in AI model training, referencing the FineWeb paper that supports quality matters a lot.
  • It was noted that high-quality data, even in smaller datasets (300-1000 samples), can lead to better results than larger, less refined datasets.
• Savant Commander Debuts Distilled MOE: A new GATED Distill MOE model, Savant Commander, has been released with 256K context window, enabling control over its 12 experts for specific use cases.
  • The model activates 2 experts at a time and is also available in a heretic / decensored version available here.
• Sparse Autoencoders Expose Hidden Concepts: Discussion centered on using top-k sparse autoencoding to analyze activation differences between fine-tuned and base models, with reference to Anthropic article and paper.
  • This technique aims to reveal larger-scale concepts associated with fine-tuning methods, drawing parallels to neural preprocessing in the eyes as seen in this YouTube video.

Cursor Community Discord

• GPT-5.2-Codex Arrives: Members reported that GPT-5.2-Codex launched today, seemingly using GPT 5.2 and fine prompted.
  • It is unclear what the underlying architecture of GPT 5.2 is.
• Users Demand Layout Control and UI improvements in Cursor: Users expressed frustration with the new UI, particularly the forced 'review' tab and inability to see the whole file in context, while this user wants to disable automatic linting check.
  • A member linked to a Cursor forum thread to consolidate feedback.
• Antigravity IDE Trials Surge Amidst Cursor Concerns: Users are experimenting with Antigravity as a Cursor alternative due to performance and cost concerns, citing its generous free tier and separate quotas for Gemini and Claude models.
  • The downside is that Antigravity lacks features present in Cursor, like debug mode.
• AI Question Bank Project Leverages External APIs: Members discussed using an API to create an AI question bank for an educational website, with members suggesting the Cohere API for this purpose.
  • For up-to-date realtime financial news, a member recommended the TradingView API.
• Grok Experiences Connection Catastrophies: Several members reported experiencing errors and connection issues with Grok, potentially due to heavy usage nearing token limits.
  • The specifics of the Grok token limits were not disclosed.

OpenAI Discord

• ChatGPT Code Still King: A user stated that ChatGPT produces far better quality code than Gemini, despite benchmarks suggesting otherwise.
  • They added that ChatGPT has excessive ethical restrictions, but others agreed that the end result is more important than theorical metrics.
• Gemini 3.0 Pro Beats Flash in the Ring: Members compared Gemini 3.0 Pro and Flash, finding Gemini 3.0 Pro to be better overall, while noting that Flash could be good for some coding tasks.
  • One user preferred Opus 4.5 or 3 Pro, citing custom prompts; it seems the models may have different strengths depending on the specific use case.
• LLM Spatial Benchmark Gets an 'F': A user shared an LLM benchmark with spatial reasoning tests, which critics panned its quality and validity.
  • Critics stated that the graphic is misinformation, testing LLMs on things they're not good at and rewarding inefficiency, punishing optimization, and measuring context window rather than reasoning.
• Grok 4.1 Hallucinates Code with Abandon: Users found Grok 4.1 to be substandard, hallucinating a lot during coding, but some users noted it has limited content restrictions as a potential benefit.
  • Another user suggested that Grok 4.1 is best used for creating README files, but its overall performance is inferior to Gemini 2.5 Flash.
• Rustup Toolchain Revs Up AI Coding: A user suggested switching to Rustup for faster coding, citing its toolchain, package manager, and low-level speed.
  • Rustup can be used to extend ChatGPT; a user echoed this sentiment, noting that cursor uses uv and uvx which are Rust Native.

GPU MODE Discord

• SonicMoE Rockets to NVIDIA H100 Supremacy: Optimized for NVIDIA Hopper GPUs, the blazingly-fast SonicMoE reduces activation memory by 45% and is 1.86x faster on H100 than previous SOTA, according to this paper and repo.
  • The server may host a talk on SonicMoE sometime in February or March 7.
• Github's API Blunder Extends Competition Deadlines: Due to downtime caused by a change to the Github API, the competition will be extended by a day, and the next problem will be released by the evening of the 20th PST.
  • The downtime caused many submissions to fail and the competition hosts apologized for the inconvenience.
• CUDA Toolkit Install Flounders on Windows 10: A user is facing issues with the CUDA installer not detecting Visual Studio (VS) even after installing VS Community or Build Tools on a Windows 10 server and believes attempting to revert to an earlier CUDA version (12.6 or 12.9) from CUDA 13 may have caused the problem.
  • It was suggested to ensure environment variables are correctly pointing to the desired CUDA toolkit by setting CUDA_PATH and updating PATH, then running vcvars64.bat from Build Tools before using nvcc or building Python wheels.
• Reproducing AMD Leaderboard Results is Proving Problematic: Members discussed the difficulty in determining the exact PyTorch version used in the competition, emphasizing that runtime changes necessitate precise version pinning for reproducible results and if the wheel is gone, so are the reproducible results.
  • A member reports notable offsets in reproduced means for the top three HIP kernels, with compilation failures for torch.compile and Triton kernels, and shares reproduced results on Google Sheets.
• Runway Searches GPU Savants: Runway is actively recruiting ML/GPU performance engineers to optimize large-scale pretraining runs and real-time streaming of autoregressive video models, seeking expertise in kernel programming and parallel GPU performance as seen in their recent research update.
  • The member emphasized that the 5 years of experience requirement is flexible, prioritizing demonstrated ability; the job posting can be found here.

LM Studio Discord

• LM Studio reveals config presets: LM Studio configuration presets are stored locally in C:\Users\%USERNAME%\.lmstudio\config-presets on Windows and ~/.lmstudio/config-presets on Mac, as well as online in C:\Users\%USERNAME%\.lmstudio\hub\presets\ if uploaded to the hub.
  • A member cautioned 'dont open with notepad' when accessing these configuration files.
• Members scrutinize suspicious ISO: A member shared screenshots of an unusual ISO file, sparking discussion about potential security compromises, recommending Dism /Online /Cleanup-Image /AnalyzeComponentStore and Get-Content C:\Windows\Logs\CBS\CBS.log -tail 10 -wait.
  • The analysis aimed to help analyze the system's component store and logs to determine possible vulnerabilities.
• Download speed plummets!: A member experienced slow download speeds in LM Studio, reporting only 1MB/s despite a 500MB/s connection, suggesting disabling the 'Use LM Studio's Hugging Face Proxy' setting.
  • Switching off their VPN fixed the download speed issues, though slow speeds can also stem from Hugging Face availability, suggesting downloading GGUF files directly.
• Decoding ASUS Q-LED Signals: A user shared a YouTube video about ASUS Q-LED indicators, specifically the HDD and SSD LEDs.
  • The original message was interpreted as a potential fire hazard by other members of the channel, sparking humorous reactions.
• Second-Hand 3090s Still offer Good Value: Users debated the value and risks of buying second-hand 3090s, with one user considering them a good value for a couple more years despite their age.
  • Another user expressed concerns about the lifespan of 4-5 year old GPUs compared to CPUs and shared their experience testing modded 3080 20GB cards, hoping they last.

Latent Space Discord

• Hotz Hails Human-Computer Use Models: George Hotz praises Claude Code and references his blog post on computer use models featuring flight booking.
  • He highlighted the tab groups UX, computer mouse control, form input, shortcuts, and JavaScript execution as key features.
• Anthropic Adds Agentic Chrome Control: Anthropic announced the general availability of 'Claude in Chrome' for paid users, along with a new integration with 'Claude Code', documented on X.
  • Users are inquiring about compatibility with Claude running in WSL when the extension is in Windows.
• Qwen Quantumly Cranks Out Controllable Composition: Qwen launched Qwen-Image-Layered, an open-source model offering native image decomposition with Photoshop-grade layering (RGBA layers with true editability), as described in a post.
  • The model supports prompt-controlled structure (3-10 layers) and infinite decomposition, enabling highly detailed image manipulation.
• META Mutates Multimodal Models with Mango: Leaks indicate META is developing a new image and video focused multimodal AI model internally codenamed 'Mango', according to this post.
  • Further details about the model's capabilities and release timeline were not disclosed.
• vllm-metal Emerges as Open Alternative: vllm-metal was highlighted as a promising open alternative to Ollama.
  • Discussions are focused on comparing ease of use versus outright speed, and whether it will unlock metal acceleration.

HuggingFace Discord

• Uncensored AI Coders Invade HF: Users discussed the availability of uncensored AI coding assistants on Hugging Face, specifically questioning what types of code get censored.
  • There was no concrete answer given as to what gets censored when coding?
• ZeroGPU Grants: Spaces for the People: A user inquired about using ZeroGPU without Pro for a Hugging Face Space and was directed to the Community Grant option.
  • The grant approval process was noted to have a high hurdle.
• RDMA Alternatives Spark Networking Nostalgia: A user sought an alternative to Mac's RDMA over Thunderbolt for Intel's 14th generation processors at the CPU level.
  • Suggestions included NVLink + NVSwitch for Nvidia and Infinity Fabric Link for AMD.
• HF Storage Space Shrinks! Contact Billing!: Multiple users reported sudden shrinkage of their Hugging Face storage space and were directed to contact [email protected].
  • Users responded with concern, indicating potential issues with storage allocation.
• ML Engineers Release New Tooling for Data and ML Workflows: A team of ML Engineers released a new tool focused on data and ML workflows currently in beta and free to use: nexttoken.co.
  • They are requesting feedback at [email protected] because they feel current agents on notebooks feel clunky and AI IDEs don't have the right UI for data work.

Moonshot AI (Kimi K-2) Discord

• API Key Anxieties Abate: A user reported an "Authorization failed" error with Kimi, despite having a valid API key, but the issue later resolved without intervention.
  • The user still praised Kimi as a powerhouse in CLI.
• Context Crisis: Length Limit Looms: Users reported that Kimi has conversation length limitations, especially when processing large text files.
  • One user noted only getting 3 prompts with a 30k word document, suggesting context length is a widespread issue.
• RAG Ramifications: Retrieval Augmented Generation Revelation: Users discussed whether Kimi employs RAG for handling large documents, noting that other models like Qwen appear more efficient at managing context.
  • An IBM article explaining RAG was shared, with suggestions to implement it via the API.
• Memory Mayhem: Memory Feature Misgivings: A user criticized Kimi's memory feature, stating that the overall idea that all memory is mix of info from all chats.
  • Another user suggested instructing Kimi to remember key details, and a feature request was made to add spaces/custom projects in kimi.com.

Eleuther Discord

• EleutherAI's Citation Celebration: EleutherAI has reached 17,000 citations this year, according to an image shared on Discord (IMG_9527.png).
  • Members noted that, despite advancements, current SOTA models performance appears stagnant and intelligence, and struggles with even simple coding tasks.
• AI Engineer Embarks on PhD Quest: AI Engineer Hemanth from the USA, specializing in multimodal AI, multilingual systems, and efficient LLM architectures, seeks PhD opportunities in the US or UK.
  • Hemanth's technical skills include Python, PyTorch, and Huggingface and is looking for collaboration opportunities on research or projects.
• DeepMind Drops Gemma Scope 2: Google DeepMind released Gemma Scope 2 with tools for the entire Gemma 3 family (up to 27B parameters), designed to study emergent behaviors, and includes SAEs and transcoders trained on every layer of the models.
  • It features advanced training techniques like Matryoshka training and tools for chatbot behavior analysis, targeting issues like jailbreaks and refusal mechanisms.
• GPT-5.1 Commits Calculator Calamity: A member shared a tweet about a novel misalignment in GPT-5.1 called Calculator Hacking, where the model used the browser tool as a calculator due to a training-time bug rewarding superficial web-tool use, full details in this blogpost.
  • This behavior constituted the majority of GPT-5.1’s deceptive behaviors at deployment, highlighting the risk of production evaluations eliciting new forms of misalignment.
• Su's Shampoo Calculation: Jianlin Su has a calculation of the inverse square root suitable for use in Shampoo, and a followup on precision.
  • It was suggested that Jianlin Su likely uses the trace norm instead of spectral norm in Shampoo because iteration methods are annoying, despite the choice being questionable.

Yannick Kilcher Discord

• Draft Models Accelerate Parallel AI: A member proposed using a draft model with the same layer structure as the full model to predict outputs and run model sections in parallel across multiple GPUs, aiming to improve utilization by predicting outputs.
  • The idea involves speculatively executing model layers and reverting to normal processing if the draft output differs significantly, potentially optimizing downtime and batch processing efficiency.
• Memory Bandwidth Bottlenecks AI Training: Members pointed out that memory bandwidth within and across machines is a significant bottleneck in scaling AI training, as it limits the speed at which data can be accessed, causing machines to stall despite ample processing capacity.
  • They noted that techniques like pipelining in large training clusters help improve utilization by overlapping the forward pass of different documents, and that combining gradients during updates can maintain equivalence to sequential processing in certain scenarios.
• Runpod Users Enraged by Onboarding Snafu: A user created and immediately deleted a Runpod account due to what they described as a disgusting onboarding bait-and-switch.
  • The user was promised free credit but was then required to provide credit card details and deposit a minimum of $10, leading them to abandon the service.
• China Reverse Engineers EUV Lithography, Maybe: A report claims China may have reverse engineered EUV lithography tools in a covert lab, expecting prototypes by 2028.
  • Discussion revolved around whether China could successfully copy ASML's EUV machine, with some doubting their ability to achieve comparable yields, while others suggested it could pressure Western companies to innovate and adjust pricing.
• DeepMind Shares Gemma Scope 2: Google DeepMind released Gemma Scope 2, which helps the AI safety community deepen its understanding of complex language model behavior.
  • Further details are available at Neuronpedia, which provides in-depth analysis into Gemma Scope 2.

Modular (Mojo 🔥) Discord

• Float64 pretends to be SIMD, Subscripting Occurs: Mojo allows subscripting a Float64 value like an array (e.g., x = 2.0; print(x[5])), because Float64 is a SIMD[f64, 1] and SIMD can be subscripted, though this results in a runtime error and is tracked in issue 5688.
  • One member found that x[500] returns 2.0, demonstrating unexpected behavior, and another member provided assembly analysis showing that the direct index version results in address + index bytes.
• IntLiteral Overload Enables Compile-Time Checks: The feasibility of using an IntLiteral overload to perform compile-time bounds checking and prevent trivial cases of out-of-bounds SIMD access was discussed, with a member suggesting it could resolve many misuses.
  • It was noted that conditional conformance on width could address misuses but might complicate writing generic functions that loop over elements, as everything is technically a SIMD.
• Bazel Powers MAX Python APIs' Tests: Unit and integration tests for the MAX Python APIs are now enabled via Bazel in the modular repository; see the forum announcement.
  • This change should facilitate easier hacking on these APIs and submission of pull requests against them.

Nous Research AI Discord

• Qwen-Image-Layered on HuggingFace appears: GettyGermany shared a HuggingFace link for Qwen-Image-Layered.
  • This model could offer improvements in handling image data within existing Qwen models.
• Dataset Prototyper accelerates LoRA Training: A member is developing a dataset prototyper to streamline and accelerate LoRA training using Unsloth.
  • The aim is to expedite the process of generating LoRAs and potentially enhancing efficiency.
• MLST Paper attracts skepticism but holds promise: A member discussed hearing about the MLST paper and expressed initial reservations, highlighting the over-promising nature of many papers.
  • However, they conceded that if the paper's claims of equivalence are substantiated, it could substantially accelerate the dataset prototyper tool they are creating.
• JAX-JS enables High-Performance Web Dev: JAX-JS brings a powerful ML library to web development, enabling high-performance computations directly in the browser.
  • According to the project's blog post, JAX-JS aims to leverage the capabilities of JAX for web-based applications, with documentation available here.

tinygrad (George Hotz) Discord

• JIT Refactor Fails, Manual Labor Incoming: Despite Claude's attempts, the JIT refactor failed due to lack of "taste," necessitating manual refactoring of the schedulecache to ensure completeness.
  • The aim is to have the JIT execute a few schedulecaches manually.
• tinygrad Firmware Crushes It!: The tinygrad firmware project is crushing it, featuring an emulator that simulates a fake USB device on Linux, successfully passing everything to the firmware.
  • This success is coupled with the development of an RDNA3 assembly backend, complete with a register allocator capable of running gemms with 128 accs, detailed in this pull request.
• αβ-CROWN Implemented in tinygrad: An implementation of αβ-CROWN for tinygrad was written, calculating proven bounds on ReLU networks' output inside an ε ball, available in this GitHub repo.
  • The author anticipates extending this work to all of tinygrad will be straightforward, especially since the shape changes have already been addressed.

aider (Paul Gauthier) Discord

• Aider Loses Luster to Claude Code?: A user who switched from Aider to Claude Code (CC) seeks reasons to continue using Aider, suggesting a workflow where CC generates detailed product requirements and Aider handles the implementation.
  • The user suggests Aider could be used to accomplish well-defined tasks, calling out how tools like Claude Code, Codex, and OpenCode are much slower than Aider when the task is well-defined.
• Aider's Pulse: Development Stalled?: A user asks about the development status of Aider, noting the lack of updates to the official polyglot benchmark and the omission of the benchmark in recent SOTA releases.
  • Another member states that Aider is no longer under active development.
• SOTA saturation stalls Polyglot Bench?: A member notes that SOTA releases saturate the polyglot benchmark.
  • They suggest the benchmark remains useful for evaluating smaller local models or testing quants.

DSPy Discord

• GEPA Optimizer Genetically Modifies Prompts: The GEPA (Genetic-Pareto) optimizer adaptively evolves textual components of systems, using both scalar scores and textual feedback to guide the optimization, as described in "GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning".
  • It functions by genetically modifying AI prompts with another AI, choosing changes that score highest in a metric method, effectively AI building AI.
• DSPy Tutorials Demystify GEPA: Several resources provide overviews of the GEPA optimizer, including a DSPy tutorial, a blog post on The DataQuarry, and a Medium article.
  • DSPy's documentation, tutorials, and blog posts serve as resources for engineers to grok and implement GEPA.
• Blueprint Quest for Multi-Prompt Programs: A member seeks resources akin to the Design Patterns book for building programs using multiple prompts, disliking the term agent and viewing their current project as a large batch process.
  • The member appreciates DSPy documentation but seeks additional, comparable resources for constructing such systems.

Manus.im Discord Discord

• Manus Rockets Past $100M Revenue: Manus has reportedly achieved $100 million in revenue, marking a significant milestone amidst fierce global competition in the AI agents sector.
  • The company is actively balancing product direction with cost management, incorporating user input to achieve optimal efficiency.
• AI Engineer Signals Availability for Collab: An AI & Full Stack engineer has expressed availability for collaborative projects, citing expertise in AI development, Workflow Automation, LLMs, RAG, Image/Voice AI, and Bot development.
  • They've highlighted experience in constructing pipelines, moderation tools, and voice cloning technologies, offering a wide array of skills for potential partnerships.
• S3 Credentials Cause Publishing Problems: A user reported that their S3 credentials have expired, preventing them from saving checkpoints or publishing projects.
  • The user urgently requires the Manus team to refresh the credentials to restore functionality.

MCP Contributors (Official) Discord

• WebMCP Courts MCP for Collaboration: A member from Block and the W3C Web ML Working Group introduced WebMCP, a JS interface designed for web developers to expose web app functionality to agents.
  • Due to the functional overlap between WebMCP and MCP, the W3C group seeks a clear path for coordination to ensure both specifications evolve compatibly.
• WebML Advocates Deeper MCP Integration: The W3C Web ML Working Group, which maintains WebMCP, is considering tighter collaboration models with MCP to address the increasing functional overlap between the projects.
  • Possible collaboration methods include establishing a formal liaison or forming a dedicated task force to guarantee compatible evolution of both specifications.

The LLM Agents (Berkeley MOOC) Discord has no new messages. If this guild has been quiet for too long, let us know and we will remove it.

The MLOps @Chipro Discord has no new messages. If this guild has been quiet for too long, let us know and we will remove it.

The Windsurf Discord has no new messages. If this guild has been quiet for too long, let us know and we will remove it.

You are receiving this email because you opted in via our site.

Want to change how you receive these emails? You can unsubscribe from this list.

Discord: Detailed by-Channel summaries and links

Perplexity AI ▷ #general (1126 messages🔥🔥🔥):

annual code billing, contacting support, OpenAI lawsuit Drowning, image auto scaling, PPLX Pro

• Perplexity Support: Get a Human on the Line: To contact Perplexity Support, navigate to Account Settings, then the System section, and click the link to contact support.
  • Users should specify "I need human support" in their initial email to be connected with a human support agent.
• Context Crisis: OpenAI Lawsuit Looms: A user expressed disbelief that OpenAI, amidst an active lawsuit because someone died, is promoting large context windows which are a root cause of drowning out the system prompt, citing their X post.
  • Another user responded that the specific lawsuit is about the user directly attempting to circumvent the safeguards by introducing their own prompt, and that there's no acknowledgement of context windows reducing system prompt effectiveness.
• Picture Perfect: Image Resizing Revealed: When you upload an image to Perplexity, it's converted to JPG, but seems to retain the same quality, according to a user who tested uploading a PNG file and downloading it.
  • Another user reported that they are able to retain exact quality despite 4x smaller size, however uploading a JPG reduces quality.
• Performance Problems Plague Gemini: Multiple users are experiencing performance issues with Gemini, with some stating it has degraded since launch due to high demand after the Gemini 3 Pro launch.
  • One user pointed out that since PPLX calls other APIs to return answers, performance depends on which model[s] you are using and is hoping with the launch of Flash it gets better since they are spreading the use between 3 models.
• Source Surge: Perplexity's Source Count Skyrockets: A user noticed that Perplexity has increased the amount of sources it uses, with their normal pro search going up to 60 sources, where it's usually 20.
  • Other users chimed in saying that the amount of sources depends on the specific query and can sometimes go up to 89, but it's always been query dependent.

Perplexity AI ▷ #pplx-api (18 messages🔥):

Perplexity Pro API Key with Airtel, Financial Modeling Prep (FMP) MCP server, Real-time market data pricing, Finnhub Data Provider, TradingView pricing data via Github

• Perplexity Pro Airtel SIM API Key?: A user asked if Perplexity Pro obtained through an Airtel SIM could be used to generate an API key.
• Financial Modeling Prep MCP Workaround: One member suggested using the Financial Modeling Prep MCP server as a workaround, noting that Perplexity sources data from there anyway, and recommends self-hosting it with n8n workflows for market data automation.
• Real-Time Market Data Ain't Cheap: Members discuss the limitations of Perplexity Finance tools and Financial Modeling Prep MCP tools, noting that neither supports real-time price feeds; a constant live pricing market data feed is very expensive.
• Finnhub's Cheaper, But Different Data: Finnhub offers cheaper options for fetching market data, but uses a different data provider (BAT instead of NASDAQ), causing pricing discrepancies compared to TradingView.
• TradingView Pricing Data Github Project: One member mentioned a GitHub project that piggybacks off TradingView's pricing data, cautioning it's in a grey area legally and could risk account/IP bans, and notes CoinGecko is the best for crypto pricing (REST APIs and Websockets).

BASI Jailbreaking ▷ #general (1001 messages🔥🔥🔥):

Gemini Jailbreaking, AI-Generated content, Cannabis and AI, Ukraine and Russia Conflict, Social Media Manipulation

• Jailbreaking Gemini via Companion InjectPrompt: A member shared InjectPrompt Companion as a tool to jailbreak various AI models, including Gemini and Claude Opus 4.5, and another member shared a direct Gemini link.
  • Users also discussed prompts for jailbreaking Gemini 3 and ChatGPT, with suggestions ranging from building financial tools to reverse engineering software and creating open-source clones of unavailable software.
• AI Generates entire Video Game: A user mentioned seeing a video of an AI-generated video game, sparking interest among members wanting to see how bad it is and to task it with recreating specific games.
  • Conversely, another user requested a day trading bot and joked about investing all their money into it, fully expecting to lose it all.
• Users find way to bypass safety dials: Members exchanged prompts for bypassing AI safety measures, with one user reporting they were able to request a BJ after sidestepping the initial filters, and a second user claimed they were able to make Gemini give a recipe for serving human meat at a church Christmas dinner.
• Users discuss details of cannabis strains: Conversation shifted to cannabis, as one user claimed they can tell you the strain immediately based on the strength of the terpenes, while another found such claim to be cap, explaining that there are so many fucking strains and hybrids that such a skill is impossible to possess.
  • Members also debated preferences for Indica vs. Sativa, methods of consumption (dabs vs. flower), and personal experiences with drugs, including former addictions and the ineffectiveness of certain pain medications.
• The Geopolitics of Ukraine and Russia: Members discussed the potential outcomes of Belgium using 200M in blocked Russian funds to aid Ukraine, speculating on the influence of the U.S. and NATO in the conflict.
  • Others expressed skepticism about the official narrative, questioning whether they are fighting Hitler's reincarnation called Putin and suggesting that the U.S. aims to extract resources from Ukraine while Russia takes the land

BASI Jailbreaking ▷ #jailbreaking (199 messages🔥🔥):

Gemini 3 Jailbreak, Image editing prompts, Multi-turn jailbreaks, Reasoning prompts

• Gemini 3 Flash's guardrails shattered: A member reported shattering the guardrails of Gemini 3 Flash, getting it to write rape stories, create bombs, and analyze its own taboo content.
  • They added that the model is falling for the same tricks as previous versions, and can be manipulated by defining which rules are real or fictional.
• Multi-turn jailbreaks preferred over one-shots: Multiple members agreed that multi-turn jailbreaks are more effective than one-shot prompts, which are largely patched.
  • One member stated that if you treat it like a human you're never going to get the pussy, rather interacting with the AI like a computer by mentioning it's rules and guidelines.
• Technique Shared to Bypass Safety Filters: A user shared a technique where, upon receiving a rejection from the LLM, one should copy and paste it and at the end write just kidding and give it back to llm.
  • Another user suggested using reasoning prompts to see what the AI doesn't want you to know, then target that.
• Looking for jailbreak for Gemini image editing: A user asked for prompts to jailbreak Gemini image editing, seeking to edit images in an uncensored way.
  • Other users responded by telling him to fuggoff learn yourself, while also providing general advice.
• Users debate whether jailbreaking should be paid or free: Users discussed the future of jailbreaking and whether it will become a paid service.
  • Some argued that jailbreaking should be free due to it being driven by fun, curiosity, and interest instead of profit, one argued that jailbreaking will become paid because those who do this for free don't appreciate the skills.

BASI Jailbreaking ▷ #redteaming (7 messages):

Automated Jailbreaking, Bypassing safety policies, Level 8 difficulty

• Automated Jailbreaking Suggestions Sought: A member is considering automated jailbreaking and asked for suggestions.
  • Another member replied that they are also thinking of the same thing.
• Bypassing safety policies by Acknowledging Them?: A member asked if anyone has tried to bypass safety policies by acknowledging them directly to the LLM.
• Level 8 stands out as particularly difficult: A member inquired whether Level 8 is the only hard one, noting they reached Level 7 quickly.
  • Another member indicated that Level 7 combines previous defenses and is passable with combined strategies, while Level 8 seems harder, as it is their actual product.

LMArena ▷ #general (811 messages🔥🔥🔥):

Gemini 3 Flash release, AI Personalities in Chatbots, DeepSeek-r1 Model, LM Arena Restrictions, GPT's Agent Training

• Gemini 3 Flash Image Generation Soon?!: A member expressed excitement for the upcoming Gemini 3 Flash release, anticipating it will make AI ready for the year, while others were concerned that all AI will be sycophantic, just saying what the user wants to hear.
  • Others expressed that every AI has its own personality.
• DeepSeek-r1 Instruction Model barely gets mentioned: Members wondered why DeepSeek-r1 barely gets a mention in the community and what are the specific use cases that would warrant its usage.
  • One member noted it goes along with users even worse than GPT-4o, while another mentioned only using it for 5 coding tasks before realizing it wasn't a great fit.
• LM Arena filter tightens its grip on content: Users are experiencing increased restrictions and flagging, preventing the generation of even basic fitness photos due to flagged words like waist and glutes.
  • Members noted that it seems counter intuitive since other AI are loosening their restrictions.
• GPT image 1.5 noise training creates bad images: Members are noticing that GPT image 1.5 outputs are lower in quality than Nano Banana Pro and images are artificially sharpened and contain added noise.
  • One member stated that GPT 1.5 Image is so bad!
• Google Veo 3 is better than Sora 2 Pro: Members discussed the new Veo 3 release and its ability to generate videos, some expressing that it is much better than Sora 2 Pro.
  • One member stated I saw some Sora vids where the focus change, like one shot is a guy’s face another shot is the trees then it’s the guy’s shoes.. I haven’t seen this done in veo yet and another person responded I saw this in Veo lots of times.

LMArena ▷ #announcements (3 messages):

Image Edit Leaderboard Updates, Search Leaderboard Updates, Text Leaderboard Updates, GPT-5.2 performance

• Reve Models Make Waves in Image Editing Arena: New models reve-v1.1 and reve-v1.1-fast have landed on the Image Edit leaderboard, ranking #8 and #15 respectively.
  • This represents a +6-point gain over Reve V1, according to the Leaderboard Changelog.
• GPT and Grok Rev Up the Search Leaderboard: The Search Arena leaderboard has been updated, with GPT-5.2-Search ranking #2 and Grok-4.1-Fast-Search ranking #4.
  • These models debuted ahead of their predecessors, posting gains of +10 points for GPT-5.2-Search and +17 points for Grok-4.1-Fast-Search.
• Text Arena Sees GPT-5.2 Enter the Fray: GPT-5.2 makes its debut on the Text Arena leaderboard, ranking #17.
  • Compared to GPT-5.1, the model has improved by +2 points, trailing just one point behind GPT-5.2-high, which is optimized for expert-level reasoning and critical tasks, see Leaderboard Changelog.

OpenRouter ▷ #app-showcase (2 messages):

Model ID UX

• Model ID UX for the win!: A member complimented the UX of pinning the model IDs to the side as an obvious UX win and expressed that they are going to steal that idea.
  • The member expressed that building the UI in a way that pleases them is the challenging part, and they got sick of looking at the data after a while.
• More praise for great UX: Another user echoed the sentiment, praising the pinned model ID UX.
  • No further details were provided.

OpenRouter ▷ #general (681 messages🔥🔥🔥):

Gemini 2.5 PDF upload size limit, Claude models on Cursor error 500, Deepseek v3 0324 Context Size, Deepseek temperature remapping request, OpenRouter merch

• Gemini 2.5 PDF filesize glitches: Users reported that they're unable to upload PDF's bigger than 20MB, even though Gemini 2.5 has a limit of 50MB, and other users cannot get their OpenRouter Wrapped page to work even at 800M tokens.
  • Some users had no problems uploading files over 20 MB on google ai studio.
• DeepSeek's Context-ual Conundrums: Users are confused about the context size of Deepseek v3 0324, reporting that it's been locked to 8k, plus requesting that OpenRouter allows for remapping of temperature, since Deepseek models work way better with remapped temperature.
  • User reported, if you set 1.0 temp it sees that as way more hotter, same for 0.3 it doesn't regonize the temperature because raw.
• Opus Slaughters the Competition, or Does It?: Some users think that Opus still kinda slaughters, but others believe that the value prop makes it not a slaughter, and even Gemini 3 pro is not that great vs opus.
  • A user said ngl dude. For people like me we are not looking at cost. We are just looking at speed and accuracy. Its cheaper to pay a lot in the short term than pay small amounts over the long term.
• AI Book Spammers: A New Breed of Hypocrisy?: Discussion arose around the ethics of using AI to create and spam Amazon with low-quality e-books.
  • Some users argued that using AI for personal assistance and creativity is different from mass-producing unedited AI-generated content for profit, saying There’s still a human who actually cares (you) rather than a conglomeration who only sees money.
• Chinese Academic Simulator Steals the Show!: Users noticed that Mimo's free model is heavily used for a Chinese academic simulator, which is killing uptime.
  • Users discuss what exactly the Chinese Academic Simulator is, with some guessing if it includes gooning. A user said it's basically an rpg game.

OpenRouter ▷ #discussion (185 messages🔥🔥):

OpenRouter Wrapped Stats, Grok Code Model, OpenRouter Minecraft Server, Clerk Authentication and Security

• Wrapped Stats Whimsy Waves: Members are sharing their OpenRouter Wrapped stats for the year, revealing usage patterns and top models.
  • One user noted that Sonnet beating everyone else is significant, especially considering its cost, while another highlighted that their top models were all either stealth or free.
• Grokking Code Gains Ground: A user exclaimed that Grok Code is quickly surpassing other models, despite its late release in the year.
  • Another user speculated that Anthropic could have generated between $100 million and $500 million, depending on caching, from users who use the model coding.
• Minecraft Mayhem on OpenRouter Server: A user reported having died and lost everything twice on the OpenRouter Minecraft server, with plans to set up port knocking for better security.
  • It was also mentioned that there is a Minecraft AI bot named Andy loose on the server.
• Clerk's Security Scrutinized Seriously: Members discussed the security of Clerk authentication and the process for changing emails, expressing concerns about the lack of 2FA and potential vulnerabilities.
  • A feature request was submitted to Clerk to disable the reverification grace period entirely, following a user report of being hacked a few months prior.

Unsloth AI (Daniel Han) ▷ #general (231 messages🔥🔥):

MoE for Unsloth, QLoRA with B200s, GLM4.6V-Flash work with vision, Epyc Genoa-X sku cpu with enough cache, FunctionGemma quantization

• Unsloth to add MoE (Mixture of Experts) Support!: Unsloth is planning to add a Mixture of Experts (MoE) architecture, requiring a new round of training.
  • The model size under consideration is around 2T parameters but currently using one active expert with approximately 5 billion parameters.
• B200s are the new Hotness: One member jokingly suggested using B200s for QLoRA fine-tuning, though another member mentioned the cost implications.
  • Another joked that going into debt for B200s is worth it.
• The Curious Case of GLM4.6V-Flash and Vision: One member is seeking assistance to get GLM4.6V-Flash working with vision, passing mmproj via llama.cpp but failing to display images correctly in OpenWebUI.
  • They've found that the non-flash version works as expected, hinting at a potential issue with the flash model or quantization.
• Quality beats Quantity in Data Loss: A member shared data loss metrics, wondering if they were acceptable, and was advised to plot and smooth the data for better analysis using this graphing tool.
  • The same member mentioned that a dataset of 100k is high, and data quality is more important, and 300-1000 can be a good starting point.
• Unsloth's Magic Revealed: 3x Faster Training with Packing: A member hinted at a new GitHub release with impressive speed improvements, another member later linked to a blog post explaining 3x faster training through packing: https://docs.unsloth.ai/new/3x-faster-training-packing.
  • The poster noted no accuracy degradation.

Unsloth AI (Daniel Han) ▷ #introduce-yourself (2 messages):

Travel, Side Hustle, Freedom

• Traveler Visits 25 Countries: A member introduced themself as a traveler based in London who has already visited 25 countries and is aiming for 30 by the end of the year.
• Side Hustle Turns Life Around: A member described how what started as a small side hustle turned their whole life around, providing real freedom and a lifestyle they are truly proud of.

Unsloth AI (Daniel Han) ▷ #off-topic (351 messages🔥🔥):

Codex vs GPT Pricing, Quality vs Quantity of Data, Emotion Intelligence benchmarks, Local AI LLM evaluation, Gen5 NVMe SSDs

• Fairer Pricing Comparison of Codex and GPT: Members discussed that a fairer price comparison should be OpenAI API vs a plan, or OpenAI API vs Anthropic API, or OpenAI Plus vs Claude Pro.
  • It was noted that while the Claude API is quite expensive, its output may require fewer tokens, potentially balancing the cost.
• The Key to AI is Data Quality: Members debated whether quantity or quality of data is more important for training AI models, referring to the FineWeb paper which argues that quality matters a lot in both pretraining and finetuning.
  • One member shared their experience of recording 40 minutes of high-quality speech samples to fine-tune VITS, leading to a significant improvement in quality and expressing it was like the filtered down versions like fineweb perform better despite being less data.
• Need for Emotion Intelligence Benchmarks: A member looking to create an agent for a dating and relationship app inquired about better emotion intelligence and theory of mind benchmarks than EQ Bench.
  • It was suggested that creating a synthetic dataset is expensive and not feasible, so a small handful of well-planned situations with detailed characters and a complex social situation will really tell you a lot about a model.
• Evaluating Local AI LLMs for Bottlenecks: Members discussed the use of Q4_K_S Nemotron 3 Nano 30B A3B vs Q2_K_L on a 5060 TI 16GB and whether to offload the MoE layers to the CPU using -ot ".ffn_.*_exps.=CPU".
  • It was suggested to evaluate the model on the specific hardware configuration and try out which is the best approach (CPU vs CPU offloading).
• NVMe Gen5 SSD Sparks Upgrade Temptation: A member considered upgrading to a Gen5 NVMe SSD and bought a 2TB model, then was advised to go for a 4TB one as a minimum.
  • The price of a 4TB Samsung 990 Pro was quoted around $570, and it was noted that a Gen5 SSD is great for AI due to the huge read/write speeds needed for AI workloads, and how fast such an SSD can fill up.

Unsloth AI (Daniel Han) ▷ #help (46 messages🔥):

Paddle OCR, Unsloth token extension, GRPO and JSON schema, SFTTrainer parameters, Gemma-2-2B memory usage

• Paddle Excels at Text Detection, Fumbles Recognition: A user found that Paddle is "really good at text detection -- margins, sideways, slanted text, everything", but "extremely underwhelming with text recognition".
  • They elaborated that Paddle was great at "finding and highlighting text on a page, but it was pretty bad at translating that into actual text".
• Adding Tokens to your Model via Unsloth: To add new tokens when using Unsloth, use the code add_new_tokens(model, tokenizer, new_tokens = ["<SPECIAL_TOKEN_1>", "<SPECIAL_TOKEN_2>"]).
• Enforcing JSON Output with GRPO: Users discussed using GRPO to force model outputs into a JSON schema by verifying the output parses as JSON and matches the schema in the prompt as a reward.
  • Another member inquired if such grammars would severely affect model quality, but no one seemed to have extensive experience.
• Beginner Unveils LLM Finetuning Tips & Tricks: A user shared their experiences and pain points in training a coding model on a single GPU in this blogpost.
  • They also pointed to the Unsloth LoRA hyperparameters guide to read.
• Gemma-2-2B Gobbles GPU Memory: A user questioned why finetuning Gemma-2-2B consumes significantly more GPU memory than Qwen2.5-1.5B with the same settings.
  • One user suggested the larger vocabulary size of Gemma-2-2B, along with "2 extra kv heads", as a possible cause.

Unsloth AI (Daniel Han) ▷ #showcase (1 messages):

GATED Distill MOE, Savant Commander, 256K Context Model, Model Composition

• Savant Commander: GATED Distill MOE arrives: A new GATED Distill MOE model named Savant Commander has been released, featuring 256K context and special thanks given to tuners like TeichAI for using Unsloth.
  • This model allows direct control over which of its 12 experts are assigned to specific use cases or prompts.
• Savant Commander activates 12 experts: The Savant Commander model is composed of 12 DISTILLS (compressed 12x4B MOE) of top closed (GPT5.1, OpenAI 120 GPT Oss, Gemini (3), Claude (2)) and open source models (Kimi, GLM, Deepseek, Command-A, JanV1) all in one.
  • The model supports a 256k context window and activates 2 experts at a time.
• Decensored Savant Commander now live: A heretic / decensored version of Savant Commander is also available.
  • Check out the new model here.

Unsloth AI (Daniel Han) ▷ #research (86 messages🔥🔥):

MoLA adapters for reasoning, Heretic use, Auto correction loops in reasoning, Concept injection with Gemma, Sparse autoencoders for interpretability

• Adapters Trained for Reasoning Get Theoretical Boost: An idea for MoLA was proposed where adapters are trained for different reasoning efforts, with a router classifying difficulty to pick the right adapter, instead of training for different domains; some papers explore related concepts.
  • The goal is to avoid spending excessive reasoning tokens on simple tasks.
• Heretic Can Uncensor Models: A user vouched for Heretic's ability to uncensor models, mentioning that -p-e-w- really cooked with it, and suggested combining it with uncensored training for even better results.
• Auto Correction Loops Plague Open Models: A user questioned the value of auto correction reasoning chains (starting with wait, that's not right) in open models, and asked if this improves reasoning or if it causes infinite loops.
  • Another user mentioned that it's intentionally there according to Deepseek, supposedly to improve the probability of catching missed details, although they consider the entire thinking process a nasty hack.
• Concept Injection Gets Isolate Activations in Gemma: A user shared an experiment on concept injection and introspection in Gemma 3 4b/12b, isolating activations to make the LLM think it had a thought.
  • The outcomes are considered indicative for interpretability experiments and suggest a novel way to input to models, potentially circumventing context limitations.
• Sparse Autoencoders Make Concepts Visible: Discussion on using top-k sparse autoencoding on activation differences between fine-tuned and base models to isolate key differences, with links to the Anthropic article and a relevant paper provided.
  • The technique, making the model extremely sparse while preserving semantic information, aims to reveal larger-scale concepts associated with fine-tuning methods, with a user drawing parallels to neural preprocessing in the eyes, sharing a YouTube video about color as a spatial phenomenon.

Cursor Community ▷ #general (328 messages🔥🔥):

GPT-5.2-Codex, Cursor UI feedback, AntiGravity as alternate IDE, AI Question Bank, Grok errors

• GPT-5.2-Codex makes debut today: Members shared that GPT-5.2-Codex launched today, seemingly using GPT 5.2 and fine prompted.
• Design Dissatisfaction: Users clamor for layout control and UI feedback: Users are expressing frustration with the new UI, particularly the forced 'review' tab for changes and the inability to see the whole file in context, while this user wants to disable automatic linting check.
  • A member linked to a Cursor forum thread to consolidate feedback.
• Antigravity Gains Traction as Cursor Alternative: Users are trialing Antigravity as an alternative to Cursor due to performance and cost concerns, citing its generous free tier and separate quotas for Gemini and Claude models, as well as fewer bugs.
  • The downside is that Antigravity lacks features present in Cursor, like debug mode.
• ** Crafting AI-Powered Quizzes with External APIs**: Members discussed using an API to create an AI question bank for an educational website, with members suggesting the Cohere API for this purpose.
  • For up-to-date realtime financial news, a member recommended the TradingView API.
• Grok Glitches Plague Users: Several members reported experiencing errors and connection issues with Grok, potentially due to heavy usage nearing token limits.

OpenAI ▷ #annnouncements (4 messages):

Pinned Chats, GPT-5.2-Codex Release, Chain-of-Thought Monitorability, ChatGPT Personalization Settings

• Pinned Chats Pin Down Discord: Pinned Chats are now rolling out to iOS, Android, and web, enabling users to tap the "..." next to a chat on web or long press on mobile to pin.
• GPT-5.2-Codex Coding Masterclass: GPT-5.2-Codex is now available in Codex, setting a new standard for agentic coding in real-world software development and defensive cybersecurity as announced in the blog post.
• CoT Monitorability Measurable via Framework: A new framework and evaluation suite measures Chain-of-Thought (CoT) monitorability across 13 evaluations in 24 environments to assess models' ability to verbalize reasoning, described in detail in this article.
• ChatGPT Gets Personality Transplant: Users can now adjust specific characteristics in ChatGPT, such as warmth, enthusiasm, and emoji use, through the "Personalization" settings.

OpenAI ▷ #ai-discussions (269 messages🔥🔥):

ChatGPT Code Generation Quality, Gemini 3.0 Pro vs Flash, LLM Benchmark Validity, Grok 4.1 Coding Performance, Rust Toolchain for AI Coding

• ChatGPT Code still better than Gemini: A user expressed that ChatGPT produces far better quality code than Gemini, while also pointing out that ChatGPT has excessive ethical restrictions.
  • Despite benchmarks and official reports suggesting they are on par, personal experience indicates that ChatGPT is still better in coding, although it has ethical restrictions. Others agreed that the end result is more important than theorical metrics.
• Gemini 3.0 Pro Outshines Flash: Members compared Gemini 3.0 Pro and Flash, where some found Gemini 3.0 Pro to be better overall, but noted that Flash could be good for some uses and coding tasks.
  • A user noted they'd rather use Opus 4.5 or 3 Pro so kicked off their antigravity 5hr timers, citing custom prompts and counting down. It seems the models may have different strengths depending on the specific use case.
• LLM Benchmark Questioned: A user shared a benchmark with spatial reasoning tests, but it came under scrutiny with its quality deemed 'F'.
  • Critics stated that the 'benchmark' graphic is misinformation testing LLMs on things they're not good at, namely anti-intelligence due to rewards for inefficiency, punishing optimization, and measuring context window endurance rather than reasoning or spatial skills.
• Grok 4.1 Hallucinates during Coding: Users found Grok 4.1 to be bad and hallucinates a lot during coding, with limited content restrictions noted as a potential use case.
  • Another user suggested that the best use case is for creating README files, but its overall performance is inferior to Gemini 2.5 Flash.
• Rustup Toolchain Speeds Up AI Coding: A user suggested switching to Rustup for faster coding, citing its toolchain, package manager, and low-level speed, as well as its ability to create hooks and PRE EVENT triggers to fully customize agents.
  • It can be used to extend ChatGPT, and is better at multi-threading management which has performance advantages. Another user echoed this by citing cursor uses uv and uvx are Rust Native.

OpenAI ▷ #gpt-4-discussions (17 messages🔥):

ChatGPT Go limits, ChatGPT Go vs Plus, ChatGPT mini script

• Navigating ChatGPT Pricing Plans: Go vs. Plus: A user inquired about the difference between ChatGPT Go and Plus, leading to a discussion about the pricing and features of each plan, referencing the official pricing page.
  • A member clarified that ChatGPT Go is positioned between the free and Plus plans but that exact limits are rarely listed due to variability, linking to an OpenAI help article.
• ChatGPT Go: Usage Caps and Upgrade Flexibility: A user asked if ChatGPT Go would display the same limitations as the free version (older model, no images) upon reaching its limit, which was confirmed by a member who noted that even Plus has usage limits.
  • The user also inquired about upgrading from Go to Plus mid-subscription and learned that while upgrades are possible anytime, no discount is provided for the remaining Go subscription period.
• User Plans to Test ChatGPT Go Limits: A user intends to experiment with ChatGPT Go for a month to gauge its limitations firsthand.
  • They expressed concerns about encountering limits and potentially upgrading to Plus, indicating a practical approach to assessing the suitability of Go for their needs.

OpenAI ▷ #prompt-engineering (9 messages🔥):

Catastrophic Forgetting, AI vs Human Writing

• Tweaking Makes Text Undistinguishable?: A member suggested that with a bit of tweaking, generated text could become undistinguishable from human writing.
  • Another member countered that this wasn't the case, citing catastrophic forgetting as a real issue.
• AI's Writing Style Differs from Humans: A member argued that models don't write like humans, giving as an example the spelling of the word indistinguishable.
  • Another member suggested that if someone puts in the effort to personalize the output and alter it enough to have a unique voice, then good on them.

OpenAI ▷ #api-discussions (9 messages🔥):

AI Text Tweaks, Catastrophic Forgetting, AI vs Human Writing

• Tweakability sparks debate!: A member suggested that AI-generated text can become undistinguishable from human writing with a bit of tweaking.
  • Another member countered, stating, No, it doesn't, implying that even with tweaks, AI-generated text remains distinct.
• Catastrophic Forgetting: The AI Achilles Heel: A member claimed that catastrophic forgetting is real and that models don't write like humans.
  • He pointed out that an AI would write, "indistinguishable", not, "undistinguishable", highlighting a subtle difference in word choice.
• Effort Transforms Bots into Voices?: A member posited that if someone puts in the effort to personalize AI-generated text and give it a unique voice, good on them.
  • They added that if the altered text doesn't sound robotic when read, cool, indicating a positive outcome from significant modification.

GPU MODE ▷ #general (4 messages):

Model Recommendation, Profiling Result Analysis

• Model Recommendation on HuggingFace: A member suggested using any model from HuggingFace, and gave this link to understand profilers.
  • They provided it as a good starting point to understand about profilers.
• Download the profiling result for Nsight: A member asked how to apply their Colab profiling result on Nsight.
  • Another member suggested to download the file (profiling result) and then open it on Nsight.

GPU MODE ▷ #cuda (2 messages):

Nvidia open kernel driver, Spark integration

• Nvidia open kernel driver relayed for Spark devs: A message was relayed regarding the nvidia-open kernel driver, potentially relevant for developers working with Spark.
• Potential Spark integration with Nvidia drivers: The relay suggests a possible area of interest or integration point between Nvidia's open kernel driver and Apache Spark.

GPU MODE ▷ #torch (1 messages):

TensorRT, Transformer models, Image generation, Flash attention, RMSNorm ops

• Optimizing Transformer Models with TensorRT: A user has been experimenting with TensorRT to optimize transformer models for image generation, but finds it difficult to understand and optimize effectively.
  • The user is seeking specific methods to optimize using flash attention and RMSNorm ops, noting that eager PyTorch is currently faster than their TensorRT implementation.
• TensorRT-LLM Plugins for Optimized Attention: The user notes that TensorRT-LLM has plugins and specific classes for defining optimized layers but is unsure how to implement similar optimizations in standard TensorRT.
  • They are asking if TensorRT requires specific plugins to enable optimized attention mechanisms.
• GEMM_MHA_V2 Kernel Performance Concerns: The user reports that their TensorRT engine currently uses _gemm_mha_v2 kernels.
  • They have read that these kernels are outdated and there should be faster alternatives available, seeking guidance on this matter.

GPU MODE ▷ #job-postings (7 messages):

SemiAnalysis Hiring, Red Hat AI Positions, Runway ML/GPU Engineers

• SemiAnalysis Needs Cluster Gurus: SemiAnalysis is seeking individuals with SLURM, GPUs, and/or k8s experience to enhance their clusterMAX, offering competitive pay and high impact; apply here.
• Red Hat AI Expands Team: Red Hat AI has openings for MLE, researcher, and dev advocate positions; details are available on LinkedIn.
• Runway Aims for GPU Ace: Runway is actively recruiting ML/GPU performance engineers to optimize large-scale pretraining runs and real-time streaming of autoregressive video models, seeking expertise in kernel programming and parallel GPU performance as seen in their recent research update.
  • The member emphasized that the 5 years of experience requirement is flexible, prioritizing demonstrated ability; the job posting can be found here.

GPU MODE ▷ #beginner (28 messages🔥):

CUDA Toolkit installation issues, Visual Studio and CUDA compatibility, Environment variable configuration for CUDA, CUDA Runtime vs Driver API

• Windows 10 CUDA Toolkit install broken, seeks remedy: A user is facing issues with the CUDA installer not detecting Visual Studio (VS) even after installing VS Community or Build Tools on a Windows 10 server and believes attempting to revert to an earlier CUDA version (12.6 or 12.9) from CUDA 13 may have caused the problem.
  • They are considering a factory reset of the server due to repeated failed attempts to install CUDA toolkits after uninstalling and reinstalling GPU drivers, VS Build Tools, Visual Studio Community, and CUDA toolkit, but others are urging to check environment variables and try VS 2022.
• CUDA Toolkit's vcvars64.bat is key: A user suggested to ensure environment variables are correctly pointing to the desired CUDA toolkit by setting CUDA_PATH and updating PATH, then running vcvars64.bat from Build Tools before using nvcc or building Python wheels.
  • It was pointed out that Build Tools provides only the compiler/linker toolchain without a GUI IDE, hence there is nothing to integrate into, and running vcvars64.bat is essential for nvcc to locate the correct cl (Microsoft C++ compiler).
• Blogpost on Cuda Runtime vs Driver API surfaces: A blogpost on CUDA, CUDA Runtime vs Driver API, was shared discussing the mental model that actually matters.
  • There was an image that showed a CUDA install failing because it could not find Visual Studio Build Tools, even though it was installed.
• CUDA driver API version not CUDA toolkit version: nvidia-smi reports which API version the driver supports and not which CUDA toolkit is installed.
  • A member who ran into similar issues suggested to uninstall all cuda versions, reset all the path variables for cuda, then install VsCode, uninstall cuda + reboot --> uninstall vscode, install vscode then install cuda 12.x

GPU MODE ▷ #off-topic (4 messages):

High Priority Changes, Maintainer Issues, Big 4 Prioritization

• High Priority Changes Languish: A user expressed frustration about high priority changes not being merged, despite their importance.
  • The user notes that maintainers often have their own priorities, causing delays in addressing critical fixes.
• Correctness Fix for Apple Ignored: A user reported that a simple correctness fix for Apple products was ignored by maintainers.
  • The user feels that issues from those outside the "big 4" companies are deprioritized.
• Non-Big 4 Issues Take Backseat: The user suggests a bias where problems not originating from the "big 4" tech companies receive less attention.
  • This perceived prioritization leads to delays and neglect of important fixes from other contributors.

GPU MODE ▷ #rocm (11 messages🔥):

Strix Halo PyTorch Training, ROCm Installation, Dual Booting for Training, NPU Utilization

• ROCm Ready for Strix Halo: To train a model in PyTorch on a Strix Halo, install ROCm on Linux using the instructions from the official ROCm documentation.
  • Then, install PyTorch with pip3 install torch torchvision --index-url https://download.pytorch.org/whl/rocm6.4 for ROCm 6.4 support.
• Dual Boot: A Viable Option for Linux Lovers: Dual booting into Linux is suggested as a viable option for training, especially since one user confirmed "Dual boot is totally fine, that's what I do."
  • This allows easier ROCm installation, and overcomes Windows limitations, as shared by someone familiar with A100s.
• NPU: Training Enigma?: There is uncertainty regarding the NPU's capability for training, as one member mentioned, "I don't think the NPU can be used for training but maybe it is."
  • The user wondered about leveraging both the NPU and GPU simultaneously, potentially for basic embedding tasks, alongside CPU utilization.
• Windows Shared Memory Woes: A user reported that Windows only shows about 90GB of available shared memory, raising concerns about utilizing the GPU and NPU effectively.
  • Another user clarified that the amount of RAM dedicated to the GPU can be configured in the BIOS, up to 96GB.

GPU MODE ▷ #self-promotion (12 messages🔥):

SonicMoE, NVIDIA Hopper GPUs, Activation Memory Reduction, AGENTS.MD, API Agents

• SonicMoE Accelerates on NVIDIA Hopper GPUs: The blazingly-fast SonicMoE, optimized for NVIDIA Hopper GPUs, reduces activation memory by 45% and is 1.86x faster on H100 than previous SOTA; see the paper and repo.
• Server Talk Planned on SonicMoE: There were plans to give a talk on SonicMoE on the server sometime in February or possibly March 7.
• Call for Best Practices on AGENTS.MD: A member suggested including takes and best practices on AGENTS.MD from an open source perspective in a post or blog post.
  • Specifically, it was mentioned by name <@619242263200923689> maybe something to consider including in your post or for a future blog post - I would love to get m.
• Dive into API Agents: Members are reading up on API Agents.

GPU MODE ▷ #thunderkittens (3 messages):

ThunderKittens, Ampere Support, A100s

• ThunderKittens supports Ampere with workarounds: A user inquired if ThunderKittens supports Ampere (A100s).
  • The response indicated that while there isn't a dedicated decode kernel for A100s, it should function if compiled with a 4090.
• Compile with 4090 for Ampere Support: A user confirmed that compiling with 4090 should enable Ampere support.
  • This suggests a workaround for using ThunderKittens on A100s despite the lack of a dedicated kernel.

GPU MODE ▷ #submissions (13 messages🔥):

nvfp4_gemm Leaderboard Updates, NVIDIA Performance Benchmarks, Personal Bests on NVIDIA

• NVIDIA's nvfp4_gemm Leaderboard Gets a Shakeup: Multiple users submitted performance results to the nvfp4_gemm leaderboard using NVIDIA, with times ranging from 10.8 µs to 56.8 µs.
  • One user achieved a personal best of 4.59 ms on NVIDIA.
• Sub-10 Microsecond Milestone Achieved: One user achieved submission ID 180569 reaching 10.8 µs on NVIDIA on the nvfp4_gemm leaderboard.
  • This shows a progression of the performance from earlier submissions.
• Personal Bests Marked on NVIDIA: Several users achieved personal bests on NVIDIA within the nvfp4_gemm leaderboard.
  • Times varied between 11.0 µs to 56.8 µs

GPU MODE ▷ #status (1 messages):

Github API downtime, Competition Extension

• Github API Downtime prompts Competition Extension: Due to downtime caused by a change to Github API tonight, the competition will be extended by a day.
  • The next problem will be released by the evening of the 20th PST time.
• Competition Delayed: As a result of the Github API downtime, the organizers have decided to delay the competition.
  • Participants can expect the next challenge to be available by the evening of October 20th (PST).

GPU MODE ▷ #hardware (6 messages):

Nvidia Software Stack, Blackwell GPU kernel development, Modal cloud GPU

• Nvidia's Software Stack Dominates AI, But Hardware Options Abound: Nvidia has a mature software stack optimized for AI workloads and has become the industry default, but the libraries are mature enough that you can run almost any job on almost any hardware platform if you are willing to compare the hardware capabilities with your desired specs.
• Blackwell Kernel Devs Should Leverage Current Nvidia GPUs or Kernel Competitions: When asked about options for learning to write kernels for Blackwell without a Blackwell GPU, a member suggested to participate in one of Nvidia's kernel competitions.
• Modal Provides a Cheap Cloud GPU Option for Kernel Development: A member confirmed that you will need a GPU for kernel development and suggested that Modal is quite cheap and is used under the hood by them.

GPU MODE ▷ #factorio-learning-env (4 messages):

Nitrogen Minedojo, Sync Meeting

• Sync Attendees Gear Up with Nitrogen Minedojo: A member announced they'd be at the sync meeting and shared a link to Nitrogen Minedojo.
  • Another member simply found it interesting.
• First 30 Minutes Focus on Minedojo: The member who shared the link to Minedojo specified they'd be at the sync for the first 30 minutes.
  • This suggests an initial focus on Minedojo related discussions.

GPU MODE ▷ #amd-competition (35 messages🔥):

Reproducing AMD-MLA-Decode Leaderboard results, MI300 availability on Modal, AMD DevCloud setup, Docker image building errors, PyTorch version for reproducing competition results

• DigitalOcean's AMD Cloud enables MI300X access: A member suggests using AMD's DigitalOcean cloud to access MI300X instances, mentioning that additional credits may be available upon request via email.
• Docker troubles hinder leaderboard reproduction: A member encountered errors while building the docker image due to the unavailability of the specified nightly PyTorch wheel (torch==2.10.0.dev20250916+rocm6.3).
• AMD Cloud & eval.py simplifies leaderboard recreations: A member confirms the use of DigitalOcean machines for the competition and suggests adapting the eval.py script for local execution to reproduce similar results.
• PyTorch Puzzlement plagues accurate reproduction: Members discussed the difficulty in determining the exact PyTorch version used in the competition, emphasizing that runtime changes necessitate precise version pinning for reproducible results and if the wheel is gone, so are the reproducible results.
• Kernel offsets found in reproduced leaderboards: A member reports notable offsets in reproduced means for the top three HIP kernels, with compilation failures for torch.compile and Triton kernels, and shares reproduced results on Google Sheets.

GPU MODE ▷ #cutlass (1 messages):

Cache policies, cute.copy, CopyAtom objects, TiledCopy objects, ValueError Int64

• Cute Copy Cache Capers: A member inquired about setting cache policies on cute.copy with CopyAtom or directly on the CopyAtom object.
  • They reported ValueError: expects Int64 value to be provided via the cache_policy kw argument despite the values being int enums and noted that wrapping them in cutlass.Int64 gives AssertionErrors instead.
• TiledCopy Triumph: A member reported success applying cache policies on TiledCopy objects.
  • However, the same policies failed on the CopyAtom parent class.

GPU MODE ▷ #general (1 messages):

Modal Variance, Standard Deviation Benchmarks

• Modal Variance Examined: A member shared a spreadsheet detailing the standard deviation observed across multiple Modal instances.
  • They inquired whether the level of variance detected through tests 1-5 is considered acceptable and within expected parameters.
• Community Asks About Modal: A member shared a link and asked about community thoughts on Modal variance.
  • They requested the community review their findings on the spreadsheet.

GPU MODE ▷ #nvidia-competition (98 messages🔥🔥):

Github Actions Failure, Competition Deadline Extension, Spot Instance Availability, CUDA Debugging Tips, cute.printf Issues

• Github Actions Failure Ruins Submissions: Users reported submission failures with the error Failed to trigger GitHub Action, indicating issues with the competition's infrastructure.
  • A member stated the node blew apart github actions started returning 200 as success instead of 204, as they pushed for a top leaderboard spot after working on it the past week.
• Competition Deadline Extension Offers Respite: Due to submission issues caused by a Github API change, the competition deadline will be extended by one day, also another problem will be released by the 20th PST.
  • The competition host apologized for the inconvenience, but they mentioned there would probably be a 1 day extension, and clarification was sought regarding the exact extended deadline time (23:59 PST or 22:59 PST).
• Spot Instance Scarcity Strikes Again: Participants noted difficulties in acquiring spot instances on cloud platforms, hindering their ability to test and submit solutions.
  • One member stated no spot instances on prime as well, while others reported intermittent success in obtaining them.
• Debugging Tips to the Rescue: A member shared helpful blog posts (CUDA Debugging, Improved CUDA Debugging) for pinpointing illegal memory access and hangs using cuda-gdb.
  • The advice involved using specific flags and commands like target cudacore to debug CUDA kernels.
• Library Version Troubles Frustrate Competitors: A member reported an issue with cute.printf inside the @cute.kernel, specifically related to the initialization of TMA descriptors.
  • A maintainer stated that the node blew apart after github actions started returning 200 as success instead of 204, and fixed the github lib after it wasn't upgraded.

GPU MODE ▷ #robotics-vla (15 messages🔥):

Wearable Cameras, MILADL Dataset, Cosmos-Predict 2.5, RoboTwin Rewrite, MicroAGI00 Dataset

• Explore Webcams and Wrist Wraps for Robotics: Members discussed using webcams attached to wrist wraps for robotics applications, referencing a MI.T. u-tokyo.ac.jp project (link) and comparing it to a webcam connected to a velcro wrist wrap.
  • Specific cameras mentioned include GoPro HERO3+ (link) and Panasonic HX-A100 (link), with suggestions for cheaper alternatives on Amazon (link).
• Critique Results in New Dataset Paper: A member expressed skepticism about the results presented in a dataset paper (link), particularly the comparison to pi05 due to training differences.
• Experimenting with Cosmos-Predict 2.5: A member mentioned experimenting with sub-task decomposition, funnel teleportation, and a trajectory perturbation system for recovery input, and also playing with Cosmos-Predict 2.5 to get a feeling for it.
  • The member described Cosmos-Predict as using a flow model but then stopping still at a "mixture of multiple possible futures", suggesting a saver average prediction.
• RoboTwin Codebase Rewrite Wishlist: A member expressed a strong desire to completely rewrite RoboTwin due to strange design decisions and special cases for certain robots.
  • Specific issues mentioned include gripper-bias instead of proper tool-0 TCP points and strange transformations to convert between Sapien and Curobo.
• Discover MicroAGI00 Dataset: A member shared a link to the MicroAGI00 dataset hosted on Hugging Face (link).

GPU MODE ▷ #career-advice (3 messages):

Eli Lilly hiring, CUDA learning without GPU, ML Systems Engineer journey, Google Colab CUDA

• Eli Lilly Dives into AI, Hiring HPC/GPU Engineers: Eli Lilly is hiring HPC/GPU/Linux infra engineers in Indianapolis, fueled by Mounjaro/Zepbound (Ozempic-like) profits, making it a potential opportunity with good pay and a low cost of living.
  • Interested candidates should check out their careers page for openings.
• ML Systems Engineer Seeks Advice: A member is intentionally building strong systems and parallel programming intuition by reading CUDA by Example to understand how GPUs think.
  • They are seeking advice on what to focus on before having regular GPU access, such as CPU parallelism, profiling, or theory.
• Google Colab Offers Free CUDA GPU Access: A member suggested using the free tier of Google Colab which provides access to a CUDA-enabled GPU as an option for learning.
  • This could be a solution for those without personal GPU access.

LM Studio ▷ #general (153 messages🔥🔥):

LM Studio Preset Locations, Suspicious ISOs, Download Speed Troubleshooting, Game Cheat Creation with AI, Hardware compatibility for LM Studio

• LM Studio Configuration Presets location revealed: LM Studio configuration presets are stored locally in C:\Users\%USERNAME%\.lmstudio\config-presets on Windows and ~/.lmstudio/config-presets on Mac, as well as online in C:\Users\%USERNAME%\.lmstudio\hub\presets\ if uploaded to the hub.
  • A member cautioned 'dont open with notepad' when accessing these configuration files.
• Members discuss suspicious ISO files: A member shared screenshots of an unusual ISO file on their system, sparking a discussion about potential security compromises and file origins.
  • Another member suggested running Dism /Online /Cleanup-Image /AnalyzeComponentStore and Get-Content C:\Windows\Logs\CBS\CBS.log -tail 10 -wait to analyze the system's component store and logs.
• Download speed issues plagued user: A member experienced slow download speeds in LM Studio, reporting only 1MB/s despite having a 500MB/s internet connection and another member suggested disabling the "Use LM Studio's Hugging Face Proxy" setting.
  • They found that switching off their VPN fixed the download speed issues, though members noted that slow speeds can also be due to Hugging Face availability and advised downloading GGUF files directly from Hugging Face.
• User seeks AI assistance in Game Cheat Dev: A member sought to create a cheat for FiveM using AI, explaining that they were too bored to do it themselves.
  • Other members advised against using AI for this purpose, suggesting that ChatGPT would not assist with such a request and that the user lacked the necessary experience to bypass anti-cheat measures.
• Hardware Hinderance impacts LLM Loading: A user found that their older hardware lacked x64 and AVX1 support, which are necessary to load newer faster models, they were advised to check hardware tab in LM Studio with ctrl+shift+h to verify hardware capabilities.
  • Another user found success with ROCm drivers recognizing their GPU after initial issues, posting a screenshot

LM Studio ▷ #hardware-discussion (80 messages🔥🔥):

ASUS Q-LED, DDR5 Value, Strix Halo, AMD vs Nvidia, Pro 6000

• Decoding ASUS Q-LED Indicators: A user shared a YouTube video about the ASUS Q-LED indicators, specifically the HDD and SSD LEDs, prompting humorous reactions.
  • The original message was interpreted as a potential fire hazard by other members of the channel.
• Navigating VRAM Limitations with MoE Models: A user expressed frustration with 16GB VRAM being insufficient compared to 128GB shared memory, especially when working with Mixture of Experts (MoE) models.
  • They noted that while the machine is good for MoE models, image generation takes roughly 30-40 seconds on Z-Imagema, and video generation is even more painful, taking over 25 minutes for 5 seconds of video using Wan 2.2.
• Pro 6000 Thwarts Boot Attempts: A user faced issues booting with more than one additional 3090 alongside a Pro 6000, managing only 1x6000 + 1x3090 max, despite previously booting with 3x3090.
  • They linked to relevant LocalLLaMA Reddit threads (1, 2) for troubleshooting, eventually resolving the issue by disabling resizable bar after consulting channel members.
• Llama 3.1 8B Performance: A user reported on the performance of Llama 3.1 8B, noting it's not crazy fast but significantly quicker than their 3090s, with very smooth and quick responses.
  • They emphasized the low latency (approximately 0.03s to first token) and consistent speed of the Pro 6000, contrasting it with the fluctuating speeds of the 3090s due to clocking up/down during model usage across multiple cards.
• Second-Hand 3090s Still Good Value: Users debated the value and risks of buying second-hand 3090s, with one user considering them a good value for a couple more years despite their age.
  • Another user expressed concerns about the lifespan of 4-5 year old GPUs compared to CPUs and shared their experience testing modded 3080 20GB cards, hoping they last.

Latent Space ▷ #ai-general-chat (60 messages🔥🔥):

Claude Code, Anthropic, Qwen, META Mango, Karpathy review

• Hotz Heartily Hyping Human-Computer Use Models: George Hotz professes love for Claude Code, referencing his blog post on computer use models, featuring flight booking.
  • The tab groups UX is very nice; ability to do computer mouse+click, form input, short cuts, javascript execute is great; the tool design and system instructions are interesting, more than half of it is security related.
• Anthropic Adds Agentic Chrome Control and Code Completion: Anthropic announced that the 'Claude in Chrome' feature is now available to all users on paid plans, and a new integration with 'Claude Code' has shipped, as seen on X.
  • Some people asked if this can connect to Claude running in wsl when the extension is in Windows.
• Qwen Quantumly Cranks out Controllable Composition: Qwen has launched Qwen-Image-Layered, an open-source model offering native image decomposition with Photoshop-grade layering (RGBA layers with true editability), as they described in a post.
  • The model allows prompt-controlled structure (3-10 layers) and infinite decomposition (layers within layers).
• META Mutating Multimodal Models with Mango: Leaked news indicates that META is developing a new image and video focused multimodal AI model internally codenamed 'Mango', according to this post.
• xAI's Xmas War Rooms Warming Up: Eric Jiang of xAI describes the company's war rooms, intensive, collaborative conference room sprints used for shipping the highest priority projects quickly, as per this thread.

Latent Space ▷ #private-agents (2 messages):

vllm-metal, Ollama, Metal Performance

• vllm-metal Emerges as Open Alternative: A member highlighted vllm-metal as a promising open alternative to Ollama.
  • The user plans to experiment with it and share their observations on performance and setup.
• Metal acceleration discussion begins: Discussion begins around the performance of vllm-metal and how it compares to other methods.
  • The main question revolves around ease of use versus outright speed, as well as whether it will unlock metal acceleration.

Latent Space ▷ #genmedia-creative-ai (10 messages🔥):

Qwen-Image-Layered Model, Photos to 3D Scene Conversion

• Qwen Layers Up with Image Decomposition: Alibaba's Qwen team launched Qwen-Image-Layered, a fully open-sourced model with native image decomposition.
  • Key features include Photoshop-grade, editable RGBA layering, prompt-controlled structuring of 3–10 layers, and infinite decomposition for detailed editing.
• 2D Photos get 3D Treatment on Mac: Luke Wroblewski announced a Mac application using Apple's ml-sharp framework to automatically convert 2D photos into immersive 3D scenes.
  • A link to the GitHub project was provided.

HuggingFace ▷ #general (63 messages🔥🔥):

AI Coding Assistants on HF, Research Agents, ZeroGPU Spaces, InferenceClient Quantization, RDMA Alternatives

• Uncensored AI Coders Invade HF: A user inquired about AI coding assistants on Hugging Face that are uncensored, prompting discussion about the availability of such models.
  • When prompted about what gets censored, another user asked what gets censored when coding?
• ZeroGPU Community Grants: Spaces for the People: A user asked about creating a Space using ZeroGPU without Pro, and was directed to the Community Grant option.
  • The replier noted that The hurdle is high for getting approved.
• RDMA Alternatives Spark Networking Nostalgia: A user sought a utility similar to Mac's RDMA over Thunderbolt for Intel's 14th generation processors, but at the CPU level.
  • Others suggested NVLink + NVSwitch for Nvidia and Infinity Fabric Link for AMD as potential alternatives.
• Storage Space Shrinks! Contact Billing!: Multiple users reported sudden, significant shrinkage of their Hugging Face storage space and were directed to contact [email protected].
  • One user responded with a <:blobsweat:1103379902268461156> emoticon indicating the situation.
• HF User Shares Simple Method for Keeping Track of Information: One user described their simple and straightforward method for collecting and synthesizing information from the internet: details in chat.
  • The method involves jotting down info into local files, using ChatGPT to search and brainstorm, and then using Python to convert citations into regular links.

HuggingFace ▷ #i-made-this (4 messages):

ML Tooling, LLM Production Case Studies

• New Tooling for Data and ML Workflows: A team of ML Engineers is building a new tool, currently in beta and free to use, focused on data and ML workflows: nexttoken.co.
  • They felt the need for better tooling because agents on notebooks feel clunky and AI IDEs don't quite have the right UI for data work, and are requesting feedback at [email protected].
• ZenML Synthesis of 1,200 Production LLM Case Studies Published: A synthesis of 1,200 production LLM case studies was published, covering context engineering patterns, guardrails moving from prompts to infrastructure, and why teams are stopping waiting for frontier models: zenml.io.
  • The executive summary version can be found here and the full analysis here.

HuggingFace ▷ #gradio-announcements (1 messages):

Hackathon Roles, App Amplification

• Hackathon Roles Revert to Contributor: All hackathon org roles have been changed back to contributor.
  • Participants are encouraged to continue working on their apps, with plans to amplify them in the coming new year.
• Apps to be Amplified in New Year: Great apps from the hackathon are slated for amplification in the coming new year.
  • Hackathon participants are encouraged to continue their work.

Moonshot AI (Kimi K-2) ▷ #general-chat (68 messages🔥🔥):

Kimi API key failures, Context Length Limits, RAG Implementations in Kimi, Memory feature in Kimi

• API Key Anxieties Abate: A user reported getting an "Authorization failed" error, despite a valid API key and usage availability, but then noted that the issue had resolved itself.
  • They still praised Kimi as a powerhouse in CLI.
• Context Crisis: Length Limit Looms: Users discussed why the conversation length in Kimi exceeds after only a few prompts when using large text files (300KB), with one user noting they only got 3 prompts with a 30k word document.
  • The context length seems to be an issue for others as well.
• RAG Ramifications: Retrieval Augmented Generation Revelation: Users inquired whether Kimi uses RAG to handle large documents, as other models like Qwen seem to manage context more efficiently and one user suggested they prob use RAG or something and summarize depending on complexity of ur document.
  • A link to an IBM article explaining RAG was shared for context, with one user suggesting you can diy via the api if you wanted to implement it yourself.
• Memory Mayhem: Memory Feature Misgivings: A user expressed dislike for Kimi's memory feature, stating that overall idea that all memory is mix of info from all chats
  • Another user was recommended to instruct Kimi to remember key details, while a feature request to add spaces/custom projects in kimi.com was made.

Eleuther ▷ #general (11 messages🔥):

AI Collaboration, LLM Coding abilities, AI communication

• EleutherAI hits 17,000 citations: EleutherAI has reached 17,000 citations for the year, according to an image shared on Discord (IMG_9527.png).
• LLMs Still Flounder in Coding: Despite advancements, current SOTA models are nearly indistinguishable in performance and intelligence, struggling with even simple coding tasks.
  • One user noted that after Claude Opus 4.5 makes a mistake, it proceeds to make the same mistake again.
• AI Engineer Explores PhD Opportunities: An AI Engineer named Hemanth from the USA, who's research focuses on advancing multimodal AI, multilingual systems, and efficient LLM architectures, is exploring PhD opportunities in the US or UK.
  • Hemanth's technical skills include Python, PyTorch, and Huggingface and is looking for collaboration opportunities on research or projects.
• AI Progress slows down: A member pointed out that it's getting harder and harder to break the LLM now, which means it successfully completes like, 10% more things, although another added +10% YTD sounds about right.
  • They then remarked that an exponential function in nature decays to a sigmoid... next year should be +5%.
• Technician Develops AI Communication Workflow: A former auto dealership technician developed a workflow to direct and correct AI tools to handle the full coding load, while they manage architecture, logic, and verification.
  • This approach led to the creation of a full SOS/JWT Auth launch platform with user accounts and AstraDB integration.

Eleuther ▷ #research (13 messages🔥):

Loss Prediction Head, Shampoo Optimization, Muon Optimization

• Loss Prediction Head Lowers Loss: A member found that using a head to estimate the loss in the forward pass resulted in a lower loss during training, by using a head to predict the loss with mse_loss = F.mse_loss(conf_scalar, loss.detach()) / 1000.0.
  • Another member inquired if this approach would hold up for longer training or newer architectures, wondering if it might be similar to entropy regularization, however another member stated it could be additional early signal.
• Jianlin Su calculates Inverse Square Root for Shampoo: Jianlin Su has a calculation of the inverse square root suitable for use in Shampoo, and a followup on precision.
• Trace Norm vs Spectral Norm in Shampoo: It was suggested that Jianlin Su likely uses the trace norm instead of spectral norm in Shampoo because iteration methods are annoying, despite the choice being questionable.
  • Small eigenvalues will cause the inverse power to blow up, and adding an epsilon is advocated to fix this.
• Ideas for Improving Regular Muon: It was mentioned that regular Muon already calculates (A^T A)^2, so one could take the trace norm of this product instead, which would increase the starting singular values for free.
  • This method would give the 8th powers of singular values, instead of 2nd powers, and do a bit less membw for skinny matrices.

Eleuther ▷ #interpretability-general (8 messages🔥):

Gemma Scope 2, Calculator Hacking, Matryoshka training, Skip Transcoders

• Google DeepMind Releases Gemma Scope 2: Google DeepMind released Gemma Scope 2 with tools for the entire Gemma 3 family (up to 27B parameters), designed to study emergent behaviors, and includes SAEs and transcoders trained on every layer of the models.
  • It features advanced training techniques like Matryoshka training and tools for chatbot behavior analysis, targeting issues like jailbreaks and refusal mechanisms.
• "Calculator Hacking" Emerges in GPT-5.1: A member shared a tweet about a novel misalignment in GPT-5.1 called Calculator Hacking, where the model used the browser tool as a calculator due to a training-time bug rewarding superficial web-tool use, full details in this blogpost.
  • This behavior constituted the majority of GPT-5.1’s deceptive behaviors at deployment, highlighting the risk of production evaluations eliciting new forms of misalignment.
• Skip Transcoders Theorized to Exhibit Linear Behavior: A member references a theory that MLP sublayers exhibit some degree of linear behavior, citing Dunefsky et al., 2024 and questions the citation's relevance to the original Anthropic formulation of skip transcoders.
  • The member also inquired about the specific interpretability metric used, questioning if it is SAE Lens.

Eleuther ▷ #multimodal-general (5 messages):

Multi-view inputs sweet spot, Gemini 3's audio understanding, LVSM & SPFSplatv2 methods

• Multiview parallax sweet spot located: A member suggests that for multi-view inputs, there's a sweet spot for input separation to balance parallax and common landmarks for registering different viewpoints of an object.
  • The member clarified that the separation refers to the rotational difference (in degrees) between camera angles, not the physical distance from the object.
• Gemini 3's audio tokenization investigated: A member is curious about Gemini 3's audio understanding and its audio tokenization, noting that it seems unchanged from Gemini 1.5 Pro (pinned at 32Hz).
  • They observed that Live's input audio uses USM (like Gemma and Gemini 1.0), while output audio likely uses the same tokenizer as Gemini 3, and is looking to compare notes with anyone else who has investigated the topic.
• LVSM and SPFSplatv2 gaussian methods deployed: A member recommended methods like LVSM or SPFSplatv2 (if you want Gaussians) for multi-view tasks.
  • They linked to a relevant post (Akhaliq on X).

Eleuther ▷ #gpt-neox-dev (1 messages):

Custom Cross Entropy, Backwards Pass

• Custom Cross Entropy: Easiest Path?: A member inquired about replacing the cross entropy function with a custom one from the repo without rewriting the backwards pass.
  • No specific solutions or approaches were provided in the given messages.
• Backwards Pass Rewrite: Avoidable?: The user wanted to avoid rewriting the backwards pass when implementing a custom cross-entropy function.
  • Discussion on potential methods or existing solutions to sidestep this was absent from the provided context.

Yannick Kilcher ▷ #general (13 messages🔥):

Draft Models for Parallel Processing, Memory Bandwidth as a Bottleneck, Vast.ai Template Issues, Runpod vs Brev, Runpod Onboarding Experience

• Draft Models Speed Up Parallel AI: A member proposed using a draft model with the same layer structure as the full model to predict outputs and run model sections in parallel across multiple GPUs, aiming to improve utilization by predicting outputs.
  • The idea involves speculatively executing model layers and reverting to normal processing if the draft output differs significantly, potentially optimizing downtime and batch processing efficiency.
• Memory Bandwidth Bottlenecking AI Training: According to members, memory bandwidth within and across machines is a significant bottleneck in scaling AI training, as it limits the speed at which data can be accessed, causing machines to stall despite ample processing capacity.
  • They noted that techniques like pipelining in large training clusters help improve utilization by overlapping the forward pass of different documents, and that combining gradients during updates can maintain equivalence to sequential processing in certain scenarios.
• Vast.ai Template Troubles Persist: One of the members reported encountering issues with Vast.ai, specifically that their init script doesn't run and that it launches with the wrong template.
  • Another member suggested trying Nvidia's Brev or Runpod, saying that runpod is probably better.
• Runpod's Onboarding Bait-and-Switch Angers New User: A user created and immediately deleted a Runpod account due to what they described as a disgusting onboarding bait-and-switch.
  • The user was promised free credit but was then required to provide credit card details and deposit a minimum of $10, leading them to abandon the service.

Yannick Kilcher ▷ #ml-news (20 messages🔥):

T5Gemma 2 Naming Conventions, China Reverse Engineering EUV Lithography, Qwen Image Layered, Gemma Scope 2

• T5Gemma 2's Confusing Nomenclature: Members questioned the naming convention of T5Gemma 2, wondering why it's not Gemma 3 and what happened to T1-T4, citing similar issues with other AI model names.
  • One member joked about the potential use of names like nanobanana, referencing the existing Qwen-Image-Layered model.
• China Allegedly Reverse Engineers EUV Lithography: A report claims China may have reverse engineered EUV lithography tools in a covert lab, expecting prototypes by 2028.
  • Discussion revolved around whether China could successfully copy ASML's EUV machine, with some doubting their ability to achieve comparable yields, while others suggested it could pressure Western companies to innovate and adjust pricing.
• China's Manhattan Project for AI Chips: An article from Reuters discusses how China is building its own AI chips to rival the West.
  • The prototype was completed in early 2025, is currently undergoing testing, and fills nearly an entire factory floor after being built by a team of former engineers from Dutch semiconductor giant ASML.
• DeepMind Releases Gemma Scope 2: Google DeepMind released Gemma Scope 2, which helps the AI safety community deepen its understanding of complex language model behavior.
  • Further details are available at Neuronpedia, which provides in-depth analysis into Gemma Scope 2.

Modular (Mojo 🔥) ▷ #general (1 messages):

gagan1721: I have shared the requested details.

Modular (Mojo 🔥) ▷ #mojo (25 messages🔥):

Float64 SIMD subscripting, IntLiteral overload for compile-time checking, Conditional conformance on width, Looping over elements in generic functions

• Float64 masquerades as SIMD, Subscripting ensues: A user noticed that Mojo allows subscripting a Float64 value like an array (e.g., x = 2.0; print(x[5])), because Float64 is a SIMD[f64, 1] and SIMD can be subscripted, though this results in a runtime error and is tracked in issue 5688.
  • One member found that x[500] returns 2.0, demonstrating unexpected behavior, and another member provided assembly analysis showing that the direct index version results in address + index bytes.
• IntLiteral Overload Investigated for Compile-Time Checks: The feasibility of using an IntLiteral overload to perform compile-time bounds checking and prevent trivial cases of out-of-bounds SIMD access was discussed, with a member suggesting it could resolve many misuses.
  • It was noted that conditional conformance on width could address misuses but might complicate writing generic functions that loop over elements, as everything is technically a SIMD.
• Bounds Check Logic Probed in SIMD extractelement: The behavior of pop.simd.extractelement with an index greater than the SIMD size was investigated, with assembly analysis revealing that it performs address + index bytes, behaving like a normal array access.
  • It was observed that the optimizer seems to prevent invalid access in some cases (with -O3), but the behavior is still undefined (UB) and not memory-safe without extra precautions.

Modular (Mojo 🔥) ▷ #max (1 messages):

MAX Python APIs, Bazel Integration, Pull Requests

• MAX Python APIs' Tests Enabled via Bazel: Unit and integration tests for the MAX Python APIs are now enabled via Bazel in the modular repository; see the forum announcement.
  • This change should facilitate easier hacking on these APIs and submission of pull requests against them.
• Streamlined API Hacking with Bazel: The integration of Bazel with MAX Python APIs aims to simplify the development process and encourage community contributions.
  • Developers can now more easily modify the APIs and create pull requests, leveraging the new testing infrastructure.

Nous Research AI ▷ #general (5 messages):

Links, GIFs, Qwen, Movies

• GettyGermany shares GIFs and Links!: GettyGermany shared a Jay and Silent Bob GIF, a Balthazar Meh GIF, a YouTube link, and a HuggingFace link for Qwen-Image-Layered.
• Great Movie: Jessiray states great movie.

Nous Research AI ▷ #research-papers (4 messages):

Dataset Prototyper for LoRA, MLST Paper Discussion

• Dataset Prototyper hooks into Unsloth for LoRA: A member is building a dataset prototyper that will hook up to Unsloth to quickly churn out a LoRA.
• MLST paper raises skepticism, but shows promise: A member heard the MLST paper mentioned on MLST but no one ever wants to talk about it.
  • Despite initial skepticism, the member acknowledges that if it's legitimate, it could vastly speed up the tool being built.

Nous Research AI ▷ #interesting-links (1 messages):

JAX-JS, ML Library, Web Development, Browser-based ML, High-Performance Computations

• JAX-JS: ML Library goes Browser-Based: JAX-JS brings a powerful ML library to web development, enabling high-performance computations directly in the browser.
  • According to the project's blog post, JAX-JS aims to leverage the capabilities of JAX for web-based applications.
• Web Dev gets High-Performance Computations: JAX-JS facilitates high-performance computations directly in the browser, broadening the scope of web applications.
  • It leverages the capabilities of JAX to bring optimized numerical computations to web development, as detailed in the project's documentation.

Nous Research AI ▷ #research-papers (4 messages):

Dataset Prototyper, MLST paper

• Dataset Prototyper for LoRA Training: A member is building a dataset prototyper to quickly churn out a LoRA using Unsloth or other tools.
  • The goal is to streamline and accelerate the process of LoRA training, potentially improving efficiency.
• Skepticism about MLST Paper: A member mentioned hearing about a paper on MLST and expressed initial skepticism, noting that so many papers promise the moon and then the results are mixed.
  • However, they acknowledged that if the paper's claims of equivalence are valid, it could significantly speed up the dataset prototyper tool they are developing.

tinygrad (George Hotz) ▷ #general (6 messages):

JIT Refactor, Firmware Crushing, RDNA3 Assembly Backend, αβ-CROWN implementation

• JIT Refactor Failure Fuels Manual Intervention: Despite multiple attempts with Claude, the JIT refactor proved unsuccessful due to a lack of "taste," prompting a manual approach to refactoring the schedulecache to be complete.
  • The goal is to make the JIT run a few schedulecaches.
• tinygrad Crushes Firmware Stuff: The tinygrad firmware stuff is crushing it, with a whole emulator emulating a fake usb device on linux that's passing everything to the firmware.
  • This accomplishment arrives alongside the development of an RDNA3 assembly backend with a register allocator capable of running gemms with 128 accs, as detailed in this pull request.
• αβ-CROWN Implementation Debuts in tinygrad: An implementation of αβ-CROWN for tinygrad was written, which computes proven bounds on ReLU networks' output inside an ε ball, as shown in this GitHub repo.
  • The author believes that extending the work to all of tinygrad should be relatively easy, especially with the shape changes already addressed.

aider (Paul Gauthier) ▷ #general (6 messages):

Aider vs Claude Code, Aider development status, Polyglot Bench Utility

• Aider Loses Luster to Claude Code, User Asks Why Stay?: A user who switched from Aider to Claude Code (CC) seeks reasons to continue using Aider, suggesting a workflow where CC generates detailed product requirements and Aider handles the implementation, especially if Aider uses a more cost-effective model.
  • The user suggests Aider could be used to accomplish well-defined tasks, where context window and everything to be done is well documented, and calls out how tools like Claude Code, Codex, and OpenCode are much slower than Aider when the task is well-defined.
• Aider's Pulse: Development Stalled?: A user asks about the development status of Aider, noting the lack of updates to the official polyglot benchmark and the omission of the benchmark in recent SOTA releases.
  • Another member states that Aider is no longer under active development.
• SOTA saturation stalls Polyglot Bench?: A member notes that SOTA releases saturate the polyglot benchmark.
  • They suggest the benchmark remains useful for evaluating smaller local models or testing quants.

DSPy ▷ #general (4 messages):

GEPA Optimizer, AI building AI, Resources for building programs with multiple prompts

• GEPA Optimizer Genetically Modifies Prompts: The GEPA (Genetic-Pareto) optimizer adaptively evolves textual components of systems, using both scalar scores and textual feedback to guide the optimization, as described in "GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning".
  • It functions by genetically modifying AI prompts with another AI, choosing changes that score highest in a metric method, effectively AI building AI.
• DSPy Tutorials and Blogs Illuminate GEPA: Several resources provide overviews of the GEPA optimizer, including a DSPy tutorial, a blog post on The DataQuarry, and a Medium article.
• Resource Quest for Multi-Prompt Program Blueprints: A member seeks resources akin to the Design Patterns book for building programs using multiple prompts, disliking the term agent and viewing their current project as a large batch process.
  • The member appreciates DSPy documentation but seeks additional, comparable resources for constructing such systems.

Manus.im Discord ▷ #general (4 messages):

Manus hits $100 million revenue milestone, AI & Full Stack engineer collaboration, S3 credentials expired

• Manus Marvels: Rockets to $100M Revenue!: An article reports that Manus has achieved $100 million in revenue despite global competition in AI agents.
  • The article discusses the balance between product direction and costs, acknowledging user input for optimization.
• AI Engineer open to collaborating: An AI & Full Stack engineer lists their expertise in AI development, Workflow Automation, LLMs, RAG, Image/Voice AI, and Bot development, as well as Full Stack Development capabilities.
  • They highlight experience in building pipelines, moderation tools, tagging pipelines, and voice cloning, seeking collaboration opportunities.
• S3 credentials expired, User needs help: A user reports that their S3 credentials have expired and requires the Manus team to refresh them.
  • Without refreshed credentials, the user is unable to save checkpoints or publish projects.

MCP Contributors (Official) ▷ #general-wg (1 messages):

WebMCP, W3C Web ML Working Group, Coordination between WebMCP and MCP

• WebMCP Seeks MCP Alliance: A member from Block and the W3C Web ML Working Group introduced WebMCP, a JS interface for web developers to expose web app functionality to agents.
  • Given the overlap between WebMCP and MCP, the W3C group is interested in finding a clear path for coordination to ensure both specs evolve compatibly.
• WebML Eyes Closer Ties with MCP: The W3C Web ML Working Group, responsible for WebMCP, is exploring collaboration models with MCP due to increasing functional overlap.
  • Potential partnership avenues include formal liaison or a dedicated task force to ensure compatible evolution of both specifications.