All tags
Person: "dabit3"
not much happened today
dflash nemo-automodel claude openai broadcom qualcomm modular nvidia skypilot modal anthropic hugging-face hardware inference performance-optimization model-training agent-ux security capability-based-security open-source fine-tuning infrastructure model-optimization gdb kimmonismus scaling01 clattner_llvm karpathy gallabytes dabit3 kentonvarda random_walker jubbaonjeans victormustar
OpenAI announced Jalapeño, its first custom AI chip for LLM inference, built with Broadcom, aiming to control more of the AI stack and improve compute economics with a fast 9-month design cycle. Community analysis suggests Jalapeño features 216GB HBM3E, ~7.1–7.4 TB/s bandwidth, and ~10 PFLOPS FP4 performance, signaling hyperscaler-style inference silicon as a new standard. Meanwhile, Qualcomm is acquiring Modular, with Mojo open-sourcing on track, indicating rising competition in vertically integrated inference stacks beyond NVIDIA/CUDA. On infrastructure, NVIDIA's NeMo AutoModel boosts training throughput for MoE models by 3.4–3.7x, and startups like SkyPilot and Modal advance unified and open-source inference solutions. Custom training of DFLASH models yields 30–50% decode gains. In UX, Anthropic's Slack-native Claude agent shifts agent interaction from tools to coworkers, raising new security and cost concerns around identity, permissions, and lock-in, with debates on capability-based security and attribution. Hugging Face responded with its self-hosted Slack coding agent Moon Bot.
not much happened today
codex openai github cursor langchain nous-research agent-harnesses multi-agent-systems software-engineering tooling orchestration observability remote-control security-hardening user-experience open-source community-engagement andrew_ng steve_yegge gabrielchua giffmana rhys_sullivan teknium shaun_furman dabit3 robinebers zainanzhou nicoalbanese10 bromann elliothyun tiagonbotelho pierceboggan sydneyrunkle
Harness engineering is emerging as a key discipline in AI agent development, emphasizing components like filesystems, memory, and retries beyond just models. OpenAI's Codex is expanding agentic coding workflows beyond software engineering, including codebase understanding and bug triage. Tooling trends show convergence on multi-agent orchestration, observability, and remote control, with GitHub Copilot, Cursor, and LangChain advancing these capabilities. The Hermes Agent v0.9.0 release introduces a local web dashboard and enhanced security, gaining community traction over OpenClaw for UX and efficiency. The open agent ecosystem is growing with projects like Open Agents and DeepAgent providing modular stacks and runtimes.