All tags
Topic: "scaling-efficiency"
not much happened today
kimi-k3 moonshot vllm baseten modal together-ai ollama dell nvidia mixture-of-experts model-scaling numerical-stability model-architecture open-models model-distribution model-licensing agentic-ai vision scaling-efficiency open-source-infrastructure commercial-restrictions ai-security kimi_moonshot jensenhuang natolambert petergostev artificialanlys
Moonshot released the Kimi K3 open-weights model, a 2.8T-parameter MoE with 104B active parameters, 896 experts, and 1M-token context featuring native visual understanding. The release includes open-source infrastructure like FlashKDA, MoonEP, and AgentENV, enabling large-scale agentic post-training and serving. The technical report highlights a ~2.5× scaling-efficiency improvement over K2 with innovations in numerical stability and MoE routing. Licensing is source-available with commercial-use restrictions, signaling a trend towards open-weight models with business carve-outs. Distribution was broad and immediate via platforms like vLLM, Baseten, Modal, Together, and Ollama Cloud. Separately, NVIDIA launched the Open Secure AI Alliance to build an ecosystem combining open and closed frontier models for AI security, emphasizing defense against attackers already equipped with strong AI.