All tags
Company: "dell"
not much happened today
kimi-k3 moonshot vllm baseten modal together-ai ollama dell nvidia mixture-of-experts model-scaling numerical-stability model-architecture open-models model-distribution model-licensing agentic-ai vision scaling-efficiency open-source-infrastructure commercial-restrictions ai-security kimi_moonshot jensenhuang natolambert petergostev artificialanlys
Moonshot released the Kimi K3 open-weights model, a 2.8T-parameter MoE with 104B active parameters, 896 experts, and 1M-token context featuring native visual understanding. The release includes open-source infrastructure like FlashKDA, MoonEP, and AgentENV, enabling large-scale agentic post-training and serving. The technical report highlights a ~2.5× scaling-efficiency improvement over K2 with innovations in numerical stability and MoE routing. Licensing is source-available with commercial-use restrictions, signaling a trend towards open-weight models with business carve-outs. Distribution was broad and immediate via platforms like vLLM, Baseten, Modal, Together, and Ollama Cloud. Separately, NVIDIA launched the Open Secure AI Alliance to build an ecosystem combining open and closed frontier models for AI security, emphasizing defense against attackers already equipped with strong AI.
not much happened today
deepseek-r1 deepseek-v3 coder-v2 prover deepseek hugging-face dell openai instruction-tuning performance-benchmarks model-deployment training-costs hardware-scalability ai-safety risk-mitigation ethical-ai open-source gpu-utilization yann-lecun yoshua-bengio francois-chollet giffman
DeepSeek-R1 and DeepSeek-V3 models have made significant advancements, trained on an instruction-tuning dataset of 1.5M samples with 600,000 reasoning and 200,000 non-reasoning SFT data. The models demonstrate strong performance benchmarks and are deployed on-premise via collaborations with Dell and Hugging Face. Training costs are estimated around $5.5M to $6M, with efficient hardware utilization on 8xH100 servers. The International AI Safety Report highlights risks such as malicious use, malfunctions, and systemic risks including AI-driven cyberattacks. Industry leaders like Yann LeCun and Yoshua Bengio provide insights on market reactions, AI safety, and ethical considerations, with emphasis on AI's role in creativity and economic incentives.