All tags
Person: "jonasgeiping"
not much happened today
nemotron-3.5-lightning gpt-oss-120b frontier hugging-face nvidia together-ai ollama baseten vllm_project perplexity-api chain-of-thought privacy api-security model-optimization mixture-of-experts context-window agentic-ai model-distribution ai-text-watermarking kotekjedi_ml jonasgeiping scaling01 eliebakouch _can1357 vipulved blackhc trq212 wightmanr ryangreenblatt giffmana
Frontier API vulnerability revealed exposure of hidden reasoning traces including sensitive data like 62 unique API keys and 33 passwords, raising privacy and operational-security concerns. Discussions highlighted the risks of public trace sharing and challenges in monitoring terse or multilingual chain-of-thought (CoT) outputs. Concurrently, debate on AI text watermarking under EU compliance pressure surfaced, with concerns about output bloat versus subtle signature embedding. NVIDIA released Nemotron 3.5 Lightning, a 30B MoE model with 3B active parameters, offering up to 4× throughput, 1M context window, and strong agentic performance metrics, distributed rapidly across platforms like Together AI, Ollama, and Baseten. This marks a significant push in small open agent models with customizable release artifacts on Hugging Face.