All tags
Topic: "throughput"
not much happened today
gpt-5.5 gpt-image-2 gpt-5.5-pro gpt-5.5-instant gpt-realtime-2 gpt-5.5-cyber codex zaya1-74b-preview zaya1-vl-8b qwen3-omni openai zyphra amd deepseek vllm_project model-release model-training mixture-of-experts inference model-optimization sandboxing alignment cybersecurity agent-runtime throughput quantization telemetry real-time-detection reach_vb dhh gdb patience_cave ithilgore cryps1s sama deredleritt3r
OpenAI rapidly expanded the GPT-5.5 family with multiple variants including gpt-image-2, GPT-5.5 Pro, and GPT-5.5 Cyber, receiving positive feedback for efficiency and usability. Codex evolved into a long-running agent runtime with a new /goal mechanism, achieving 61% success on ARC-AGI-3 games after extensive testing. OpenAI also introduced cybersecurity-focused models like GPT-5.5-Cyber targeting enterprise and government sectors. Meanwhile, Zyphra released the open-model ZAYA1-74B-Preview, a 74B parameter mixture-of-experts model trained on AMD hardware under Apache 2.0 license, alongside a vision-language model ZAYA1-VL-8B. Inference infrastructure competition intensified with vLLM updates improving throughput and latency, including support for DeepSeek V4 and enhanced quantization/backends.
not much happened today
gemini-3.1-flash-lite gemini-3 gpt-5.3 gpt-5.4 qwen google-deepmind google openai alibaba multimodality latency throughput context-window model-pricing model-benchmarking model-performance conversational-ai hallucination-reduction api model-rollout leadership-exit jeffdean noamshazeer sundarpichai aidan_mclau justinlin610
Google DeepMind launched Gemini 3.1 Flash-Lite, emphasizing dynamic thinking levels for adjustable compute, with notable metrics like $0.25/M input, $1.50/M output, 1432 Elo on LMArena, and 2.5× faster time-to-first-token than Gemini 2.5 Flash. It supports a 1M context window and high throughput for multimodal inputs including text, images, video, audio, and PDFs. OpenAI rolled out GPT-5.3 Instant to all ChatGPT users, improving conversational naturalness and reducing hallucinations by 26.8% with search. The upcoming GPT-5.4 was teased amid speculation. Alibaba's Qwen faces leadership exits, raising concerns about its future and open-source status. The news highlights advancements in model efficiency, pricing, and multimodality, alongside organizational changes impacting AI development.