All tags
Topic: "model-ranking"
not much happened today
claude-3-sonnet claude-3-opus gpt-5-codex grok-4-fast qwen-3-next gemini-2.5-pro sora-2-pro ray-3 kling-2.5 veo-3 modernvbert anthropic x-ai google google-labs openai arena epoch-ai mit luma akhaliq coding-agents cybersecurity api model-taxonomy model-ranking video-generation benchmarking multi-modal-generation retrieval image-text-retrieval finbarrtimbers gauravisnotme justinlin610 billpeeb apples_jimmy akhaliq
Anthropic announces a new CTO. Frontier coding agents see updates with Claude Sonnet 4.5 showing strong cybersecurity and polished UX but trailing GPT-5 Codex in coding capability. xAI Grok Code Fast claims higher edit success at lower cost. Google's Jules coding agent launches a programmable API with CI/CD integration. Qwen clarifies its model taxonomy and API tiers. Vision/LM Arena rankings show a tight competition among Claude Sonnet 4.5, Claude Opus 4.1, Gemini 2.5 Pro, and OpenAI's latest models. In video generation, Sora 2 Pro leads App Store rankings with rapid iteration and a new creator ecosystem; early tests show it answers GPQA-style questions at 55% accuracy versus GPT-5's 72%. Video Arena adds new models like Luma's Ray 3 and Kling 2.5 for benchmarking. Multi-modal video+audio generation model Ovi (Veo-3-like) is released. Retrieval models include ModernVBERT from MIT with efficient image-text retrieval capabilities. "Claude Sonnet 4.5 is basically the same as Opus 4.1 for coding" and "Jules is a programmable team member" highlight key insights.
LMSys killed Model Versioning (gpt 4o 1120, gemini exp 1121)
gpt-4o-2024-11-20 gemini-exp-1121 deepseek-r1 openai google-deepmind anthropic deepseek mistral-ai model-release model-ranking open-source vision coding reasoning market-competition
AI News for 11/21/2024-11/22/2024 highlights the intense frontier lab race with OpenAI's gpt-4o-2024-11-20 and Google DeepMind's gemini-exp-1121 trading top spots on the Lmsys leaderboard. The trend of using date-based model identifiers instead of traditional versioning is noted across leading labs including Anthropic. DeepSeek R1 is gaining attention as a potent open-source alternative, especially in the context of the AI competition between China and the US. Gemini-Exp-1121 is praised for improvements in vision, coding, and reasoning, while MistralAI expands with a new Palo Alto office, signaling growth and hiring.