All tags
Topic: "multi-domain-evaluation"
not much happened today
hy3 glm-5.2 claude-fable-5 opus-4.8 gemini-3.5-flash gpt-5.5-xhigh glm-5.2-max tencent nvidia amd nous-research hugging-face artificial-anlysiis dair-ai mixture-of-experts model-quantization speculative-decoding inference-speed agent-evaluation long-context memory-optimization cost-efficiency benchmarking multi-domain-evaluation eliebakouch shunyuyao12 vllm_project teortaxestex tinygrad mbusigin artificialanlys fchollet omarsar0
Tencent released Hy3, a 295B MoE open-weight model with 21B active parameters, 192 experts, and 256K context supporting MTP speculative decoding. It runs natively on vLLM with optimizations for NVIDIA and AMD hardware, achieving up to 2.95x speedups and latency reductions. Hy3 competes closely with GLM-5.2 in the open model space. AutomationBench-AA leaderboard evaluates agents on 657 tasks across 40 SaaS apps, with Claude Fable 5 leading, followed by Opus 4.8, Gemini 3.5 Flash, and GPT-5.5 xhigh. Open models lag behind, with GLM-5.2 max best at 27.8%. New domain-specific capability indices highlight cost-performance tradeoffs. Research on persistent agent memory includes A-TMA improving conflict accuracy and ReContext enhancing long-context inference without retraining.