24 of 30 Firsts on One Self-Test Table, Still Not a Win
The official Baidu model card publishes a 30-row evaluation table comparing ERNIE-5.5-Flash-Base (280B/14B) with DeepSeek-V4-Flash-Base (284B/13B), Hy3-preview-Base (295B/21B) and MiMo-V2.5-Base (310B/15B) under one framework, identical prompts and few-shot examples and a single judge model. In this vendor-run evaluation ERNIE tops 24 of 30 rows with MMLU 93.3, MMLU-Pro 78.4, HumanEval+ 82.3, LiveCodeBench 40.1 and RepoQA 91.7, while losing six rows including ChineseSimpleQA, BBH with chain of thought, INCLUDE-lite, FullStackBench, HELMET-Rerank and InfiniteBench. This is not a license comparison. It explains what such a self-reported table can and cannot show: no third-party replication, all four are pre-post-training Base checkpoints, scores are not chat or agent experience, and cross-leaderboard comparisons are invalid. It then covers activated-parameter ratio, KV cache, 128K training versus 1M inference extrapolation and post-training cost as selection criteria.