| # | 题目Question | 测试包Pack | 难度Difficulty | 结果Result | 得分Score | 重试Retry | sandbox | 耗时Time | 失败类型Failure Type | 点评Comment |
|---|
Gemma-4-12B 90.3 分, 85.3 分( 5 次)。12B 稠密,6.4GB 体积,126.3 t/s 输出速度——Gemma-4 系列中最轻量。QAT 量化技术让 12B 参数在 Q4_0 精度下仍保持不错性能。TC=97、BF=88、HA=87 三项均衡,仅 5 次。Gemma-4-12B: 90.3, 85.3 (5 runs). 12B dense, 6.4GB size, 126.3 t/s output speed—the lightest in the Gemma-4 series. QAT quantization maintains solid performance for the 12B parameters at Q4_0 precision. Balanced TC=97, BF=88, HA=87 with only 5 runs.
一句话评价 TL;DR:Gemma-4 家族最轻量成员——6.4GB、126t/s、85.3 分,QAT 量化的性价比之选。TL;DR: The lightest member of the Gemma-4 family—6.4GB, 126t/s, 85.3 points, a cost-effective choice with QAT quantization.