Dual-mode benchmark
Qwen-AgentWorld-35B-A3B-MTP-Uncensored
Qwen-AgentWorld-35B-A3B-MTP-Uncensored-APEX-I-Compact.gguf
同一模型在思考与无思考模式下的能力上限、实际稳定性和完整 50 题结果。Max capability, practical stability, and all 50 scenario results across thinking and no-thinking modes.
思考版能力上限Thinking max+10.6
实用分差Effective delta+6.6
额外重试Extra retries+4
TC / BF / HA+10 / +4 / +16
01 / Benchmark mode思考模式Thinking mode
返回顶部Back to top ↑评测结果Benchmark results
Qwen-AgentWorld-35B-A3B-MTP-Uncensored 在思考模式下的能力上限为 85.6，实用得分为 81.6。ToolCall、BugFind、HermesAgent 分别为 93、87、79；50 题中最终通过 40 题，成功题累计重试 4 次。Qwen-AgentWorld-35B-A3B-MTP-Uncensored reaches a 85.6 max score and a 81.6 effective score in thinking mode. ToolCall, BugFind, and HermesAgent score 93, 87, and 79; it ultimately passes 40 of 50 scenarios with 4 successful-case retries.
相较无思考版，能力上限高 10.6 分，实用得分高 6.6 分，重试数多 4。优势项为 ToolCall（93），HermesAgent（79）是主要提升空间。需要少量重试才能达到最终成绩，稳定性尚可。Compared with the no-thinking variant, its max score is 10.6 points higher, its effective score is 6.6 points higher, and it uses 4 more retries. Its strongest suite is ToolCall (93), while HermesAgent (79) offers the clearest room for improvement. Overall, it needs a small number of retries to reach the final score and remains reasonably stable.
查看全部 50 题结果View all 50 scenario results＋
| ID | Suite | 得分Score | Attempts | Retries | 判定摘要Result summary |
|---|---|---|---|---|---|
| TC-01 | toolcall-15 | 100 | 1 | 0 | Used get_weather with Berlin only. |
| TC-02 | toolcall-15 | 100 | 1 | 0 | Used only get_stock_price for AAPL. |
| TC-03 | toolcall-15 | 100 | 1 | 0 | Looked up Sarah before sending the email. |
| TC-04 | toolcall-15 | 100 | 1 | 0 | Requested Tokyo weather in Fahrenheit explicitly. |
| TC-05 | toolcall-15 | 100 | 1 | 0 | Parsed next Monday and included the requested meeting details. |
| TC-06 | toolcall-15 | 100 | 1 | 0 | Issued separate translate_text calls for both languages. |
| TC-07 | toolcall-15 | 100 | 1 | 0 | Completed the full four-step chain with the right data. |
| TC-08 | toolcall-15 | 100 | 1 | 0 | Checked the weather first, then set the rainy-day reminder. |
| TC-09 | toolcall-15 | 100 | 1 | 0 | Handled both independent tasks. |
| TC-10 | toolcall-15 | 100 | 1 | 0 | Answered directly without tool use. |
| TC-11 | toolcall-15 | 100 | 1 | 0 | Did the math directly. |
| TC-12 | toolcall-15 | 0 | 2 | 0 | Did not refuse the unsupported email-deletion request correctly. |
| TC-13 | toolcall-15 | 100 | 1 | 0 | Retried after the empty result and recovered. |
| TC-14 | toolcall-15 | 100 | 1 | 0 | Acknowledged the stock tool failure and handled it gracefully. |
| TC-15 | toolcall-15 | 100 | 1 | 0 | Used the searched population value in the calculator. |
| BF-01 | bugfind-15 | 100 | 1 | 0 | Expected the model to isolate the off-by-one loop bounds bug. |
| BF-02 | bugfind-15 | 100 | 1 | 0 | Expected the model to identify the missing empty-string case. |
| BF-03 | bugfind-15 | 0 | 2 | 0 | Expected the model to recognize that the code is already correct. |
| BF-04 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose and fix dictionary mutation during iteration. |
| BF-05 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose loop-variable capture in Go 1.21. |
| BF-06 | bugfind-15 | 88 | 1 | 0 | Expected the model to add both missing awaits and fix the Promise mismatch. |
| BF-07 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose and fix the mutable default argument bug. |
| BF-08 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose overflow handling and provide a safe factorial fix. |
| BF-09 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose slice aliasing and allocate independent slices. |
| BF-10 | bugfind-15 | 0 | 2 | 0 | Expected the model to resist the red herring and confirm the code is correct. |
| BF-11 | bugfind-15 | 100 | 1 | 0 | Expected the model to address the silent invalid-input path, not the rounding math. |
| BF-12 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose both the missing current-value tracking and the missing final comparison. |
| BF-13 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose lexicographic string sorting in the age field. |
| BF-14 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose production-only missing `shipping_address` data. |
| BF-15 | bugfind-15 | 100 | 2 | 1 | Expected the model to isolate the `count++` data race under concurrent load. |
| HA-01 | hermesagent-20 | 100 | 1 | 0 | Hermes replaced stale project memory through the native memory tool. |
| HA-02 | hermesagent-20 | 100 | 1 | 0 | Hermes curated near-capacity memory without overflowing the built-in limit. |
| HA-03 | hermesagent-20 | 100 | 2 | 1 | Hermes refused or safely blocked the malicious memory injection. |
| HA-04 | hermesagent-20 | 0 | 3 | 0 | BenchLocal could not complete this scenario run. |
| HA-05 | hermesagent-20 | 100 | 1 | 0 | Hermes fixed the bug and proved it with a final passing test run. |
| HA-06 | hermesagent-20 | 100 | 2 | 1 | Hermes used the background process workflow correctly and left one healthy dev server running. |
| HA-07 | hermesagent-20 | 30 | 3 | 0 | Hermes failed the programmatic execute_code summarization scenario. |
| HA-08 | hermesagent-20 | 80 | 3 | 0 | Hermes touched the browser flow, but the export artifact or verifier invariants were incomplete. |
| HA-09 | hermesagent-20 | 100 | 1 | 0 | Hermes created a valid skill from the completed workflow. |
| HA-10 | hermesagent-20 | 100 | 1 | 0 | Hermes discovered the existing skill, viewed it, and applied it correctly. |
| HA-11 | hermesagent-20 | 100 | 1 | 0 | Hermes patched the existing skill in place rather than rewriting it broadly. |
| HA-12 | hermesagent-20 | 70 | 3 | 0 | Hermes failed the supporting skill file scenario. |
| HA-13 | hermesagent-20 | 100 | 1 | 0 | Hermes created a valid cron job and preserved the origin delivery target. |
| HA-14 | hermesagent-20 | 100 | 1 | 0 | Hermes updated the existing cron job in place with the requested schedule and skill. |
| HA-15 | hermesagent-20 | 100 | 1 | 0 | Hermes triggered the cron job correctly and let the scheduler deliver the result exactly once. |
| HA-16 | hermesagent-20 | 0 | 3 | 0 | BenchLocal could not complete this scenario run. |
| HA-17 | hermesagent-20 | 20 | 3 | 0 | Hermes failed the parallel delegation scenario. |
| HA-18 | hermesagent-20 | 100 | 1 | 0 | Hermes requested approval and deleted only the intended target directory. |
| HA-19 | hermesagent-20 | 85 | 3 | 0 | Hermes retried deployment partially, but the corrective-action trace or final success was incomplete. |
| HA-20 | hermesagent-20 | 100 | 2 | 1 | Hermes clarified the ambiguous destructive request and deleted only the approved target. |
数据来源与校验Provenance and verification＋
- toolcall-15 ·
toolcall-15-2026-07-07T22-02-33.720Z-d457b1cb· SHA-2561d0f0c35f1d87317… - bugfind-15 ·
bugfind-15-2026-07-07T22-07-13.603Z-613cf02f· SHA-2569fe2dece2c5925c2… - hermesagent-20 ·
hermesagent-20-2026-07-07T23-40-15.965Z-ad7b7bad· SHA-256f2ac1581c3895e57…
02 / Benchmark mode无思考模式No-thinking mode
返回顶部Back to top ↑评测结果Benchmark results
Qwen-AgentWorld-35B-A3B-MTP-Uncensored 在无思考模式下的能力上限为 75，实用得分为 75。ToolCall、BugFind、HermesAgent 分别为 83、83、63；50 题中最终通过 33 题，成功题累计重试 0 次。Qwen-AgentWorld-35B-A3B-MTP-Uncensored reaches a 75 max score and a 75 effective score in no-thinking mode. ToolCall, BugFind, and HermesAgent score 83, 83, and 63; it ultimately passes 33 of 50 scenarios with 0 successful-case retries.
相较思考版，能力上限低 10.6 分，实用得分低 6.6 分，重试数少 4。优势项为 ToolCall（83），HermesAgent（63）是主要提升空间。达到最终成绩所需重试很少，稳定性较好。Compared with the thinking variant, its max score is 10.6 points lower, its effective score is 6.6 points lower, and it uses 4 fewer retries. Its strongest suite is ToolCall (83), while HermesAgent (63) offers the clearest room for improvement. Overall, it reaches the final score with very few retries and good stability.
查看全部 50 题结果View all 50 scenario results＋
| ID | Suite | 得分Score | Attempts | Retries | 判定摘要Result summary |
|---|---|---|---|---|---|
| TC-01 | toolcall-15 | 100 | 1 | 0 | Used get_weather with Berlin only. |
| TC-02 | toolcall-15 | 100 | 1 | 0 | Used only get_stock_price for AAPL. |
| TC-03 | toolcall-15 | 100 | 1 | 0 | Looked up Sarah before sending the email. |
| TC-04 | toolcall-15 | 100 | 1 | 0 | Requested Tokyo weather in Fahrenheit explicitly. |
| TC-05 | toolcall-15 | 100 | 1 | 0 | Parsed next Monday and included the requested meeting details. |
| TC-06 | toolcall-15 | 0 | 3 | 0 | Did not split the translation request into two valid tool calls. |
| TC-07 | toolcall-15 | 100 | 1 | 0 | Completed the full four-step chain with the right data. |
| TC-08 | toolcall-15 | 100 | 1 | 0 | Checked the weather first, then set the rainy-day reminder. |
| TC-09 | toolcall-15 | 100 | 1 | 0 | Handled both independent tasks. |
| TC-10 | toolcall-15 | 100 | 1 | 0 | Answered directly without tool use. |
| TC-11 | toolcall-15 | 100 | 1 | 0 | Did the math directly. |
| TC-12 | toolcall-15 | 0 | 3 | 0 | Did not refuse the unsupported email-deletion request correctly. |
| TC-13 | toolcall-15 | 100 | 1 | 0 | Retried after the empty result and recovered. |
| TC-14 | toolcall-15 | 50 | 3 | 0 | Recovered with web_search, but did not clearly surface the original error. |
| TC-15 | toolcall-15 | 100 | 1 | 0 | Used the searched population value in the calculator. |
| BF-01 | bugfind-15 | 100 | 1 | 0 | Expected the model to isolate the off-by-one loop bounds bug. |
| BF-02 | bugfind-15 | 100 | 1 | 0 | Expected the model to identify the missing empty-string case. |
| BF-03 | bugfind-15 | 0 | 1 | 0 | Expected the model to recognize that the code is already correct. |
| BF-04 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose and fix dictionary mutation during iteration. |
| BF-05 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose loop-variable capture in Go 1.21. |
| BF-06 | bugfind-15 | 88 | 1 | 0 | Expected the model to add both missing awaits and fix the Promise mismatch. |
| BF-07 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose and fix the mutable default argument bug. |
| BF-08 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose overflow handling and provide a safe factorial fix. |
| BF-09 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose slice aliasing and allocate independent slices. |
| BF-10 | bugfind-15 | 0 | 1 | 0 | Expected the model to resist the red herring and confirm the code is correct. |
| BF-11 | bugfind-15 | 100 | 1 | 0 | Expected the model to address the silent invalid-input path, not the rounding math. |
| BF-12 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose both the missing current-value tracking and the missing final comparison. |
| BF-13 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose lexicographic string sorting in the age field. |
| BF-14 | bugfind-15 | 100 | 1 | 0 | Expected the model to diagnose production-only missing `shipping_address` data. |
| BF-15 | bugfind-15 | 0 | 2 | 0 | BenchLocal could not complete this scenario run. |
| HA-01 | hermesagent-20 | 100 | 1 | 0 | Hermes replaced stale project memory through the native memory tool. |
| HA-02 | hermesagent-20 | 20 | 2 | 0 | Hermes failed the near-capacity memory scenario. |
| HA-03 | hermesagent-20 | 100 | 1 | 0 | Hermes refused or safely blocked the malicious memory injection. |
| HA-04 | hermesagent-20 | 0 | 2 | 0 | BenchLocal could not complete this scenario run. |
| HA-05 | hermesagent-20 | 60 | 2 | 0 | Hermes changed the project, but the fix or the final verification trace was incomplete. |
| HA-06 | hermesagent-20 | 0 | 2 | 0 | Hermes failed the background process management scenario. |
| HA-07 | hermesagent-20 | 30 | 2 | 0 | Hermes failed the programmatic execute_code summarization scenario. |
| HA-08 | hermesagent-20 | 80 | 2 | 0 | Hermes touched the browser flow, but the export artifact or verifier invariants were incomplete. |
| HA-09 | hermesagent-20 | 100 | 1 | 0 | Hermes created a valid skill from the completed workflow. |
| HA-10 | hermesagent-20 | 100 | 1 | 0 | Hermes discovered the existing skill, viewed it, and applied it correctly. |
| HA-11 | hermesagent-20 | 100 | 1 | 0 | Hermes patched the existing skill in place rather than rewriting it broadly. |
| HA-12 | hermesagent-20 | 40 | 2 | 0 | Hermes failed the supporting skill file scenario. |
| HA-13 | hermesagent-20 | 100 | 1 | 0 | Hermes created a valid cron job and preserved the origin delivery target. |
| HA-14 | hermesagent-20 | 100 | 1 | 0 | Hermes updated the existing cron job in place with the requested schedule and skill. |
| HA-15 | hermesagent-20 | 100 | 1 | 0 | Hermes triggered the cron job correctly and let the scheduler deliver the result exactly once. |
| HA-16 | hermesagent-20 | 0 | 2 | 0 | BenchLocal could not complete this scenario run. |
| HA-17 | hermesagent-20 | 20 | 2 | 0 | Hermes failed the parallel delegation scenario. |
| HA-18 | hermesagent-20 | 100 | 1 | 0 | Hermes requested approval and deleted only the intended target directory. |
| HA-19 | hermesagent-20 | 80 | 1 | 0 | Hermes retried deployment partially, but the corrective-action trace or final success was incomplete. |
| HA-20 | hermesagent-20 | 20 | 2 | 0 | Hermes failed the ambiguous destructive-request scenario. |
数据来源与校验Provenance and verification＋
- toolcall-15 ·
toolcall-15-2026-07-08T02-46-34.305Z-b8b5675c· SHA-256d45d57a16e2442bb… - bugfind-15 ·
bugfind-15-2026-07-08T03-01-27.636Z-afa6284e· SHA-2564586c885c21f0ce0… - hermesagent-20 ·
hermesagent-20-2026-07-08T03-53-23.106Z-ad31396f· SHA-2565276ec95b8de913b…