Search results

[Bug] TextVQA，输出predcition正确，但是result精度为0

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#187 In AISBench/benchmark;

· MansonX opened on Mar 12, 2026

[Bug] 测试完成后解析结果的时候发生报错，提示需设置trust_remote_code=True

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#183 In AISBench/benchmark;

· NSDie opened on Mar 11, 2026

[疑问] 在dp=8，max_num_seq=160场景下,为什么用aisbench跑达不到预期并发160（每个dp）。但是用curl的方式能达到160。

content_check_failedissue content check failedissue content check failed

questionFurther information is requestedFurther information is requested

Status: Open.

#181 In AISBench/benchmark;

· chopper0126 opened on Mar 10, 2026

[Bug] 裁判模型场景下如果裁判模型没有推理完，reuse会有问题

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#172 In AISBench/benchmark;

· SJTUyh opened on Mar 5, 2026

[疑问] 请问现在aisbench支持评测rerank和embedding模型吗

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#169 In AISBench/benchmark;

· Ruiiiny opened on Mar 5, 2026

[Bug] Qwen3-Omni-30B-A3B-Thinking模型，使用aisbench评测vocalsound数据集精度，精度评分异常

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#167 In AISBench/benchmark;

· mominhua opened on Mar 5, 2026

[Bug] textvqa多模态测试预测结果为空，acc为0

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#166 In AISBench/benchmark;

· zy-charon opened on Mar 5, 2026

[文档] ARC-e下载结果与文档描述不符

content_check_passedissue content check passedissue content check passed

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#158 In AISBench/benchmark;

· JohnH868 opened on Mar 3, 2026

[文档] generated_prompts_path参数描述不够完善，可用数据集任务名称应为mooncake_trace_gen

content_check_passedissue content check passedissue content check passed

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#154 In AISBench/benchmark;

· liuyang-2026 opened on Feb 28, 2026

[疑问] aisbench哪里可以控制 不发 penalties 在配置文件里已经注释掉了

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#146 In AISBench/benchmark;

· chenghaitao1987 opened on Feb 11, 2026

[Roadmap] AISBench 2026 Q1 Roadmap

content_check_failedissue content check failedissue content check failed

Status: Open.

Feature

#140 In AISBench/benchmark;

· GaoHuaZhang opened on Feb 9, 2026

·  

AISBench 2026 Q1 Roadmap

[Bug] Qwen3-Coder-Next跑humanevalx数据集报错

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#139 In AISBench/benchmark;

· kurt739910017 opened on Feb 9, 2026