Skip to content

Actions: EvolvingLMMs-Lab/lmms-eval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,319 workflow runs
3,319 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

[Bug / Design] serve mode loses 3D RoPE temporal encoding for Qwen3-VL Claude Code #1103: Issue comment #1266 (comment) created by ychencq
8s
8s
Claude Code Claude Code #1102: created by ychencq
1s
1s
fix: preserve HME100k prediction case in OCRBench scoring Lint #3081: Pull request #1278 opened by akawincent
57s akawincent:fix/1220_HME100k_score
akawincent:fix/1220_HME100k_score
57s
fix: preserve HME100k prediction case in OCRBench scoring task-input-ab #101: Pull request #1278 opened by akawincent
2m 9s akawincent:fix/1220_HME100k_score
akawincent:fix/1220_HME100k_score
2m 9s
Fix the incompatibility issue caused by top_p=0 when using vllm to inference (#1265) Lint #3080: Pull request #1277 opened by akawincent
53s akawincent:fix/1265_vllm_top_p
akawincent:fix/1265_vllm_top_p
53s
[Bug / Design] serve mode loses 3D RoPE temporal encoding for Qwen3-VL Claude Code #1101: Issue comment #1266 (comment) created by Tohrusky
1s
1s
feat: add MMBench static evaluation mode (no OpenAI API needed) Lint #3079: Pull request #1276 opened by Luodian
1m 4s feat/mmbench-static-eval
feat/mmbench-static-eval
1m 4s
feat: add MMBench static evaluation mode (no OpenAI API needed) task-input-ab #100: Pull request #1276 opened by Luodian
1m 57s feat/mmbench-static-eval
feat/mmbench-static-eval
1m 57s
feat: add process_results_use_image and video metadata dict support in task API Lint #3078: Pull request #1275 opened by Luodian
59s feat/task-api-enhancements
feat/task-api-enhancements
59s
feat: add process_results_use_image and video metadata dict support in task API task-input-ab #99: Pull request #1275 opened by Luodian
2m 3s feat/task-api-enhancements
feat/task-api-enhancements
2m 3s
fix: improve evaluation logic across 10+ existing benchmarks task-input-ab #98: Pull request #1274 opened by Luodian
1m 56s fix/benchmark-task-improvements
fix/benchmark-task-improvements
1m 56s
fix: improve evaluation logic across 10+ existing benchmarks Lint #3077: Pull request #1274 opened by Luodian
59s fix/benchmark-task-improvements
fix/benchmark-task-improvements
59s
feat: add COVER and WM-aBench video understanding benchmarks Lint #3076: Pull request #1273 opened by Luodian
56s feat/cover-wm-abench
feat/cover-wm-abench
56s
feat: add COVER and WM-aBench video understanding benchmarks task-input-ab #97: Pull request #1273 opened by Luodian
1m 50s feat/cover-wm-abench
feat/cover-wm-abench
1m 50s
feat: add physics reasoning benchmarks (PhysBench, ContPhy, PhysGame, PhysicsRW, PhysReason) task-input-ab #96: Pull request #1272 opened by Luodian
2m 7s feat/physics-benchmarks
feat/physics-benchmarks
2m 7s
feat: add physics reasoning benchmarks (PhysBench, ContPhy, PhysGame, PhysicsRW, PhysReason) Lint #3075: Pull request #1272 opened by Luodian
55s feat/physics-benchmarks
feat/physics-benchmarks
55s
feat: add VBench video generation evaluation benchmark task-input-ab #95: Pull request #1271 opened by Luodian
2m 8s feat/vbench-benchmark
feat/vbench-benchmark
2m 8s
feat: add VBench video generation evaluation benchmark Lint #3074: Pull request #1271 opened by Luodian
1m 2s feat/vbench-benchmark
feat/vbench-benchmark
1m 2s
Fix missing video_metadata argument in qwen2.5-vl processor forward path Claude Code #1100: Issue comment #1261 (comment) created by akawincent
1s
1s
feat: add MiniMax as LLM judge provider Claude Code #1099: Issue comment #1263 (comment) created by Luodian
2s
2s
Add CambriansVSR/VSC/VSCStreaming model integrations (#1268) Line Stats #45: Commit 2c08ee5 pushed by Luodian
9s main
main
9s
Add CambriansVSR/VSC/VSCStreaming model integrations (#1268) Lint #3073: Commit 2c08ee5 pushed by Luodian
54s main
main
54s
Add CambriansVSR/VSC/VSCStreaming model integrations Claude Code #1098: Pull request #1268 submitted by Luodian
1s
1s
refactor: consolidate qwen3_vl and qwen3_5 into unified base class (#… Line Stats #44: Commit f8279ad pushed by Luodian
13s main
main
13s
refactor: consolidate qwen3_vl and qwen3_5 into unified base class (#… Lint #3072: Commit f8279ad pushed by Luodian
54s main
main
54s