Skip to content

chore(benchmarks): migrate competition-only Maven dependencies to HuggingFace or private Maven mirror #184

@acorn421

Description

@acorn421

Summary

Competition-only Maven dependencies currently hosted in ad-hoc locations should be migrated to HuggingFace or a private Maven mirror for long-term availability and reproducibility.

Description

Several Java benchmarks depend on Maven artifacts that were prepared specifically for the AIxCC competition. These artifacts are not guaranteed to remain available at their current hosting locations, which creates a reproducibility risk for CRSBench runs that rely on them.

To ensure long-term stability, these dependencies should be relocated to either:

  • HuggingFace (as a persistent artifact store), or
  • A dedicated private Maven mirror owned by the project.

Problem

  • Competition-only Maven deps may disappear or change without notice.
  • Benchmark builds can break silently when upstream hosts rotate or remove artifacts.
  • No single authoritative mirror exists for these dependencies today.

Proposed Solution

  • Inventory all competition-only Maven dependencies currently referenced by benchmarks.
  • Mirror them to HuggingFace or a private Maven repository with versioned, immutable storage.
  • Update benchmark build configurations to point to the new mirror.

Current Status

Not started — tracking issue only. Work will be scheduled later.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions