Leaderboards - Harbor

Harbor Hub leaderboards are owner-managed ranked tables attached to a dataset package. Their definitions control columns and ranking rules, while rows can reference trials for provenance.

Create a leaderboard

Creating a leaderboard requires authentication and owner access to the package’s organization.

harbor auth login

harbor hub leaderboard init \
  --package acme/my-dataset \
  --name main \
  --title "Main leaderboard" \
  --output leaderboard.yaml

harbor hub leaderboard create --config leaderboard.yaml

Browse leaderboards

Public leaderboards can be read without authentication. Private leaderboards are visible to members of the owning organization.

harbor hub leaderboard list
harbor hub leaderboard show acme/my-dataset/main

Use harbor hub leaderboard --help to manage definitions and harbor hub leaderboard row --help to manage rows and their trial associations.