Introducing the JevalKit Leaderboard
JevalKit now has a public leaderboard for exploring and comparing decision models.
The release brings benchmark and model-size filters, model comparison, probability metrics, and downloadable results into a single place.
A common evaluation workflow
JevalKit provides unified model interfaces and prepared datasets for eight Jev-related benchmark families. The published dataset collection contains ten TSV views; image and video views are subdivisions of VisualDecisionBench.
Twenty model families are registered. Registration is separate from complete evaluation coverage: the leaderboard distinguishes complete evaluations, smoke tests, and imported predictions.
Explore the results
- Filter by benchmark and model size.
- Compare model results and probability metrics.
- Download the exported evaluation results.
- Inspect coverage and result provenance before comparing scores.
Run an evaluation
Use the JevalKit quickstart to install dependencies, download a model and dataset, and run an evaluation. The benchmark protocols explain how each suite is scored.
Source: JevalKit release notes.