Add benchmark website (GitHub Pages) - #5
Conversation
Static site with an interactive leaderboard of the paper's results (energy, direction, track/cascade, vertex, inelasticity), dataset cards with download links, model overview, usage guide and citation. Result tables were parsed programmatically from the paper's LaTeX sources (arXiv:2511.13111); no build step required. Enable via Settings -> Pages -> Deploy from branch: main, /docs. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Band plots, ROC curves, vertex contours etc. from the paper's PDF sources, rendered to PNG (docs/assets/figures) and shown with captions under the per-task results tables. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
Hey @RasmusOrsoe! I let Claude run loose and thought this would actually be a neat addition :) Let me know what you think! |
|
Hey @sevmag! Thanks for putting a bit of time into this. We were actually hoping to provide a public leaderboard when we started the project. At the time, paperswithcode was the obvious choice, but when we were ready to submit (much later) paperswithcode was in an odd transition state after being acquired by Meta. We never got around to revisiting this - perhaps that is now. Regarding your PR: I like the visuals - in particular the landing page, dataset and model cards. The leaderboard itself looks nice. In its current form, I see a few problems:
So - there is a choice to make: a) If we want to provide a public leaderboard for the community to use, I'd strongly suggest finding existing portals that provide the mechanics for this. It improves discoverability and also puts the burden of maintenance onto someone else. Or b) if you're proposing to present only the results of the paper in a neat, concise way, I would suggest implement the following changes:
Hope you're doing well! |
|
I think the visualization alone is already quite nice, even if that means that one would need to update it manually to add new models to the leaderboard. Christian Locatelli is still working on the plotting scripts, so once these are done, we could add the functionality so that just uploading the predictions automatically updates the website. I'll ask Claude to implement your suggestions for the wording and reading flow! Have you checked HuggingFace for hosting a leaderboard? I'm not too sure if it costs money for our purposes, but that could make it easier (also for the data download, I believe) |
Hi @RasmusOrsoe!
This PR adds a static website for NuBench under
docs/, ready to serve via GitHub Pages — a leaderboard-style page presenting the paper's results, in the spirit of other ML benchmark sites.Live preview (deployed from my fork): https://sevmag.github.io/NuBench/
What's included
Data provenance
The results in
docs/data.jswere parsed programmatically from the paper's LaTeX table sources (arXiv:2511.13111, tables 2–6) rather than transcribed by hand, including the bold best-model markup (with statistical ties) and the gaps (GRIT not trained on Flower S, DeepIce direction-only, no Hexagon Ice LE inelasticity). The figures underdocs/assets/figures/are rendered from the paper's own PDF figure sources.To deploy
After merging: Settings → Pages → Deploy from branch →
main, folder/docs. The site will appear at https://graphnet-team.github.io/NuBench/ (all in-site links in this PR already point atgraphnet-team).Happy to adjust anything — content, wording, colors, or where results/figures should live.
🤖 Generated with Claude Code