H2H-eval-comparator / README.md
rohansampath's picture
Update README.md
8c8448c verified

A newer version of the Gradio SDK is available: 5.42.0

Upgrade
metadata
title: Head to Head Evaluations Comparator
emoji: 🦀
colorFrom: indigo
colorTo: blue
sdk: gradio
sdk_version: 5.18.0
app_file: app.py
pinned: false
license: apache-2.0
short_description: Evaluates 2 models or 1 model w/diff configs on a dataset

This Space replicates the evaluation of different models on various datasets. Dataset: https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro GitHub: https://github.com/TIGER-AI-Lab/MMLU-Pro Paper: https://arxiv.org/abs/2406.01574 (Submitted at NeurIPS 2024)

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference