File size: 2,054 Bytes
4ff62ee
15fd462
 
 
 
 
 
3f0aca6
4ff62ee
15fd462
 
 
 
 
 
 
 
 
 
4ff62ee
 
15fd462
067b68d
15fd462
067b68d
15fd462
067b68d
15fd462
 
 
 
 
 
067b68d
15fd462
067b68d
15fd462
067b68d
15fd462
067b68d
15fd462
 
 
 
 
 
 
 
 
 
 
067b68d
15fd462
bc08cf9
15fd462
 
 
 
 
 
 
 
 
 
 
 
 
 
bc08cf9
15fd462
bc08cf9
15fd462
bc08cf9
15fd462
 
 
 
bc08cf9
15fd462
bc08cf9
15fd462
 
 
1ffc326
15fd462
64efa0c
15fd462
c202dd6
15fd462
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
---
title: Open Financial LLM Leaderboard
emoji: πŸ†
colorFrom: blue
colorTo: red
sdk: docker
hf_oauth: true
pinned: true
license: apache-2.0
duplicated_from: open-llm-leaderboard/open_llm_leaderboard
short_description: Evaluating LLMs on Multilingual Multimodal Financial Tasks
tags:
  - leaderboard
  - modality:text
  - submission:manual
  - test:public
  - judge:function
  - eval:generation
  - domain:financial
---

# Open LLM Leaderboard

Modern React interface for comparing Large Language Models (LLMs) in an open and reproducible way.

## Features

- πŸ“Š Interactive table with advanced sorting and filtering
- πŸ” Semantic model search
- πŸ“Œ Pin models for comparison
- πŸ“± Responsive and modern interface
- 🎨 Dark/Light mode
- ⚑️ Optimized performance with virtualization

## Architecture

The project is split into two main parts:

### Frontend (React)

```
frontend/
β”œβ”€β”€ src/
β”‚   β”œβ”€β”€ components/     # Reusable UI components
β”‚   β”œβ”€β”€ pages/         # Application pages
β”‚   β”œβ”€β”€ hooks/         # Custom React hooks
β”‚   β”œβ”€β”€ context/       # React contexts
β”‚   └── constants/     # Constants and configurations
β”œβ”€β”€ public/            # Static assets
└── server.js          # Express server for production
```

### Backend (FastAPI)

```
backend/
β”œβ”€β”€ app/
β”‚   β”œβ”€β”€ api/           # API router and endpoints
β”‚   β”‚   └── endpoints/ # Specific API endpoints
β”‚   β”œβ”€β”€ core/          # Core functionality
β”‚   β”œβ”€β”€ config/        # Configuration
β”‚   └── services/      # Business logic services
β”‚       β”œβ”€β”€ leaderboard.py
β”‚       β”œβ”€β”€ models.py
β”‚       β”œβ”€β”€ votes.py
β”‚       └── hf_service.py
└── utils/             # Utility functions
```

## Technologies

### Frontend

- React
- Material-UI
- TanStack Table & Virtual
- Express.js

### Backend

- FastAPI
- Hugging Face API
- Docker

## Development

The application is containerized using Docker and can be run using:

```bash
docker-compose up
```