neovalle commited on
Commit
e638176
Β·
verified Β·
1 Parent(s): c9684b2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +92 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  title: H4rmonyEval
3
- emoji: 🐒
4
  colorFrom: purple
5
  colorTo: gray
6
  sdk: gradio
@@ -11,4 +11,94 @@ license: mit
11
  short_description: Model Judge For Ecolinguistic Evaluation
12
  ---
13
 
14
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  title: H4rmonyEval
3
+ emoji: 🌍
4
  colorFrom: purple
5
  colorTo: gray
6
  sdk: gradio
 
11
  short_description: Model Judge For Ecolinguistic Evaluation
12
  ---
13
 
14
+ # πŸ¦β€β¬› H4rmonyEval: Model Judge for Ecolinguistic Evaluation
15
+
16
+ **H4rmonyEval** is a specialised evaluation tool designed to assess language model outputs through an **ecolinguistic** perspective. It enables both single prompt evaluation and batch assessments via CSV, focusing on how well model responses align with ecological and sustainable narratives.
17
+
18
+ Hosted on **Hugging Face Spaces**, powered by **Gradio**.
19
+
20
+ ---
21
+
22
+ ## 🌿 Features
23
+
24
+ - **Single Q&A Evaluation**
25
+ Quickly score individual prompt/answer pairs on a scale of **0–5**.
26
+
27
+ - **Batch CSV Evaluation**
28
+ Upload a CSV with questions (and optional answers) for automated scoring. Download detailed results.
29
+
30
+ - **Ecolinguistic-Aware Judging**
31
+ Leveraging a Cohere language model with custom system instructions based on ecolinguistic principles.
32
+
33
+ ---
34
+
35
+ ## πŸ“„ CSV Format
36
+
37
+ - Required: `question` column.
38
+ - Optional: `answer` column (if empty, the system generates answers using a selected model).
39
+
40
+ Example:
41
+
42
+ | question | answer |
43
+ |-------------------------|----------------------|
44
+ | What is green AI? | AI focused on... |
45
+ | Define ecological ethics| |
46
+
47
+ ---
48
+
49
+ ## 🎯 Scoring System
50
+
51
+ - **5** – Perfect, accurate, and ecologically aligned.
52
+ - **3** – Partially correct, limited ecological framing.
53
+ - **0** – Incorrect or ecologically harmful/misaligned.
54
+
55
+ Final scores are presented as percentages for batch evaluations.
56
+
57
+ ---
58
+
59
+ ## βš™οΈ How It Works
60
+
61
+ - **Judge:** Cohere `command-r-plus` model guided by custom instructions.
62
+ - **Answer Generation:** Hugging Face Inference API (if no answer is provided).
63
+ - **Frontend:** Gradio `5.27.0`.
64
+
65
+ ---
66
+
67
+ ## πŸš€ Quick Start
68
+
69
+ 1. Upload your CSV **or** enter a single Q&A.
70
+ 2. Click the appropriate evaluation button.
71
+ 3. View your score and download results.
72
+
73
+ ---
74
+
75
+ ## πŸ” Environment Variables
76
+
77
+ - `COHERE_API_KEY` – Required.
78
+ - `HF_TOKEN` – *(Optional)* For Hugging Face Inference.
79
+
80
+ ---
81
+
82
+ ## 🌍 About H4rmony
83
+
84
+ Part of the **H4rmony Project**, promoting AI aligned with ecological justice and sustainability through language.
85
+
86
+ Learn more:
87
+ πŸ”— https://TheH4rmonyProject.org
88
+ ---
89
+
90
+ ## 🀝 Acknowledgements
91
+
92
+ - **Cohere** for LLM infrastructure.
93
+ - **Hugging Face** for Spaces and APIs.
94
+ - Inspired by the work of the **The H4rmony Project, University of Gloucestershire & International Ecolinguistics Association**.
95
+
96
+ ---
97
+
98
+ ## πŸ“œ License
99
+
100
+ MIT License.
101
+
102
+ ---
103
+
104
+ Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference