Spaces:
Running
Running
mehran
commited on
Commit
·
145eaf4
1
Parent(s):
0babe14
add links
Browse files
.gradio/certificate.pem
ADDED
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
-----BEGIN CERTIFICATE-----
|
2 |
+
MIIFazCCA1OgAwIBAgIRAIIQz7DSQONZRGPgu2OCiwAwDQYJKoZIhvcNAQELBQAw
|
3 |
+
TzELMAkGA1UEBhMCVVMxKTAnBgNVBAoTIEludGVybmV0IFNlY3VyaXR5IFJlc2Vh
|
4 |
+
cmNoIEdyb3VwMRUwEwYDVQQDEwxJU1JHIFJvb3QgWDEwHhcNMTUwNjA0MTEwNDM4
|
5 |
+
WhcNMzUwNjA0MTEwNDM4WjBPMQswCQYDVQQGEwJVUzEpMCcGA1UEChMgSW50ZXJu
|
6 |
+
ZXQgU2VjdXJpdHkgUmVzZWFyY2ggR3JvdXAxFTATBgNVBAMTDElTUkcgUm9vdCBY
|
7 |
+
MTCCAiIwDQYJKoZIhvcNAQEBBQADggIPADCCAgoCggIBAK3oJHP0FDfzm54rVygc
|
8 |
+
h77ct984kIxuPOZXoHj3dcKi/vVqbvYATyjb3miGbESTtrFj/RQSa78f0uoxmyF+
|
9 |
+
0TM8ukj13Xnfs7j/EvEhmkvBioZxaUpmZmyPfjxwv60pIgbz5MDmgK7iS4+3mX6U
|
10 |
+
A5/TR5d8mUgjU+g4rk8Kb4Mu0UlXjIB0ttov0DiNewNwIRt18jA8+o+u3dpjq+sW
|
11 |
+
T8KOEUt+zwvo/7V3LvSye0rgTBIlDHCNAymg4VMk7BPZ7hm/ELNKjD+Jo2FR3qyH
|
12 |
+
B5T0Y3HsLuJvW5iB4YlcNHlsdu87kGJ55tukmi8mxdAQ4Q7e2RCOFvu396j3x+UC
|
13 |
+
B5iPNgiV5+I3lg02dZ77DnKxHZu8A/lJBdiB3QW0KtZB6awBdpUKD9jf1b0SHzUv
|
14 |
+
KBds0pjBqAlkd25HN7rOrFleaJ1/ctaJxQZBKT5ZPt0m9STJEadao0xAH0ahmbWn
|
15 |
+
OlFuhjuefXKnEgV4We0+UXgVCwOPjdAvBbI+e0ocS3MFEvzG6uBQE3xDk3SzynTn
|
16 |
+
jh8BCNAw1FtxNrQHusEwMFxIt4I7mKZ9YIqioymCzLq9gwQbooMDQaHWBfEbwrbw
|
17 |
+
qHyGO0aoSCqI3Haadr8faqU9GY/rOPNk3sgrDQoo//fb4hVC1CLQJ13hef4Y53CI
|
18 |
+
rU7m2Ys6xt0nUW7/vGT1M0NPAgMBAAGjQjBAMA4GA1UdDwEB/wQEAwIBBjAPBgNV
|
19 |
+
HRMBAf8EBTADAQH/MB0GA1UdDgQWBBR5tFnme7bl5AFzgAiIyBpY9umbbjANBgkq
|
20 |
+
hkiG9w0BAQsFAAOCAgEAVR9YqbyyqFDQDLHYGmkgJykIrGF1XIpu+ILlaS/V9lZL
|
21 |
+
ubhzEFnTIZd+50xx+7LSYK05qAvqFyFWhfFQDlnrzuBZ6brJFe+GnY+EgPbk6ZGQ
|
22 |
+
3BebYhtF8GaV0nxvwuo77x/Py9auJ/GpsMiu/X1+mvoiBOv/2X/qkSsisRcOj/KK
|
23 |
+
NFtY2PwByVS5uCbMiogziUwthDyC3+6WVwW6LLv3xLfHTjuCvjHIInNzktHCgKQ5
|
24 |
+
ORAzI4JMPJ+GslWYHb4phowim57iaztXOoJwTdwJx4nLCgdNbOhdjsnvzqvHu7Ur
|
25 |
+
TkXWStAmzOVyyghqpZXjFaH3pO3JLF+l+/+sKAIuvtd7u+Nxe5AW0wdeRlN8NwdC
|
26 |
+
jNPElpzVmbUq4JUagEiuTDkHzsxHpFKVK7q4+63SM1N95R1NbdWhscdCb+ZAJzVc
|
27 |
+
oyi3B43njTOQ5yOf+1CceWxG1bQVs5ZufpsMljq4Ui0/1lvh+wjChP4kqKOJ2qxq
|
28 |
+
4RgqsahDYVvTH9w7jXbyLeiNdd8XM2w9U/t7y0Ff/9yi0GE44Za4rF2LN9d11TPA
|
29 |
+
mRGunUHBcnWEvgJBQl9nJEiU0Zsnvgc/ubhPgXRR4Xq37Z0j4r7g1SgEEzwxA57d
|
30 |
+
emyPxgcYxn/eR44/KJ4EBs+lVDR3veyJm+kXQ99b21/+jh5Xos1AnX5iItreGCc=
|
31 |
+
-----END CERTIFICATE-----
|
__pycache__/about.cpython-310.pyc
CHANGED
Binary files a/__pycache__/about.cpython-310.pyc and b/__pycache__/about.cpython-310.pyc differ
|
|
__pycache__/submission.cpython-310.pyc
CHANGED
Binary files a/__pycache__/submission.cpython-310.pyc and b/__pycache__/submission.cpython-310.pyc differ
|
|
about.py
CHANGED
@@ -17,22 +17,28 @@ def render_about():
|
|
17 |
with gr.Accordion("1. PerCoR (Persian Commonsense Reasoning)", open=False):
|
18 |
gr.Markdown("""
|
19 |
PerCoR is the first large-scale Persian benchmark for evaluating models' ability in **commonsense reasoning** through multi-choice sentence completion. It includes over 106,000 samples from diverse domains such as news, religion, and lifestyle, extracted from more than 40 Persian websites. Innovative methods like "segmentation by conjunctions" were used to create coherent and diverse sentences and options, while the DRESS-AF technique helped generate challenging, human-solvable distractors.
|
20 |
-
|
|
|
|
|
21 |
|
22 |
with gr.Accordion("2. Persian IFEval (Persian Instruction Following Evaluation)", open=False):
|
23 |
gr.Markdown("""
|
24 |
This dataset is a Persian-adapted and localized version of **IFEval**, assessing models' proficiency in **accurately executing complex, multi-step instructions (Instruction Following)**. The translation process involved a hybrid machine-human approach, with prompts unsuitable for the Persian language being rewritten or removed.
|
25 |
-
|
|
|
|
|
26 |
|
27 |
with gr.Accordion("3. PerMMLU (Persian Massive Multitask Language Understanding)", open=False):
|
28 |
gr.Markdown("""
|
29 |
-
|
30 |
<ul>
|
31 |
<li><strong>SPK (School Persian Knowledge):</strong> Contains 5,581 multiple-choice questions from the official Iranian school curriculum (grades 4-12) across 78 diverse subjects. Data was collected from the "Paadars" educational website and subsequently cleaned.</li>
|
32 |
<li><strong>UPK (University Persian Knowledge):</strong> Includes 7,793 multiple-choice questions from Master's and PhD entrance exams across 25 academic disciplines (e.g., medicine, engineering, humanities, arts). This data was extracted from exam booklets using OCR technology and cleaned by LLMs.</li>
|
33 |
<li><strong>GPK (General Persian Knowledge):</strong> Consists of 1,003 multiple-choice questions on 15 topics related to general knowledge specific to Iranian society (e.g., city souvenirs, religious edicts, national laws, famous personalities, cultural idioms). This data was generated using LLMs with specific prompts and reviewed by humans.</li>
|
34 |
</ul>
|
35 |
-
|
|
|
|
|
36 |
|
37 |
with gr.Accordion("4. Persian MT-Bench (Persian Multi-Turn Benchmark)", open=False):
|
38 |
gr.Markdown("""
|
@@ -41,7 +47,9 @@ def render_about():
|
|
41 |
<li><strong>Native Iranian Knowledge:</strong> Questions about cultural topics such as films, actors, and Iranian figures.</li>
|
42 |
<li><strong>Chat-Retrieval:</strong> Involves a multi-turn dialogue where the model must extract a relevant question and answer based on the user's needs.</li>
|
43 |
</ul>
|
44 |
-
|
|
|
|
|
45 |
|
46 |
with gr.Accordion("5. Persian NLU (Persian Natural Language Understanding)", open=False):
|
47 |
gr.Markdown("""
|
@@ -56,7 +64,9 @@ def render_about():
|
|
56 |
<li><strong>Extractive Question Answering (EQA):</strong> PQuAD</li>
|
57 |
<li><strong>Keyword Extraction:</strong> Synthetic Persian Keywords</li>
|
58 |
</ul>
|
59 |
-
|
|
|
|
|
60 |
|
61 |
with gr.Accordion("6. Persian NLG (Persian Natural Language Generation)", open=False):
|
62 |
gr.Markdown("""
|
@@ -67,7 +77,9 @@ def render_about():
|
|
67 |
<li><strong>Question Generation:</strong> PersianQA</li>
|
68 |
</ul>
|
69 |
The goal is to assess the generative capabilities of models.
|
70 |
-
|
|
|
|
|
71 |
|
72 |
# with gr.Accordion("7. BoolQ-fa (Persian Boolean Question Answering)", open=False):
|
73 |
# gr.Markdown("""
|
|
|
17 |
with gr.Accordion("1. PerCoR (Persian Commonsense Reasoning)", open=False):
|
18 |
gr.Markdown("""
|
19 |
PerCoR is the first large-scale Persian benchmark for evaluating models' ability in **commonsense reasoning** through multi-choice sentence completion. It includes over 106,000 samples from diverse domains such as news, religion, and lifestyle, extracted from more than 40 Persian websites. Innovative methods like "segmentation by conjunctions" were used to create coherent and diverse sentences and options, while the DRESS-AF technique helped generate challenging, human-solvable distractors.
|
20 |
+
|
21 |
+
[link](https://huggingface.co/datasets/MCINext/percor)
|
22 |
+
""")
|
23 |
|
24 |
with gr.Accordion("2. Persian IFEval (Persian Instruction Following Evaluation)", open=False):
|
25 |
gr.Markdown("""
|
26 |
This dataset is a Persian-adapted and localized version of **IFEval**, assessing models' proficiency in **accurately executing complex, multi-step instructions (Instruction Following)**. The translation process involved a hybrid machine-human approach, with prompts unsuitable for the Persian language being rewritten or removed.
|
27 |
+
|
28 |
+
[link](https://huggingface.co/datasets/MCINext/persian-ifeval)
|
29 |
+
""")
|
30 |
|
31 |
with gr.Accordion("3. PerMMLU (Persian Massive Multitask Language Understanding)", open=False):
|
32 |
gr.Markdown("""
|
33 |
+
PerMMLU is an expanded and localized version of the renowned **MMLU** benchmark, designed to measure **general and specialized knowledge** of models in Persian. Tailored to cover knowledge at various levels and relevant to the Iranian cultural context, it comprises three main sub-datasets:
|
34 |
<ul>
|
35 |
<li><strong>SPK (School Persian Knowledge):</strong> Contains 5,581 multiple-choice questions from the official Iranian school curriculum (grades 4-12) across 78 diverse subjects. Data was collected from the "Paadars" educational website and subsequently cleaned.</li>
|
36 |
<li><strong>UPK (University Persian Knowledge):</strong> Includes 7,793 multiple-choice questions from Master's and PhD entrance exams across 25 academic disciplines (e.g., medicine, engineering, humanities, arts). This data was extracted from exam booklets using OCR technology and cleaned by LLMs.</li>
|
37 |
<li><strong>GPK (General Persian Knowledge):</strong> Consists of 1,003 multiple-choice questions on 15 topics related to general knowledge specific to Iranian society (e.g., city souvenirs, religious edicts, national laws, famous personalities, cultural idioms). This data was generated using LLMs with specific prompts and reviewed by humans.</li>
|
38 |
</ul>
|
39 |
+
|
40 |
+
[link](https://huggingface.co/datasets/MCINext/permmlu)
|
41 |
+
""")
|
42 |
|
43 |
with gr.Accordion("4. Persian MT-Bench (Persian Multi-Turn Benchmark)", open=False):
|
44 |
gr.Markdown("""
|
|
|
47 |
<li><strong>Native Iranian Knowledge:</strong> Questions about cultural topics such as films, actors, and Iranian figures.</li>
|
48 |
<li><strong>Chat-Retrieval:</strong> Involves a multi-turn dialogue where the model must extract a relevant question and answer based on the user's needs.</li>
|
49 |
</ul>
|
50 |
+
|
51 |
+
[link](https://huggingface.co/datasets/MCINext/persian-mt-bench)
|
52 |
+
""")
|
53 |
|
54 |
with gr.Accordion("5. Persian NLU (Persian Natural Language Understanding)", open=False):
|
55 |
gr.Markdown("""
|
|
|
64 |
<li><strong>Extractive Question Answering (EQA):</strong> PQuAD</li>
|
65 |
<li><strong>Keyword Extraction:</strong> Synthetic Persian Keywords</li>
|
66 |
</ul>
|
67 |
+
|
68 |
+
[link](https://huggingface.co/datasets/MCINext/persian-nlu)
|
69 |
+
""")
|
70 |
|
71 |
with gr.Accordion("6. Persian NLG (Persian Natural Language Generation)", open=False):
|
72 |
gr.Markdown("""
|
|
|
77 |
<li><strong>Question Generation:</strong> PersianQA</li>
|
78 |
</ul>
|
79 |
The goal is to assess the generative capabilities of models.
|
80 |
+
|
81 |
+
[link](https://huggingface.co/datasets/MCINext/persian-nlg)
|
82 |
+
""")
|
83 |
|
84 |
# with gr.Accordion("7. BoolQ-fa (Persian Boolean Question Answering)", open=False):
|
85 |
# gr.Markdown("""
|
leaderboard/__pycache__/leaderboard.cpython-310.pyc
CHANGED
Binary files a/leaderboard/__pycache__/leaderboard.cpython-310.pyc and b/leaderboard/__pycache__/leaderboard.cpython-310.pyc differ
|
|