Upload folder using huggingface_hub

README.md

@@ -161,18 +161,41 @@ print(scores.tolist())
 | StackOverFlow-QA                      | 94.47         | 96.33         | 67.68           | 97.17           | 95.35     |
 | CodeFeedBack-ST                       | 86.36         | 87.53         | 65.35           | 90.67           | 90.56     |
 | CodeFeedBack-MT                       | 65.51         | 68.83         | 28.74           | 93.58           | 94.38     |
-| AVG                                   | 75.65         | 78.20         | 56.26           | 78.53    | 81.77     |
+| AVG                                   | **75.65**         | **78.20**         | **56.26**           | **78.53**    | **81.77**     |
 
 - CodedRAG
 
 |                 | HummanEval | MBPP | DS-1000 | ODEX | RepoEval | SWE-bench-Lite | AVG  |
 | --------------- | ---------- | ---- | ------- | ---- | -------- | -------------- | ---- |
-| SFR             | 100.0      | 99.0 | 19.3    | 37.1 | 83.8     | 62.7           | 67.0 |
-| Jina-v2-code    | 100.0      | 97.7 | 26.2    | 19.9 | 90.5     | 58.3           | 65.4 |
-| CodeXEmbed-2B   | 100.0      | 97.4 | 25.4    | 23.9 | 88.7     | 52.4           | 64.6 |
-| Voyage-Code-002 | 100.0      | 99.0 | 33.1    | 26.6 | 94.3     | 29.1           | 63.7 |
-| Voyage-Code-003 | 100.0      | 99.6 | 38.9    | 36.3 | 90.0     | 70.1           | 72.5 |
-| BGE-Code-v1       | 100.0      | 99.2 | 40.9    | 36.1 | 93.1     | 67.4           | 72.8 |
+| SFR             | 100.0      | 99.0 | 19.3    | 37.1 | 83.8     | 62.7           | **67.0** |
+| Jina-v2-code    | 100.0      | 97.7 | 26.2    | 19.9 | 90.5     | 58.3           | **65.4** |
+| CodeXEmbed-2B   | 100.0      | 97.4 | 25.4    | 23.9 | 88.7     | 52.4           | **64.6** |
+| Voyage-Code-002 | 100.0      | 99.0 | 33.1    | 26.6 | 94.3     | 29.1           | **63.7** |
+| Voyage-Code-003 | 100.0      | 99.6 | 38.9    | 36.3 | 90.0     | 70.1           | **72.5** |
+| BGE-Code-v1       | 100.0      | 99.2 | 40.9    | 36.1 | 93.1     | 67.4           | **72.8** |
+
+### Instruction for Evaluation
+
+```python
+{
+    "Apps": "Given a code contest problem description, retrieve relevant code that can help solve the problem.",
+    "CosQA": "Given a web search query, retrieve relevant code that can help answer the query.",
+    "Text2SQL": "Given a question in text, retrieve SQL queries that are appropriate responses to the question.",
+    "CSN": "Given a piece of code, retrieve the document string that summarizes the code.",
+    "CSN-CCR": "Given a piece of code segment, retrieve the code segment that is the latter part of the code.",
+    "CodeTrans-DL": "Given a piece of code, retrieve code that is semantically equivalent to the input code.",
+    "CodeTrans-Contest": "Given a piece of Python code, retrieve C++ code that is semantically equivalent to the input code.",
+    "StackOverFlow-QA": "Given a question that consists of a mix of text and code snippets, retrieve relevant answers that also consist of a mix of text and code snippets, and can help answer the question.",
+    "CodeFeedBack-ST": "Given a question that consists of a mix of text and code snippets, retrieve relevant answers that also consist of a mix of text and code snippets, and can help answer the question.",
+    "CodeFeedBack-MT": "Given a multi-turn conversation history that consists of a mix of text and code snippets, retrieve relevant answers that also consist of a mix of text and code snippets, and can help answer the question.",
+    "HummanEval": "Given a question that consists of a mix of text and code snippets, retrieve relevant answers that also consist of a mix of text and code snippets, and can help answer the question.",
+    "MBPP": "Given a textual explanation of code functionality, retrieve the corresponding code implementation.",
+    "DS-1000": "Given a question that consists of a mix of text and code snippets, retrieve relevant answers that also consist of a mix of text and code snippets, and can help answer the question.",
+    "ODEX": "Given a question, retrieve relevant answers that also consist of a mix of text and code snippets, and can help answer the question.",
+    "RepoEval": "Given a piece of code segment, retrieve the code segment that is the latter part of the code.",
+    "SWE-bench-Lite": "Given a code snippet containing a bug and a natural language description of the bug or error, retrieve code snippets that demonstrate solutions or fixes for similar bugs or errors (the desired documents)."
+}
+```
 
 ## Citation