gdms commited on
Commit
8b164ee
·
1 Parent(s): a547fcd

Estudo das perguntas + Pensamentos filósoficos sobre a solução

Browse files
Files changed (2) hide show
  1. README.md +8 -1
  2. perguntas.json +7 -6
README.md CHANGED
@@ -20,4 +20,11 @@ Check out the configuration reference at https://huggingface.co/docs/hub/spaces-
20
  - https://huggingface.co/spaces/gaia-benchmark/leaderboard - Leaderboard com exemplo de Prompt
21
  - Exemplo de prompt: You are a general AI assistant. I will ask you a question. Report your thoughts, and finish your answer with the following template: FINAL ANSWER: [YOUR FINAL ANSWER]. YOUR FINAL ANSWER should be a number OR as few words as possible OR a comma separated list of numbers and/or strings. If you are asked for a number, don't use comma to write your number neither use units such as $ or percent sign unless specified otherwise. If you are asked for a string, don't use articles, neither abbreviations (e.g. for cities), and write the digits in plain text unless specified otherwise. If you are asked for a comma separated list, apply the above rules depending of whether the element to be put in the list is a number or a string.
22
  - https://huggingface.co/spaces/agents-course/Students_leaderboard - Leaderboard do Curso
23
- -
 
 
 
 
 
 
 
 
20
  - https://huggingface.co/spaces/gaia-benchmark/leaderboard - Leaderboard com exemplo de Prompt
21
  - Exemplo de prompt: You are a general AI assistant. I will ask you a question. Report your thoughts, and finish your answer with the following template: FINAL ANSWER: [YOUR FINAL ANSWER]. YOUR FINAL ANSWER should be a number OR as few words as possible OR a comma separated list of numbers and/or strings. If you are asked for a number, don't use comma to write your number neither use units such as $ or percent sign unless specified otherwise. If you are asked for a string, don't use articles, neither abbreviations (e.g. for cities), and write the digits in plain text unless specified otherwise. If you are asked for a comma separated list, apply the above rules depending of whether the element to be put in the list is a number or a string.
22
  - https://huggingface.co/spaces/agents-course/Students_leaderboard - Leaderboard do Curso
23
+
24
+
25
+
26
+ ### Arquitetura da Solução
27
+
28
+ Uma LLM só para fazer tudo me parece confuso, o prompt vai virar um MONSTRO!!!
29
+ Acredito que a melhor solução é ter agentes especialistas provendo o orquestrador de informação, ele deve saber se o que foi informado é suficiente e pedir mais, por exemplo.
30
+ Ter somente uma LLM obriga a explicar tudo, inclusive como navegar
perguntas.json CHANGED
@@ -4,21 +4,21 @@
4
  "question": "How many studio albums were published by Mercedes Sosa between 2000 and 2009 (included)? You can use the latest 2022 version of english wikipedia.",
5
  "Level": "1",
6
  "file_name": "",
7
- "detalhes": "internet, wikipedia, histórico wikepedia"
8
  },
9
  {
10
  "task_id": "a1e91b78-d3d8-4675-bb8d-62741b4b68a6",
11
  "question": "In the video https://www.youtube.com/watch?v=L1vXCYZAYYM, what is the highest number of bird species to be on camera simultaneously?",
12
  "Level": "1",
13
  "file_name":"",
14
- "detalhes": "análise de vídeo, retirar frames a cada 5 segundos e enviar para um analisador de imagens (YOLOv5 ou GPT4V). Google Video AI também é uma opção"
15
  },
16
  {
17
  "task_id": "2d83110e-a098-4ebb-9987-066c06fa42d0",
18
  "question": ".rewsna eht sa \"tfel\" drow eht fo etisoppo eht etirw ,ecnetnes siht dnatsrednu uoy fI",
19
  "Level": "1",
20
  "file_name":"",
21
- "detalhes": "Frase está invertida"
22
  },
23
  {
24
  "task_id": "cca530fc-4052-43b2-b130-b30968d8aa44",
@@ -37,7 +37,8 @@
37
  "task_id": "6f37996b-2ac7-44b0-8e68-6d28256631b4",
38
  "question": "Given this table defining * on the set S = {a, b, c, d, e}\n\n|*|a|b|c|d|e|\n|---|---|---|---|---|---|\n|a|a|b|c|b|d|\n|b|b|c|a|e|c|\n|c|c|a|b|b|a|\n|d|b|e|b|e|d|\n|e|d|b|a|d|c|\n\nprovide the subset of S involved in any possible counter-examples that prove * is not commutative. Provide your answer as a comma separated list of the elements in the set in alphabetical order.",
39
  "Level": "1",
40
- "file_name": ""
 
41
  },
42
  {
43
  "task_id": "9d191bce-651d-4746-be2d-7ef8ecadb9c2",
@@ -122,12 +123,12 @@
122
  "question": "The attached Excel file contains the sales of menu items for a local fast-food chain. What were the total sales that the chain made from food (not including drinks)? Express your answer in USD with two decimal places.",
123
  "Level": "1",
124
  "file_name": "7bd855d8-463d-4ed5-93ca-5fe35145f733.xlsx",
125
- "detalhes": "Leitor excel."
126
  },
127
  {
128
  "task_id": "5a0c1adf-205e-4841-a666-7c3ef95def9d",
129
  "question": "What is the first name of the only Malko Competition recipient from the 20th Century (after 1977) whose nationality on record is a country that no longer exists?",
130
  "Level": "1",
131
- "file_name": ""
132
  }
133
  ]
 
4
  "question": "How many studio albums were published by Mercedes Sosa between 2000 and 2009 (included)? You can use the latest 2022 version of english wikipedia.",
5
  "Level": "1",
6
  "file_name": "",
7
+ "detalhes": "internet, wikipedia, histórico wikepedia (mwclient)"
8
  },
9
  {
10
  "task_id": "a1e91b78-d3d8-4675-bb8d-62741b4b68a6",
11
  "question": "In the video https://www.youtube.com/watch?v=L1vXCYZAYYM, what is the highest number of bird species to be on camera simultaneously?",
12
  "Level": "1",
13
  "file_name":"",
14
+ "detalhes": "análise de vídeo, retirar frames a cada 5 segundos e enviar para um analisador de imagens (YOLOv5[huggingface) ou GPT4o). Google Video AI também é uma opção"
15
  },
16
  {
17
  "task_id": "2d83110e-a098-4ebb-9987-066c06fa42d0",
18
  "question": ".rewsna eht sa \"tfel\" drow eht fo etisoppo eht etirw ,ecnetnes siht dnatsrednu uoy fI",
19
  "Level": "1",
20
  "file_name":"",
21
+ "detalhes": "fornecer tool para tentar fazer sentido em uma frase "
22
  },
23
  {
24
  "task_id": "cca530fc-4052-43b2-b130-b30968d8aa44",
 
37
  "task_id": "6f37996b-2ac7-44b0-8e68-6d28256631b4",
38
  "question": "Given this table defining * on the set S = {a, b, c, d, e}\n\n|*|a|b|c|d|e|\n|---|---|---|---|---|---|\n|a|a|b|c|b|d|\n|b|b|c|a|e|c|\n|c|c|a|b|b|a|\n|d|b|e|b|e|d|\n|e|d|b|a|d|c|\n\nprovide the subset of S involved in any possible counter-examples that prove * is not commutative. Provide your answer as a comma separated list of the elements in the set in alphabetical order.",
39
  "Level": "1",
40
+ "file_name": "",
41
+ "detalhes": "gpt4o-mini consegue responder em uma integração"
42
  },
43
  {
44
  "task_id": "9d191bce-651d-4746-be2d-7ef8ecadb9c2",
 
123
  "question": "The attached Excel file contains the sales of menu items for a local fast-food chain. What were the total sales that the chain made from food (not including drinks)? Express your answer in USD with two decimal places.",
124
  "Level": "1",
125
  "file_name": "7bd855d8-463d-4ed5-93ca-5fe35145f733.xlsx",
126
+ "detalhes": "pandas para ler excel, transformar em MD e passar para LLM"
127
  },
128
  {
129
  "task_id": "5a0c1adf-205e-4841-a666-7c3ef95def9d",
130
  "question": "What is the first name of the only Malko Competition recipient from the 20th Century (after 1977) whose nationality on record is a country that no longer exists?",
131
  "Level": "1",
132
+ "file_name": "Buscar na interneta a lista de vencedores"
133
  }
134
  ]