File size: 1,161 Bytes
f03ce0a 680a1d3 f03ce0a 31588bc f03ce0a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
license: llama3.2
datasets:
- teknium/OpenHermes-2.5
- NousResearch/hermes-function-calling-v1
base_model:
- minpeter/QLoRA-Llama-3.2-1B-chatml-tool-v4
- meta-llama/Llama-3.2-1B
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- axolotl
- merge
---
## Model Performance Comparison (BFCL)
| task name | minpeter/Llama-3.2-1B-chatml-tool-v4 | meta-llama/Llama-3.2-1B-Instruct (measure) | meta-llama/Llama-3.2-1B-Instruct (Reported) |
|-----------------|-----------------------------------|-----------------------------------|---------------------------------------|
| parallel_multiple | 0.000 | 0.025 | **0.15** |
| parallel | 0.000 | 0.035 | **0.36** |
| simple | **0.7725** | 0.215 | 0.2925 |
| multiple | **0.765** | 0.17 | 0.335 |
*Parallel calls are not taken into account. 0 points are expected. We plan to fix this in next version.* |