Instructions to use mlx-community/firefunction-v2-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/firefunction-v2-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/firefunction-v2-8bit --local-dir firefunction-v2-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- 5ed8804059b83ef9d9e24845b62ab934eceff466b993651585df898545105f70 (600cc0f4c0b1afb58f21f324e47a28f49bec5815) - 4f67fe6f59e048233fc292dfdd6924fe43e9687b7c9af608c37cebadd10b9e5c (95be0d11c1ea59e943f716dd6b0d7d45eaa1fea2) - 3dc82869a9565d3a8d88c4274a7de4d75690dec0d09aaf20839e49f5807cbd6d (882ec4495e4dbe35e0957e2b3e8ced7f5b324645) - 911bcb3e56dfbc20bd28acc796f4347117985e66182b2902d7783585bcbf8345 (82b9ddd2091f77f98c1a1e8a18eb166cfd67fe4b) - ca0ff86e1ba00fa2c6c1fb7e4ba6335e2370446592fbfd1324572784eb8a4a82 (145b80ddcc9ffa09bfadf29c7f2e90c67014797c) - 0908aaed85e94d26b105771d8b5b10f52389f8c2140576e41526ceb0b7c9e84a (60263f721c76924f4c79929278aa01deb0fdfed2) - 5bdff8f11d83bfbca010664bf83121a4dcc96fecc904c7921b26e0ea7da62474 (6a9046158ba709e82cce5b699aeb39bd78d270f6) - 6cc0fe2a03ffce713a628bf735254c9618aa73d20f702483c24bc06d1affd849 (2ca4841d3ef704489480334bc0b8393f80357e16) - bab8d88e5fa4305d0222566610c14847c7269f231a219531c1ccef04c76db8b9 (9b3fa4c46b2453150a4a2e878ae790f20c8fdb77) - ad13d535…4ab5ea1