mlx-community
/

CodeLlama-7b-Python-hf-4bit

Text Generation

Model card Files Files and versions

CodeLlama-7b-Python-hf-4bit / README.md

pcuenq's picture

pcuenq HF Staff

Upload folder using huggingface_hub

ebe683c over 2 years ago

|

572 Bytes

	---
	language:
	- code
	license: llama2
	tags:
	- llama-2
	- mlx
	pipeline_tag: text-generation
	---

	# CodeLlama-7b-Python-hf-4bit

	This model was converted to MLX format from [`codellama/CodeLlama-7b-Python-hf`]().
	Please, refer to the [original model card](https://huggingface.co/codellama/CodeLlama-7b-Python-hf) for more details on the original model.

	## Use with mlx

	```bash
	pip install mlx
	git clone https://github.com/ml-explore/mlx-examples.git

	cd mlx-examples/llms/hf_llm
	python generate.py --model mlx-community/CodeLlama-7b-Python-hf-4bit --prompt "My name is"
	```