Instructions to use pipenetwork/GLM-5.2-MLX-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use pipenetwork/GLM-5.2-MLX-6bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("pipenetwork/GLM-5.2-MLX-6bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use pipenetwork/GLM-5.2-MLX-6bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-6bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "pipenetwork/GLM-5.2-MLX-6bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use pipenetwork/GLM-5.2-MLX-6bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "pipenetwork/GLM-5.2-MLX-6bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-6bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "pipenetwork/GLM-5.2-MLX-6bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use pipenetwork/GLM-5.2-MLX-6bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-6bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default pipenetwork/GLM-5.2-MLX-6bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use pipenetwork/GLM-5.2-MLX-6bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "pipenetwork/GLM-5.2-MLX-6bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "pipenetwork/GLM-5.2-MLX-6bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Add files using upload-large-folder tool
Browse files- model-00002-of-00121.safetensors +3 -0
- model-00007-of-00121.safetensors +3 -0
- model-00010-of-00121.safetensors +3 -0
- model-00011-of-00121.safetensors +3 -0
- model-00014-of-00121.safetensors +3 -0
- model-00023-of-00121.safetensors +3 -0
- model-00026-of-00121.safetensors +3 -0
- model-00029-of-00121.safetensors +3 -0
- model-00035-of-00121.safetensors +3 -0
- model-00043-of-00121.safetensors +3 -0
- model-00046-of-00121.safetensors +3 -0
- model-00055-of-00121.safetensors +3 -0
- model-00062-of-00121.safetensors +3 -0
- model-00066-of-00121.safetensors +3 -0
- model-00067-of-00121.safetensors +3 -0
- model-00074-of-00121.safetensors +3 -0
- model-00082-of-00121.safetensors +3 -0
- model-00087-of-00121.safetensors +3 -0
- model-00088-of-00121.safetensors +3 -0
- model-00090-of-00121.safetensors +3 -0
- model-00091-of-00121.safetensors +3 -0
- model-00094-of-00121.safetensors +3 -0
- model-00102-of-00121.safetensors +3 -0
- model-00106-of-00121.safetensors +3 -0
- model-00107-of-00121.safetensors +3 -0
- model-00108-of-00121.safetensors +3 -0
- model-00111-of-00121.safetensors +3 -0
- model-00114-of-00121.safetensors +3 -0
model-00002-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a37fdc61f32bb840f82e4ee09af92fcb8e17c7898e07941d99b482b36cff619
|
| 3 |
+
size 5320632555
|
model-00007-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81d02ebbb8cdae78e04e4c7822ace907c0bf9c23c6076fa3854d5725ddb13a9a
|
| 3 |
+
size 5301758504
|
model-00010-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3fddb52225b72824b412f77a1ff47cd0684ce3c5cdf9cad7017611733c1278ae
|
| 3 |
+
size 2986502589
|
model-00011-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9b65e11ec76f746aeba8d632b8021bc774c236e372581b383fb3bf183fc910cf
|
| 3 |
+
size 5234492178
|
model-00014-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14a991224930eae9df62e496208e096c1fc0f6be206aab96538c1011cff3f53d
|
| 3 |
+
size 5268332906
|
model-00023-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:267bae76ae2a75cf434401e3205ad5c8b90844b43f4f6ddbccbafbb7b41b9740
|
| 3 |
+
size 5301758502
|
model-00026-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c431080196ddf575d04769b219ef92d883ee5e3d20b8d560c17f046cd17e90e6
|
| 3 |
+
size 2986502633
|
model-00029-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ea20bcac2c06bba0898a093cdbd16a74237c68fb5671445c4f6f36d2312fb743
|
| 3 |
+
size 5368581210
|
model-00035-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e7308d00d4fee86b80ade71503056b3f6a2ed90a305abefb50ba555271adb7bc
|
| 3 |
+
size 5234492180
|
model-00043-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd3e259107a7b905df7f66c7fae615020671493735b2fd251d114e86776c738f
|
| 3 |
+
size 5234492188
|
model-00046-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dbb9c2b98a6b8cb1c3524ffcc298ddcabd3a5a7985974a28020429e67c265c53
|
| 3 |
+
size 5268332904
|
model-00055-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:af445d82198bf1c52d12d3ce25b8be6186a39808ec9421db467ee24c47d1158e
|
| 3 |
+
size 5301758542
|
model-00062-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fdb6af54983467723793948fb8a3b302fd05602e01e403462a831434592a9ea3
|
| 3 |
+
size 5268332904
|
model-00066-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f761e349f6aae51fc08f3cab0f7c62f4a569dbb23dc63b61a7bf35c59cf8727
|
| 3 |
+
size 2986502647
|
model-00067-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c8512bf0229296434af01b4f1101bc5017ee2af6a54c3165c5c21da97b4f6016
|
| 3 |
+
size 5234492186
|
model-00074-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c5b768a00f2183596fceb4d8df6894cfe6c566dad5b160cc01ca0df5cb4a84df
|
| 3 |
+
size 2986502663
|
model-00082-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:acd44e6ea7c7a0d4c9492014311fa53874f8f887da196ad9da1df73b2c033af0
|
| 3 |
+
size 2994119008
|
model-00087-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9985d3e728741ebb2f876a1fbedb473131fb0db263a5269dcbe0808811c48512
|
| 3 |
+
size 5301758528
|
model-00088-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d0440329e48af093bffcf7dea7249e548ae8c5b9530ce9106c5843c150a8b034
|
| 3 |
+
size 5335155609
|
model-00090-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6126da29182fd2925f03796cddb668896c85e29e6a1dd0a97442395fcb542903
|
| 3 |
+
size 2986502629
|
model-00091-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c751c5cf58819a59b462dc5ea068adab29dddde75d01d2aa339891c12d591e1d
|
| 3 |
+
size 5234492186
|
model-00094-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9b596ab6aa93dedcbe2343c72f58b4f766e676d5fa94fb0e99d0db863d4acff9
|
| 3 |
+
size 5268332906
|
model-00102-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eb2d70723c034d7986e385e355b404d4eb1f242a247b2374f00e02c7f666968e
|
| 3 |
+
size 5275949231
|
model-00106-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:21bbc96210a1d8e3f5db43673c5e68d6c7c315f8c0031c3222bf40a79166ccbe
|
| 3 |
+
size 2986502631
|
model-00107-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:669fb8affcf4444ef814fe7d7786f3749aa0d7e66c9e99f6254234c38a2d3537
|
| 3 |
+
size 5234492184
|
model-00108-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:48960d3334558830db70b31de067a5ec499748894e70429b0ad14a937c8778da
|
| 3 |
+
size 5309374749
|
model-00111-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4db23d9ba01bed9b9260d37d4e60991ad2702fe439af736b854f89b4afdc3afc
|
| 3 |
+
size 5301758484
|
model-00114-of-00121.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8cabafb9b05896ab6131fb4235847e4eb22293992424c52e9f7225b5dc945e72
|
| 3 |
+
size 2994118916
|