henrywangxf commited on
Commit
a495018
·
verified ·
1 Parent(s): a1f6f59

sync model card from c6fc451a9921b5d06668dffb174b4e056877e644

Browse files
Files changed (1) hide show
  1. README.md +87 -3
README.md CHANGED
@@ -1,3 +1,87 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen3-1.7B
4
+ tags:
5
+ - linux
6
+ - sysadmin
7
+ - agent
8
+ - tool-use
9
+ - gguf
10
+ language:
11
+ - en
12
+ pipeline_tag: text-generation
13
+ ---
14
+
15
+ # lux
16
+
17
+ Fine-tuned [Qwen3-1.7B](https://huggingface.co/Qwen/Qwen3-1.7B) for Linux system administration tool calls. Powers the slow path of the [lux CLI](https://github.com/henrywang/lux) — when the rule-based fast path can't classify a request, this model parses it into a structured tool invocation.
18
+
19
+ This repo ships the **raw GGUF weights + Modelfile**. If you want the full CLI experience (with luxd, ollama, pre-pulled weights, and a REPL), use [`henrywangxf/lux-portable`](https://huggingface.co/henrywangxf/lux-portable) instead.
20
+
21
+ ## Usage
22
+
23
+ ### With ollama (recommended)
24
+
25
+ ```bash
26
+ ollama pull hf.co/henrywangxf/lux
27
+ ollama run hf.co/henrywangxf/lux "restart nginx"
28
+ ```
29
+
30
+ Ollama reads the bundled `Modelfile` automatically — SYSTEM prompt, template, and sampling params come with the pull.
31
+
32
+ ### With llama.cpp
33
+
34
+ ```bash
35
+ wget https://huggingface.co/henrywangxf/lux/resolve/main/qwen3-1.7b.Q4_K_M.gguf
36
+ ./llama-cli -m qwen3-1.7b.Q4_K_M.gguf -p "restart nginx"
37
+ ```
38
+
39
+ You'll need to supply your own prompt template — see `Modelfile` in this repo for the one lux expects.
40
+
41
+ ## What the model outputs
42
+
43
+ Trained to emit tool calls for lux's registry. Typical interaction:
44
+
45
+ ```
46
+ user: my disk is almost full
47
+ model: {"tool": "check_disk_usage", "args": {}}
48
+ ```
49
+
50
+ ```
51
+ user: install firefox
52
+ model: {"tool": "install_flatpak", "args": {"app": "org.mozilla.firefox"}}
53
+ ```
54
+
55
+ The full tool schema lives in [lux-tools](https://github.com/henrywang/lux/tree/main/crates/lux-tools). If you're using this model outside of lux, you'll need to parse these tool calls and dispatch them yourself.
56
+
57
+ ## Training
58
+
59
+ - **Base:** [Qwen/Qwen3-1.7B](https://huggingface.co/Qwen/Qwen3-1.7B) (Apache 2.0)
60
+ - **Method:** LoRA fine-tuning on a curated set of Linux sysadmin tool-use traces
61
+ - **Quantization:** Q4_K_M (GGUF)
62
+ - **Recipe:** see [finetune/](https://github.com/henrywang/lux/tree/main/finetune) in the main repo
63
+
64
+ ## Intended use
65
+
66
+ - Parsing natural-language sysadmin requests into structured tool calls
67
+ - Running locally on a laptop (≥8 GB RAM is comfortable for Q4_K_M)
68
+ - Integrating with your own agent loop over lux's tool schema — or using lux directly
69
+
70
+ ## Limitations
71
+
72
+ - **English only.**
73
+ - **Tuned for Fedora / RHEL-family systems** (dnf, systemd, firewalld). Other distros work for most tools but package-manager queries degrade.
74
+ - **Not a general-purpose chatbot** — asking unrelated questions produces garbage tool calls.
75
+ - **Small model, small context.** Multi-turn conversations longer than a handful of exchanges will drift; lux avoids this by keeping history trimmed.
76
+ - **Destructive actions are not gated by the model** — that's the job of the lux CLI, which asks for confirmation before running anything destructive. If you call the model directly, implement your own confirmation step.
77
+
78
+ ## License
79
+
80
+ Apache-2.0, inherited from Qwen3-1.7B. Fine-tuning derived weights are redistributed under the same terms.
81
+
82
+ ## Links
83
+
84
+ - Source: https://github.com/henrywang/lux
85
+ - Portable bundle: https://huggingface.co/henrywangxf/lux-portable
86
+ - Base model: https://huggingface.co/Qwen/Qwen3-1.7B
87
+ - Issues / feedback: https://github.com/henrywang/lux/issues