update readme
This commit is contained in:
@@ -39,7 +39,7 @@ Built on the public porting workspace from [instructkr/claw-code](https://github
|
|||||||
| 🧠 **Context Engine** | Automatic context building with CLAUDE.md discovery and usage reporting |
|
| 🧠 **Context Engine** | Automatic context building with CLAUDE.md discovery and usage reporting |
|
||||||
| 🔄 **Session Persistence** | Save and resume agent sessions across runs |
|
| 🔄 **Session Persistence** | Save and resume agent sessions across runs |
|
||||||
| 🔐 **Permission System** | Granular control: `--allow-write`, `--allow-shell`, `--unsafe` |
|
| 🔐 **Permission System** | Granular control: `--allow-write`, `--allow-shell`, `--unsafe` |
|
||||||
| 🏗️ **OpenAI-Compatible** | Works with any OpenAI-compatible model server (vLLM, Ollama, etc.) |
|
| 🏗️ **OpenAI-Compatible Runtime** | Python client targets an OpenAI-compatible API, with `vLLM` as the documented setup |
|
||||||
| 🐉 **Qwen3-Coder** | First-class support for `Qwen3-Coder-30B-A3B-Instruct` via vLLM |
|
| 🐉 **Qwen3-Coder** | First-class support for `Qwen3-Coder-30B-A3B-Instruct` via vLLM |
|
||||||
|
|
||||||
---
|
---
|
||||||
@@ -118,7 +118,7 @@ claw-code/
|
|||||||
| Requirement | Details |
|
| Requirement | Details |
|
||||||
|-------------|---------|
|
|-------------|---------|
|
||||||
| 🐍 Python | `3.10` or higher |
|
| 🐍 Python | `3.10` or higher |
|
||||||
| 🖥️ Model Server | Any OpenAI-compatible server (vLLM recommended) |
|
| 🖥️ Model Server | `vLLM` with tool calling enabled |
|
||||||
| 🧠 Model | [`Qwen/Qwen3-Coder-30B-A3B-Instruct`](https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct) (recommended) |
|
| 🧠 Model | [`Qwen/Qwen3-Coder-30B-A3B-Instruct`](https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct) (recommended) |
|
||||||
|
|
||||||
---
|
---
|
||||||
@@ -154,6 +154,34 @@ export OPENAI_API_KEY=local-token
|
|||||||
export OPENAI_MODEL=Qwen/Qwen3-Coder-30B-A3B-Instruct
|
export OPENAI_MODEL=Qwen/Qwen3-Coder-30B-A3B-Instruct
|
||||||
```
|
```
|
||||||
|
|
||||||
|
### Use Another Model With vLLM
|
||||||
|
|
||||||
|
If you want to try another model, keep the same `vLLM` server setup and change the `--model` value when you launch `vLLM`.
|
||||||
|
|
||||||
|
Example:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
python -m vllm.entrypoints.openai.api_server \
|
||||||
|
--model your-model-name \
|
||||||
|
--host 127.0.0.1 \
|
||||||
|
--port 8000 \
|
||||||
|
--enable-auto-tool-choice \
|
||||||
|
--tool-call-parser your_parser
|
||||||
|
```
|
||||||
|
|
||||||
|
Then update:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
export OPENAI_MODEL=your-model-name
|
||||||
|
```
|
||||||
|
|
||||||
|
Notes:
|
||||||
|
|
||||||
|
- the documented path in this repository is `vLLM`
|
||||||
|
- the model must support tool calling well enough for agent use
|
||||||
|
- some model families require a different `--tool-call-parser`
|
||||||
|
- slash commands such as `/help`, `/context`, and `/tools` are local and do not require the model server
|
||||||
|
|
||||||
### 3. Run the Agent
|
### 3. Run the Agent
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
|
|||||||
Reference in New Issue
Block a user