update readme to include ollama
This commit is contained in:
@@ -118,7 +118,7 @@ claw-code/
|
|||||||
| Requirement | Details |
|
| Requirement | Details |
|
||||||
|-------------|---------|
|
|-------------|---------|
|
||||||
| 🐍 Python | `3.10` or higher |
|
| 🐍 Python | `3.10` or higher |
|
||||||
| 🖥️ Model Server | `vLLM` with tool calling enabled |
|
| 🖥️ Model Server | `vLLM` or `Ollama`, with tool calling support |
|
||||||
| 🧠 Model | [`Qwen/Qwen3-Coder-30B-A3B-Instruct`](https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct) (recommended) |
|
| 🧠 Model | [`Qwen/Qwen3-Coder-30B-A3B-Instruct`](https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct) (recommended) |
|
||||||
|
|
||||||
---
|
---
|
||||||
@@ -146,6 +146,33 @@ curl http://127.0.0.1:8000/v1/models
|
|||||||
|
|
||||||
> 📚 **References:** [vLLM Tool Calling Docs](https://docs.vllm.ai/en/v0.13.0/features/tool_calling/) · [OpenAI-Compatible Server](https://docs.vllm.ai/en/v0.13.0/serving/openai_compatible_server.html)
|
> 📚 **References:** [vLLM Tool Calling Docs](https://docs.vllm.ai/en/v0.13.0/features/tool_calling/) · [OpenAI-Compatible Server](https://docs.vllm.ai/en/v0.13.0/serving/openai_compatible_server.html)
|
||||||
|
|
||||||
|
### Optional: Use Ollama Instead of vLLM
|
||||||
|
|
||||||
|
`claw-code-agent` can also work with Ollama because the runtime targets an OpenAI-compatible API. Use a model that supports tool calling well.
|
||||||
|
|
||||||
|
Example:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
ollama serve
|
||||||
|
ollama pull qwen3
|
||||||
|
```
|
||||||
|
|
||||||
|
Then configure:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
export OPENAI_BASE_URL=http://127.0.0.1:11434/v1
|
||||||
|
export OPENAI_API_KEY=ollama
|
||||||
|
export OPENAI_MODEL=qwen3
|
||||||
|
```
|
||||||
|
|
||||||
|
Notes:
|
||||||
|
|
||||||
|
- prefer tool-capable models such as `qwen3`
|
||||||
|
- plain chat-only models are not enough for full agent behavior
|
||||||
|
- Ollama does not use the `vLLM` parser flags shown above
|
||||||
|
|
||||||
|
> 📚 **References:** [Ollama OpenAI Compatibility](https://docs.ollama.com/api/openai-compatibility) · [Ollama Tool Calling](https://docs.ollama.com/capabilities/tool-calling)
|
||||||
|
|
||||||
### 2. Configure Environment
|
### 2. Configure Environment
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
|
|||||||
Reference in New Issue
Block a user