Pluggable backends
OpenAI-compatible HTTP, OpenRouter Responses, Google Gemini, local llama.cpp, and browser transformers.js — behind the same runtime model.
A unified API with pluggable backends for native apps and the browser — chat, tools, streaming, and more.
This project is in an early stage; the public API is still evolving. See the introduction for what is implemented today and how to try it.
| Topic | Link |
|---|---|
| Install and build | Getting started |
| Environment variables | Configuration |
| Crate layout | Architecture |
| Workspace migration | Workspace refactor |
| Rust runtime and tools | Rust SDK |
| npm / WASM package | JavaScript |
| TTS (Qwen3) | QTS |
| Releases and CI | Development |