Documentation
Run it, route it, read the numbers.
Everything you need to put ollama-mesh in front of your cluster -- connect your tools, ship to production, and understand exactly what it's saving you.
Guides
Integrations
ollama-mesh exposes an Ollama-compatible API on port 11434 and passes through Ollama's OpenAI-compatible /v1 endpoints u...
Read →Known limitations
This page documents what ollama-mesh does not do, what has been tested, and what to plan around in production. Infrastru...
Read →Production
This guide covers running ollama-mesh in a real production environment. It assumes you have already configured config.ya...
Read →Savings math
This document is the financial model behind ollama-mesh's savings tracking. It is designed for infrastructure directors ...
Read →Use cases
The infrastructure control plane Ollama doesn't ship: secure multi-tenant access, hardware-aware load balancing, cost-aw...
Read →Deploy
Integrations
Continue
Continue is an open-source AI coding assistant. Point it at ollama-mesh and every completion request routes through warm...
Read →LibreChat
LibreChat supports Ollama as a custom endpoint. Point it at ollama-mesh to get warm-first routing across multiple GPU no...
Read →Open WebUI
Point Open WebUI at ollama-mesh instead of a single Ollama box and you get warm-first routing across all your GPU nodes,...
Read →