Lemonade MCP Server
by lemonade-sdkLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Lemonade is an open-source mcp server by lemonade-sdk, written mainly in C++, with 6,036 GitHub stars and the Apache-2.0 license. Its code was last updated Nov 1, 2026.
🍋 Lemonade: Refreshingly fast local AI
<p align="center"> <a href="https://discord.gg/5xXzkMu8Zk"> <img src="https://img.shields.io/badge/Discord-7289DA?logo=discord&logoColor=white" alt="Discord" /></a> <a href="https://github.com/lemonade-sdk/lemonade/blob/main/docs/dev/contribute.md" title="Contribution Guide"> <img src="https://img.shields.io/badge/PRs-welcome-brightgreen.svg" alt="PRs Welcome" /></a> <a href="https://github.com/lemonade-sdk/lemonade/releases/latest" title="Download the latest release"> <img src="https://img.shields.io/github/v/release/lemonade-sdk/lemonade?include_prereleases" alt="Latest Release" /></a> <a href="https://tooomm.github.io/github-release-stats/?username=lemonade-sdk&repository=lemonade"> <img src="https://img.shields.io/github/downloads/lemonade-sdk/lemonade/total.svg" alt="GitHub downloads" /></a> <a href="https://github.com/lemonade-sdk/lemonade/issues"> <img src="https://img.shields.io/github/issues/lemonade-sdk/lemonade" alt="GitHub issues" /></a> <a href="https://github.com/lemonade-sdk/lemonade/blob/main/LICENSE"> <img src="https://img.shields.io/badge/License-Apache-yellow.svg" alt="License: Apache" /></a> <a href="https://star-history.com/#lemonade-sdk/lemonade"> <img src="https://img.shields.io/badge/Star%20History-View-brightgreen" alt="Star History Chart" /></a> </p> <p align="center"> <img src="https://github.com/lemonade-sdk/assets/blob/main/docs/banner_03.png?raw=true" alt="Lemonade Banner" /> </p> <h3 align="center"> <a href="./docs/guide/install/README.md">Download</a> | <a href="./docs/README.md">Documentation</a> | <a href="https://discord.gg/5xXzkMu8Zk">Discord</a> </h3>Lemonade is the local AI server that gives you the same capabilities as cloud APIs, except 100% free and private. Use the latest models for chat, coding, speech, and image generation on your own NPU and GPU.
Lemonade comes in two flavors:
- Lemonade Server installs a service you can connect to hundreds of great apps using standard OpenAI, Anthropic, and Ollama APIs.
- Embeddable Lemonade is a portable binary you can package into your own application to give it multi-modal local AI that auto-optimizes for your user’s PC.
This project is built by the community for every PC, with optimizations by AMD engineers to get the most from Ryzen AI, Radeon, and Strix Halo PCs.
Getting Started
- Install: Windows · Linux · macOS · Docker · Source
- Get Models: Browse and download with the Model Manager
- Generate: Try models with the built-in interfaces for chat, image gen, speech gen, and more
- Mobile: Take your lemonade to go: iOS · Android · Source
- Connect: Use Lemonade with your favorite apps:
Supported Platforms
| Platform | Build |
|---|---|
 |  |
 |  |
 |  |
 |  |
 |  |
 |  |
 |  |
 |  |
Using the CLI
To run and chat with Gemma:
lemonade run Gemma-4-E2B-it-GGUF
To code with Lemonade models:
lemonade launch claude
Multi-modality:
# image gen
lemonade run SDXL-Turbo
# speech gen
lemonade run kokoro-v1
# transcription
lemonade run Whisper-Large-v3-Turbo
To see available models and download them:
lemonade list
lemonade pull Gemma-4-E2B-it-GGUF
To manage model aliases for environment-independent naming and active-standby failover:
lemonade alias add production-llm Gemma-4-E2B-it-GGUF
lemonade alias list
# Instant active-standby failover to a different model target
lemonade alias add production-llm Qwen3-0.6B-GGUF
lemonade alias remove production-llm
To see the backends available on your PC:
lemonade backends
For hybrid setups, Lemonade can also route to any OpenAI-compatible cloud provider (Fireworks, OpenAI, OpenRouter, Together, …) alongside local models — see Cloud Offload. (Experimental.)
Model Library
<img align="right" src="https://github.com/lemonade-sdk/assets/blob/main/docs/model_manager_03.png?raw=true" alt="Model Manager" width="280" />Lemonade supports a wide variety of LLMs (GGUF, FLM, and ONNX), whisper, stable diffusion, etc. models across CPU, GPU, and NPU.
Use lemonade pull or the built-in Model Manager to download models. Custom GGUF/ONNX models can be pulled from Hugging Face or ModelScope, with their source retained for future updates.
Browse the included model catalog →
<br clear="right"/>Supported Configurations
Lemonade supports multiple inference engines for LLM, speech, TTS, and image generation, and each has its own backend and hardware requirements.
<!-- BEGIN GENERATED: backends-matrix --> <table> <thead> <tr> <th>Modality</th> <th>Engine</th> <th>Backend</th> <th>Device</th> <th>OS</th> </tr> </thead> <tbody> <tr> <td rowspan="16"><strong>Text generation</strong></td> <td rowspan="8"><code>llamacpp</code></td> <td><code>system</code></td> <td><code>x86_64</code>/ARM64 CPU, GPU</td> <td>Linux</td> </tr> <tr> <td><code>metal</code></td> <td>Apple Silicon GPU</td> <td>macOS</td> </tr> <tr> <td><code>cuda</code></td> <td>NVIDIA GPUs (Turing or newer)**</td> <td>Windows, Linux</td> </tr> <tr> <td><code>vulkan</code></td> <td><code>x86_64</code> CPU, AMD iGPU, AMD dGPU; ARM64 CPU/GPU (Linux)</td> <td>Windows, Linux</td> </tr> <tr> <td><code>rocm</code></td> <td>AMD GPUs supported by ROCm</td> <td>Windows, Linux</td> </tr> <tr> <td><code>cpu</code></td> <td><code>x86_64</code> CPU; ARM64 CPU (Linux)</td> <td>Windows, Linux</td> </tr> <tr> <td><code>nathanw</code>‡</td> <td>AMD Strix Halo (Vulkan performance fork)</td> <td>Linux</td> </tr> <tr> <td><code>halobox</code>‡</td> <td>AMD Strix Halo (Halo Box ROCm fork)</td> <td>Linux</td> </tr> <tr> <td rowspan="1"><code>llamacpp-hrx</code></td> <td><code>hrx</code>†</td> <td>AMD GPUs (gfx1100, gfx1151)</td> <td>Linux</td> </tr> <tr> <td rowspan="1"><code>flm</code></td> <td><code>npu</code></td> <td>XDNA2 NPU</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="1"><code>ryzenai-llm</code></td> <td><code>npu</code></td> <td>XDNA2 NPU</td> <td>Windows</td> </tr> <tr> <td rowspan="1"><code>vllm</code></td> <td><code>rocm</code>†</td> <td>Strix Halo iGPU (gfx1151)</td> <td>Linux</td> </tr> <tr> <td rowspan="1"><code>ds4</code></td> <td><code>rocm</code>‡</td> <td>Prebuilt ds4 for AMD Strix Halo</td> <td>Linux</td> </tr> <tr> <td rowspan="1"><code>rocmfpx</code></td> <td><code>rocm</code>‡</td> <td>AMD Strix Halo</td> <td>Linux</td> </tr> <tr> <td rowspan="1"><code>halogen</code></td> <td><code>rocm</code>‡</td> <td>AMD Strix Halo</td> <td>Linux</td> </tr> <tr> <td rowspan="1"><code>gufo</code></td> <td><code>rocm</code>‡</td> <td>AMD Strix Halo</td> <td>Linux</td> </tr> <tr> <td rowspan="6"><strong>Speech-to-text</strong></td> <td rowspan="5"><code>whispercpp</code></td> <td><code>npu</code></td> <td>XDNA2 NPU</td> <td>Windows</td> </tr> <tr> <td><code>metal</code></td> <td>Apple Silicon GPU</td> <td>macOS</td> </tr> <tr> <td><code>vulkan</code></td> <td><code>x86_64</code> CPU</td> <td>Windows, Linux</td> </tr> <tr> <td><code>rocm</code></td> <td>Supported AMD ROCm iGPU/dGPU families*</td> <td>Windows, Linux</td> </tr> <tr> <td><code>cpu</code></td> <td><code>x86_64</code> CPU</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="1"><code>moonshine</code></td> <td><code>cpu</code></td> <td><code>x86_64</code>/<code>arm64</code> CPU</td> <td>Windows, Linux, macOS</td> </tr> <tr> <td rowspan="4"><strong>Text-to-speech</strong></td> <td rowspan="2"><code>kokoro</code></td> <td><code>metal</code></td> <td>Apple Silicon GPU</td> <td>macOS</td> </tr> <tr> <td><code>cpu</code></td> <td><code>x86_64</code> CPU</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="2"><code>openmoss</code></td> <td><code>cuda</code>†</td> <td>NVIDIA GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>vulkan</code>†</td> <td>Vulkan-capable GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="6"><strong>Audio generation</strong></td> <td rowspan="3"><code>thinksound</code></td> <td><code>cuda</code>†</td> <td>NVIDIA GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>vulkan</code>†</td> <td>Vulkan-capable GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>rocm</code>†</td> <td>Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock)</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="3"><code>acestep</code></td> <td><code>cuda</code>†</td> <td>NVIDIA GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>vulkan</code>†</td> <td>Vulkan-capable GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>rocm</code>†</td> <td>Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock)</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="7"><strong>Image generation</strong></td> <td rowspan="5"><code>sd-cpp</code></td> <td><code>metal</code></td> <td>Apple Silicon GPU</td> <td>macOS</td> </tr> <tr> <td><code>cuda</code></td> <td>NVIDIA GPUs (Turing or newer)**</td> <td>Windows, Linux</td> </tr> <tr> <td><code>vulkan</code></td> <td>Vulkan-capable GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>rocm</code></td> <td>Supported AMD ROCm iGPU/dGPU families*</td> <td>Windows, Linux</td> </tr> <tr> <td><code>cpu</code></td> <td><code>x86_64</code> CPU</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="2"><code>thenoise</code></td> <td><code>rocm</code></td> <td>Supported AMD ROCm families</td> <td>Windows, Linux</td> </tr> <tr> <td><code>cuda</code>†</td> <td>NVIDIA GPUs</td> <td>Linux</td> </tr> <tr> <td rowspan="4"><strong>3D generation</strong></td> <td rowspan="4"><code>trellis</code></td> <td><code>cuda12</code>†</td> <td>NVIDIA Pascal/Volta GPUs (CUDA 12)</td> <td>Windows, Linux</td> </tr> <tr> <td><code>cuda</code>†</td> <td>NVIDIA GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>vulkan</code>†</td> <td>Vulkan-capable GPUs</td> <td>Windows, Linux</td> </tr> <tr> <td><code>rocm</code>†</td> <td>Supported AMD ROCm iGPU/dGPU families (ROCm via TheRock)</td> <td>Windows, Linux</td> </tr> <tr> <td rowspan="3"><strong>Text classification</strong></td> <td rowspan="3"><code>onnxruntime</code></td> <td><code>cpu</code>†</td> <td><code>x86_64</code> CPU</td> <td>Windows</td> </tr> <tr> <td><code>cpu</code>†</td> <td><code>x86_64</code>/<code>arm64</code> CPU</td> <td>Linux</td> </tr> <tr> <td><code>cpu</code>†</td> <td><code>arm64</code> CPU</td> <td>macOS</td> </tr> </tbody> </table>† experimental backend, ‡ guest backend. See Backend Tiers and Formats.
<!-- END GENERATED: backends-matrix -->To check exactly which recipes/backends are supported on your own machine, run:
lemonade backends
Project Roadmap
Lemonade's roadmap is defined by a set of working groups. Visit the landing page here to learn each group's goal and roadmap.
Integrate Embeddable Lemonade in Your Application
Embeddable Lemonade is a binary version of Lemonade that you can bundle into your own app to give it a portable, auto-optimizing, multi-modal local AI stack. This lets users focus on your app, with zero Lemonade installers, branding, or telemetry.
Check out the Embeddable Lemonade guide.
Connect Lemonade Server to Your Application
You can use any OpenAI-compatible client library by configuring it to use http://localhost:13305/v1 as the base URL. A table containing official and popular OpenAI clients on different languages is shown below.
Feel free to pick and choose your preferred language.
| Python | C++ | Java | C# | Node.js | Go | Ruby | Rust | PHP |
|---|---|---|---|---|---|---|---|---|
| openai-python | openai-cpp | openai-java | openai-dotnet | openai-node | go-openai | ruby-openai | async-openai | openai-php |
Python Client Example
from openai import OpenAI
# Initialize the client to use Lemonade Server
client = OpenAI(
base_url="http://localhost:13305/api/v1",
api_key="lemonade" # required but unused
)
# Create a chat completion
completion = client.chat.completions.create(
model="Gemma-4-E2B-it-GGUF", # or any other available model
messages=[
{"role": "user", "content": "What is the capital of France?"}
]
)
# Print the response
print(completion.choices[0].message.content)
Click to learn more about the available APIs and how to embed Lemonade in your own application.
FAQ
To read our frequently asked questions, see our FAQ Guide
Contributing
Lemonade is built by the local AI community! If you would like to contribute to this project, please check out our contribution guide.
Maintainers
This is a community project with many maintainers, please see the maintainers list here to see their subject areas. You can reach us by filing an issue or joining our Discord. This project is sponsored by AMD.
Code Signing Policy
Free code signing provided by SignPath.io, certificate by SignPath Foundation.
- Committers and reviewers: Maintainers of this repo
- Approvers: Owners
Privacy policy: This program will not transfer any information to other networked systems unless specifically requested by the user or the person installing or operating it. When the user requests a model download or registry lookup, Lemonade may contact Hugging Face Hub (see their privacy policy) or ModelScope, according to the model source selected by the user or packager.
License and Attribution
This project is:
- Built with C++ (server) and React (app) with ❤️ for the open source community,
- Standing on the shoulders of great tools from:
- Licensed under the Apache 2.0 License.
- Portions of the project are licensed as described in LICENSE.
Lemonade alternatives
View more →Similar mcp servers in Communication, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.
| Name | Stars | Licence | Last updated | Scan |
|---|---|---|---|---|
| Lemonade (this page) lemonade-sdk | 6k | Apache-2.0 | Nov 1, 2026 | Scanned, no flagged issues |
| TrendRadar sansan0 | 63k | GPL-3.0 | Oct 29, 2026 | Scanned, no flagged issues |
| Waha devlikeapro | 7.7k | Apache-2.0 | Oct 28, 2026 | Scanned, no flagged issues |
| Pipeshub AI pipeshub-ai | 3.9k | Apache-2.0 | Nov 1, 2026 | Scanned, no flagged issues |
| Slackdump rusq | 2.8k | AGPL-3.0 | Nov 1, 2026 | Scanned, no flagged issues |
| MCP SuperAssistant srbhptl39 | 2.6k | MIT | Feb 9, 2026 | Scanned, no flagged issues |