Skip to content
#

sd-cpp

Here are 3 public repositories matching this topic...

Language: All
Filter by language

A multi-engine and multimodal local inference platform. One process routes GGUF, safetensors, quantized, and MLX models to the right engine lane (llama.cpp, mistral.rs, SGLang, MLX-lm, sd.cpp and whisper) and serves them through OpenAI- and ollama-compatible APIs, with durable jobs, federation, speech, vision, and image lanes behind the same CLI.

  • Updated Oct 8, 2026
  • Rust

Add this topic to your repo

To associate your repository with the sd-cpp topic, visit your repo's landing page and select "manage topics."

Learn more