Pinned Loading

1. neutronstar neutronstar Public

   Forked from antirez/ds4

   Giant MoE models on a single consumer GPU by streaming experts from SSD. CUDA fork of antirez/ds4: runs GLM-5.2 (743B), Tencent Hy3 (295B), and DeepSeek 4 Flash, with io_uring expert streaming, LFU…

   C 29 1

2. pulsar pulsar Public

   SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB GPUs. Zero-config multi-GPU: measures PCIe bandwidth, places …

   Rust 23 2

3. kokoro-tts-mcp kokoro-tts-mcp Public

   MCP server for Kokoro text-to-speech, with adjustable voices/speed and an optional OpenAI-compatible (kokoro-fastapi) backend.

   Python 10 4

4. omni-retrieval omni-retrieval Public

   Fully-local, air-gapped cross-modal retrieval (text/image/audio/video) with LCO-Embedding-Omni + turbovec

   Python 2