Self-hosted benchmark console for local LLM servers: TTFT, prefill/decode tok/s across 1K–64K contexts, concurrency sweeps, GPU telemetry and MTP/draft-acceptance stats with browser-side history and comparison.
GPU monitor for local LLM rigs -- btop-style TUI, per-process VRAM for Ollama/vLLM, thermal automation, Prometheus + Grafana
An integrated flagship MLOps platform combining GPU telemetry monitoring, model serving registries, LangChain RAG, edge video inference, sandboxed code execution, and LLM benchmarking.
Enterprise Multi-Node Hybrid RAG, PyTorch Neural Vector Reranker & GPU Compute Console
To associate your repository with the gpu-telemetry topic, visit your repo's landing page and select "manage topics."