GPU-aware inference mesh for large-scale AI serving
rust distributed-systems fault-tolerance high-availability service-mesh observability inference-engine model-serving ml-infrastructure ai-inference gpu-inference ai-infrastructure gpu-mesh
-
Updated
Sep 25, 2025 - Rust