Calculate maximum quantized LLM size fitting available RAM
-
Updated
May 19, 2026 - TypeScript
#
model-sizing
Here are 2 public repositories matching this topic...
Will this mixture-of-experts model run on my machine, and how fast? Answered from the model's index, before downloading it.
python cli capacity-planning inference self-hosted moe quantization vram mixture-of-experts huggingface llm safetensors llama-cpp local-llm llm-inference ollama gguf deepseek model-sizing yserver
-
Updated
Sep 24, 2026 - Python
Add this topic to your repo
To associate your repository with the model-sizing topic, visit your repo's landing page and select "manage topics."