THIS REPO HAS BEEN ARCHIVED AS OF SEPTEMBER 2024. NEURAL MAGIC IS STILL RELEASING ENTERPRISE PACKAGES RELATED TO VLLM. OUR RELEASE REPO HAS JUST GONE PRIVATE.
To learn more about nm-vllm Enterprise, visit the nm-vllm product page.
To contribute and to see our contributions to vLLM, visit vLLM.
To view the latest releases, benchmarking, models, and evaluations from Neural Magic, visit nm-vllm-certs.
Neural Magic maintains a variety of optimized models on our Hugging Face organization profiles: