Neural Magic
Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM
Pinned Loading
Repositories
Showing 10 of 111 repositories
- transformers-gdm Public Forked from huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- nm-vllm-omni-ent Public Forked from vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
- inspect_k8s_sandbox Public Forked from UKGovernmentBEIS/inspect_k8s_sandbox
A Kubernetes sandbox environment for use with inspect_ai
- model-validation-configs Public
- eval-hub-contrib Public Forked from eval-hub/eval-hub-contrib
Community-contributed evaluation framework adapters for eval-hub
