Pinned Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 8 1

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++ 1

3. ginfer ginfer Public

   C++ 1

4. ik_llama.cpp ik_llama.cpp Public

   Forked from ikawrakow/ik_llama.cpp

   llama.cpp fork with additional SOTA quants and improved performance

   C++