Pinned Loading

1. gpustack gpustack Public

   Forked from gpustack/gpustack

   A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

   Python

2. jan jan Public

   Forked from janhq/jan

   Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

   TypeScript

3. llama.cpp llama.cpp Public

   C++

4. nano-vllm nano-vllm Public

   Forked from GeeeekExplorer/nano-vllm

   Nano vLLM

   Python

5. tokenspeed tokenspeed Public

   Forked from lightseekorg/tokenspeed

   TokenSpeed is a speed-of-light LLM inference engine.

   Python

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python