Support for OpenAI Responses API

Currently, dstack Models work with Chat Completions API, but since March OpenAI has introduced the Responses API (migration guide). OpenAI says that the Chat Completions API will not be deprecated, but Responses API is the recommended default, with new features and improved efficiency. Ecosystem projects (vLLM, Ollama, etc.) are actively adding Responses API support, mainly because Codex does not work with Chat Completions.

In our docs, chat model is said to have OpenAI-compatible endpoint, which is confusing since there are different OpenAI formats with Responses API being the new default.

dstack/docs/docs/concepts/services.md

Lines 163 to 165 in 38e66bc

    
           If the service is running a chat model with an OpenAI-compatible interface, 
        
           set the [`model`](#model) property to make the model accessible via `dstack`'s  
        
           global OpenAI-compatible endpoint, and also accessible via `dstack`'s UI.

Consider adding Responses API support to dstack if we continue to provide OpenAI-compatible endpoints.

This issue is stale because it has been open for 30 days with no activity.

Since we migrated from the deprecated gateway.-prefixed endpoint to the service endpoint (#3560), we now rely on the serving framework directly, which seems to already support the Responses API.

Tested with an SGLang-based service (deepseek-ai/DeepSeek-R1-Distill-Qwen-32B on H100 NVL):

curl -X POST "https://qwen32.peterschmidt85.sky.dstack.ai/v1/responses" \
  -H "Authorization: Bearer <token>" \
  -H "Content-Type: application/json" \
  -d '{"model":"deepseek-ai/DeepSeek-R1-Distill-Qwen-32B","input":"Hello"}'

The response comes back with the proper response object format (id, output, status, etc.).

Navigation Menu

Repository navigation

Support for OpenAI Responses API #3000

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

	If the service is running a chat model with an OpenAI-compatible interface,
	set the [`model`](#model) property to make the model accessible via `dstack`'s
	global OpenAI-compatible endpoint, and also accessible via `dstack`'s UI.

Support for OpenAI Responses API #3000

Description

Activity

github-actions commented on Sep 19, 2025

peterschmidt85 commented on Feb 12, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions