Skip to content

Support audio input#22679

Draft
fjord-oai wants to merge 1 commit into
mainfrom
fjord/audio_input
Draft

Support audio input#22679
fjord-oai wants to merge 1 commit into
mainfrom
fjord/audio_input

Conversation

@fjord-oai
Copy link
Copy Markdown
Contributor

Summary

Adds audio as a structured tool-output content item, gated by model input modalities.

  • Adds InputModality::Audio and input_audio function-call output items.
  • Converts MCP audio content blocks to Responses-compatible structured output for audio-capable models.
  • Fails MCP/code-mode audio output clearly when the selected model does not advertise audio input.
  • Adds a strict code-mode audio(...) helper.
  • Regenerates app-server protocol schemas so clients can round-trip the new content item shape.

@fjord-oai fjord-oai force-pushed the fjord/audio_input branch from aca820a to eebdc1f Compare May 14, 2026 20:10
@fjord-oai fjord-oai force-pushed the fjord/audio_input branch from eebdc1f to 15d68ed Compare May 14, 2026 20:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant