Skip to content

Route model inference through Cloudflare AI Gateway - #38

Merged
matthewp merged 2 commits into
mainfrom
feat/ai-gateway
Sep 18, 2026
Merged

matthewp merged 2 commits into
mainfrom
feat/ai-gateway

Conversation

@matthewp

@matthewp matthewp commented Sep 18, 2026

Copy link
Copy Markdown
Contributor

Changes

  • Routes Workers AI and Anthropic models exclusively through the shared Cloudflare AI Gateway using Factory-scoped Worker secrets.
  • Removes direct provider paths and the Workers AI binding, disables payload retention, and translates existing anthropic/… and cloudflare/… config values to gateway routes.

Testing

  • Adds provider tests for secret mapping, gateway endpoints, Kimi metadata, and payload-retention headers.
  • Updates configuration tests to cover gateway model names, legacy alias translation, and unsupported providers.

Docs

  • Updates the README and local secret template for gateway-only model configuration.

@matthewp
matthewp marked this pull request as ready for review September 18, 2026 00:23
@matthewp
matthewp merged commit d385efb into main Sep 18, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant