Skip to content
@truefoundry

TrueFoundry

Build fast, secure and cost-efficient ML/LLM Apps
README.md

TrueFoundryTrueFoundry

TrueFoundry - One Gateway for Your Entire AI Stack

Twitter Follow Artifact Hub YouTube Discord Signup

What is TrueFoundry?

  • TrueFoundry is an enterprise AI Gateway that gives organizations one control plane to securely access, govern, and observe LLMs, MCP servers, and agents.
  • The platform brings together identity & access, routing & discovery, policies & guardrails, credentials & trust, usage & cost controls, and observability & audit across your AI stack.

One Gateway for Your Entire AI Stack

TrueFoundry AI Gateway Architecture

  • LLM Gateway - Access 1000+ commercial, open-source, and fine-tuned models through one interface with routing, fallbacks, caching, guardrails, budgets, access controls, and observability.

  • MCP Gateway - Secure and govern access to MCP servers and tools with centralized authentication, authorization, credential management, policies, and observability.

  • Agent Gateway - Register, discover, and govern agents with identity, access controls, policies, guardrails, cost controls, and end-to-end visibility.

TrueFoundry Docs →

Explore guides, APIs, integrations, and deployment options for running the TrueFoundry AI Gateway as SaaS, in your VPC, on-prem, or in air-gapped environments.

OpenSource

  • TrueForge - Our open-source, vendor-neutral agent harness for building general-purpose agents. Bring your own model, MCP servers, tools, sandbox, and infrastructure.

Get in touch 💬

👉 Join our Discord community

🐦 Follow the latest from the TrueFoundry team on Twitter @truefoundry

📚 Explore the TrueFoundry Docs

🌐 Visit truefoundry.com

Pinned Loading

  1. trueforge trueforge Public

    The open-source agent harness - the runtime layer that turns an LLM into a working agent.

    TypeScript 5.7k 443

  2. CruiseKube CruiseKube Public

    CruiseKube is an intelligent Kubernetes resource optimization controller that automatically monitors, analyzes, and applies resource recommendations to improve cluster efficiency and reduce costs.

    Go 109 9

  3. aitori aitori Public

    Go 49

  4. models models Public

    Community-maintained registry of AI/LLM model configurations - pricing, features, and limits across 19 providers and 1000+ models

    41 8

  5. infra-charts infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    Go Template 7 6

  6. llm-locust llm-locust Public

    LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking

    TypeScript 37 11

Repositories

Showing 10 of 109 repositories
  • CruiseKube Public

    CruiseKube is an intelligent Kubernetes resource optimization controller that automatically monitors, analyzes, and applies resource recommendations to improve cluster efficiency and reduce costs.

    truefoundry/CruiseKube's past year of commit activity
    Go 109 9 3 5 Updated Sep 17, 2026
  • mcp-servers Public
    truefoundry/mcp-servers's past year of commit activity
    Python 2 4 0 20 Updated Sep 18, 2026
  • agentic-ai-with-truefoundry Public

    This course offers a comprehensive introduction to Agentic AI for GenAI developers, along with covering usage of TrueFoundry's AI Gateway and Deployment features for deploying production-grade Agentic AI applications.

    truefoundry/agentic-ai-with-truefoundry's past year of commit activity
    Jupyter Notebook 0 1 0 66 Updated Sep 17, 2026
  • trueforge Public

    The open-source agent harness - the runtime layer that turns an LLM into a working agent.

    truefoundry/trueforge's past year of commit activity
    TypeScript 5,743 MIT 443 45 (6 issues need help) 48 Updated Sep 17, 2026
  • axolotl Public Forked from axolotl-ai-cloud/axolotl

    Go ahead and axolotl questions

    truefoundry/axolotl's past year of commit activity
    Python 1 Apache-2.0 1,465 0 5 Updated Sep 17, 2026
  • infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    truefoundry/infra-charts's past year of commit activity
    Go Template 7 6 0 17 Updated Sep 17, 2026
  • models Public

    Community-maintained registry of AI/LLM model configurations - pricing, features, and limits across 19 providers and 1000+ models

    truefoundry/models's past year of commit activity
    41 MIT 8 0 178 Updated Sep 17, 2026
  • truefoundry-agents-assistant-ui-runtime Public
    truefoundry/truefoundry-agents-assistant-ui-runtime's past year of commit activity
    TypeScript 1 Apache-2.0 1 0 2 Updated Sep 17, 2026
  • tfy-local-ai-setup Public
    truefoundry/tfy-local-ai-setup's past year of commit activity
    0 0 0 0 Updated Sep 16, 2026
  • linear-dashboards Public

    Developer productivity dashboard for Linear — team velocity, project allocation, on-time completion, and per-developer metrics

    truefoundry/linear-dashboards's past year of commit activity
    TypeScript 0 0 0 8 Updated Sep 13, 2026
View all repositories