Are there any plans to support self-built Literm in the future?

[lidisi8520]

Are there any plans to support self-built Literm in the future?

[mldangelo-oai]

Thanks for the suggestion. Could you link the project you mean by "Literm" and describe the endpoint or protocol you want to use? If you mean a self-hosted OpenAI-compatible inference provider, #52 is the existing tracker.