I've been playing around with Cerebras and the speed is just insane.. they have Gemma and GLM that are pretty decent models for "live" interactive coding, the kind that works great with ECA (as opposed to hands off agent loop style coding)
Could we add them as a provider? Their API is OpenAI compatible.
https://inference-docs.cerebras.ai/api-reference/chat-completions
https://inference-docs.cerebras.ai/resources/openai
To upvote this issue, give it a thumbs up. See this list for the most upvoted issues.
I've been playing around with Cerebras and the speed is just insane.. they have Gemma and GLM that are pretty decent models for "live" interactive coding, the kind that works great with ECA (as opposed to hands off agent loop style coding)
Could we add them as a provider? Their API is OpenAI compatible.
https://inference-docs.cerebras.ai/api-reference/chat-completions
https://inference-docs.cerebras.ai/resources/openai
To upvote this issue, give it a thumbs up. See this list for the most upvoted issues.