Skip to content

Support WebSocket protocol #141

@jianzs

Description

@jianzs

The text generation process of large language models usually takes some time, so it's common to use streams to send the result back to users. Therefore, we need to support the WebSocket protocol in both the Router and Function.

Metadata

Metadata

Assignees

No one assigned

    Labels

    good first issueGood for newcomerssdkClient SDK and Infra SDK

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions