Skip to content

multi rollout support#24

Merged
mayinghan merged 12 commits intomainfrom
support-mcp-server-session-data-reset
Aug 6, 2025
Merged

multi rollout support#24
mayinghan merged 12 commits intomainfrom
support-mcp-server-session-data-reset

Conversation

@mayinghan
Copy link
Copy Markdown
Collaborator

@mayinghan mayinghan commented Aug 5, 2025

  1. specialize duty for session and execution manager. Session manager will manage each session's underlying connection and all session related stuff, where execution manager only handles rollout. The lifecycle of sessions are maintained by themselves.
  2. make ep.make() async, and do session initialization during make() instead of during each rollout. This can help reuse the same session resources (such as connections) in multiple rollout rounds.
  3. support mcp server session reset, which will reset the state of a session.

@mayinghan mayinghan changed the title specialize duty for session and execution manager for further customi… multi rollout support Aug 5, 2025
@mayinghan mayinghan force-pushed the support-mcp-server-session-data-reset branch from c63836f to d7c5cde Compare August 5, 2025 21:36
@mayinghan mayinghan requested review from dphuang2 and xzrderek August 6, 2025 06:10
Copy link
Copy Markdown
Contributor

@xzrderek xzrderek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

mcp_session = session._mcp_session

# 1. Execute the tool call via MCP protocol (DATA PLANE)
print("session.session_id", session._mcp_session)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove print statements

@mayinghan mayinghan merged commit 1a37ee1 into main Aug 6, 2025
1 check passed
@mayinghan mayinghan deleted the support-mcp-server-session-data-reset branch August 6, 2025 08:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants