Event-Driven Architecture Refactoring

[teith]

Problem: SDK fails with 50+ concurrent requests due to O(N) listener dispatch, polling loops starving event loop, and false disconnects from missed heartbeat pongs.

Solution:

• Replace polling with asyncio.Future for O(1) message routing via _pending_operations HashMap
• Add semaphore to limit concurrent requests (default 15, env RUNWARE_MAX_CONCURRENT_REQUESTS )
• Add jitter on reconnect to prevent thundering herd
• Increase PING_TIMEOUT_DURATION from 10s to 30s for stability
• Graceful cancellation of pending operations on disconnect

Result: Stable operation at high concurrency, no more false "Connection lost" errors.

[Copilot]

Pull request overview

This PR refactors the SDK’s WebSocket message handling toward a more event-driven model by routing responses to per-request asyncio.Futures, aiming to improve high-concurrency stability and reduce polling/listener overhead.

Changes:

• Introduces _pending_operations with an OperationState state machine to route inbound messages to waiting Futures.
• Adds a global request semaphore (MAX_CONCURRENT_REQUESTS) and reconnect jitter/backoff adjustments.
• Tweaks connection stability settings (e.g., increased ping/pong timeout) and adds disconnect-time cancellation of pending operations.

Reviewed changes

Copilot reviewed 3 out of 4 changed files in this pull request and generated 8 comments.

File	Description
runware/utils.py	Increases ping timeout; adds MAX_CONCURRENT_REQUESTS env-configured constant.
runware/types.py	Adds OperationState and request wrapper dataclasses used by retry/routing logic.
runware/server.py	Routes messages to pending-operation futures and cancels pending operations on close.
runware/base.py	Implements pending-operation registry, retry/reconnect behavior updates, and semaphore-based concurrency limiting.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 4 out of 5 changed files in this pull request and generated 10 comments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 4 out of 5 changed files in this pull request and generated 6 comments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 4 out of 5 changed files in this pull request and generated 3 comments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Sirsho1997]

LGTM
I made some additional changes. Please review these