feat(realtime): add unified set()

[AdirAmsalem]

Summary

Alternative to PR #76. Adds the same set() SDK method but without introducing a new wire protocol type.

• set() sends type: "set_image" on the wire (same as setImage())
• Server sees set_image for both calls — no server changes needed
• No set_input / set_input_ack wire types introduced

Usage

// set() replaces the full state — prompt + image atomically in a single message
await realtimeClient.set({
  prompt: "A person wearing a superhero costume",
  enhance: true,
  image: "https://example.com/superhero-reference.png",
});

Tradeoffs vs #76

	This PR (SDK-only)	PR #76 (new wire type)
Wire type	set_image (reused)	set_input (new)
Backend changes	None	Yes
Server observability	Can't distinguish set() vs setImage()	Can distinguish
Deploy coordination	SDK only	SDK + API
Future flexibility	Locked to set_image behavior	Can diverge later

Tests

70/70 passing

---

Note

Medium Risk
Adds a new realtime client API that changes how prompt/image updates are sent and introduces URL fetching/base64 conversion behavior, which can affect runtime behavior and timeouts but does not change the wire protocol.

Overview
Adds a unified realtimeClient.set() method that atomically updates prompt and/or reference image via the existing set_image pathway (with input validation and a longer update timeout), and exposes the new SetInput type from the SDK entrypoint.

Refactors image handling to a shared imageToBase64 helper (supporting File/Blob, raw base64, data: URLs, and http(s) URLs via fetch) and updates the lucy-2 realtime example plus new unit tests covering set() validation and call behavior.

^{Written by Cursor Bugbot for commit efca18d. This will update automatically on new commits. Configure here.}

[pkg-pr-new]

Open in StackBlitz

npm i https://pkg.pr.new/DecartAI/sdk/@decartai/sdk@77

commit: efca18d

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

[tomershlasky]

I pretty like it actually, looks much more clean and maintainable (and the other pros you mentioned)