[omnidreams] Crazy Robotaxi x live-edit integration plan

[wenqingw-nv]

Proposal: integrate the omnidreams live-edit stack into the Crazy Robotaxi standalone game (#463) as optional, flag-gated gameplay abilities — mid-run game-skin switching (#458), coin/item pickups composited via Robotaxi's FTheta marker projection, random spawned-obstacle events (#431), and sudden weather changes (#431). Vanilla Robotaxi is unchanged with the flags off.

This PR adds the plan document only (integrations/omnidreams/docs/robotaxi_live_edit_integration.md) — seams, mechanisms, costs, estimates (~4 days total), and the supporting evidence from #431/#458. Implementation will follow in separate PRs once the seam questions are settled with #463's author.

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[greptile-apps]

Greptile Summary

This documentation-only PR proposes optional OmniDreams live-edit abilities for Crazy Robotaxi and outlines the intended integration seams, costs, and implementation schedule.

• Plans flag-gated style switching, composited pickups, obstacle events, and weather changes.
• Identifies FTheta projection, presenter, inference-session, and conditioning hooks to investigate during implementation.
• Estimates approximately four days of follow-up implementation work.

Confidence Score: 5/5

The PR appears safe to merge because it changes documentation only and no actionable defect was established.

The new document clearly presents the work as a proposal with implementation deferred to later pull requests, so currently missing runtime seams do not break existing behavior.

Important Files Changed

Filename	Overview
integrations/omnidreams/docs/robotaxi_live_edit_integration.md	Adds a proposal describing four flag-gated Robotaxi live-edit abilities, their prospective integration seams, costs, evidence, and estimates; no concrete defect requiring a review comment was established.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
    Events[Robotaxi game events and input] --> Flags{Ability enabled?}
    Flags -->|Style| Style[Prompt and style adapter]
    Flags -->|Pickup| Projection[FTheta world-to-frame projection]
    Flags -->|Obstacle| Spawn[Conditioned spawn or compositor]
    Flags -->|Weather| Weather[Weather prompt update]
    Style --> Inference[OmniDreams inference session]
    Spawn --> Inference
    Weather --> Inference
    Projection --> Presenter[Presenter compositing]
    Inference --> Presenter
    Presenter --> Encode[Frame encode and stream]
    Projection --> Scoring[Pickup and collision scoring]
    Spawn --> Scoring

Loading

_{Reviews (1): Last reviewed commit: "Add Crazy Robotaxi x live-edit integrati..." | Re-trigger Greptile}

[wenqingw-nv]

Handoff note: my NVIDIA access ends 2026-08-28. Maintainer edits are enabled on this PR; all trained checkpoints are published (fork releases on wenqingw-nv/flashdreams-wq) and the full code+weights+demo-videos snapshot is mirrored internally at gitlab-master.nvidia.com/worldsim/flashdreams (branches wenqingw/*, artifacts in wenqingw/handoff-artifacts via LFS). Context owners going forward: @aidanfnv (game integration, #463/#494-merged) and Yong He (research review). Happy to answer questions async post-internship.

🤖 Generated with Claude Code