Skip to content

add local Nemotron speech recognition - #3218

Merged
Hillary Mutisya (hillary-mutisya) merged 2 commits into
mainfrom
dev/hillarym/localASR
Oct 24, 2026
Merged

Hillary Mutisya (hillary-mutisya) merged 2 commits into
mainfrom
dev/hillarym/localASR

Conversation

@hillary-mutisya

Copy link
Copy Markdown
Collaborator

Add a Nemotron speech provider hosted in an Electron utility process using Foundry Local and ONNX Runtime.

  • Add @shell speechProvider azure|whisper|nemotron with persisted selection
  • Download and cache Nemotron on first selection, with progress and cancellation
  • Stream microphone PCM to native inference and partial transcripts to the textbox
  • Add preparing/finalizing states while preserving editable text and no auto-submit
  • Retain Azure as the default and localWhisper on/off as deprecated aliases
  • Clean up capture and recognition resources on cancellation, switching, and shutdown
  • Add focused tests and Electron worker/native-library packaging configuration

Initially supports Windows x64 single-shot dictation.

Add a Nemotron speech provider hosted in an Electron utility process
using Foundry Local and ONNX Runtime.

- Add @shell speechProvider azure|whisper|nemotron with persisted selection
- Download and cache Nemotron on first selection, with progress and cancellation
- Stream microphone PCM to native inference and partial transcripts to the textbox
- Add preparing/finalizing states while preserving editable text and no auto-submit
- Retain Azure as the default and localWhisper on/off as deprecated aliases
- Clean up capture and recognition resources on cancellation, switching, and shutdown
- Add focused tests and Electron worker/native-library packaging configuration

Initially supports Windows x64 single-shot dictation.
Inject the shared speech provider selector when registering the deprecated Whisper commands, removing their runtime import back to speechProvider while preserving provider selection behavior.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@hillary-mutisya
Hillary Mutisya (hillary-mutisya) merged commit d6b9c40 into main Oct 24, 2026
30 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant