docs: Add Generative SLM support for INFERENCE data event - #80
Conversation
83a6321 to
403f985
Compare
There was a problem hiding this comment.
Pull request overview
Note
Copilot couldn't run its full agentic review because no GitHub Actions runner was available. Make sure your repository has a runner available to run Copilot's review, or add a copilot-setup-steps.yml file specifying one with the runs-on attribute. See the docs for more details.
Extends the INFERENCE data event documentation to cover on-device Generative LLM inference (in addition to existing Vision ML) including configuration parameters, output shape, and a new example.
Changes:
- Adds “Generative LLM” as a documented execution mode with an LLM-specific
configschema. - Updates model auto-detection docs and examples to include LLM model file extensions and outputs.
- Adds an on-device LLM summarization example and additional device resource guidance.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Ref: FLCRM-20635
Ref: FLCRM-20635
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
db9b070 to
b3cf095
Compare
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
There was a problem hiding this comment.
Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.
Note
This error may be related to your runner configuration. You can now configure runners for Copilot code review separately from Copilot cloud agent by creating a copilot-code-review.yml file with your setup steps. Read the docs for details.
Description
This PR extends the
INFERENCEdata event documentation to add support for on-device SLM inference, alongside the existing Vision ML modes.Key Changes
.tflite,.litertlm, and.taskmodel formats.configschema (prompt,systemPrompt,temperature,topK,topP,maxTokens,contextSize).result.outputs.text).labels.txtas a companion form reference file alongside the Vision ML model and the resolvedresult.labelsoutput.gemma-4-e2b.litertlm).JIRA / Issue Reference
Ref: FLCRM-21757