Skip to content

docs: Add Generative SLM support for INFERENCE data event - #80

Merged
javoweb-fc merged 10 commits into
v2from
task/FLCRM-20635-llm-inference-support
Aug 6, 2026
Merged

docs: Add Generative SLM support for INFERENCE data event#80
javoweb-fc merged 10 commits into
v2from
task/FLCRM-20635-llm-inference-support

Conversation

@javoweb-fc

@javoweb-fc javoweb-fc commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Description

This PR extends the INFERENCE data event documentation to add support for on-device SLM inference, alongside the existing Vision ML modes.

Key Changes

  1. Execution Modes: Adds SLM as a supported execution mode, alongside Vision ML.
  2. Model Detection: Documents the supported .tflite, .litertlm, and .task model formats.
  3. Parameters: Documents the SLM config schema (prompt, systemPrompt, temperature, topK, topP, maxTokens, contextSize).
  4. Callback Signature: Documents the SLM output shape (result.outputs.text).
  5. Class Labels: Documents uploading labels.txt as a companion form reference file alongside the Vision ML model and the resolved result.labels output.
  6. Device Warnings: Adds SLM-specific battery and memory guidance.
  7. New Example: Adds an on-device SLM text summarization example (gemma-4-e2b.litertlm).

JIRA / Issue Reference

Ref: FLCRM-21757

@javoweb-fc
javoweb-fc force-pushed the task/FLCRM-20635-llm-inference-support branch 2 times, most recently from 83a6321 to 403f985 Compare July 9, 2026 22:15
@javoweb-fc
javoweb-fc requested a lite review from Copilot July 9, 2026 22:47

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot couldn't run its full agentic review because no GitHub Actions runner was available. Make sure your repository has a runner available to run Copilot's review, or add a copilot-setup-steps.yml file specifying one with the runs-on attribute. See the docs for more details.

Extends the INFERENCE data event documentation to cover on-device Generative LLM inference (in addition to existing Vision ML) including configuration parameters, output shape, and a new example.

Changes:

  • Adds “Generative LLM” as a documented execution mode with an LLM-specific config schema.
  • Updates model auto-detection docs and examples to include LLM model file extensions and outputs.
  • Adds an on-device LLM summarization example and additional device resource guidance.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread docs/DATA EVENTS/data-events-reference/data-events-inference.md Outdated
Comment thread docs/DATA EVENTS/data-events-reference/data-events-inference.md
Comment thread docs/DATA EVENTS/data-events-reference/data-events-inference.md Outdated
Base automatically changed from task/FLCRM-20635-onnx-litert-deprecation to v2 July 15, 2026 16:06
javoweb-fc and others added 3 commits August 6, 2026 13:50
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings August 6, 2026 18:50
@javoweb-fc
javoweb-fc force-pushed the task/FLCRM-20635-llm-inference-support branch from db9b070 to b3cf095 Compare August 6, 2026 18:50
javoweb-fc and others added 2 commits August 6, 2026 13:52
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@javoweb-fc javoweb-fc changed the title docs: Add Generative LLM support for INFERENCE data event docs: Add Generative SLM support for INFERENCE data event Aug 6, 2026
javoweb-fc and others added 5 commits August 6, 2026 13:56
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@javoweb-fc javoweb-fc self-assigned this Aug 6, 2026
@javoweb-fc
javoweb-fc marked this pull request as ready for review August 6, 2026 19:14
@javoweb-fc
javoweb-fc requested review from a team as code owners August 6, 2026 19:14

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Note

This error may be related to your runner configuration. You can now configure runners for Copilot code review separately from Copilot cloud agent by creating a copilot-code-review.yml file with your setup steps. Read the docs for details.

@javoweb-fc
javoweb-fc merged commit c76eb35 into v2 Aug 6, 2026
3 checks passed
@javoweb-fc
javoweb-fc deleted the task/FLCRM-20635-llm-inference-support branch August 6, 2026 23:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants