Skip to content

Handle LUID selection on the evaluator loaders that return before this block #1413

Description

The GENAI and EVALUATOR_MANAGED branches return before this registry lookup. Consequently, winml eval -m --task text-generation --device gpu --device-luid accepts the pin but _load_genai_causal_lm() only forwards ep/device. Composite mask-generation evaluation similarly constructs its own ORT sessions without consulting config.device_luid. Both can evaluate on a different adapter while the JSON report records the requested LUID.

Please reject a non-null LUID for loaders that cannot honor it (as perf already does for ort-genai), or wire the selected adapter through their session creation. This needs to happen before the early returns; coverage of the normal WinMLAutoModel path won't catch it.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions