Skip to content

Regression happened when running end-end tests by XNNPACK backend with upgraded XNNPACK dependency  #370

@BruceDai

Description

@BruceDai

PR #365 with latest commit@c02da0a and PR #329 with last commit@9c256f6 reported crash issue when running SqueezeNet Nhwc model tests on Linux platform, error as below:

# Linux

[ RUN      ] SqueezeNetNhwcTests.NhwcTest0
Error: The output value at index 0 is expected as 2.42956e-05, but got -inf
../../src/webnn/tests/end2end/models/SqueezeNetNhwc.cpp:38: Failure
Value of: utils::CheckValue(result, outputNpy.as_vec<float>())
  Actual: false
Expected: true
double free or corruption (out)
/home/runner/work/_temp/010615c7-b07b-4642-a7f7-cdbd82bf8344.sh: line 3: 61148 Aborted                 (core dumped) ./out/Release/webnn_end2end_tests --gtest_output=json:/home/runner/work/webnn-native/webnn-native/../update_end2endtests.json

These two PRs didn't reproducer crash but reported regression issue by MobileNetV2NhwcTests and SqueezeNetNhwcTests on Windows and

Regression check: FAIL, 6 regressoion tests:
[  FAILED  ] MobileNetV2NhwcTests.NhwcTest0
../../src/webnn/tests/end2end/models/MobileNetV2Nhwc.cpp:[38](https://github.com/webmachinelearning/webnn-native/actions/runs/3382537158/jobs/5617558049#step:20:39)
Value of: utils::CheckValue(result, outputNpy.as_vec<float>())
  Actual: false
Expected: true
unknown file
SEH exception with code 0xc0000005 thrown in the test body.
[  FAILED  ] MobileNetV2NhwcTests.NhwcTest1
../../src/webnn/tests/end2end/models/MobileNetV2Nhwc.cpp:38
Value of: utils::CheckValue(result, outputNpy.as_vec<float>())
  Actual: false
Expected: true
unknown file
SEH exception with code 0xc0000005 thrown in the test body.
[  FAILED  ] MobileNetV2NhwcTests.NhwcTest2
../../src/webnn/tests/end2end/models/MobileNetV2Nhwc.cpp:38
Value of: utils::CheckValue(result, outputNpy.as_vec<float>())
  Actual: false
Expected: true
unknown file
SEH exception with code 0xc0000005 thrown in the test body.
[  FAILED  ] SqueezeNetNhwcTests.NhwcTest0
../../src/webnn/tests/end2end/models/SqueezeNetNhwc.cpp:38
Value of: utils::CheckValue(result, outputNpy.as_vec<float>())
  Actual: false
Expected: true
unknown file
SEH exception with code 0xc0000005 thrown in the test body.
[  FAILED  ] SqueezeNetNhwcTests.NhwcTest1
../../src/webnn/tests/end2end/models/SqueezeNetNhwc.cpp:38
Value of: utils::CheckValue(result, outputNpy.as_vec<float>())
  Actual: false
Expected: true
unknown file
SEH exception with code 0xc0000005 thrown in the test body.
[  FAILED  ] SqueezeNetNhwcTests.NhwcTest2
../../src/webnn/tests/end2end/models/SqueezeNetNhwc.cpp:38
Value of: utils::CheckValue(result, outputNpy.as_vec<float>())
  Actual: false
Expected: true
unknown file
SEH exception with code 0xc0000005 thrown in the test body.

Before fixing these regressions, I plan to disable "Auto Roll DEPS / XNNPACK" CI to keep PR clean.
WDYT @fujunwei, thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions