Skip to content

[do not merge] Run large tests serially#761

Open
christiangnrd wants to merge 2 commits into
mainfrom
serialtests
Open

[do not merge] Run large tests serially#761
christiangnrd wants to merge 2 commits into
mainfrom
serialtests

Conversation

@christiangnrd

@christiangnrd christiangnrd commented Apr 2, 2026

Copy link
Copy Markdown
Member

TODO before merge:

  • Update ParallelTestRunner compat once released
  • Revert temporary commit

@christiangnrd christiangnrd changed the title {do not merge] Test serial tests [do not merge] Test serial tests Apr 2, 2026

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Metal Benchmarks

Details
Benchmark suite Current: a87a5de Previous: 59e377f Ratio
array/accumulate/Float32/1d 583166 ns 573625 ns 1.02
array/accumulate/Float32/dims=1 572292 ns 571125 ns 1.00
array/accumulate/Float32/dims=1L 8847583 ns 8850292 ns 1.00
array/accumulate/Float32/dims=2 629750 ns 625125 ns 1.01
array/accumulate/Float32/dims=2L 3327708.5 ns 3358312 ns 0.99
array/accumulate/Int64/1d 885667 ns 894208 ns 0.99
array/accumulate/Int64/dims=1 1130708 ns 1095792 ns 1.03
array/accumulate/Int64/dims=1L 9578250 ns 9580896 ns 1.00
array/accumulate/Int64/dims=2 1462250 ns 1462208 ns 1.00
array/accumulate/Int64/dims=2L 6583958.5 ns 6584667 ns 1.00
array/broadcast 368084 ns 364209 ns 1.01
array/construct 3375 ns 3334 ns 1.01
array/permutedims/2d 621667 ns 633458 ns 0.98
array/permutedims/3d 1090375 ns 1098354 ns 0.99
array/permutedims/4d 1688709 ns 1590750.5 ns 1.06
array/private/copy 417459 ns 407917 ns 1.02
array/private/copyto!/cpu_to_gpu 384042 ns 382125 ns 1.01
array/private/copyto!/gpu_to_cpu 379458 ns 377459 ns 1.01
array/private/copyto!/gpu_to_gpu 361292 ns 357750 ns 1.01
array/private/iteration/findall/bool 1117417 ns 1140208 ns 0.98
array/private/iteration/findall/int 1283584 ns 1280458 ns 1.00
array/private/iteration/findfirst/bool 1425833 ns 1428334 ns 1.00
array/private/iteration/findfirst/int 1448792 ns 1466499.5 ns 0.99
array/private/iteration/findmin/1d 1570791 ns 1567125 ns 1.00
array/private/iteration/findmin/2d 1257709 ns 1270709 ns 0.99
array/private/iteration/logical 1823229.5 ns 1933750 ns 0.94
array/private/iteration/scalar 2888875 ns 2445416 ns 1.18
array/random/rand/Float32 615229.5 ns 616666 ns 1.00
array/random/rand/Int64 628125 ns 629708 ns 1.00
array/random/rand!/Float32 527750 ns 530625 ns 0.99
array/random/rand!/Int64 495625 ns 495291.5 ns 1.00
array/random/randn/Float32 573250 ns 570667 ns 1.00
array/random/randn!/Float32 484584 ns 477000 ns 1.02
array/reductions/mapreduce/Float32/1d 714041 ns 715520.5 ns 1.00
array/reductions/mapreduce/Float32/dims=1 483291 ns 492000 ns 0.98
array/reductions/mapreduce/Float32/dims=1L 686250 ns 689083 ns 1.00
array/reductions/mapreduce/Float32/dims=2 497500 ns 494792 ns 1.01
array/reductions/mapreduce/Float32/dims=2L 1335083 ns 1335459 ns 1.00
array/reductions/mapreduce/Int64/1d 910750 ns 943459 ns 0.97
array/reductions/mapreduce/Int64/dims=1 777375 ns 812625 ns 0.96
array/reductions/mapreduce/Int64/dims=1L 1085375 ns 1075667 ns 1.01
array/reductions/mapreduce/Int64/dims=2 937833 ns 987541 ns 0.95
array/reductions/mapreduce/Int64/dims=2L 2170000 ns 2168458 ns 1.00
array/reductions/reduce/Float32/1d 716208 ns 693083 ns 1.03
array/reductions/reduce/Float32/dims=1 482750 ns 496312.5 ns 0.97
array/reductions/reduce/Float32/dims=1L 685583 ns 687979.5 ns 1.00
array/reductions/reduce/Float32/dims=2 400125 ns 395834 ns 1.01
array/reductions/reduce/Float32/dims=2L 492958.5 ns 485542 ns 1.02
array/reductions/reduce/Int64/1d 897229.5 ns 962083 ns 0.93
array/reductions/reduce/Int64/dims=1 775875 ns 814541.5 ns 0.95
array/reductions/reduce/Int64/dims=1L 1079395.5 ns 1069500 ns 1.01
array/reductions/reduce/Int64/dims=2 937166 ns 973542 ns 0.96
array/reductions/reduce/Int64/dims=2L 2150666.5 ns 2149542 ns 1.00
array/shared/copy 154125 ns 154083 ns 1.00
array/shared/copyto!/cpu_to_gpu 39416 ns 40708 ns 0.97
array/shared/copyto!/gpu_to_cpu 39125 ns 41000 ns 0.95
array/shared/copyto!/gpu_to_gpu 39875 ns 41208 ns 0.97
array/shared/iteration/findall/bool 1123792 ns 1148500 ns 0.98
array/shared/iteration/findall/int 1286292 ns 1285750 ns 1.00
array/shared/iteration/findfirst/bool 1125708 ns 1119667 ns 1.01
array/shared/iteration/findfirst/int 1153916.5 ns 1207312.5 ns 0.96
array/shared/iteration/findmin/1d 1301416 ns 1317938 ns 0.99
array/shared/iteration/findmin/2d 1264250 ns 1269625 ns 1.00
array/shared/iteration/logical 1647750 ns 1709354 ns 0.96
array/shared/iteration/scalar 3421.875 ns 3614.625 ns 0.95
integration/byval/reference 1137417 ns 1141958 ns 1.00
integration/byval/slices=1 1137666 ns 1136875 ns 1.00
integration/byval/slices=2 2049208 ns 2055750 ns 1.00
integration/byval/slices=3 7122708 ns 8460958 ns 0.84
integration/metaldevrt 438875 ns 451500 ns 0.97
kernel/indexing 360708 ns 351792 ns 1.03
kernel/indexing_checked 536375 ns 534209 ns 1.00
kernel/launch 1966.7 ns 1975 ns 1.00
kernel/rand 525542 ns 528250 ns 0.99
latency/import 1786320417 ns 1791534292 ns 1.00
latency/precompile 39398859062 ns 39637308833.5 ns 0.99
latency/ttfp 2118924917 ns 2124080375 ns 1.00
metal/synchronization/context 523.9637305699482 ns 523.9637305699482 ns 1
metal/synchronization/stream 275.390625 ns 277.5974025974026 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

@codecov

codecov Bot commented Apr 11, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 82.05%. Comparing base (1af3aef) to head (d7642b8).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #761      +/-   ##
==========================================
- Coverage   82.66%   82.05%   -0.61%     
==========================================
  Files          62       59       -3     
  Lines        2872     2875       +3     
==========================================
- Hits         2374     2359      -15     
- Misses        498      516      +18     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@christiangnrd christiangnrd changed the title [do not merge] Test serial tests [do not merge] Run large tests serially Jun 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant