[do not merge] Run large tests serially#761
Open
christiangnrd wants to merge 2 commits into
Open
Conversation
christiangnrd
force-pushed
the
serialtests
branch
from
April 2, 2026 22:20
a941404 to
e70c90b
Compare
Contributor
There was a problem hiding this comment.
Metal Benchmarks
Details
| Benchmark suite | Current: a87a5de | Previous: 59e377f | Ratio |
|---|---|---|---|
array/accumulate/Float32/1d |
583166 ns |
573625 ns |
1.02 |
array/accumulate/Float32/dims=1 |
572292 ns |
571125 ns |
1.00 |
array/accumulate/Float32/dims=1L |
8847583 ns |
8850292 ns |
1.00 |
array/accumulate/Float32/dims=2 |
629750 ns |
625125 ns |
1.01 |
array/accumulate/Float32/dims=2L |
3327708.5 ns |
3358312 ns |
0.99 |
array/accumulate/Int64/1d |
885667 ns |
894208 ns |
0.99 |
array/accumulate/Int64/dims=1 |
1130708 ns |
1095792 ns |
1.03 |
array/accumulate/Int64/dims=1L |
9578250 ns |
9580896 ns |
1.00 |
array/accumulate/Int64/dims=2 |
1462250 ns |
1462208 ns |
1.00 |
array/accumulate/Int64/dims=2L |
6583958.5 ns |
6584667 ns |
1.00 |
array/broadcast |
368084 ns |
364209 ns |
1.01 |
array/construct |
3375 ns |
3334 ns |
1.01 |
array/permutedims/2d |
621667 ns |
633458 ns |
0.98 |
array/permutedims/3d |
1090375 ns |
1098354 ns |
0.99 |
array/permutedims/4d |
1688709 ns |
1590750.5 ns |
1.06 |
array/private/copy |
417459 ns |
407917 ns |
1.02 |
array/private/copyto!/cpu_to_gpu |
384042 ns |
382125 ns |
1.01 |
array/private/copyto!/gpu_to_cpu |
379458 ns |
377459 ns |
1.01 |
array/private/copyto!/gpu_to_gpu |
361292 ns |
357750 ns |
1.01 |
array/private/iteration/findall/bool |
1117417 ns |
1140208 ns |
0.98 |
array/private/iteration/findall/int |
1283584 ns |
1280458 ns |
1.00 |
array/private/iteration/findfirst/bool |
1425833 ns |
1428334 ns |
1.00 |
array/private/iteration/findfirst/int |
1448792 ns |
1466499.5 ns |
0.99 |
array/private/iteration/findmin/1d |
1570791 ns |
1567125 ns |
1.00 |
array/private/iteration/findmin/2d |
1257709 ns |
1270709 ns |
0.99 |
array/private/iteration/logical |
1823229.5 ns |
1933750 ns |
0.94 |
array/private/iteration/scalar |
2888875 ns |
2445416 ns |
1.18 |
array/random/rand/Float32 |
615229.5 ns |
616666 ns |
1.00 |
array/random/rand/Int64 |
628125 ns |
629708 ns |
1.00 |
array/random/rand!/Float32 |
527750 ns |
530625 ns |
0.99 |
array/random/rand!/Int64 |
495625 ns |
495291.5 ns |
1.00 |
array/random/randn/Float32 |
573250 ns |
570667 ns |
1.00 |
array/random/randn!/Float32 |
484584 ns |
477000 ns |
1.02 |
array/reductions/mapreduce/Float32/1d |
714041 ns |
715520.5 ns |
1.00 |
array/reductions/mapreduce/Float32/dims=1 |
483291 ns |
492000 ns |
0.98 |
array/reductions/mapreduce/Float32/dims=1L |
686250 ns |
689083 ns |
1.00 |
array/reductions/mapreduce/Float32/dims=2 |
497500 ns |
494792 ns |
1.01 |
array/reductions/mapreduce/Float32/dims=2L |
1335083 ns |
1335459 ns |
1.00 |
array/reductions/mapreduce/Int64/1d |
910750 ns |
943459 ns |
0.97 |
array/reductions/mapreduce/Int64/dims=1 |
777375 ns |
812625 ns |
0.96 |
array/reductions/mapreduce/Int64/dims=1L |
1085375 ns |
1075667 ns |
1.01 |
array/reductions/mapreduce/Int64/dims=2 |
937833 ns |
987541 ns |
0.95 |
array/reductions/mapreduce/Int64/dims=2L |
2170000 ns |
2168458 ns |
1.00 |
array/reductions/reduce/Float32/1d |
716208 ns |
693083 ns |
1.03 |
array/reductions/reduce/Float32/dims=1 |
482750 ns |
496312.5 ns |
0.97 |
array/reductions/reduce/Float32/dims=1L |
685583 ns |
687979.5 ns |
1.00 |
array/reductions/reduce/Float32/dims=2 |
400125 ns |
395834 ns |
1.01 |
array/reductions/reduce/Float32/dims=2L |
492958.5 ns |
485542 ns |
1.02 |
array/reductions/reduce/Int64/1d |
897229.5 ns |
962083 ns |
0.93 |
array/reductions/reduce/Int64/dims=1 |
775875 ns |
814541.5 ns |
0.95 |
array/reductions/reduce/Int64/dims=1L |
1079395.5 ns |
1069500 ns |
1.01 |
array/reductions/reduce/Int64/dims=2 |
937166 ns |
973542 ns |
0.96 |
array/reductions/reduce/Int64/dims=2L |
2150666.5 ns |
2149542 ns |
1.00 |
array/shared/copy |
154125 ns |
154083 ns |
1.00 |
array/shared/copyto!/cpu_to_gpu |
39416 ns |
40708 ns |
0.97 |
array/shared/copyto!/gpu_to_cpu |
39125 ns |
41000 ns |
0.95 |
array/shared/copyto!/gpu_to_gpu |
39875 ns |
41208 ns |
0.97 |
array/shared/iteration/findall/bool |
1123792 ns |
1148500 ns |
0.98 |
array/shared/iteration/findall/int |
1286292 ns |
1285750 ns |
1.00 |
array/shared/iteration/findfirst/bool |
1125708 ns |
1119667 ns |
1.01 |
array/shared/iteration/findfirst/int |
1153916.5 ns |
1207312.5 ns |
0.96 |
array/shared/iteration/findmin/1d |
1301416 ns |
1317938 ns |
0.99 |
array/shared/iteration/findmin/2d |
1264250 ns |
1269625 ns |
1.00 |
array/shared/iteration/logical |
1647750 ns |
1709354 ns |
0.96 |
array/shared/iteration/scalar |
3421.875 ns |
3614.625 ns |
0.95 |
integration/byval/reference |
1137417 ns |
1141958 ns |
1.00 |
integration/byval/slices=1 |
1137666 ns |
1136875 ns |
1.00 |
integration/byval/slices=2 |
2049208 ns |
2055750 ns |
1.00 |
integration/byval/slices=3 |
7122708 ns |
8460958 ns |
0.84 |
integration/metaldevrt |
438875 ns |
451500 ns |
0.97 |
kernel/indexing |
360708 ns |
351792 ns |
1.03 |
kernel/indexing_checked |
536375 ns |
534209 ns |
1.00 |
kernel/launch |
1966.7 ns |
1975 ns |
1.00 |
kernel/rand |
525542 ns |
528250 ns |
0.99 |
latency/import |
1786320417 ns |
1791534292 ns |
1.00 |
latency/precompile |
39398859062 ns |
39637308833.5 ns |
0.99 |
latency/ttfp |
2118924917 ns |
2124080375 ns |
1.00 |
metal/synchronization/context |
523.9637305699482 ns |
523.9637305699482 ns |
1 |
metal/synchronization/stream |
275.390625 ns |
277.5974025974026 ns |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
christiangnrd
force-pushed
the
serialtests
branch
from
April 11, 2026 17:29
e70c90b to
8bc1ba0
Compare
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #761 +/- ##
==========================================
- Coverage 82.66% 82.05% -0.61%
==========================================
Files 62 59 -3
Lines 2872 2875 +3
==========================================
- Hits 2374 2359 -15
- Misses 498 516 +18 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
christiangnrd
force-pushed
the
serialtests
branch
from
June 25, 2026 13:24
d7642b8 to
a87a5de
Compare
christiangnrd
force-pushed
the
serialtests
branch
from
July 17, 2026 15:06
a87a5de to
1dd6cf4
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TODO before merge: