[Benchmark X64] [jkoritzinsky] Move CoreCLR over to the managed wait subsystem #1682
Description
Job completed in 29 minutes 9 seconds (remote runner delay: 1 minute 32 seconds).
dotnet/runtime#117788
Using arguments: benchmark System.Collections.Concurrent
System.Collections.Concurrent.IsEmpty_String_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-UATSTI : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-YKZQKY : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 IterationTime=250ms
MaxIterationCount=20 MemoryRandomization=Default MinIterationCount=15
WarmupCount=1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Dictionary | Main | 0 | 65.9281 ns | 0.0684 ns | 1.00 | - | NA |
| Dictionary | PR | 0 | 66.1361 ns | 0.1147 ns | 1.00 | - | NA |
| Queue | Main | 0 | 1.7718 ns | 0.0108 ns | 1.00 | - | NA |
| Queue | PR | 0 | 1.7450 ns | 0.0111 ns | 0.98 | - | NA |
| Stack | Main | 0 | 0.0000 ns | 0.0000 ns | ? | - | ? |
| Stack | PR | 0 | 0.0016 ns | 0.0023 ns | ? | - | ? |
| Bag | Main | 0 | 6.4287 ns | 0.0098 ns | 1.00 | - | NA |
| Bag | PR | 0 | 6.3692 ns | 0.0087 ns | 0.99 | - | NA |
| Dictionary | Main | 512 | 2.9051 ns | 0.0023 ns | 1.00 | - | NA |
| Dictionary | PR | 512 | 2.9092 ns | 0.0102 ns | 1.00 | - | NA |
| Queue | Main | 512 | 1.2462 ns | 0.0063 ns | 1.00 | - | NA |
| Queue | PR | 512 | 1.2480 ns | 0.0070 ns | 1.00 | - | NA |
| Stack | Main | 512 | 0.0000 ns | 0.0000 ns | ? | - | ? |
| Stack | PR | 512 | 0.0005 ns | 0.0004 ns | ? | - | ? |
| Bag | Main | 512 | 5.7079 ns | 0.0130 ns | 1.00 | - | NA |
| Bag | PR | 512 | 5.8231 ns | 0.0089 ns | 1.02 | - | NA |
System.Collections.Concurrent.IsEmpty_Int32_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-UATSTI : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-YKZQKY : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 IterationTime=250ms
MaxIterationCount=20 MemoryRandomization=Default MinIterationCount=15
WarmupCount=1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Dictionary | Main | 0 | 66.5415 ns | 0.1328 ns | 1.00 | - | NA |
| Dictionary | PR | 0 | 65.9239 ns | 0.1428 ns | 0.99 | - | NA |
| Queue | Main | 0 | 1.7547 ns | 0.0114 ns | 1.00 | - | NA |
| Queue | PR | 0 | 1.7366 ns | 0.0111 ns | 0.99 | - | NA |
| Stack | Main | 0 | 0.0016 ns | 0.0006 ns | 1.15 | - | NA |
| Stack | PR | 0 | 0.0006 ns | 0.0007 ns | 0.44 | - | NA |
| Bag | Main | 0 | 3.7171 ns | 0.0085 ns | 1.00 | - | NA |
| Bag | PR | 0 | 3.9912 ns | 0.0134 ns | 1.07 | - | NA |
| Dictionary | Main | 512 | 2.9416 ns | 0.0026 ns | 1.00 | - | NA |
| Dictionary | PR | 512 | 2.9062 ns | 0.0057 ns | 0.99 | - | NA |
| Queue | Main | 512 | 1.2843 ns | 0.0057 ns | 1.00 | - | NA |
| Queue | PR | 512 | 1.2502 ns | 0.0045 ns | 0.97 | - | NA |
| Stack | Main | 512 | 0.0000 ns | 0.0000 ns | ? | - | ? |
| Stack | PR | 512 | 0.0004 ns | 0.0004 ns | ? | - | ? |
| Bag | Main | 512 | 3.0545 ns | 0.0107 ns | 1.00 | - | NA |
| Bag | PR | 512 | 3.0413 ns | 0.0096 ns | 1.00 | - | NA |
System.Collections.Concurrent.Count_String_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-UATSTI : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-YKZQKY : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 IterationTime=250ms
MaxIterationCount=20 MemoryRandomization=Default MinIterationCount=15
WarmupCount=1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Dictionary | Main | 512 | 65.953 ns | 0.1158 ns | 1.00 | - | NA |
| Dictionary | PR | 512 | 64.920 ns | 0.1756 ns | 0.98 | - | NA |
| Queue | Main | 512 | 2.467 ns | 0.0237 ns | 1.00 | - | NA |
| Queue | PR | 512 | 2.464 ns | 0.0075 ns | 1.00 | - | NA |
| Queue_EnqueueCountDequeue | Main | 512 | 13.757 ns | 0.0478 ns | 1.00 | - | NA |
| Queue_EnqueueCountDequeue | PR | 512 | 14.674 ns | 0.0275 ns | 1.07 | - | NA |
| Stack | Main | 512 | 566.391 ns | 0.1360 ns | 1.00 | - | NA |
| Stack | PR | 512 | 566.208 ns | 0.0894 ns | 1.00 | - | NA |
| Bag | Main | 512 | 17.084 ns | 0.0182 ns | 1.00 | - | NA |
| Bag | PR | 512 | 18.998 ns | 0.0321 ns | 1.11 | - | NA |
System.Collections.Concurrent.Count_Int32_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-UATSTI : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-YKZQKY : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 IterationTime=250ms
MaxIterationCount=20 MemoryRandomization=Default MinIterationCount=15
WarmupCount=1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| Dictionary | Main | 512 | 65.527 ns | 0.1690 ns | 1.00 | - | NA |
| Dictionary | PR | 512 | 65.280 ns | 0.0769 ns | 1.00 | - | NA |
| Queue | Main | 512 | 2.365 ns | 0.0143 ns | 1.00 | - | NA |
| Queue | PR | 512 | 2.368 ns | 0.0112 ns | 1.00 | - | NA |
| Queue_EnqueueCountDequeue | Main | 512 | 11.204 ns | 0.0417 ns | 1.00 | - | NA |
| Queue_EnqueueCountDequeue | PR | 512 | 12.085 ns | 0.0496 ns | 1.08 | - | NA |
| Stack | Main | 512 | 565.480 ns | 0.0676 ns | 1.00 | - | NA |
| Stack | PR | 512 | 566.410 ns | 0.2543 ns | 1.00 | - | NA |
| Bag | Main | 512 | 17.552 ns | 0.0492 ns | 1.00 | - | NA |
| Bag | PR | 512 | 17.112 ns | 0.0326 ns | 0.97 | - | NA |
System.Collections.Concurrent.AddRemoveFromSameThreads_String_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-ZRSSBP : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-DVTPLJ : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 InvocationCount=1
IterationTime=250ms MaxIterationCount=20 MaxWarmupIterationCount=10
MemoryRandomization=Default MinIterationCount=15 MinWarmupIterationCount=6
UnrollFactor=1 WarmupCount=-1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| ConcurrentBag | Main | 2000000 | 233.8 ms | 8.11 ms | 1.00 | 1.23 KB | 1.00 |
| ConcurrentBag | PR | 2000000 | 231.8 ms | 9.77 ms | 0.99 | 1.49 KB | 1.22 |
| ConcurrentStack | Main | 2000000 | 108.3 ms | 5.33 ms | 1.00 | 125000.76 KB | 1.00 |
| ConcurrentStack | PR | 2000000 | 108.0 ms | 3.28 ms | 1.00 | 125000.66 KB | 1.00 |
| ConcurrentQueue | Main | 2000000 | 358.5 ms | 8.95 ms | 1.00 | 129.37 KB | 1.00 |
| ConcurrentQueue | PR | 2000000 | 353.1 ms | 13.82 ms | 0.99 | 129.74 KB | 1.00 |
System.Collections.Concurrent.AddRemoveFromSameThreads_Int32_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-ZRSSBP : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-DVTPLJ : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 InvocationCount=1
IterationTime=250ms MaxIterationCount=20 MaxWarmupIterationCount=10
MemoryRandomization=Default MinIterationCount=15 MinWarmupIterationCount=6
UnrollFactor=1 WarmupCount=-1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| ConcurrentBag | Main | 2000000 | 167.48 ms | 15.191 ms | 1.01 | 1000 B | 1.00 |
| ConcurrentBag | PR | 2000000 | 171.39 ms | 9.409 ms | 1.03 | 1240 B | 1.24 |
| ConcurrentStack | Main | 2000000 | 73.30 ms | 4.012 ms | 1.00 | 128000440 B | 1.00 |
| ConcurrentStack | PR | 2000000 | 78.24 ms | 6.173 ms | 1.07 | 128000992 B | 1.00 |
| ConcurrentQueue | Main | 2000000 | 344.87 ms | 12.842 ms | 1.00 | 34144 B | 1.00 |
| ConcurrentQueue | PR | 2000000 | 338.91 ms | 14.231 ms | 0.98 | 34352 B | 1.01 |
System.Collections.Concurrent.AddRemoveFromDifferentThreads_String_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-ZRSSBP : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-DVTPLJ : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 InvocationCount=1
IterationTime=250ms MaxIterationCount=20 MaxWarmupIterationCount=10
MemoryRandomization=Default MinIterationCount=15 MinWarmupIterationCount=6
UnrollFactor=1 WarmupCount=-1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| ConcurrentBag | Main | 2000000 | 178.17 ms | 21.943 ms | 1.02 | 32 MB | 1.00 |
| ConcurrentBag | PR | 2000000 | 182.69 ms | 20.464 ms | 1.05 | 32 MB | 1.00 |
| ConcurrentStack | Main | 2000000 | 60.75 ms | 9.392 ms | 1.03 | 61.04 MB | 1.00 |
| ConcurrentStack | PR | 2000000 | 56.43 ms | 10.640 ms | 0.96 | 61.04 MB | 1.00 |
| ConcurrentQueue | Main | 2000000 | 40.87 ms | 18.326 ms | 1.35 | 8 MB | 1.00 |
| ConcurrentQueue | PR | 2000000 | 37.52 ms | 14.245 ms | 1.24 | 8 MB | 1.00 |
System.Collections.Concurrent.AddRemoveFromDifferentThreads_Int32_
BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
Job-ZRSSBP : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job-DVTPLJ : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
OutlierMode=Default PowerPlanMode=00000000-0000-0000-0000-000000000000 InvocationCount=1
IterationTime=250ms MaxIterationCount=20 MaxWarmupIterationCount=10
MemoryRandomization=Default MinIterationCount=15 MinWarmupIterationCount=6
UnrollFactor=1 WarmupCount=-1
| Method | Toolchain | Size | Mean | Error | Ratio | Allocated | Alloc Ratio |
|---|---|---|---|---|---|---|---|
| ConcurrentBag | Main | 2000000 | 169.86 ms | 27.710 ms | 1.04 | 16 MB | 1.00 |
| ConcurrentBag | PR | 2000000 | 168.26 ms | 28.765 ms | 1.03 | 16 MB | 1.00 |
| ConcurrentStack | Main | 2000000 | 55.38 ms | 8.712 ms | 1.03 | 61.04 MB | 1.00 |
| ConcurrentStack | PR | 2000000 | 51.83 ms | 6.964 ms | 0.96 | 61.04 MB | 1.00 |
| ConcurrentQueue | Main | 2000000 | 33.04 ms | 12.851 ms | 1.23 | 1 MB | 1.00 |
| ConcurrentQueue | PR | 2000000 | 34.53 ms | 13.761 ms | 1.29 | 1 MB | 1.00 |
Artifacts:
- BDN_Artifacts.zip (247 KB)
- results.md (17 KB)