Skip to content

Commit 153cd97

Browse files
github-actions[bot]nginx-botsjberman
authored
NFR Test Results for NGF version edge (#4389)
Co-authored-by: nginx-bot <integrations@nginx.com> Co-authored-by: Saylor Berman <s.berman@f5.com>
1 parent 01aa2c7 commit 153cd97

File tree

74 files changed

+420
-407
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

74 files changed

+420
-407
lines changed

‎tests/results/dp-perf/edge/edge-oss.md‎

Lines changed: 22 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -6,14 +6,14 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: b41c973c8399458984def3c2a8a268a237c864c8
10-
- Date: 2025-10-30T03:04:40Z
9+
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
10+
- Date: 2025-12-03T19:53:07Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.33.5-gke.1162000
16+
- k8s version: v1.33.5-gke.1201000
1717
- vCPUs per node: 16
1818
- RAM per node: 65851520Ki
1919
- Max pods per node: 110
@@ -23,10 +23,10 @@ GKE Cluster:
2323
## Test1: Running latte path based routing
2424

2525
```text
26-
Requests [total, rate, throughput] 30000, 1000.01, 999.98
27-
Duration [total, attack, wait] 30.001s, 30s, 878.426µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 691.466µs, 925.511µs, 900.472µs, 1.032ms, 1.085ms, 1.259ms, 20.439ms
29-
Bytes In [total, mean] 4770000, 159.00
26+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
27+
Duration [total, attack, wait] 30s, 29.999s, 838.332µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 692.485µs, 865.674µs, 849.247µs, 942.06µs, 980.287µs, 1.102ms, 12.585ms
29+
Bytes In [total, mean] 4800000, 160.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:30000
@@ -36,10 +36,10 @@ Error Set:
3636
## Test2: Running coffee header based routing
3737

3838
```text
39-
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
40-
Duration [total, attack, wait] 30s, 29.999s, 969.607µs
41-
Latencies [min, mean, 50, 90, 95, 99, max] 707.948µs, 975.218µs, 945.999µs, 1.072ms, 1.128ms, 1.308ms, 25.057ms
42-
Bytes In [total, mean] 4800000, 160.00
39+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
40+
Duration [total, attack, wait] 30s, 29.999s, 930.164µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 715.081µs, 933.802µs, 901.019µs, 1.005ms, 1.048ms, 1.246ms, 24.929ms
42+
Bytes In [total, mean] 4830000, 161.00
4343
Bytes Out [total, mean] 0, 0.00
4444
Success [ratio] 100.00%
4545
Status Codes [code:count] 200:30000
@@ -50,9 +50,9 @@ Error Set:
5050

5151
```text
5252
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
53-
Duration [total, attack, wait] 30s, 29.999s, 985.199µs
54-
Latencies [min, mean, 50, 90, 95, 99, max] 742.731µs, 975.095µs, 950.844µs, 1.088ms, 1.15ms, 1.35ms, 18.942ms
55-
Bytes In [total, mean] 5040000, 168.00
53+
Duration [total, attack, wait] 30s, 29.999s, 973.811µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 714.576µs, 928.334µs, 900.33µs, 1.003ms, 1.045ms, 1.265ms, 23.419ms
55+
Bytes In [total, mean] 5070000, 169.00
5656
Bytes Out [total, mean] 0, 0.00
5757
Success [ratio] 100.00%
5858
Status Codes [code:count] 200:30000
@@ -62,10 +62,10 @@ Error Set:
6262
## Test4: Running tea GET method based routing
6363

6464
```text
65-
Requests [total, rate, throughput] 30000, 1000.01, 999.97
66-
Duration [total, attack, wait] 30.001s, 30s, 1.013ms
67-
Latencies [min, mean, 50, 90, 95, 99, max] 706.711µs, 978.996µs, 954.535µs, 1.081ms, 1.14ms, 1.306ms, 24.648ms
68-
Bytes In [total, mean] 4710000, 157.00
65+
Requests [total, rate, throughput] 30000, 1000.01, 999.98
66+
Duration [total, attack, wait] 30.001s, 30s, 868.411µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 724.995µs, 935.31µs, 907.468µs, 1.019ms, 1.064ms, 1.254ms, 24.206ms
68+
Bytes In [total, mean] 4740000, 158.00
6969
Bytes Out [total, mean] 0, 0.00
7070
Success [ratio] 100.00%
7171
Status Codes [code:count] 200:30000
@@ -75,10 +75,10 @@ Error Set:
7575
## Test5: Running tea POST method based routing
7676

7777
```text
78-
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
79-
Duration [total, attack, wait] 30s, 29.999s, 954.887µs
80-
Latencies [min, mean, 50, 90, 95, 99, max] 744.41µs, 974.612µs, 949.589µs, 1.088ms, 1.147ms, 1.325ms, 11.186ms
81-
Bytes In [total, mean] 4710000, 157.00
78+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
79+
Duration [total, attack, wait] 30s, 29.999s, 796.165µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 709.716µs, 908.982µs, 888.17µs, 990.493µs, 1.033ms, 1.183ms, 25.115ms
81+
Bytes In [total, mean] 4740000, 158.00
8282
Bytes Out [total, mean] 0, 0.00
8383
Success [ratio] 100.00%
8484
Status Codes [code:count] 200:30000

‎tests/results/dp-perf/edge/edge-plus.md‎

Lines changed: 21 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -6,16 +6,16 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: b41c973c8399458984def3c2a8a268a237c864c8
10-
- Date: 2025-10-30T03:04:40Z
9+
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
10+
- Date: 2025-12-03T19:53:07Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.33.5-gke.1162000
16+
- k8s version: v1.33.5-gke.1201000
1717
- vCPUs per node: 16
18-
- RAM per node: 65851520Ki
18+
- RAM per node: 65851512Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
@@ -24,9 +24,9 @@ GKE Cluster:
2424

2525
```text
2626
Requests [total, rate, throughput] 30000, 1000.01, 999.98
27-
Duration [total, attack, wait] 30.001s, 30s, 833.602µs
28-
Latencies [min, mean, 50, 90, 95, 99, max] 679.176µs, 908.167µs, 879.785µs, 1.011ms, 1.069ms, 1.306ms, 24.313ms
29-
Bytes In [total, mean] 4830000, 161.00
27+
Duration [total, attack, wait] 30.001s, 30s, 959.135µs
28+
Latencies [min, mean, 50, 90, 95, 99, max] 663.558µs, 875.826µs, 845.323µs, 958.333µs, 1.007ms, 1.194ms, 23.064ms
29+
Bytes In [total, mean] 4800000, 160.00
3030
Bytes Out [total, mean] 0, 0.00
3131
Success [ratio] 100.00%
3232
Status Codes [code:count] 200:30000
@@ -37,9 +37,9 @@ Error Set:
3737

3838
```text
3939
Requests [total, rate, throughput] 29999, 1000.01, 999.98
40-
Duration [total, attack, wait] 30s, 29.999s, 885.413µs
41-
Latencies [min, mean, 50, 90, 95, 99, max] 735.321µs, 993.589µs, 965.051µs, 1.109ms, 1.179ms, 1.454ms, 26.207ms
42-
Bytes In [total, mean] 4859838, 162.00
40+
Duration [total, attack, wait] 30s, 29.999s, 860.551µs
41+
Latencies [min, mean, 50, 90, 95, 99, max] 712.205µs, 923.729µs, 901.1µs, 1.02ms, 1.069ms, 1.227ms, 21.375ms
42+
Bytes In [total, mean] 4829839, 161.00
4343
Bytes Out [total, mean] 0, 0.00
4444
Success [ratio] 100.00%
4545
Status Codes [code:count] 200:29999
@@ -49,10 +49,10 @@ Error Set:
4949
## Test3: Running coffee query based routing
5050

5151
```text
52-
Requests [total, rate, throughput] 30000, 1000.04, 999.98
53-
Duration [total, attack, wait] 30s, 29.999s, 1.588ms
54-
Latencies [min, mean, 50, 90, 95, 99, max] 728.765µs, 995.743µs, 964.788µs, 1.12ms, 1.205ms, 1.515ms, 22.473ms
55-
Bytes In [total, mean] 5100000, 170.00
52+
Requests [total, rate, throughput] 30000, 1000.01, 999.98
53+
Duration [total, attack, wait] 30.001s, 30s, 968.736µs
54+
Latencies [min, mean, 50, 90, 95, 99, max] 737.91µs, 952.257µs, 928.142µs, 1.05ms, 1.105ms, 1.292ms, 21.593ms
55+
Bytes In [total, mean] 5070000, 169.00
5656
Bytes Out [total, mean] 0, 0.00
5757
Success [ratio] 100.00%
5858
Status Codes [code:count] 200:30000
@@ -63,9 +63,9 @@ Error Set:
6363

6464
```text
6565
Requests [total, rate, throughput] 30000, 1000.01, 999.98
66-
Duration [total, attack, wait] 30.001s, 30s, 961.065µs
67-
Latencies [min, mean, 50, 90, 95, 99, max] 717.726µs, 952.076µs, 925.718µs, 1.072ms, 1.146ms, 1.407ms, 20.945ms
68-
Bytes In [total, mean] 4770000, 159.00
66+
Duration [total, attack, wait] 30.001s, 30s, 870.48µs
67+
Latencies [min, mean, 50, 90, 95, 99, max] 699.503µs, 896.1µs, 872.493µs, 987.672µs, 1.041ms, 1.214ms, 23.127ms
68+
Bytes In [total, mean] 4740000, 158.00
6969
Bytes Out [total, mean] 0, 0.00
7070
Success [ratio] 100.00%
7171
Status Codes [code:count] 200:30000
@@ -75,10 +75,10 @@ Error Set:
7575
## Test5: Running tea POST method based routing
7676

7777
```text
78-
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
79-
Duration [total, attack, wait] 30s, 29.999s, 949.913µs
80-
Latencies [min, mean, 50, 90, 95, 99, max] 718.639µs, 953.232µs, 922.53µs, 1.067ms, 1.144ms, 1.41ms, 20.724ms
81-
Bytes In [total, mean] 4770000, 159.00
78+
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
79+
Duration [total, attack, wait] 30s, 29.999s, 943.532µs
80+
Latencies [min, mean, 50, 90, 95, 99, max] 681.741µs, 906.971µs, 887.005µs, 998.855µs, 1.046ms, 1.198ms, 11.182ms
81+
Bytes In [total, mean] 4740000, 158.00
8282
Bytes Out [total, mean] 0, 0.00
8383
Success [ratio] 100.00%
8484
Status Codes [code:count] 200:30000

‎tests/results/ngf-upgrade/edge/edge-oss.md‎

Lines changed: 17 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -6,14 +6,14 @@ NGINX Plus: false
66

77
NGINX Gateway Fabric:
88

9-
- Commit: b41c973c8399458984def3c2a8a268a237c864c8
10-
- Date: 2025-10-30T03:04:40Z
9+
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
10+
- Date: 2025-12-03T19:53:07Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.33.5-gke.1162000
16+
- k8s version: v1.33.5-gke.1201000
1717
- vCPUs per node: 16
1818
- RAM per node: 65851520Ki
1919
- Max pods per node: 110
@@ -23,29 +23,31 @@ GKE Cluster:
2323
## Test: Send https /tea traffic
2424

2525
```text
26-
Requests [total, rate, throughput] 6000, 100.02, 100.01
27-
Duration [total, attack, wait] 59.991s, 59.99s, 1.098ms
28-
Latencies [min, mean, 50, 90, 95, 99, max] 852.123µs, 1.151ms, 1.127ms, 1.302ms, 1.363ms, 1.583ms, 11.026ms
29-
Bytes In [total, mean] 925971, 154.33
26+
Requests [total, rate, throughput] 6000, 100.01, 99.80
27+
Duration [total, attack, wait] 59.997s, 59.993s, 4.183ms
28+
Latencies [min, mean, 50, 90, 95, 99, max] 519.547µs, 1.833s, 1.186ms, 8.79s, 11.649s, 13.963s, 14.52s
29+
Bytes In [total, mean] 922152, 153.69
3030
Bytes Out [total, mean] 0, 0.00
31-
Success [ratio] 100.00%
32-
Status Codes [code:count] 200:6000
31+
Success [ratio] 99.80%
32+
Status Codes [code:count] 0:12 200:5988
3333
Error Set:
34+
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.56:443: connect: connection refused
3435
```
3536

3637
![https-oss.png](https-oss.png)
3738

3839
## Test: Send http /coffee traffic
3940

4041
```text
41-
Requests [total, rate, throughput] 6000, 100.02, 100.01
42-
Duration [total, attack, wait] 59.991s, 59.99s, 1.195ms
43-
Latencies [min, mean, 50, 90, 95, 99, max] 616.849µs, 976.017µs, 987.768µs, 1.167ms, 1.223ms, 1.342ms, 12.457ms
44-
Bytes In [total, mean] 961988, 160.33
42+
Requests [total, rate, throughput] 6000, 100.01, 99.80
43+
Duration [total, attack, wait] 59.997s, 59.993s, 4.518ms
44+
Latencies [min, mean, 50, 90, 95, 99, max] 437.037µs, 1.822s, 1.135ms, 8.517s, 11.638s, 13.967s, 14.524s
45+
Bytes In [total, mean] 958080, 159.68
4546
Bytes Out [total, mean] 0, 0.00
46-
Success [ratio] 100.00%
47-
Status Codes [code:count] 200:6000
47+
Success [ratio] 99.80%
48+
Status Codes [code:count] 0:12 200:5988
4849
Error Set:
50+
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.56:80: connect: connection refused
4951
```
5052

5153
![http-oss.png](http-oss.png)

‎tests/results/ngf-upgrade/edge/edge-plus.md‎

Lines changed: 26 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -6,46 +6,56 @@ NGINX Plus: true
66

77
NGINX Gateway Fabric:
88

9-
- Commit: b41c973c8399458984def3c2a8a268a237c864c8
10-
- Date: 2025-10-30T03:04:40Z
9+
- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
10+
- Date: 2025-12-03T19:53:07Z
1111
- Dirty: false
1212

1313
GKE Cluster:
1414

1515
- Node count: 12
16-
- k8s version: v1.33.5-gke.1162000
16+
- k8s version: v1.33.5-gke.1201000
1717
- vCPUs per node: 16
18-
- RAM per node: 65851520Ki
18+
- RAM per node: 65851512Ki
1919
- Max pods per node: 110
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

2323
## Test: Send http /coffee traffic
2424

2525
```text
26-
Requests [total, rate, throughput] 6000, 100.02, 100.01
27-
Duration [total, attack, wait] 59.991s, 59.99s, 1.067ms
28-
Latencies [min, mean, 50, 90, 95, 99, max] 795.356µs, 1.082ms, 1.067ms, 1.203ms, 1.254ms, 1.38ms, 9.67ms
29-
Bytes In [total, mean] 966000, 161.00
26+
Requests [total, rate, throughput] 6000, 100.01, 99.78
27+
Duration [total, attack, wait] 59.994s, 59.992s, 2.101ms
28+
Latencies [min, mean, 50, 90, 95, 99, max] 507.107µs, 414.573ms, 1.114ms, 1.103s, 4.036s, 6.367s, 6.934s
29+
Bytes In [total, mean] 961744, 160.29
3030
Bytes Out [total, mean] 0, 0.00
31-
Success [ratio] 100.00%
32-
Status Codes [code:count] 200:6000
31+
Success [ratio] 99.77%
32+
Status Codes [code:count] 0:14 200:5986
3333
Error Set:
34+
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:53013->10.138.0.114:80: read: connection reset by peer
35+
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:46203->10.138.0.114:80: read: connection reset by peer
36+
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:47717->10.138.0.114:80: read: connection reset by peer
37+
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:53217->10.138.0.114:80: read: connection reset by peer
38+
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.114:80: connect: connection refused
3439
```
3540

3641
![http-plus.png](http-plus.png)
3742

3843
## Test: Send https /tea traffic
3944

4045
```text
41-
Requests [total, rate, throughput] 6000, 100.02, 100.01
42-
Duration [total, attack, wait] 59.991s, 59.99s, 985.482µs
43-
Latencies [min, mean, 50, 90, 95, 99, max] 794.318µs, 1.163ms, 1.142ms, 1.285ms, 1.332ms, 1.432ms, 10.328ms
44-
Bytes In [total, mean] 931950, 155.32
46+
Requests [total, rate, throughput] 6000, 100.01, 99.78
47+
Duration [total, attack, wait] 59.994s, 59.993s, 1.947ms
48+
Latencies [min, mean, 50, 90, 95, 99, max] 600.657µs, 421.024ms, 1.175ms, 1.162s, 4.089s, 6.405s, 6.961s
49+
Bytes In [total, mean] 923930, 153.99
4550
Bytes Out [total, mean] 0, 0.00
46-
Success [ratio] 100.00%
47-
Status Codes [code:count] 200:6000
51+
Success [ratio] 99.77%
52+
Status Codes [code:count] 0:14 200:5986
4853
Error Set:
54+
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:57081->10.138.0.114:443: read: connection reset by peer
55+
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:35237->10.138.0.114:443: read: connection reset by peer
56+
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:40395->10.138.0.114:443: read: connection reset by peer
57+
Get "https://cafe.example.com/tea": write tcp 10.138.0.103:50087->10.138.0.114:443: write: connection reset by peer
58+
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.114:443: connect: connection refused
4959
```
5060

5161
![https-plus.png](https-plus.png)

‎tests/results/ngf-upgrade/edge/http-oss.png‎

10 Bytes
Loading

‎tests/results/ngf-upgrade/edge/http-plus.png‎

-265 Bytes
Loading

‎tests/results/ngf-upgrade/edge/https-oss.png‎

10 Bytes
Loading

‎tests/results/ngf-upgrade/edge/https-plus.png‎

-265 Bytes
Loading

0 commit comments

Comments
 (0)