Skip to content

Longevity and NFR test results for NGF version 1.5.0 #2771

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Nov 14, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
update test summaries for NFR results
  • Loading branch information
salonichf5 committed Nov 14, 2024
commit a07cddab1d8d24fd7796321e849af23eafa68f43
5 changes: 5 additions & 0 deletions tests/results/dp-perf/1.5.0/1.5.0-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,11 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems to have improved. There is improved latency and response times across all routing methods.


## Test1: Running latte path based routing

```text
Expand Down
4 changes: 4 additions & 0 deletions tests/results/dp-perf/1.5.0/1.5.0-plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems consistent with previous test run.

## Test1: Running latte path based routing

```text
Expand Down
2 changes: 2 additions & 0 deletions tests/results/longevity/1.5.0/oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,8 @@ No error logs in nginx-gateway

Error logs in nginx

We could not get non-2xx errors from the cluster but should likely be similar to last release's issues.

### Key Metrics

#### Containers memory
Expand Down
9 changes: 2 additions & 7 deletions tests/results/longevity/1.5.0/plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,12 +56,7 @@ No error logs in nginx-gateway

Error logs in nginx

Several errors related to R33 integration

```
2024-11-11 22:57:46.685 PST
2024/11/12 06:57:46 [crit] 49#49: open() "/var/lib/nginx/state//nginx-mgmt-state" failed (2: No such file or directory)
```
We could not get non-2xx errors from the cluster but should likely be similar to last release's issues.


### Key Metrics
Expand Down Expand Up @@ -93,4 +88,4 @@ for endpoints changes.

## Comparison with previous runs

Graphs look similar to 1.3.0 results.
Graphs look similar to 1.4.0 results.
4 changes: 4 additions & 0 deletions tests/results/ngf-upgrade/1.5.0/1.5.0-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance has slightly improved reduced latencies across both HTTPS and HTTP traffic.

## Test: Send https /tea traffic

```text
Expand Down
4 changes: 4 additions & 0 deletions tests/results/ngf-upgrade/1.5.0/1.5.0-plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance has slightly improved.

## Test: Send https /tea traffic

```text
Expand Down
4 changes: 4 additions & 0 deletions tests/results/reconfig/1.5.0/1.5.0-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems consistent with previous run.

## Test 1: Resources exist before startup - NumResources 30

### Reloads and Time to Ready
Expand Down
4 changes: 4 additions & 0 deletions tests/results/reconfig/1.5.0/1.5.0-plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems to be consistent with previous run but has slightly higher reload and event processing times.

## Test 1: Resources exist before startup - NumResources 30

### Reloads and Time to Ready
Expand Down
4 changes: 4 additions & 0 deletions tests/results/scale/1.5.0/1.5.0-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems consistent with previous test run with slightly higher reload times and some errors.

## Test TestScale_Listeners

### Reloads
Expand Down
4 changes: 4 additions & 0 deletions tests/results/scale/1.5.0/1.5.0-plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems consistent with previous run but slightly higher reload and event batch processing times.

## Test TestScale_Listeners

### Reloads
Expand Down
5 changes: 5 additions & 0 deletions tests/results/zero-downtime-scale/1.5.0/1.5.0-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,11 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems consistent with previous run.
- No errors seen.

## One NGF Pod runs per node Test Results

### Scale Up Gradually
Expand Down
5 changes: 5 additions & 0 deletions tests/results/zero-downtime-scale/1.5.0/1.5.0-plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,11 @@ GKE Cluster:
- Zone: us-west2-a
- Instance Type: n2d-standard-16

## Summary:

- Performance seems consistent with previous run.
- No errors seen.

## One NGF Pod runs per node Test Results

### Scale Up Gradually
Expand Down
Loading