ISSUE-922: chore(tests/containers): implement retry if port-forwarding fails

[jiridanek]

Fixes #922

Description

There were two issues.

First, that socket.accept() would block, and sometimes the script got blocked on it.

Second, that sometimes the proxy would RST the connection if the pod was not yet ready.

How Has This Been Tested?

• RHOAIENG-21690: chore(Dockerfiles): augument micropipenv with uv for faster package installs #968

-------------------------------- live log call ---------------------------------
2025-03-21 15:19:09 INFO Waiting for: readiness of all Pods matching app=notebook-tests-pod in Namespace test-ns-notebook-tests-pod
2025-03-21 15:19:19 INFO Pods matching test-ns-notebook-tests-pod/app=notebook-tests-pod are ready
2025-03-21 15:19:19 INFO Proxy listening on localhost:0
2025-03-21 15:19:19 INFO Waiting for: Connecting to pod succeeds
2025-03-21 15:19:19 INFO Accepted connection from 127.0.0.1:55462
2025-03-21 15:19:20 INFO Accepted connection from 127.0.0.1:55478
2025-03-21 15:19:21 INFO Accepted connection from 127.0.0.1:55562
2025-03-21 15:19:21 INFO Reading from remote socket failed, client ('127.0.0.1', 55562) has been disconnected
2025-03-21 15:19:22 INFO Accepted connection from 127.0.0.1:55568
PASSED                                                                   [100%]

Merge criteria:

• The commits are squashed in a cohesive manner and have meaningful messages.
• Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
• The developer has manually tested the changes and verified that the changes work

[jstourac]

/lgtm

thanks for investigating this and for the fix, Jiri!

[jiridanek]

/approve

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jiridanek

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [jiridanek]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[jiridanek]

thanks for investigating this and for the fix, Jiri!

well, I did it wrong the first time