✨ Introduce NetworkPolicy for core component workloads.

[anik120]

RFC

Description of the change:

Motivation for the change:

Architectural changes:

Testing remarks:

Reviewer Checklist

• Implementation matches the proposed design, or proposal is updated to match implementation
• Sufficient unit test coverage
• Sufficient end-to-end test coverage
• Bug fixes are accompanied by regression test(s)
• e2e tests and flake fixes are accompanied evidence of flake testing, e.g. executing the test 100(0) times
• tech debt/todo is accompanied by issue link(s) in comments in the surrounding code
• Tests are comprehensible, e.g. Ginkgo DSL is being used appropriately
• Docs updated or added to /doc
• Commit messages sensible and descriptive
• Tests marked as [FLAKE] are truly flaky and have an issue
• Code is properly formatted

[anik120]

Depends on #3568 for the tests to pass

[perdasilva]

oh oh - it's not liking the policies - I'll debug a bit and see if I can figure out what's up...

rc: deny all blocks incoming comms on the catalogsource pod - we need Joe's PR (it's merging now)
we may also need to add egress 50051 to one or both of the controller policies