Skip to content

crawl_permissions fails: DatabricksError: Workspace X exceeded the concurrent limit of 20 requests. #401

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
dmoore247 opened this issue Oct 7, 2023 · 3 comments · May be fixed by databricks/databricks-sdk-py#391
Closed

crawl_permissions fails: DatabricksError: Workspace X exceeded the concurrent limit of 20 requests. #401

dmoore247 opened this issue Oct 7, 2023 · 3 comments · May be fixed by databricks/databricks-sdk-py#391
Assignees
@nfx
Labels
step/assessment go/uc/upgrade - Assessment Step

Comments

@dmoore247
Copy link
Contributor

During the workspace analysis, crawl permissions fails with a concurrent limit of 20 exceeded.

release: 0.3.0
image

Notice that the crawl starts out at 50 rps and slows to 5 rps.
@github-project-automation github-project-automation bot moved this to Triage in UCX Oct 7, 2023
@nfx
Copy link
Collaborator

nfx commented Oct 7, 2023

50rps -> 5rps is not noticeable via screenshot

@nfx nfx changed the title crawl_permissions fails: DatabricksError: Workspace 9999999999999999999 exceeded the concurrent limit of 20 requests. crawl_permissions fails: DatabricksError: Workspace X exceeded the concurrent limit of 20 requests. Oct 7, 2023
@nfx
Copy link
Collaborator

nfx commented Oct 7, 2023

Please create an internal ES ticket, so that we make sure that platform sends the correct HTTP 429 response with Retry-After header

@nfx nfx self-assigned this Oct 7, 2023
@nfx nfx added the bug label Oct 7, 2023
nfx added a commit to databricks/databricks-sdk-py that referenced this issue Oct 7, 2023
@nfx
Additional retries on `DatabricksError: Workspace X exceeded the conc…
dc65dc7 
…urrent limit of Y requests`

Platform doesn't seem to send HTTP 429 correctly with this response, otherwise the error would have been `TimeoutError`. This PR adds retries for error responses with this message.

Fixes databrickslabs/ucx#401

Signed-off-by: Serge Smertin <[email protected]>
@nfx nfx mentioned this issue Oct 7, 2023
Open
3 tasks
@nfx nfx moved this from Triage to Active Backlog in UCX Oct 10, 2023
@pohlposition pohlposition added the step/assessment go/uc/upgrade - Assessment Step label Oct 13, 2023
@nfx
Copy link
Collaborator

nfx commented Nov 18, 2023

Fixed in v0.6.0

@nfx nfx closed this as completed Nov 18, 2023
@github-project-automation github-project-automation bot moved this from Active Backlog to Archive in UCX Nov 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nfx nfx

Labels
step/assessment go/uc/upgrade - Assessment Step
Projects
UCX
Archived in project
Milestone
No milestone
3 participants
@nfx @dmoore247 @pohlposition