Skip to content

Add ARM64 support #2595

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
May 7, 2025
Merged

Add ARM64 support #2595

merged 6 commits into from
May 7, 2025

Conversation

un-def
Copy link
Collaborator

@un-def un-def commented May 2, 2025

  • Support NVIDIA Grace superchips on Lambda
  • Support ARM with SSH fleets

Closes: #2101

* Support NVIDIA Grace superchips on Lambda
* Support ARM with SSH fleets

Closes: #2101
Copy link
Contributor

@peterschmidt85 peterschmidt85 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, how do I specify arch with dstack offer?

@@ -117,8 +117,11 @@ For more details on the options below, refer to the [server deployment](../guide
* `DSTACK_SERVER_MAX_OFFERS_TRIED` - Sets how many instance offers to try when starting a job.
Setting a high value can degrade server performance.
* `DSTACK_RUNNER_VERSION` – Sets exact runner version for debug. Defaults to `latest`. Ignored if `DSTACK_RUNNER_DOWNLOAD_URL` is set.
* `DSTACK_RUNNER_DOWNLOAD_URL` – Overrides `dstack-runner` binary download URL.
* `DSTACK_SHIM_DOWNLOAD_URL` – Overrides `dstack-shim` binary download URL.
* `DSTACK_RUNNER_DOWNLOAD_URL` – Overrides `dstack-runner` binary download URL. The URL can contain `{version}` and/or `{arch}` placeholders,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We also need to update

  1. runner/README.md
  2. runner/.just (currently it only builds/uploads one arch)

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd rather open another PR for justfile — I have some ideas for improvements.

@un-def
Copy link
Collaborator Author

un-def commented May 5, 2025

@peterschmidt85

how do I specify arch with dstack offer?

I've added --cpu option to dstack apply and dstack offer

@un-def un-def merged commit eee869d into master May 7, 2025
25 checks passed
@un-def un-def deleted the issue_2101_arm branch May 7, 2025 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature]: Support ARM CPUs
3 participants