Update Axolotl Examples #2502
Update Axolotl Examples #2502
Conversation
Updated Axolotl Nvidia Example with Llama 4 Scout Update AMD axolotl example for dependency error
Bihan
force-pushed
the
update_axolotl_example
branch
from
0c9cb3b to
46c3a47
Compare
| # Using RunPod's ROCm Docker image | ||
| image: runpod/pytorch:2.1.2-py3.10-rocm6.0.2-ubuntu22.04 | ||
| # Required environment variables | ||
| env: | ||
| - HF_TOKEN | ||
| - WANDB_API_KEY | ||
| - WANDB_PROJECT |
There was a problem hiding this comment.
How is WANDB_API_KEY not enough?
There was a problem hiding this comment.
No, we need to set WANDB_PROJECT and WANDB_NAME.
The difference is that in our current master it is set in the config file and in this PR, we are sending it as an argument. When we send it as argument, we do not need to include the config.yaml in our repo.
There was a problem hiding this comment.
Okay, then at least let's hardcode the value of WANDB_NAME, e.g. to axolotl-amd-llama31-train. If the user wants, they would change it.
There was a problem hiding this comment.
BTW this is another user case when we could set it to $DSTACK_RUN_NAME
| @@ -177,6 +182,8 @@ To request multiple GPUs, specify the quantity after the GPU name, separated by | |||
| - cd axolotl | |||
| - git checkout d4f6c65 | |||
| - pip install -e . | |||
| - pip uninstall pynvml -y | |||
| - pip install pynvml==11.5.3 | |||
There was a problem hiding this comment.
Should we add a note or at least a comment on it?
| @@ -177,6 +182,8 @@ To request multiple GPUs, specify the quantity after the GPU name, separated by | |||
| - cd axolotl | |||
| - git checkout d4f6c65 | |||
There was a problem hiding this comment.
Why this particular revision??
There was a problem hiding this comment.
Then a comment is needed I suppose
There was a problem hiding this comment.
Yes. I will update it accordingly.
Updated Axolotl Nvidia Example with Llama 4 Scout
Resolve module not found error for AMD
Error
ModuleNotFoundError: No module named 'pynvml.nvml'; 'pynvml' is not a packageSolution
Installed previous release of pynvml
pip install pynvml==11.5.3