Skip to content

Commit 2cf2c5e

Browse files
committed
Add .pt and .pth to ignore_patterns
Signed-off-by: Andrey Velichkevich <[email protected]>
1 parent 5c39812 commit 2cf2c5e

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

pkg/initializer_v2/model/huggingface.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -33,12 +33,13 @@ def download_model(self):
3333
if self.config.access_token:
3434
huggingface_hub.login(self.config.access_token)
3535

36-
# TODO (andreyvelich): We should verify these patterns for different models.
36+
# TODO (andreyvelich): We should consider to follow vLLM approach with allow patterns.
37+
# Ref: https://github.com/kubeflow/training-operator/pull/2303#discussion_r1815913663
3738
huggingface_hub.snapshot_download(
3839
repo_id=model_uri,
3940
local_dir=constants.VOLUME_PATH_MODEL,
4041
allow_patterns=["*.json", "*.safetensors", "*.model"],
41-
ignore_patterns=["*.msgpack", "*.h5", "*.bin"],
42+
ignore_patterns=["*.msgpack", "*.h5", "*.bin", ".pt", ".pth"],
4243
)
4344

4445
logging.info("Model has been downloaded")

0 commit comments

Comments
 (0)