Description
想先f16的ggml再gguf,然后再Q5
[youngchaos@youngchaos-t58v chatglm.cpp]$ python3 chatglm_cpp/convert.py -i /home/youngchaos/pretrained_models/CharacterGLM-6B -t f16 -o ./chatglm-ggml.bin
Traceback (most recent call last):
File "/home/youngchaos/chatglm.cpp/chatglm_cpp/convert.py", line 563, in
main()
File "/home/youngchaos/chatglm.cpp/chatglm_cpp/convert.py", line 555, in main
convert(
File "/home/youngchaos/chatglm.cpp/chatglm_cpp/convert.py", line 485, in convert
model = auto_model_class.from_pretrained(model_name_or_path, trust_remote_code=True, low_cpu_mem_usage=True)
File "/home/youngchaos/.conda/envs/TTS/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 553, in from_pretrained
model_class = get_class_from_dynamic_module(
File "/home/youngchaos/.conda/envs/TTS/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 553, in get_class_from_dynamic_module
return get_class_in_module(class_name, final_module, force_reload=force_download)
File "/home/youngchaos/.conda/envs/TTS/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 238, in get_class_in_module
module_files: List[Path] = [module_file] + sorted(map(Path, get_relative_import_files(module_file)))
File "/home/youngchaos/.conda/envs/TTS/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 128, in get_relative_import_files
new_imports.extend(get_relative_imports(f))
File "/home/youngchaos/.conda/envs/TTS/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 97, in get_relative_imports
with open(module_file, "r", encoding="utf-8") as f:
FileNotFoundError: [Errno 2] No such file or directory: '/home/youngchaos/.cache/huggingface/modules/transformers_modules/CharacterGLM-6B/quantization.py'