Skip to content

Commit 0395cc0

Browse files
authored
chore(model gallery): add qwen_qwen2.5-vl-72b-instruct (#5349)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 616972f commit 0395cc0

File tree

1 file changed

+39
-0
lines changed

1 file changed

+39
-0
lines changed

gallery/index.yaml

Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7174,6 +7174,45 @@
71747174
- filename: mmproj-Qwen_Qwen2.5-VL-7B-Instruct-f16.gguf
71757175
sha256: c24a7f5fcfc68286f0a217023b6738e73bea4f11787a43e8238d4bb1b8604cde
71767176
uri: https://huggingface.co/bartowski/Qwen_Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/mmproj-Qwen_Qwen2.5-VL-7B-Instruct-f16.gguf
7177+
- !!merge <<: *qwen25
7178+
name: "qwen_qwen2.5-vl-72b-instruct"
7179+
urls:
7180+
- https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct
7181+
- https://huggingface.co/bartowski/Qwen_Qwen2.5-VL-72B-Instruct-GGUF
7182+
description: |
7183+
In the past five months since Qwen2-VL’s release, numerous developers have built new models on the Qwen2-VL vision-language models, providing us with valuable feedback. During this period, we focused on building more useful vision-language models. Today, we are excited to introduce the latest addition to the Qwen family: Qwen2.5-VL.
7184+
Key Enhancements:
7185+
7186+
Understand things visually: Qwen2.5-VL is not only proficient in recognizing common objects such as flowers, birds, fish, and insects, but it is highly capable of analyzing texts, charts, icons, graphics, and layouts within images.
7187+
7188+
Being agentic: Qwen2.5-VL directly plays as a visual agent that can reason and dynamically direct tools, which is capable of computer use and phone use.
7189+
7190+
Understanding long videos and capturing events: Qwen2.5-VL can comprehend videos of over 1 hour, and this time it has a new ability of cpaturing event by pinpointing the relevant video segments.
7191+
7192+
Capable of visual localization in different formats: Qwen2.5-VL can accurately localize objects in an image by generating bounding boxes or points, and it can provide stable JSON outputs for coordinates and attributes.
7193+
7194+
Generating structured outputs: for data like scans of invoices, forms, tables, etc. Qwen2.5-VL supports structured outputs of their contents, benefiting usages in finance, commerce, etc.
7195+
7196+
Model Architecture Updates:
7197+
7198+
Dynamic Resolution and Frame Rate Training for Video Understanding:
7199+
7200+
We extend dynamic resolution to the temporal dimension by adopting dynamic FPS sampling, enabling the model to comprehend videos at various sampling rates. Accordingly, we update mRoPE in the time dimension with IDs and absolute time alignment, enabling the model to learn temporal sequence and speed, and ultimately acquire the ability to pinpoint specific moments.
7201+
7202+
Streamlined and Efficient Vision Encoder
7203+
7204+
We enhance both training and inference speeds by strategically implementing window attention into the ViT. The ViT architecture is further optimized with SwiGLU and RMSNorm, aligning it with the structure of the Qwen2.5 LLM.
7205+
overrides:
7206+
mmproj: mmproj-Qwen_Qwen2.5-VL-72B-Instruct-f16.gguf
7207+
parameters:
7208+
model: Qwen_Qwen2.5-VL-72B-Instruct-Q4_K_M.gguf
7209+
files:
7210+
- filename: Qwen_Qwen2.5-VL-72B-Instruct-Q4_K_M.gguf
7211+
sha256: d8f4000042bfd4570130321beb0ba19acdd2c53731c0f83ca2455b1ee713e52c
7212+
uri: huggingface://bartowski/Qwen_Qwen2.5-VL-72B-Instruct-GGUF/Qwen_Qwen2.5-VL-72B-Instruct-Q4_K_M.gguf
7213+
- filename: mmproj-Qwen_Qwen2.5-VL-72B-Instruct-f16.gguf
7214+
sha256: 6099885b9c4056e24806b616401ff2730a7354335e6f2f0eaf2a45e89c8a457c
7215+
uri: https://huggingface.co/bartowski/Qwen_Qwen2.5-VL-72B-Instruct-GGUF/resolve/main/mmproj-Qwen_Qwen2.5-VL-72B-Instruct-f16.gguf
71777216
- &llama31
71787217
url: "github:mudler/LocalAI/gallery/llama3.1-instruct.yaml@master" ## LLama3.1
71797218
icon: https://avatars.githubusercontent.com/u/153379578

0 commit comments

Comments
 (0)