流式推理 #192

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

zhiyu112223 opened this issue Jan 24, 2025 · 2 comments

Assignees

zhiyu112223 commented Jan 24, 2025

请问是否支持流式推理？

ddlBoJack assigned cwx-worst-one

Collaborator

cwx-worst-one commented Jan 24, 2025

We have not yet released the streaming inference version of SLAM-Omni, but the reproduction version of Mini-Omni supports streaming.

Author

zhiyu112223 commented Feb 14, 2025

请问slam-omni大概什么时候能开源流式版本，现在如果我想改成流式推理需要改哪里，怎么改呢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment