Skip to content

Issues: Lightning-AI/LitServe

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

28 Open 110 Closed
28 Open 110 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

start multiple types of models, with any number of instances for each enhancement New feature or request
#514 opened May 27, 2025 by ywh-my
2
special edge case: len(output) == len(batch) bug Something isn't working help wanted Extra attention is needed
#506 opened May 20, 2025 by mathematicalmichael
shutdown LitServe programmatically enhancement New feature or request good first issue Good for newcomers
#505 opened May 20, 2025 by aniketmaurya
1
@kumarrah2002
5
Multiple endpoints roadmap enhancement New feature or request
#492 opened May 13, 2025 by aniketmaurya
6 of 8 tasks
@aniketmaurya
4
Run a mix of async and non-async methods in LitAPI like FastAPI enhancement New feature or request
#490 opened May 13, 2025 by aniketmaurya
Remove abstract from LitAPI.setup with check and warning for user to load model in setup enhancement New feature or request
#484 opened May 9, 2025 by aniketmaurya
2
Find the latency in async mode bug Something isn't working help wanted Extra attention is needed
#481 opened May 8, 2025 by aniketmaurya
Support for OpenAI's new Responses API spec enhancement New feature or request
#455 opened Mar 17, 2025 by PierreMesure
1
5
Model Packaging and Management enhancement New feature or request
#454 opened Mar 14, 2025 by sapphire008
2
Potential Memory Leak in Response Buffer bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed
#452 opened Mar 12, 2025 by aniketmaurya
3
Allow to pass default_response_class e.g. ORJSONResponse to LitServe server enhancement New feature or request
#436 opened Feb 23, 2025 by AleksanderWWW
1
6
RFC: Support Open Inference Protocol (OIP) for Standardized Model Serving API enhancement New feature or request won't fix
#428 opened Feb 17, 2025 by bhimrazy
2
Allow resource release at the end of life of the LitAPI object enhancement New feature or request
#420 opened Feb 3, 2025 by Alexandre-SCHOEPP
2
Decouple API interface from batching configuration enhancement New feature or request won't fix
#412 opened Jan 14, 2025 by marrrcin
4
Asynchronous Task Processing in Agentic Workflows enhancement New feature or request won't fix
#405 opened Jan 9, 2025 by rakro101
3
OpenAI Spec Expansion For Multi-Modal Models? enhancement New feature or request won't fix
#404 opened Jan 8, 2025 by norman-kong
2
how to use Litserve to serve vllm engine bug Something isn't working help wanted Extra attention is needed won't fix
#382 opened Dec 4, 2024 by GhostXu11
3
Support additional content types in post requests enhancement New feature or request
#362 opened Nov 19, 2024 by ktrapeznikov
4
Raising HTTPexception on single request from encode_request or decode_request raise same for all request in batch bug Something isn't working help wanted Extra attention is needed
#340 opened Oct 23, 2024 by bimarshak7
5
Websocket Support for Streaming Input and Output enhancement New feature or request question Further information is requested
#320 opened Oct 3, 2024 by ChenghaoMou
1
14
Add Keep-Alive Functionality for GPU Resource Optimization in LitServe enhancement New feature or request won't fix
#304 opened Sep 29, 2024 by skyking363
13
dry run after server started enhancement New feature or request won't fix
#293 opened Sep 24, 2024 by Borda
2
Handle case when Logger.process is stuck enhancement New feature or request
#289 opened Sep 23, 2024 by aniketmaurya
1
@aniketmaurya
Map decode_request during dynamic batching using a threadpool enhancement New feature or request help wanted Extra attention is needed won't fix
#166 opened Jul 8, 2024 by aniketmaurya
1
2
Evict requests if the client has disconnected enhancement New feature or request help wanted Extra attention is needed won't fix
#165 opened Jul 8, 2024 by aniketmaurya
2
5
ProTip! Updated in the last three days: updated:>2025-05-29.