Skip to content

Get chat_template from a server endpoint. #5447

Closed
@lastrosade

Description

@lastrosade

Feature Description

Retrieve the "chat_template" field from the GGUF model in the /props endpoint.

Motivation

Many models incorporate a jinja2 template stored in a field called chat_template. This feature would enable users to generate appropriate templates with their scripts.

This could also probably be used on the web UI to autofill the template text boxes.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions