Skip to content

feat: cortex run model(:gguf) #1076

Closed
@vansangpfiev

Description

@vansangpfiev

Goals

  • Cortex run should load and run model
  • Cortex should run model with relevant parameters
  • Cortex should display informative error messages if it fails

Tasklist

  • cortex run model:llamacpp
  • Ensure dylib issue is fixed bug: libengine.dylib not found #953
  • Decision: should we uncouple engine install? (e.g. error message, directing user to install engine with separate command)
  • Informative Error messages for major failure modes (e.g. OOM)
  • Tests
  • Docs

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

Completed

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions