Commit 153a004
authored
feat: Generic chatml Function Calling (abetlen#957)
* Add demo notebook
* Add initial chat handler
* Update OpenAI types
* Add generic chatml function calling (wip)
* Update chatml generic function calling.
* Progress on auto-tool calls
* fix streaming functions
* Remove print statements
* fix: Suppress output from llama.cpp init and grammar creation
* Add OpenAI v1 python api compatible chat completion function
* Support non-streaming multi-tool calls
* Format
* Include function_call in response.1 parent 69413ce commit 153a004
4 files changed
Lines changed: 1660 additions & 60 deletions
File tree
- examples/notebooks
- llama_cpp
0 commit comments