Commit 1f56c64

and

authored

feat: Implement streaming for Functionary v2 + Bug fixes (abetlen#1419)

* set up streaming for v2 * assert v2 streaming, fix tool_call vs function_call * fix streaming with tool_choice/function_call * make functions return 1 function call only when 'auto' * fix --------- Co-authored-by: Andrei <abetlen@gmail.com>

1 parent f9b7221 commit 1f56c64Copy full SHA for 1f56c64

1 file changed

+443

-133

lines changed

llama_cpp
- llama_chat_format.py

1 file changed

+443

-133

lines changed

Comments

0 (0)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Commit 1f56c64

1 file changed

1 file changed

Search code, repositories, users, issues, pull requests...

File tree

1 file changed

1 file changed

0 commit comments