Commits

Commits on May 4, 2024

Merge branch 'main' into functionary-stream
abetlen
authored
d70f8e2
Copy full SHA for d70f8e2

Commits on May 3, 2024

Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
abetlen
committed
f9b7221
Copy full SHA for f9b7221
fix: Use memmove to copy str_value kv_override. Closes #1417
abetlen
committed
9f7a855
Copy full SHA for 9f7a855
feat(server): Remove temperature bounds checks for server. Closes #1384
abetlen
committed
0a454be
Copy full SHA for 0a454be
fix(server): Propagate `flash_attn` to model load. (#1424)
dthuerck
authored
2138561
Copy full SHA for 2138561

Commits on May 2, 2024

chore: Bump version
abetlen
committed
2117122
Copy full SHA for 2117122
feat: Update llama.cpp
abetlen
committed
d75dea1
Copy full SHA for d75dea1
feat: Add llama-3-vision-alpha chat format
abetlen
committed
31b1d95
Copy full SHA for 31b1d95

Commits on May 1, 2024

fix
jeffrey-fong
committed
23177a3
Copy full SHA for 23177a3
make functions return 1 function call only when 'auto'
jeffrey-fong
committed
10bf749
Copy full SHA for 10bf749
fix streaming with tool_choice/function_call
jeffrey-fong
committed
8e6a7e0
Copy full SHA for 8e6a7e0
assert v2 streaming, fix tool_call vs function_call
jeffrey-fong
committed
e11d44d
Copy full SHA for e11d44d
Merge branch 'abetlen:main' into functionary-stream
jeffrey-fong
authored
eb97945
Copy full SHA for eb97945
set up streaming for v2
jeffrey-fong
committed
4ba421a
Copy full SHA for 4ba421a

Commits on Apr 30, 2024

fix: Change default verbose value of verbose in image chat format handlers to True to match Llama
abetlen
committed
4f01c45
Copy full SHA for 4f01c45
feat: Update llama.cpp
abetlen
committed
946156f
Copy full SHA for 946156f
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
abetlen
committed
9286b5c
Copy full SHA for 9286b5c
fix: Suppress all logs when verbose=False, use hardcoded fileno's to work in colab notebooks. Closes #796 Closes #729
abetlen
committed
f116175
Copy full SHA for f116175
fix: UTF-8 handling with grammars (#1415)
Show description for 3226b3c
jsoma
authored
3226b3c
Copy full SHA for 3226b3c
docs: Change all examples from interpreter style to script style.
abetlen
committed
945c62c
Copy full SHA for 945c62c
docs: Update README.md
abetlen
committed
26478ab
Copy full SHA for 26478ab
chore: Bump version
abetlen
committed
b14dd98
Copy full SHA for b14dd98
fix: wrong parameter for flash attention in pickle __getstate__
abetlen
committed
29b6e9a
Copy full SHA for 29b6e9a
feat: Add option to enable `flash_attn` to Lllama params and ModelSettings
abetlen
committed
22d77ee
Copy full SHA for 22d77ee
feat: Update llama.cpp
abetlen
committed
8c2b24d
Copy full SHA for 8c2b24d
fix(ci): Fix build-and-release.yaml (#1413)
Show description for 6332527
Smartappli
authored
6332527
Copy full SHA for 6332527
docs: Update README to include CUDA 12.4 wheels
abetlen
committed
c8cd8c1
Copy full SHA for c8cd8c1
chore: Bump version
abetlen
committed
f417cce
Copy full SHA for f417cce
fix: Ensure image renders before text in chat formats regardless of message content order.
abetlen
committed
3489ef0
Copy full SHA for 3489ef0
fix(ci): Fix bug in use of upload-artifact failing to merge multiple artifacts into a single release.
abetlen
committed
d03f15b
Copy full SHA for d03f15b
chore: Bump version
abetlen
committed
26c7876
Copy full SHA for 26c7876
feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)
Show description for fe2da09
abetlen
authored
fe2da09
Copy full SHA for fe2da09
feat: Update llama.cpp
abetlen
committed
97fb860
Copy full SHA for 97fb860
chore(deps): bump actions/upload-artifact from 3 to 4 (#1412)
Show description for df2b5b5
dependabot[bot]
authored
df2b5b5
Copy full SHA for df2b5b5
chore(deps): bump actions/configure-pages from 4 to 5 (#1411)
Show description for be43018
dependabot[bot]
authored
be43018
Copy full SHA for be43018