Commits

Commits on Dec 18, 2023

fix: float32 is not JSON serializable when streaming logits.
abetlen
committed
a05b4da
Copy full SHA for a05b4da
Update changelog
abetlen
committed
abda047
Copy full SHA for abda047
Fix type annotations
abetlen
committed
7df6c32
Copy full SHA for 7df6c32
Fix type annotation
abetlen
committed
b703aad
Copy full SHA for b703aad
Fix type annotation
abetlen
committed
d0aedfc
Copy full SHA for d0aedfc
Fix ctypes definitions of `llama_kv_cache_view_update` and `llama_kv_cache_view_free`. (#1028)
e-c-d
authored
2993936
Copy full SHA for 2993936
Bump version
abetlen
committed
5e863d8
Copy full SHA for 5e863d8
Update low_level_api_llama_cpp.py to match current API (#1023)
jsoma
authored
cfd698c
Copy full SHA for cfd698c
Add offload_kqv option to llama and server
abetlen
committed
095c650
Copy full SHA for 095c650
Remove unnused import
abetlen
committed
472b344
Copy full SHA for 472b344
Update llama.cpp
abetlen
committed
2fc48c5
Copy full SHA for 2fc48c5
perf: Don't convert logprobs arrays to lists (#1021)
kddubey
authored
6b2e0e0
Copy full SHA for 6b2e0e0
Bugfix: Remove f16_kv, add offload_kqv field (#1019)
Show description for 62944df
brandonrobertz
authored
62944df
Copy full SHA for 62944df

Commits on Dec 17, 2023

Update README.md functionary demo typo (#996)
Show description for 37da8e8
evelynmitchell
authored
37da8e8
Copy full SHA for 37da8e8

Commits on Dec 16, 2023

Bug fixed with n_ctx=0 (#1015)
Show description for f1c631d
DanieleMorotti
authored
f1c631d
Copy full SHA for f1c631d
Fix logits_to_logprobs for 2-D and 3-D logits (#1002)
Show description for 5a89446
kddubey
authored
5a89446
Copy full SHA for 5a89446
Update llama.cpp
abetlen
committed
534b1ea
Copy full SHA for 534b1ea

Commits on Dec 14, 2023

Bump version
abetlen
committed
cbce061
Copy full SHA for cbce061
Add qwen chat format (#1005)
yhfgyyf
authored
8b4db73
Copy full SHA for 8b4db73
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
abetlen
committed
690c563
Copy full SHA for 690c563
Update llama.cpp
abetlen
committed
c0fc0a1
Copy full SHA for c0fc0a1

Commits on Dec 12, 2023

Add support for running the server with SSL (#994)
rgerganov
authored
8e44a32
Copy full SHA for 8e44a32
Replace logits_to_logprobs implementation with numpy equivalent to llama.cpp (#991)
Show description for ef22e47
player1537
authored
ef22e47
Copy full SHA for ef22e47
Fix UnsupportedOperation: fileno in suppress_stdout_stderr (#961)
Show description for ac35f68

zocainViken
and
abetlen
authored
ac35f68
Copy full SHA for ac35f68
Add Pygmalion chat format (#986)
chiensen
authored
b938ccc
Copy full SHA for b938ccc
README.md multimodal params fix (#967)
Show description for 6bbeea0
zocainViken
authored
6bbeea0
Copy full SHA for 6bbeea0
fix minor typo (#958)
Show description for c1d92ce

aniketmaurya
and
abetlen
authored
c1d92ce
Copy full SHA for c1d92ce

Commits on Dec 11, 2023

Fix docker build
abetlen
committed
e9bc4c4
Copy full SHA for e9bc4c4
Bump version
abetlen
committed
c1e73e7
Copy full SHA for c1e73e7
Remove f16_kv
abetlen
committed
ec26f36
Copy full SHA for ec26f36
Update llama.cpp
abetlen
committed
f1edc66
Copy full SHA for f1edc66

Commits on Nov 29, 2023

Update llama.cpp
abetlen
committed
f3b844e
Copy full SHA for f3b844e
Fix #891 (#952)
kddubey
authored
b069d06
Copy full SHA for b069d06

Commits on Nov 28, 2023

Bump version
abetlen
committed
ad963a0
Copy full SHA for ad963a0
Make building llava optional
abetlen
committed
e3941d9
Copy full SHA for e3941d9