Commits

Commits on May 10, 2025

Add 'gemma-3-vision' as chat_format for OpenAI-compatible server.
erdmann
committed
d4a89d7
Copy full SHA for d4a89d7

Commits on Apr 4, 2025

fix: modify the gemma3 chat template to be compatible with openai api
kossum
committed
025e7fa
Copy full SHA for 025e7fa

Commits on Apr 3, 2025

fix: added n_ctx check for prompt requirements when embedding images in Gemma3ChatHandler
kossum
committed
1b45588
Copy full SHA for 1b45588

Commits on Apr 2, 2025

resolve the image embedding issue in gemma3
kossum
committed
25b2f8f
Copy full SHA for 25b2f8f

Commits on Mar 30, 2025

feat: Add Gemma3 chat handler (#1976)
kossum
committed
f33dde3
Copy full SHA for f33dde3

Commits on Mar 12, 2025

chore: Bump version
abetlen
committed
37eb5f0
Copy full SHA for 37eb5f0
feat: Update llama.cpp
abetlen
committed
e232fae
Copy full SHA for e232fae
feat: Update llama.cpp
abetlen
committed
344c106
Copy full SHA for 344c106

Commits on Jan 29, 2025

chore: Bump version
abetlen
committed
710e19a
Copy full SHA for 710e19a
fix: error showing time spent in llama perf context print (#1898)
Show description for 4442ff8

shakalaca
and
abetlen
authored
4442ff8
Copy full SHA for 4442ff8
fix(ci): Fix the CUDA workflow (#1894)
oobabooga
authored
14879c7
Copy full SHA for 14879c7
feat: Update llama.cpp
abetlen
committed
0b89fe4
Copy full SHA for 0b89fe4
feat: Update llama.cpp
abetlen
committed
80be68a
Copy full SHA for 80be68a

Commits on Jan 8, 2025

chore: Bump version
abetlen
committed
0580cf2
Copy full SHA for 0580cf2
fix: streaming resource lock (#1879)
Show description for e8f14ce

gjpower
and
abetlen
authored
e8f14ce
Copy full SHA for e8f14ce
feat: Update llama.cpp
abetlen
committed
1d5f534
Copy full SHA for 1d5f534

Commits on Dec 30, 2024

feat: Update llama.cpp
abetlen
committed
c9dfad4
Copy full SHA for c9dfad4

Commits on Dec 19, 2024

feat: Update llama.cpp
abetlen
committed
2bc1d97
Copy full SHA for 2bc1d97

Commits on Dec 9, 2024

chore: Bump version
abetlen
committed
803924b
Copy full SHA for 803924b
feat: Update llama.cpp
abetlen
committed
801a73a
Copy full SHA for 801a73a
fix: add missing await statements for async exit_stack handling (#1858)
gjpower
authored
afedfc8
Copy full SHA for afedfc8
fix(ci): update macos runner image to non-deprecated version
abetlen
committed
ea4d86a
Copy full SHA for ea4d86a
chore: Bump version
abetlen
committed
002f583
Copy full SHA for 002f583
fix(ci): hotfix for wheels
abetlen
committed
ca80802
Copy full SHA for ca80802
chore: Bump version
abetlen
committed
a9fe0f8
Copy full SHA for a9fe0f8
Add CUDA 12.5 and 12.6 to generated output wheels
abetlen
committed
61508c2
Copy full SHA for 61508c2
feat: Update llama.cpp
abetlen
committed
5585f8a
Copy full SHA for 5585f8a

Commits on Dec 6, 2024

misc: Update run server command
abetlen
committed
b9b50e5
Copy full SHA for b9b50e5
Merge branch 'main' of github.com:abetlen/llama-cpp-python into main
abetlen
committed
6889429
Copy full SHA for 6889429
misc: Update development Makefile
abetlen
committed
df136cb
Copy full SHA for df136cb
fix: chat API logprobs format (#1788)
Show description for 4f0ec65
domdomegg
authored
4f0ec65
Copy full SHA for 4f0ec65
fix(examples): Refactor Batching notebook to use new sampler chain API (#1793)
Show description for d610477
lukestanley
authored
d610477
Copy full SHA for d610477
fix(docs): Update development instructions (#1833)
Florents-Tselai
authored
1ea6154
Copy full SHA for 1ea6154
fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context (#1798)
Show description for 9bd0c95

gjpower
and
abetlen
authored
9bd0c95
Copy full SHA for 9bd0c95
fix: added missing exit_stack.close() to /v1/chat/completions (#1796)
Show description for 073b7e4
Ian321
authored
073b7e4
Copy full SHA for 073b7e4