Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Commit 0b73da5

Browse filesBrowse files
committed
llama : add TODO for deprecating the defrag API in the future
1 parent 23e1e54 commit 0b73da5
Copy full SHA for 0b73da5

File tree

Expand file treeCollapse file tree

1 file changed

+2
-1
lines changed
Filter options
Expand file treeCollapse file tree

1 file changed

+2
-1
lines changed

‎include/llama.h

Copy file name to clipboardExpand all lines: include/llama.h
+2-1Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -692,13 +692,14 @@ extern "C" {
692692
// This will be applied:
693693
// - lazily on next llama_decode()
694694
// - explicitly with llama_kv_self_update()
695+
// TODO: deprecate and always update the cache lazily [TAG: API_KV_NO_DEFRAG]
695696
LLAMA_API void llama_kv_self_defrag(struct llama_context * ctx);
696697

697698
// Check if the context supports KV cache shifting
698699
LLAMA_API bool llama_kv_self_can_shift(const struct llama_context * ctx);
699700

700701
// Apply the KV cache updates (such as K-shifts, defragmentation, etc.)
701-
// TODO: deprecate and always update the cache lazily
702+
// TODO: deprecate and always update the cache lazily [TAG: API_KV_NO_DEFRAG]
702703
LLAMA_API void llama_kv_self_update(struct llama_context * ctx);
703704

704705
//

0 commit comments

Comments
0 (0)
Morty Proxy This is a proxified and sanitized view of the page, visit original site.