Releases · coderonion/llama.cpp

28 Dec 11:09

d79d8f3

b4393 Latest

Latest

vulkan: multi-row k quants (#10846)

* multi row k quant shaders!

* better row selection

* more row choices

* readjust row selection

* rm_kq=2 by default

Assets 23

cudart-llama-bin-win-cu11.7-x64.zip

303 MB 2024-12-28T11:09:55Z
cudart-llama-bin-win-cu12.4-x64.zip

373 MB 2024-12-28T11:10:01Z
llama-b4393-bin-macos-arm64.zip

60.2 MB 2024-12-28T11:10:08Z
llama-b4393-bin-macos-x64.zip

61 MB 2024-12-28T11:10:10Z
llama-b4393-bin-ubuntu-x64.zip

66 MB 2024-12-28T11:10:12Z
llama-b4393-bin-win-avx-x64.zip

9.76 MB 2024-12-28T11:10:13Z
llama-b4393-bin-win-avx2-x64.zip

9.76 MB 2024-12-28T11:10:14Z
llama-b4393-bin-win-avx512-x64.zip

9.78 MB 2024-12-28T11:10:15Z
llama-b4393-bin-win-cuda-cu11.7-x64.zip

147 MB 2024-12-28T11:10:16Z
llama-b4393-bin-win-cuda-cu12.4-x64.zip

147 MB 2024-12-28T11:10:19Z
Source code (zip)

2024-12-26T15:54:44Z
Source code (tar.gz)

2024-12-26T15:54:44Z

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Search code, repositories, users, issues, pull requests...

Releases: coderonion/llama.cpp

b4393

Uh oh!