Bump llama.cpp from 2347e45 to 254a7a7
#103
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Bumps [llama.cpp](https://github.com/ggerganov/llama.cpp) from `2347e45` to `254a7a7`. - [Release notes](https://github.com/ggerganov/llama.cpp/releases) - [Commits](ggml-org/llama.cpp@2347e45...254a7a7) --- updated-dependencies: - dependency-name: llama.cpp dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
deadprogram
approved these changes
Jun 15, 2023
There was a problem hiding this comment.
This is the commit from llama.cpp that brings in CUDA support: ggml-org/llama.cpp#1827
Let's merge this!
|
Yes! Definitely! Problem is, I gave a try it yesterday , but there seems to be issues still. Current master works ( no full offloading), but bringing this in seems to break it entirely. I'm testing this with a box with a GPU given from a community member ( as I don't have one to try it myself ), and seems to fail into offloading to the GPU. @deadprogram did you tried it already on your GPU? |
|
for reference, the error running the example: |
|
Superseded by #104. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Bumps llama.cpp from
2347e45to254a7a7.Commits
254a7a7CUDA full GPU acceleration, KV cache in VRAM (#1827)9254920baby-llama : fix operator!= (#1821)e32089btrain : improved training-from-scratch example (#1652)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebasewill rebase this PR@dependabot recreatewill recreate this PR, overwriting any edits that have been made to it@dependabot mergewill merge this PR after your CI passes on it@dependabot squash and mergewill squash and merge this PR after your CI passes on it@dependabot cancel mergewill cancel a previously requested merge and block automerging@dependabot reopenwill reopen this PR if it is closed@dependabot closewill close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major versionwill close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor versionwill close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependencywill close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)