Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Update low level example to match current API #1023

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Dec 18, 2023

Conversation

jsoma
Copy link
Contributor

@jsoma jsoma commented Dec 17, 2023

Two small changes to make the low level example run successfully:

  • Updated call to llama_cpp.llama_n_vocab to pass model instead of context
  • Combined previous llama_sample_repetition_penalty and llama_sample_frequency_and_presence_penalties into llama_sample_repetition_penalties with keyword arguments

Thank you!

@abetlen
Copy link
Owner

abetlen commented Dec 18, 2023

@jsoma thank you

@abetlen abetlen merged commit cfd698c into abetlen:main Dec 18, 2023
@leon-maechler
Copy link

something like this is needed again

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants
Morty Proxy This is a proxified and sanitized view of the page, visit original site.