Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Appearance settings

llama : allow using mmap without PrefetchVirtualMemory #14013

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 5, 2025
Merged

llama : allow using mmap without PrefetchVirtualMemory #14013

merged 1 commit into from
Jun 5, 2025

Conversation

slaren
Copy link
Member

@slaren slaren commented Jun 4, 2025 •
edited
Loading

  • Do not throw an exception when using mmap on Windows just because the build does not have support for PrefetchVirtualMemory, it is not a critical function
  • Fix GGML_WINVER not applying to llama.cpp sources

Fixes #9311

@github-actions github-actions bot added build Compilation issues ggml changes relating to the ggml tensor library for machine learning labels Jun 4, 2025
@slaren slaren merged commit 3a07714 into master Jun 5, 2025
45 checks passed
@slaren slaren deleted the sl/fix-winver branch June 5, 2025 09:57
furyhawk pushed a commit to furyhawk/llama.cpp that referenced this pull request Jun 6, 2025
@slaren @furyhawk
llama : allow using mmap without PrefetchVirtualMemory, apply GGML_WI…
6659721 
…N_VER to llama.cpp sources (ggml-org#14013)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ggerganov ggerganov ggerganov approved these changes

Assignees
No one assigned
Labels
build Compilation issues ggml changes relating to the ggml tensor library for machine learning
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Bug: MinGW build fails to load models with "error loading model: PrefetchVirtualMemory unavailable"
2 participants
@slaren @ggerganov
Morty Proxy This is a proxified and sanitized view of the page, visit original site.