Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Commit ad4479e

Browse filesBrowse files
authored
Merge pull request abetlen#359 from matthoffner/main
Document metal support
2 parents 74fbaae + 4eb245a commit ad4479e
Copy full SHA for ad4479e

File tree

Expand file treeCollapse file tree

1 file changed

+6
-1
lines changed
Filter options
Expand file treeCollapse file tree

1 file changed

+6
-1
lines changed

‎README.md

Copy file name to clipboardExpand all lines: README.md
+6-1Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ bash Miniforge3-MacOSX-arm64.sh
4141
```
4242
Otherwise, while installing it will build the llama.ccp x86 version which will be 10x slower on Apple Silicon (M1) Mac.
4343

44-
### Installation with OpenBLAS / cuBLAS / CLBlast
44+
### Installation with OpenBLAS / cuBLAS / CLBlast / Metal
4545

4646
`llama.cpp` supports multiple BLAS backends for faster processing.
4747
Use the `FORCE_CMAKE=1` environment variable to force the use of `cmake` and install the pip package for the desired BLAS backend.
@@ -64,6 +64,11 @@ To install with CLBlast, set the `LLAMA_CLBLAST=1` environment variable before i
6464
CMAKE_ARGS="-DLLAMA_CLBLAST=on" FORCE_CMAKE=1 pip install llama-cpp-python
6565
```
6666

67+
To install with Metal (MPS), set the `LLAMA_METAL=on` environment variable before installing:
68+
69+
```bash
70+
CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python
71+
```
6772

6873
## High-level API
6974

0 commit comments

Comments
0 (0)
Morty Proxy This is a proxified and sanitized view of the page, visit original site.