File tree Expand file tree Collapse file tree 1 file changed +6
-1
lines changed
Filter options
Expand file tree Collapse file tree 1 file changed +6
-1
lines changed
Original file line number Diff line number Diff line change @@ -41,7 +41,7 @@ bash Miniforge3-MacOSX-arm64.sh
41
41
```
42
42
Otherwise, while installing it will build the llama.ccp x86 version which will be 10x slower on Apple Silicon (M1) Mac.
43
43
44
- ### Installation with OpenBLAS / cuBLAS / CLBlast
44
+ ### Installation with OpenBLAS / cuBLAS / CLBlast / Metal
45
45
46
46
` llama.cpp ` supports multiple BLAS backends for faster processing.
47
47
Use the ` FORCE_CMAKE=1 ` environment variable to force the use of ` cmake ` and install the pip package for the desired BLAS backend.
@@ -64,6 +64,11 @@ To install with CLBlast, set the `LLAMA_CLBLAST=1` environment variable before i
64
64
CMAKE_ARGS=" -DLLAMA_CLBLAST=on" FORCE_CMAKE=1 pip install llama-cpp-python
65
65
```
66
66
67
+ To install with Metal (MPS), set the ` LLAMA_METAL=on ` environment variable before installing:
68
+
69
+ ``` bash
70
+ CMAKE_ARGS=" -DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python
71
+ ```
67
72
68
73
## High-level API
69
74
You can’t perform that action at this time.
0 commit comments