Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Commit 75466a3

Browse filesBrowse files
committed
Simplify Dockerfile
Take out references to OpenBLAS since no longer used
1 parent 6634017 commit 75466a3
Copy full SHA for 75466a3

File tree

Expand file treeCollapse file tree

1 file changed

+1
-8
lines changed
Filter options
Expand file treeCollapse file tree

1 file changed

+1
-8
lines changed

‎Dockerfile

Copy file name to clipboardExpand all lines: Dockerfile
+1-8Lines changed: 1 addition & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -9,23 +9,16 @@ RUN python3 -m pip install --upgrade pip cmake scikit-build-core[pyproject] setu
99

1010
COPY . .
1111

12-
# Install to /usr so that easily findable by cmake
13-
RUN mv /OpenBLAS /opt/OpenBLAS && cd /opt/OpenBLAS && make install PREFIX=/usr/ && cd /
14-
15-
# Have to disable GGML_LLAMAFILE for Q4_0_4_4 quantization
1612
ENV march=armv8.2-a+crypto+fp16+rcpc+dotprod
1713
ENV mcpu=cortex-a78c+crypto+noprofile+nossbs+noflagm+nopauth
1814
ENV mtune=cortex-a78c
1915

2016
ENV compiler_flags="-march=${march} -mcpu=${mcpu} -mtune=${mtune}"
2117

22-
# This is the build that uses OpenBLAS + LLAMAFILE
23-
# RUN PKG_CONFIG_PATH="/opt/OpenBLAS/install/lib/pkgconfig" CMAKE_ARGS="-DGGML_BLAS=ON -DGGML_BLAS_VENDOR=OpenBLAS -DGGML_LLAMAFILE=ON -DCMAKE_C_FLAGS='${compiler_flags}' -DCMAKE_CXX_FLAGS='${compiler_flags}'" pip install -v -e .[server] 2>&1 | tee buildlog.txt
24-
# This is a release build that works
18+
# This is a release build that works (have to disable GGML_LLAMAFILE for Q4_0_4_4 quantization)
2519
RUN CMAKE_ARGS="-DGGML_LLAMAFILE=OFF -DCMAKE_C_FLAGS='${compiler_flags}' -DCMAKE_CXX_FLAGS='${compiler_flags}' -DCMAKE_BUILD_TYPE=Release" pip install -v -e .[server] 2>&1 | tee buildlog.txt
2620

2721
RUN cd /root && pyinstaller -DF /llama_cpp/server/__main__.py \
28-
--add-data /usr/lib/libopenblas.so:. \
2922
--add-data /llama_cpp/lib/libllama.so:llama_cpp/lib \
3023
--add-data /llama_cpp/lib/libggml.so:llama_cpp/lib \
3124
-n llama-cpp-py-server

0 commit comments

Comments
0 (0)
Morty Proxy This is a proxified and sanitized view of the page, visit original site.