Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Commit 832636c

Browse filesBrowse files
committed
Update build args
- Set CC / CXX for cmmake build - Make sure python3.9-dev installed (needed for linking w/ pyinstaller into standalone) - Set CMAKE_BUILD_TYPE as env var instead of as cmake var (based on build logs)
1 parent 524ae21 commit 832636c
Copy full SHA for 832636c

File tree

Expand file treeCollapse file tree

1 file changed

+6
-2
lines changed
Filter options
Expand file treeCollapse file tree

1 file changed

+6
-2
lines changed

‎Dockerfile

Copy file name to clipboardExpand all lines: Dockerfile
+6-2Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ RUN echo "Glibc version:\n" && /lib/aarch64-linux-gnu/libc.so.6
88

99
RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y \
1010
--no-install-recommends ninja-build pkg-config python3.9 \
11-
python3-pip git
11+
python3.9-dev python3-pip git
1212

1313
# Install toolchain (GCC 11)
1414
RUN DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends software-properties-common && \
@@ -34,8 +34,12 @@ ENV mtune=cortex-a78c
3434
ENV compiler_flags="-march=${march} -mcpu=${mcpu} -mtune=${mtune}"
3535

3636
# This is a release build that works (have to disable GGML_LLAMAFILE for Q4_0_4_4 quantization)
37-
RUN CMAKE_ARGS="-DGGML_LLAMAFILE=OFF -DCMAKE_C_FLAGS='${compiler_flags}' -DCMAKE_CXX_FLAGS='${compiler_flags}' -DCMAKE_BUILD_TYPE=Release" python3.9 -m pip install -v -e .[server] 2>&1 | tee buildlog.txt
37+
RUN CC=gcc-11 CXX=g++-11 CMAKE_BUILD_TYPE=Release \
38+
CMAKE_ARGS="-DGGML_LLAMAFILE=OFF -DCMAKE_C_FLAGS='${compiler_flags}' -DCMAKE_CXX_FLAGS='${compiler_flags}'" \
39+
python3.9 -m pip install -v -e .[server] 2>&1 | tee buildlog.txt
3840

41+
# TODO: Export buildlog.txt in `make deploy.docker` step for review after
42+
# building.
3943
RUN cd /root && pyinstaller -DF /llama_cpp/server/__main__.py \
4044
--add-data /llama_cpp/lib/libllama.so:llama_cpp/lib \
4145
--add-data /llama_cpp/lib/libggml.so:llama_cpp/lib \

0 commit comments

Comments
0 (0)
Morty Proxy This is a proxified and sanitized view of the page, visit original site.