Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Commit 3826a8f

Browse filesBrowse files
committed
updated dockerfile
1 parent 8207280 commit 3826a8f
Copy full SHA for 3826a8f

File tree

Expand file treeCollapse file tree

1 file changed

+2
-2
lines changed
Filter options
Expand file treeCollapse file tree

1 file changed

+2
-2
lines changed

‎docker/openblas_simple/Dockerfile

Copy file name to clipboardExpand all lines: docker/openblas_simple/Dockerfile
+2-2Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,10 +6,10 @@ ENV HOST 0.0.0.0
66
COPY . .
77

88
# Install the package
9-
RUN apt update && apt install -y libopenblas-dev ninja-build build-essential
9+
RUN apt update && apt install -y libopenblas-dev ninja-build build-essential pkg-config
1010
RUN python -m pip install --upgrade pip pytest cmake scikit-build setuptools fastapi uvicorn sse-starlette pydantic-settings starlette-context
1111

1212
RUN CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama_cpp_python --verbose
1313

1414
# Run the server
15-
CMD python3 -m llama_cpp.server
15+
CMD python3 -m llama_cpp.server --model $MODLE_PATH --n_ctx $CONTEXT_SIZE

0 commit comments

Comments
0 (0)
Morty Proxy This is a proxified and sanitized view of the page, visit original site.