Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Commit c01fe01

Browse filesBrowse files
author
juanroesel
committed
Added instructions to sync with upstream repo
1 parent e9f4a68 commit c01fe01
Copy full SHA for c01fe01

File tree

Expand file treeCollapse file tree

1 file changed

+29
-0
lines changed
Filter options
Expand file treeCollapse file tree

1 file changed

+29
-0
lines changed

‎INSTRUCTIONS.md

Copy file name to clipboard
+29Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
## Syncing with upstream repo
2+
3+
See [here](https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork#syncing-a-fork-branch-from-the-web-ui) for more details.
4+
5+
1. On the GitHub UI, create a new branch `repo-sync`, if the branch doesn't exist already.
6+
7+
2. Click on the "Sync fork" button and then click on the "Update branch" button. This will import all the commits from the upstream repo.
8+
9+
3. Create a local branch `repo-sync` and pull the contents from the remote `repo-sync` branch.
10+
11+
4. Solve for any conflicts if they arise. Otherwise, proceed to the next step.
12+
13+
5. Since changes have probably been made to the vendor libraries (`llama_cpp`, `kompute`), we need to recompile the `llama_cpp` package. Navigate to the `vendor/llama.cpp` folder and clean the build cache:
14+
15+
```
16+
make clean
17+
```
18+
6. Navigate back to the root directory and type the following to recompile the `llama_cpp` package and build the dependenies again:
19+
20+
```
21+
make deps && make build
22+
```
23+
7. Launch the `llama_cpp_python` server using the following command:
24+
```
25+
python -m llama_cpp.server --model $MODEL --n_gpu_layers -1
26+
```
27+
NOTE: Modify the launch arguments as needed. Make sure the `MODEL` environment variable points to an absolute path containing a `.gguf` model.
28+
29+
8. If the server launches without issues, then you can proceed to create a PR with the latest changes

0 commit comments

Comments
0 (0)
Morty Proxy This is a proxified and sanitized view of the page, visit original site.