Fix UnicodeDecodeError permanently#118

Merged

abetlen merged 9 commits intoabetlen:mainfrom

Apr 29, 2023

Commits on Apr 26, 2023

Fix decode errors permanently
Mug
committed
c4a8491
Copy full SHA for c4a8491
Merge branch 'main' of https://github.com/abetlen/llama-cpp-python
Mug
committed
be2c961
Copy full SHA for be2c961
Remove try catch from chat
Mug
committed
3c130f0
Copy full SHA for 3c130f0
Also ignore errors on input prompts
Mug
committed
5f81400
Copy full SHA for 5f81400

Commits on Apr 28, 2023

Detect multi-byte responses and wait
Mug
committed
c39547a
Copy full SHA for c39547a
One day, i'll fix off by 1 errors permanently too
Mug
committed
3a98747
Copy full SHA for 3a98747
Dont detect off tokens, detect off detokenized utf8
Mug
committed
eed6128
Copy full SHA for eed6128
Python weirdness
Mug
committed
b7d14ef
Copy full SHA for b7d14ef

Commits on Apr 29, 2023

Remove excessive errors="ignore" and add utf8 test
Mug
committed
18a0c10
Copy full SHA for 18a0c10