Commits

Breadcrumbs

History for

onbatch-processing

User selector

All users

All time

Commit History

Commits on Jan 16, 2024

• fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

  K-Mistele

  authored
  9c36688

  Copy full SHA for 9c36688

• Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

  Show description for cfb7da9
  

  3 peopleauthored
  cfb7da9

  Copy full SHA for cfb7da9

Commits on Jan 15, 2024

• Add split_mode option. Closes #1085

  abetlen

  committed
  84615ad

  Copy full SHA for 84615ad

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6

  Copy full SHA for 76aafa6

Commits on Dec 22, 2023

• docs: add server config docs

  abetlen

  committed
  522aecb

  Copy full SHA for 522aecb

• server: Support none defaulting to infinity for completions (#111)

  Show description for 4b01a87
  

  swg

  and

  abetlen

  authored
  4b01a87

  Copy full SHA for 4b01a87

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623

  Copy full SHA for 33cc623

Commits on Dec 18, 2023

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650

  Copy full SHA for 095c650

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944df

  Copy full SHA for 62944df

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32

  Copy full SHA for 8e44a32

Commits on Nov 24, 2023

• docs: Update openapi endpoint names

  abetlen

  committed
  1a7bf20

  Copy full SHA for 1a7bf20

Commits on Nov 21, 2023

• Fix #569

  abetlen

  committed
  128dc47

  Copy full SHA for 128dc47

• Format

  abetlen

  committed
  7a3f878

  Copy full SHA for 7a3f878

• Add support for logit_bias outside of server api. Closes #827

  abetlen

  committed
  07e47f5

  Copy full SHA for 07e47f5

• Added support for min_p (#921)

  Show description for b8438f7
  tk-master

  authored
  b8438f7

  Copy full SHA for b8438f7

Commits on Nov 10, 2023

• Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

  abetlen

  committed
  e7962d2

  Copy full SHA for e7962d2

Commits on Nov 8, 2023

• Fix destructor NoneType is not callable error

  abetlen

  committed
  ca4cb88

  Copy full SHA for ca4cb88

• Add JSON mode support. Closes #881

  abetlen

  committed
  b30b9c3

  Copy full SHA for b30b9c3

• Add seed parameter support for completion and chat_completion requests. Closes #884

  abetlen

  committed
  86aeb9f

  Copy full SHA for 86aeb9f

• Multimodal Support (Llava 1.5) (#821)

  Show description for aab74f0
  

  damian0815

  and

  abetlen

  authored
  aab74f0

  Copy full SHA for aab74f0

Commits on Nov 3, 2023

• Update llama.cpp

  abetlen

  committed
  df9362e

  Copy full SHA for df9362e

• Add functionary support (#784)

  Show description for 3af7b21
  abetlen

  authored
  3af7b21

  Copy full SHA for 3af7b21

Commits on Nov 2, 2023

• Update llama.cpp

  Show description for fa83cc5
  abetlen

  committed
  fa83cc5

  Copy full SHA for fa83cc5

• fix: tokenization of special characters: (#850)

  Show description for 4d4e0f1
  

  antoine-lizee

  authored and

  abetlen

  committed
  4d4e0f1

  Copy full SHA for 4d4e0f1

Commits on Nov 1, 2023

• Iterate over tokens that should be biased rather than the entire vocabulary. (#851)

  zolastro

  authored
  3fc9147

  Copy full SHA for 3fc9147

• Pass-Through grammar parameter in web server. (#855) Closes #778

  dthuerck

  authored
  5f8f369

  Copy full SHA for 5f8f369

Commits on Oct 18, 2023

• update value check for n_gpu_layers field (#826)

  hxy9243

  authored
  a315128

  Copy full SHA for a315128

Commits on Oct 10, 2023

• Print traceback on server error

  abetlen

  committed
  d6a130a

  Copy full SHA for d6a130a

Commits on Sep 30, 2023

• Log server exceptions to stdout

  abetlen

  committed
  5ef5280

  Copy full SHA for 5ef5280

Commits on Sep 29, 2023

• Update server params

  abetlen

  committed
  d9bce17

  Copy full SHA for d9bce17

Commits on Sep 25, 2023

• Adds openai-processing-ms response header (#748)

  

  Viacheslav/Slava Tradunsky

  authored
  3d5e5b1

  Copy full SHA for 3d5e5b1

Commits on Sep 15, 2023

• Remove confusing helpstring from server cli args. Closes #719

  abetlen

  committed
  b047b30

  Copy full SHA for b047b30

Commits on Sep 14, 2023

• Fix boolean env vars and cli arguments

  abetlen

  committed
  0449d29

  Copy full SHA for 0449d29

• Update app.py (#705)

  earonesty

  authored
  58a6e42

  Copy full SHA for 58a6e42