Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on May 14, 2024

• feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)

  Show description for 5212fb0
  twaka

  authored
  5212fb0

  Copy full SHA for 5212fb0

Commits on May 5, 2024

• feat(server): Add support for setting root_path. Closes #1420

  abetlen

  committed
  0318702

  Copy full SHA for 0318702

Commits on Apr 17, 2024

• feat: add `disable_ping_events` flag (#1257)

  Show description for b73c73c
  khimaros

  authored
  b73c73c

  Copy full SHA for b73c73c

Commits on Apr 10, 2024

• feat: Add support for yaml based configs

  abetlen

  committed
  060bfa6

  Copy full SHA for 060bfa6

Commits on Mar 31, 2024

• feat: Add logprobs support to chat completions (#1311)

  Show description for aa9f1ae
  

  windspirit95

  and

  abetlen

  authored
  aa9f1ae

  Copy full SHA for aa9f1ae

Commits on Mar 23, 2024

• fix(server): minor type fixes

  abetlen

  committed
  d11ccc3

  Copy full SHA for d11ccc3

Commits on Mar 19, 2024

• docs: Add chat examples to openapi ui

  abetlen

  committed
  f7decc9

  Copy full SHA for f7decc9

Commits on Mar 9, 2024

• feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

  Show description for c139f8b
  

  felipelo

  and

  abetlen

  authored
  c139f8b

  Copy full SHA for c139f8b

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60c

  Copy full SHA for 727d60c

Commits on Feb 15, 2024

• fix: Use '\n' seperator for EventSourceResponse (#1188)

  Show description for ea1f88d
  

  khimaros

  and

  abetlen

  authored
  ea1f88d

  Copy full SHA for ea1f88d

Commits on Jan 25, 2024

• feat(server): include llama-cpp-python version in openapi spec

  abetlen

  committed
  cde7514

  Copy full SHA for cde7514

Commits on Jan 16, 2024

• Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

  Show description for cfb7da9
  

  3 peopleauthored
  cfb7da9

  Copy full SHA for cfb7da9

Commits on Dec 22, 2023

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623

  Copy full SHA for 33cc623

Commits on Dec 18, 2023

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650

  Copy full SHA for 095c650

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944df

  Copy full SHA for 62944df

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32

  Copy full SHA for 8e44a32

Commits on Nov 24, 2023

• docs: Update openapi endpoint names

  abetlen

  committed
  1a7bf20

  Copy full SHA for 1a7bf20

Commits on Nov 21, 2023

• Fix #569

  abetlen

  committed
  128dc47

  Copy full SHA for 128dc47

• Format

  abetlen

  committed
  7a3f878

  Copy full SHA for 7a3f878

• Add support for logit_bias outside of server api. Closes #827

  abetlen

  committed
  07e47f5

  Copy full SHA for 07e47f5

• Added support for min_p (#921)

  Show description for b8438f7
  tk-master

  authored
  b8438f7

  Copy full SHA for b8438f7

Commits on Nov 10, 2023

• Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

  abetlen

  committed
  e7962d2

  Copy full SHA for e7962d2

Commits on Nov 8, 2023

• Fix destructor NoneType is not callable error

  abetlen

  committed
  ca4cb88

  Copy full SHA for ca4cb88

• Add JSON mode support. Closes #881

  abetlen

  committed
  b30b9c3

  Copy full SHA for b30b9c3

• Add seed parameter support for completion and chat_completion requests. Closes #884

  abetlen

  committed
  86aeb9f

  Copy full SHA for 86aeb9f

• Multimodal Support (Llava 1.5) (#821)

  Show description for aab74f0
  

  damian0815

  and

  abetlen

  authored
  aab74f0

  Copy full SHA for aab74f0

Commits on Nov 3, 2023

• Update llama.cpp

  abetlen

  committed
  df9362e

  Copy full SHA for df9362e

• Add functionary support (#784)

  Show description for 3af7b21
  abetlen

  authored
  3af7b21

  Copy full SHA for 3af7b21

Commits on Nov 2, 2023

• Update llama.cpp

  Show description for fa83cc5
  abetlen

  committed
  fa83cc5

  Copy full SHA for fa83cc5

• fix: tokenization of special characters: (#850)

  Show description for 4d4e0f1
  

  antoine-lizee

  authored and

  abetlen

  committed
  4d4e0f1

  Copy full SHA for 4d4e0f1

Commits on Nov 1, 2023

• Iterate over tokens that should be biased rather than the entire vocabulary. (#851)

  zolastro

  authored
  3fc9147

  Copy full SHA for 3fc9147

• Pass-Through grammar parameter in web server. (#855) Closes #778

  dthuerck

  authored
  5f8f369

  Copy full SHA for 5f8f369

Commits on Oct 18, 2023

• update value check for n_gpu_layers field (#826)

  hxy9243

  authored
  a315128

  Copy full SHA for a315128

Commits on Oct 10, 2023

• Print traceback on server error

  abetlen

  committed
  d6a130a

  Copy full SHA for d6a130a