Commits

Breadcrumbs

History for

onupdate-sampling-api

User selector

All users

All time

Commit History

Commits on Aug 29, 2024

• feat: Add server chat_format minicpm-v-2.6 for MiniCPMv26ChatHandler

  abetlen

  committed
  97d527e

  Copy full SHA for 97d527e

Commits on Jul 17, 2024

• fix(server): Use split_mode from model settings (#1594)

  Show description for 66d5cdd
  

  grider-withourai

  and

  abetlen

  authored
  66d5cdd

  Copy full SHA for 66d5cdd

Commits on Jul 9, 2024

• fix(misc): Format

  abetlen

  committed
  c1ae815

  Copy full SHA for c1ae815

Commits on Jul 2, 2024

• fix(misc): Fix type errors

  abetlen

  committed
  387d01d

  Copy full SHA for 387d01d

• fix(server): Fix bug in FastAPI streaming response where dependency was released before request completes causing SEGFAULT

  abetlen

  committed
  296304b

  Copy full SHA for 296304b

• fix(server): Update `embeddings=False` by default. Embeddings should be enabled by default for embedding models.

  abetlen

  committed
  bf5e0bb

  Copy full SHA for bf5e0bb

Commits on Jun 13, 2024

• feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)

  Show description for 320a5d7
  

  jkawamoto

  and

  abetlen

  authored
  320a5d7

  Copy full SHA for 320a5d7

Commits on Jun 4, 2024

• feat: adding `rpc_servers` parameter to `Llama` class (#1477)

  Show description for d634efc
  

  chraac

  and

  abetlen

  authored
  d634efc

  Copy full SHA for d634efc

Commits on May 29, 2024

• fix: fix string value kv_overrides. Closes #1487

  abetlen

  committed
  df45a4b

  Copy full SHA for df45a4b

Commits on May 14, 2024

• feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)

  Show description for 5212fb0
  twaka

  authored
  5212fb0

  Copy full SHA for 5212fb0

Commits on May 5, 2024

• feat(server): Add support for setting root_path. Closes #1420

  abetlen

  committed
  0318702

  Copy full SHA for 0318702

Commits on May 3, 2024

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  f9b7221

  Copy full SHA for f9b7221

• feat(server): Remove temperature bounds checks for server. Closes #1384

  abetlen

  committed
  0a454be

  Copy full SHA for 0a454be

• fix(server): Propagate `flash_attn` to model load. (#1424)

  dthuerck

  authored
  2138561

  Copy full SHA for 2138561

Commits on May 2, 2024

• feat: Add llama-3-vision-alpha chat format

  abetlen

  committed
  31b1d95

  Copy full SHA for 31b1d95

Commits on Apr 30, 2024

• feat: Add option to enable `flash_attn` to Lllama params and ModelSettings

  abetlen

  committed
  22d77ee

  Copy full SHA for 22d77ee

• feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)

  Show description for fe2da09
  abetlen

  authored
  fe2da09

  Copy full SHA for fe2da09

Commits on Apr 26, 2024

• fix: pydantic deprecation warning

  abetlen

  committed
  fcfea66

  Copy full SHA for fcfea66

Commits on Apr 23, 2024

• feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)

  sean-bailey

  authored
  53ebcc8

  Copy full SHA for 53ebcc8

Commits on Apr 17, 2024

• feat: add `disable_ping_events` flag (#1257)

  Show description for b73c73c
  khimaros

  authored
  b73c73c

  Copy full SHA for b73c73c

• feat: Use all available CPUs for batch processing (#1345)

  

  ddh0

  authored and

  abetlen

  committed
  c96b2da

  Copy full SHA for c96b2da

Commits on Apr 10, 2024

• feat: Add support for yaml based configs

  abetlen

  committed
  060bfa6

  Copy full SHA for 060bfa6

Commits on Apr 1, 2024

• feat: add support for KV cache quantization options (#1307)

  Show description for f165048
  

  Limour-dev

  and

  abetlen

  authored
  f165048

  Copy full SHA for f165048

Commits on Mar 31, 2024

• feat: Add logprobs support to chat completions (#1311)

  Show description for aa9f1ae
  

  windspirit95

  and

  abetlen

  authored
  aa9f1ae

  Copy full SHA for aa9f1ae

Commits on Mar 23, 2024

• fix(server): minor type fixes

  abetlen

  committed
  d11ccc3

  Copy full SHA for d11ccc3

Commits on Mar 19, 2024

• docs: Add chat examples to openapi ui

  abetlen

  committed
  f7decc9

  Copy full SHA for f7decc9

Commits on Mar 9, 2024

• feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

  Show description for c139f8b
  

  felipelo

  and

  abetlen

  authored
  c139f8b

  Copy full SHA for c139f8b

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60c

  Copy full SHA for 727d60c

• feat: Update llama.cpp

  abetlen

  committed
  0d37ce5

  Copy full SHA for 0d37ce5

Commits on Feb 26, 2024

• feat(server): Add support for pulling models from Huggingface Hub (#1222)

  Show description for 4d574bd
  abetlen

  authored
  4d574bd

  Copy full SHA for 4d574bd

• fix: remove prematurely commited change

  abetlen

  committed
  dcf38f6

  Copy full SHA for dcf38f6

Commits on Feb 25, 2024

• feat: Update llama.cpp

  abetlen

  committed
  2292af5

  Copy full SHA for 2292af5

Commits on Feb 17, 2024

• feat: Update llama.cpp

  abetlen

  committed
  fdce078

  Copy full SHA for fdce078

Commits on Feb 15, 2024

• fix: Use '\n' seperator for EventSourceResponse (#1188)

  Show description for ea1f88d
  

  khimaros

  and

  abetlen

  authored
  ea1f88d

  Copy full SHA for ea1f88d

Commits on Feb 8, 2024

• fix: broken import

  abetlen

  committed
  85d3374

  Copy full SHA for 85d3374