Commits

Breadcrumbs

History for

onbatch-processing

User selector

All users

All time

Commit History

Commits on Jan 18, 2024

• Merge branch 'main' into batch-processing

  abetlen

  committed
  850416a

  Copy full SHA for 850416a

Commits on Jan 17, 2024

• Re-order classes in llama.py

  abetlen

  committed
  7b46bb5

  Copy full SHA for 7b46bb5

• Move helper classes to _internals submodule

  abetlen

  committed
  cc4630e

  Copy full SHA for cc4630e

• Move cache classes to llama_cache submodule.

  abetlen

  committed
  3b92419

  Copy full SHA for 3b92419

Commits on Jan 15, 2024

• Merge branch 'main' into batch-processing

  abetlen

  committed
  358593f

  Copy full SHA for 358593f

• Add split_mode option. Closes #1085

  abetlen

  committed
  84615ad

  Copy full SHA for 84615ad

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6

  Copy full SHA for 76aafa6

Commits on Jan 10, 2024

• Use sampling context

  abetlen

  committed
  7f4ba48

  Copy full SHA for 7f4ba48

• Merge branch 'main' into batch-processing

  abetlen

  committed
  456a601

  Copy full SHA for 456a601

• Add ability to pass in penalize_nl param (#1068)

  shankinson

  authored
  df3be58

  Copy full SHA for df3be58

Commits on Jan 5, 2024

• Fix #1038

  abetlen

  committed
  e1cd61e

  Copy full SHA for e1cd61e

• Merge branch 'main' into batch-processing

  abetlen

  committed
  b1e9962

  Copy full SHA for b1e9962

Commits on Dec 22, 2023

• Fix typo

  abetlen

  committed
  d9a1d90

  Copy full SHA for d9a1d90

• server: Support none defaulting to infinity for completions (#111)

  Show description for 4b01a87
  

  swg

  and

  abetlen

  authored
  4b01a87

  Copy full SHA for 4b01a87

• fix text_offset of multi-token characters (#1037)

  Show description for 2f03fb0
  twaka

  authored
  2f03fb0

  Copy full SHA for 2f03fb0

Commits on Dec 18, 2023

• fix: float32 is not JSON serializable when streaming logits.

  abetlen

  committed
  a05b4da

  Copy full SHA for a05b4da

• Fix logits are not json serializable

  abetlen

  committed
  fcbd177

  Copy full SHA for fcbd177

• Merge branch 'main' into batch-processing

  abetlen

  committed
  a625412

  Copy full SHA for a625412

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650

  Copy full SHA for 095c650

• Remove unnused import

  abetlen

  committed
  472b344

  Copy full SHA for 472b344

• perf: Don't convert logprobs arrays to lists (#1021)

  kddubey

  authored
  6b2e0e0

  Copy full SHA for 6b2e0e0

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944df

  Copy full SHA for 62944df

Commits on Dec 16, 2023

• Bug fixed with n_ctx=0 (#1015)

  Show description for f1c631d
  DanieleMorotti

  authored
  f1c631d

  Copy full SHA for f1c631d

• Fix logits_to_logprobs for 2-D and 3-D logits (#1002)

  Show description for 5a89446
  kddubey

  authored
  5a89446

  Copy full SHA for 5a89446

Commits on Dec 12, 2023

• Replace logits_to_logprobs implementation with numpy equivalent to llama.cpp (#991)

  Show description for ef22e47
  player1537

  authored
  ef22e47

  Copy full SHA for ef22e47

• Merge branch 'main' into batch-processing

  abetlen

  committed
  4335a9d

  Copy full SHA for 4335a9d

Commits on Dec 11, 2023

• Remove f16_kv

  abetlen

  committed
  ec26f36

  Copy full SHA for ec26f36

Commits on Nov 30, 2023

• Refactor _create_completion

  abetlen

  committed
  40f2293

  Copy full SHA for 40f2293

Commits on Nov 29, 2023

• Fix #891 (#952)

  kddubey

  authored
  b069d06

  Copy full SHA for b069d06

Commits on Nov 28, 2023

• Add sampling context

  abetlen

  committed
  3a1ba77

  Copy full SHA for 3a1ba77

• Clean up llama.py into seperate modules.

  abetlen

  committed
  3c13436

  Copy full SHA for 3c13436

Commits on Nov 26, 2023

• docs: Update Llama docs

  abetlen

  committed
  6308f21

  Copy full SHA for 6308f21

Commits on Nov 24, 2023

• docs: Update completion and chat_completion parameter docstrings

  abetlen

  committed
  4026166

  Copy full SHA for 4026166

Commits on Nov 23, 2023

• docs: Add Llama class example

  abetlen

  committed
  b6bb7ac

  Copy full SHA for b6bb7ac

Commits on Nov 21, 2023

• Format

  abetlen

  committed
  7a3f878

  Copy full SHA for 7a3f878