Commits

Breadcrumbs

History for

onintegrate-functionary-rebased

User selector

All users

Datepicker

All time

Commit history

Commits on Jan 21, 2024

• fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

  abetlen

  committed
  24f3945View commit details

  Copy full SHA for 24f3945

  View code at this pointBrowse repository at this point

Commits on Jan 19, 2024

• Fix python3.8 support

  abetlen

  committed
  141293aView commit details

  Copy full SHA for 141293a

  View code at this pointBrowse repository at this point

• feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

  abetlen

  committed
  b8fc1c7View commit details

  Copy full SHA for b8fc1c7

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2024

• Offload KQV by default

  abetlen

  committed
  48c3b77View commit details

  Copy full SHA for 48c3b77

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2024

• fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

  K-Mistele

  authored
  9c36688View commit details

  Copy full SHA for 9c36688

  View code at this pointBrowse repository at this point

• Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

  Show description for cfb7da9
  

  3 peopleauthored
  cfb7da9View commit details

  Copy full SHA for cfb7da9

  View code at this pointBrowse repository at this point

Commits on Jan 15, 2024

• Add split_mode option. Closes #1085

  abetlen

  committed
  84615adView commit details

  Copy full SHA for 84615ad

  View code at this pointBrowse repository at this point

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6View commit details

  Copy full SHA for 76aafa6

  View code at this pointBrowse repository at this point

Commits on Dec 22, 2023

• docs: add server config docs

  abetlen

  committed
  522aecbView commit details

  Copy full SHA for 522aecb

  View code at this pointBrowse repository at this point

• server: Support none defaulting to infinity for completions (#111)

  Show description for 4b01a87
  

  swg

  and

  abetlen

  authored
  4b01a87View commit details

  Copy full SHA for 4b01a87

  View code at this pointBrowse repository at this point

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2fView commit details

  Copy full SHA for 12b7f2f

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623View commit details

  Copy full SHA for 33cc623

  View code at this pointBrowse repository at this point

Commits on Dec 18, 2023

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650View commit details

  Copy full SHA for 095c650

  View code at this pointBrowse repository at this point

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944dfView commit details

  Copy full SHA for 62944df

  View code at this pointBrowse repository at this point

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32View commit details

  Copy full SHA for 8e44a32

  View code at this pointBrowse repository at this point

Commits on Nov 24, 2023

• docs: Update openapi endpoint names

  abetlen

  committed
  1a7bf20View commit details

  Copy full SHA for 1a7bf20

  View code at this pointBrowse repository at this point

Commits on Nov 21, 2023

• Fix #569

  abetlen

  committed
  128dc47View commit details

  Copy full SHA for 128dc47

  View code at this pointBrowse repository at this point

• Format

  abetlen

  committed
  7a3f878View commit details

  Copy full SHA for 7a3f878

  View code at this pointBrowse repository at this point

• Add support for logit_bias outside of server api. Closes #827

  abetlen

  committed
  07e47f5View commit details

  Copy full SHA for 07e47f5

  View code at this pointBrowse repository at this point

• Added support for min_p (#921)

  Show description for b8438f7
  tk-master

  authored
  b8438f7View commit details

  Copy full SHA for b8438f7

  View code at this pointBrowse repository at this point

Commits on Nov 10, 2023

• Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

  abetlen

  committed
  e7962d2View commit details

  Copy full SHA for e7962d2

  View code at this pointBrowse repository at this point

Commits on Nov 8, 2023

• Fix destructor NoneType is not callable error

  abetlen

  committed
  ca4cb88View commit details

  Copy full SHA for ca4cb88

  View code at this pointBrowse repository at this point

• Add JSON mode support. Closes #881

  abetlen

  committed
  b30b9c3View commit details

  Copy full SHA for b30b9c3

  View code at this pointBrowse repository at this point

• Add seed parameter support for completion and chat_completion requests. Closes #884

  abetlen

  committed
  86aeb9fView commit details

  Copy full SHA for 86aeb9f

  View code at this pointBrowse repository at this point

• Multimodal Support (Llava 1.5) (#821)

  Show description for aab74f0
  

  damian0815

  and

  abetlen

  authored
  aab74f0View commit details

  Copy full SHA for aab74f0

  View code at this pointBrowse repository at this point

Commits on Nov 3, 2023

• Update llama.cpp

  abetlen

  committed
  df9362eView commit details

  Copy full SHA for df9362e

  View code at this pointBrowse repository at this point

• Add functionary support (#784)

  Show description for 3af7b21
  abetlen

  authored
  3af7b21View commit details

  Copy full SHA for 3af7b21

  View code at this pointBrowse repository at this point

Commits on Nov 2, 2023

• Update llama.cpp

  Show description for fa83cc5
  abetlen

  committed
  fa83cc5View commit details

  Copy full SHA for fa83cc5

  View code at this pointBrowse repository at this point

• fix: tokenization of special characters: (#850)

  Show description for 4d4e0f1
  

  antoine-lizee

  authored and

  abetlen

  committed
  4d4e0f1View commit details

  Copy full SHA for 4d4e0f1

  View code at this pointBrowse repository at this point

Commits on Nov 1, 2023

• Iterate over tokens that should be biased rather than the entire vocabulary. (#851)

  zolastro

  authored
  3fc9147View commit details

  Copy full SHA for 3fc9147

  View code at this pointBrowse repository at this point

• Pass-Through grammar parameter in web server. (#855) Closes #778

  dthuerck

  authored
  5f8f369View commit details

  Copy full SHA for 5f8f369

  View code at this pointBrowse repository at this point

Commits on Oct 18, 2023

• update value check for n_gpu_layers field (#826)

  hxy9243

  authored
  a315128View commit details

  Copy full SHA for a315128

  View code at this pointBrowse repository at this point

Commits on Oct 10, 2023

• Print traceback on server error

  abetlen

  committed
  d6a130aView commit details

  Copy full SHA for d6a130a

  View code at this pointBrowse repository at this point

Commits on Sep 30, 2023

• Log server exceptions to stdout

  abetlen

  committed
  5ef5280View commit details

  Copy full SHA for 5ef5280

  View code at this pointBrowse repository at this point

Commits on Sep 29, 2023

• Update server params

  abetlen

  committed
  d9bce17View commit details

  Copy full SHA for d9bce17

  View code at this pointBrowse repository at this point