Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60cView commit details

  Copy full SHA for 727d60c

  View code at this pointBrowse repository at this point

• feat: Update llama.cpp

  abetlen

  committed
  0d37ce5View commit details

  Copy full SHA for 0d37ce5

  View code at this pointBrowse repository at this point

Commits on Feb 26, 2024

• feat(server): Add support for pulling models from Huggingface Hub (#1222)

  Show description for 4d574bd
  abetlen

  authored
  4d574bdView commit details

  Copy full SHA for 4d574bd

  View code at this pointBrowse repository at this point

• fix: remove prematurely commited change

  abetlen

  committed
  dcf38f6View commit details

  Copy full SHA for dcf38f6

  View code at this pointBrowse repository at this point

Commits on Feb 25, 2024

• feat: Update llama.cpp

  abetlen

  committed
  2292af5View commit details

  Copy full SHA for 2292af5

  View code at this pointBrowse repository at this point

Commits on Feb 17, 2024

• feat: Update llama.cpp

  abetlen

  committed
  fdce078View commit details

  Copy full SHA for fdce078

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2024

• fix: Use '\n' seperator for EventSourceResponse (#1188)

  Show description for ea1f88d
  

  khimaros

  and

  abetlen

  authored
  ea1f88dView commit details

  Copy full SHA for ea1f88d

  View code at this pointBrowse repository at this point

Commits on Feb 8, 2024

• fix: broken import

  abetlen

  committed
  85d3374View commit details

  Copy full SHA for 85d3374

  View code at this pointBrowse repository at this point

• feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

  Show description for 9018270
  

  jeffrey-fong

  and

  abetlen

  authored
  9018270View commit details

  Copy full SHA for 9018270

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2024

• Add speculative decoding (#1120)

  Show description for fb762a6
  abetlen

  authored
  fb762a6View commit details

  Copy full SHA for fb762a6

  View code at this pointBrowse repository at this point

Commits on Jan 29, 2024

• Automatically set chat format from gguf (#1110)

  Show description for da003d8
  abetlen

  authored
  da003d8View commit details

  Copy full SHA for da003d8

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2024

• feat(server): include llama-cpp-python version in openapi spec

  abetlen

  committed
  cde7514View commit details

  Copy full SHA for cde7514

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2024

• fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

  abetlen

  committed
  24f3945View commit details

  Copy full SHA for 24f3945

  View code at this pointBrowse repository at this point

Commits on Jan 19, 2024

• Fix python3.8 support

  abetlen

  committed
  141293aView commit details

  Copy full SHA for 141293a

  View code at this pointBrowse repository at this point

• feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

  abetlen

  committed
  b8fc1c7View commit details

  Copy full SHA for b8fc1c7

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2024

• Offload KQV by default

  abetlen

  committed
  48c3b77View commit details

  Copy full SHA for 48c3b77

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2024

• fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

  K-Mistele

  authored
  9c36688View commit details

  Copy full SHA for 9c36688

  View code at this pointBrowse repository at this point

• Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

  Show description for cfb7da9
  

  3 peopleauthored
  cfb7da9View commit details

  Copy full SHA for cfb7da9

  View code at this pointBrowse repository at this point

Commits on Jan 15, 2024

• Add split_mode option. Closes #1085

  abetlen

  committed
  84615adView commit details

  Copy full SHA for 84615ad

  View code at this pointBrowse repository at this point

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6View commit details

  Copy full SHA for 76aafa6

  View code at this pointBrowse repository at this point

Commits on Dec 22, 2023

• docs: add server config docs

  abetlen

  committed
  522aecbView commit details

  Copy full SHA for 522aecb

  View code at this pointBrowse repository at this point

• server: Support none defaulting to infinity for completions (#111)

  Show description for 4b01a87
  

  swg

  and

  abetlen

  authored
  4b01a87View commit details

  Copy full SHA for 4b01a87

  View code at this pointBrowse repository at this point

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2fView commit details

  Copy full SHA for 12b7f2f

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623View commit details

  Copy full SHA for 33cc623

  View code at this pointBrowse repository at this point

Commits on Dec 18, 2023

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650View commit details

  Copy full SHA for 095c650

  View code at this pointBrowse repository at this point

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944dfView commit details

  Copy full SHA for 62944df

  View code at this pointBrowse repository at this point

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32View commit details

  Copy full SHA for 8e44a32

  View code at this pointBrowse repository at this point

Commits on Nov 24, 2023

• docs: Update openapi endpoint names

  abetlen

  committed
  1a7bf20View commit details

  Copy full SHA for 1a7bf20

  View code at this pointBrowse repository at this point

Commits on Nov 21, 2023

• Fix #569

  abetlen

  committed
  128dc47View commit details

  Copy full SHA for 128dc47

  View code at this pointBrowse repository at this point

• Format

  abetlen

  committed
  7a3f878View commit details

  Copy full SHA for 7a3f878

  View code at this pointBrowse repository at this point

• Add support for logit_bias outside of server api. Closes #827

  abetlen

  committed
  07e47f5View commit details

  Copy full SHA for 07e47f5

  View code at this pointBrowse repository at this point

• Added support for min_p (#921)

  Show description for b8438f7
  tk-master

  authored
  b8438f7View commit details

  Copy full SHA for b8438f7

  View code at this pointBrowse repository at this point

Commits on Nov 10, 2023

• Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

  abetlen

  committed
  e7962d2View commit details

  Copy full SHA for e7962d2

  View code at this pointBrowse repository at this point

Commits on Nov 8, 2023

• Fix destructor NoneType is not callable error

  abetlen

  committed
  ca4cb88View commit details

  Copy full SHA for ca4cb88

  View code at this pointBrowse repository at this point

• Add JSON mode support. Closes #881

  abetlen

  committed
  b30b9c3View commit details

  Copy full SHA for b30b9c3

  View code at this pointBrowse repository at this point