Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Jan 8, 2025

• fix: streaming resource lock (#1879)

  Show description for e8f14ce
  

  gjpower

  and

  abetlen

  authored
  e8f14ceView commit details

  Copy full SHA for e8f14ce

  View code at this pointBrowse repository at this point

Commits on Dec 9, 2024

• fix: add missing await statements for async exit_stack handling (#1858)

  gjpower

  authored
  afedfc8View commit details

  Copy full SHA for afedfc8

  View code at this pointBrowse repository at this point

Commits on Dec 6, 2024

• fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context (#1798)

  Show description for 9bd0c95
  

  gjpower

  and

  abetlen

  authored
  9bd0c95View commit details

  Copy full SHA for 9bd0c95

  View code at this pointBrowse repository at this point

• fix: added missing exit_stack.close() to /v1/chat/completions (#1796)

  Show description for 073b7e4
  Ian321

  authored
  073b7e4View commit details

  Copy full SHA for 073b7e4

  View code at this pointBrowse repository at this point

Commits on Jul 9, 2024

• fix(misc): Format

  abetlen

  committed
  c1ae815View commit details

  Copy full SHA for c1ae815

  View code at this pointBrowse repository at this point

Commits on Jul 2, 2024

• fix(misc): Fix type errors

  abetlen

  committed
  387d01dView commit details

  Copy full SHA for 387d01d

  View code at this pointBrowse repository at this point

• fix(server): Fix bug in FastAPI streaming response where dependency was released before request completes causing SEGFAULT

  abetlen

  committed
  296304bView commit details

  Copy full SHA for 296304b

  View code at this pointBrowse repository at this point

Commits on May 14, 2024

• feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)

  Show description for 5212fb0
  twaka

  authored
  5212fb0View commit details

  Copy full SHA for 5212fb0

  View code at this pointBrowse repository at this point

Commits on May 5, 2024

• feat(server): Add support for setting root_path. Closes #1420

  abetlen

  committed
  0318702View commit details

  Copy full SHA for 0318702

  View code at this pointBrowse repository at this point

Commits on Apr 17, 2024

• feat: add `disable_ping_events` flag (#1257)

  Show description for b73c73c
  khimaros

  authored
  b73c73cView commit details

  Copy full SHA for b73c73c

  View code at this pointBrowse repository at this point

Commits on Apr 10, 2024

• feat: Add support for yaml based configs

  abetlen

  committed
  060bfa6View commit details

  Copy full SHA for 060bfa6

  View code at this pointBrowse repository at this point

Commits on Mar 31, 2024

• feat: Add logprobs support to chat completions (#1311)

  Show description for aa9f1ae
  

  windspirit95

  and

  abetlen

  authored
  aa9f1aeView commit details

  Copy full SHA for aa9f1ae

  View code at this pointBrowse repository at this point

Commits on Mar 23, 2024

• fix(server): minor type fixes

  abetlen

  committed
  d11ccc3View commit details

  Copy full SHA for d11ccc3

  View code at this pointBrowse repository at this point

Commits on Mar 19, 2024

• docs: Add chat examples to openapi ui

  abetlen

  committed
  f7decc9View commit details

  Copy full SHA for f7decc9

  View code at this pointBrowse repository at this point

Commits on Mar 9, 2024

• feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

  Show description for c139f8b
  

  felipelo

  and

  abetlen

  authored
  c139f8bView commit details

  Copy full SHA for c139f8b

  View code at this pointBrowse repository at this point

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60cView commit details

  Copy full SHA for 727d60c

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2024

• fix: Use '\n' seperator for EventSourceResponse (#1188)

  Show description for ea1f88d
  

  khimaros

  and

  abetlen

  authored
  ea1f88dView commit details

  Copy full SHA for ea1f88d

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2024

• feat(server): include llama-cpp-python version in openapi spec

  abetlen

  committed
  cde7514View commit details

  Copy full SHA for cde7514

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2024

• Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

  Show description for cfb7da9
  

  3 peopleauthored
  cfb7da9View commit details

  Copy full SHA for cfb7da9

  View code at this pointBrowse repository at this point

Commits on Dec 22, 2023

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2fView commit details

  Copy full SHA for 12b7f2f

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623View commit details

  Copy full SHA for 33cc623

  View code at this pointBrowse repository at this point

Commits on Dec 18, 2023

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650View commit details

  Copy full SHA for 095c650

  View code at this pointBrowse repository at this point

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944dfView commit details

  Copy full SHA for 62944df

  View code at this pointBrowse repository at this point

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32View commit details

  Copy full SHA for 8e44a32

  View code at this pointBrowse repository at this point

Commits on Nov 24, 2023

• docs: Update openapi endpoint names

  abetlen

  committed
  1a7bf20View commit details

  Copy full SHA for 1a7bf20

  View code at this pointBrowse repository at this point

Commits on Nov 21, 2023

• Fix #569

  abetlen

  committed
  128dc47View commit details

  Copy full SHA for 128dc47

  View code at this pointBrowse repository at this point

• Format

  abetlen

  committed
  7a3f878View commit details

  Copy full SHA for 7a3f878

  View code at this pointBrowse repository at this point

• Add support for logit_bias outside of server api. Closes #827

  abetlen

  committed
  07e47f5View commit details

  Copy full SHA for 07e47f5

  View code at this pointBrowse repository at this point

• Added support for min_p (#921)

  Show description for b8438f7
  tk-master

  authored
  b8438f7View commit details

  Copy full SHA for b8438f7

  View code at this pointBrowse repository at this point

Commits on Nov 10, 2023

• Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

  abetlen

  committed
  e7962d2View commit details

  Copy full SHA for e7962d2

  View code at this pointBrowse repository at this point

Commits on Nov 8, 2023

• Fix destructor NoneType is not callable error

  abetlen

  committed
  ca4cb88View commit details

  Copy full SHA for ca4cb88

  View code at this pointBrowse repository at this point

• Add JSON mode support. Closes #881

  abetlen

  committed
  b30b9c3View commit details

  Copy full SHA for b30b9c3

  View code at this pointBrowse repository at this point

• Add seed parameter support for completion and chat_completion requests. Closes #884

  abetlen

  committed
  86aeb9fView commit details

  Copy full SHA for 86aeb9f

  View code at this pointBrowse repository at this point

• Multimodal Support (Llava 1.5) (#821)

  Show description for aab74f0
  

  damian0815

  and

  abetlen

  authored
  aab74f0View commit details

  Copy full SHA for aab74f0

  View code at this pointBrowse repository at this point

Commits on Nov 3, 2023

• Update llama.cpp

  abetlen

  committed
  df9362eView commit details

  Copy full SHA for df9362e

  View code at this pointBrowse repository at this point