Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Apr 23, 2024

• chore: Bump version

  abetlen

  committed
  c50d330

  Copy full SHA for c50d330

• feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)

  sean-bailey

  authored
  53ebcc8

  Copy full SHA for 53ebcc8

• feat: Add Llama-3 chat format (#1371)

  Show description for 8559e8c
  

  andreabak

  and

  abetlen

  authored
  8559e8c

  Copy full SHA for 8559e8c

Commits on Apr 22, 2024

• feat: Use new llama_token_is_eog in create_completions

  abetlen

  committed
  d40a250

  Copy full SHA for d40a250

• Merge branch 'main' of https://github.com/abetlen/llama-cpp-python into main

  abetlen

  committed
  b21ba0e

  Copy full SHA for b21ba0e

• feat: Update llama.cpp

  abetlen

  committed
  159cc4e

  Copy full SHA for 159cc4e

Commits on Apr 20, 2024

• chore: Bump version

  abetlen

  committed
  0281214

  Copy full SHA for 0281214

• feat: Add stopping_criteria to ChatFormatter, allow stopping on arbitrary token ids, fixes llama3 instruct

  abetlen

  committed
  cc81afe

  Copy full SHA for cc81afe

Commits on Apr 18, 2024

• chore: Bump version

  abetlen

  committed
  893a27a

  Copy full SHA for 893a27a

• feat: update grammar schema converter to match llama.cpp (#1353)

  Show description for 4f42664
  themrzmaster

  authored
  4f42664

  Copy full SHA for 4f42664

Commits on Apr 17, 2024

• Revert "feat: Update json to grammar (#1350)"

  Show description for fa4bb0c
  abetlen

  committed
  fa4bb0c

  Copy full SHA for fa4bb0c

• feat: Update json to grammar (#1350)

  Show description for 610a592
  themrzmaster

  authored
  610a592

  Copy full SHA for 610a592

• feat: add `disable_ping_events` flag (#1257)

  Show description for b73c73c
  khimaros

  authored
  b73c73c

  Copy full SHA for b73c73c

• feat: Make saved state more compact on-disk (#1296)

  Show description for 4924455
  tc-wolf

  authored
  4924455

  Copy full SHA for 4924455

• feat: Use all available CPUs for batch processing (#1345)

  

  ddh0

  authored and

  abetlen

  committed
  c96b2da

  Copy full SHA for c96b2da

Commits on Apr 10, 2024

• chore: Bump version

  abetlen

  committed
  ef29235

  Copy full SHA for ef29235

• fix: pass correct type to chat handlers for chat completion logprobs

  abetlen

  committed
  bb65b4d

  Copy full SHA for bb65b4d

• feat: Add support for yaml based configs

  abetlen

  committed
  060bfa6

  Copy full SHA for 060bfa6

• feat: Add typechecking for ctypes structure attributes

  abetlen

  committed
  1347e1d

  Copy full SHA for 1347e1d

• feat: Update llama.cpp

  abetlen

  committed
  889d0e8

  Copy full SHA for 889d0e8

Commits on Apr 9, 2024

• feat: Update llama.cpp

  abetlen

  committed
  56071c9

  Copy full SHA for 56071c9

Commits on Apr 6, 2024

• chore: Bump version

  abetlen

  committed
  08b16af

  Copy full SHA for 08b16af

Commits on Apr 5, 2024

• fix: missing logprobs in response, incorrect response type for functionary, minor type issues. Closes #1328 Closes #1314

  abetlen

  committed
  1ae3abb

  Copy full SHA for 1ae3abb

Commits on Apr 3, 2024

• chore: Bump version

  abetlen

  committed
  34081dd

  Copy full SHA for 34081dd

• fix: segfault when logits_all=False. Closes #1319

  abetlen

  committed
  8649d76

  Copy full SHA for 8649d76

Commits on Apr 1, 2024

• fix: last tokens passing to sample_repetition_penalties function (#1295)

  Show description for 62aad61
  

  3 peopleauthored
  62aad61

  Copy full SHA for 62aad61

• chore: Bump version

  abetlen

  committed
  45bf5ae

  Copy full SHA for 45bf5ae

• feat: add support for KV cache quantization options (#1307)

  Show description for f165048
  

  Limour-dev

  and

  abetlen

  authored
  f165048

  Copy full SHA for f165048

Commits on Mar 31, 2024

• feat: Add logprobs support to chat completions (#1311)

  Show description for aa9f1ae
  

  windspirit95

  and

  abetlen

  authored
  aa9f1ae

  Copy full SHA for aa9f1ae

Commits on Mar 28, 2024

• feat: Update llama.cpp

  abetlen

  committed
  125b235

  Copy full SHA for 125b235

Commits on Mar 27, 2024

• feat: Update llama.cpp

  abetlen

  committed
  901fe02

  Copy full SHA for 901fe02

Commits on Mar 23, 2024

• fix(server): minor type fixes

  abetlen

  committed
  d11ccc3

  Copy full SHA for d11ccc3

• fix: tool_call missing first token.

  abetlen

  committed
  c1325dc

  Copy full SHA for c1325dc

• feat: Update llama.cpp

  abetlen

  committed
  e325a83

  Copy full SHA for e325a83

Commits on Mar 19, 2024

• docs: Add chat examples to openapi ui

  abetlen

  committed
  f7decc9

  Copy full SHA for f7decc9