Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Jul 27, 2024

• ggml : reduce hash table reset cost (#8698)

  Show description for 2b1f616
  slaren

  authored
  2b1f616

  Copy full SHA for 2b1f616

Commits on Jul 11, 2024

• tokenize : add --no-parse-special option (#8423)

  Show description for 9a55ffe
  compilade

  authored
  9a55ffe

  Copy full SHA for 9a55ffe

Commits on Jul 4, 2024

• tokenize : add --show-count (token) option (#8299)

  Show description for 6f63d64
  danbev

  authored
  6f63d64

  Copy full SHA for 6f63d64

Commits on May 25, 2024

• Make tokenize CLI tool have nicer command line arguments. (#6188)

  Show description for 5768433
  

  3 peopleauthored
  5768433

  Copy full SHA for 5768433

Commits on Apr 9, 2024

• BERT tokenizer fixes (#6498)

  Show description for 1b67731
  cebtenzzre

  authored
  1b67731

  Copy full SHA for 1b67731

Commits on Feb 16, 2024

• ggml : add numa options (#5377)

  Show description for f486f6e
  

  4 peopleauthored
  f486f6e

  Copy full SHA for f486f6e

Commits on Nov 18, 2023

• tokenize example: Respect normal add BOS token behavior (#4126)

  Show description for 28a2e6e
  KerfuffleV2

  authored
  28a2e6e

  Copy full SHA for 28a2e6e

Commits on Nov 17, 2023

• tokenize : fix trailing whitespace

  ggerganov

  committed
  5ad387e

  Copy full SHA for 5ad387e

• examples : add tokenize (#4039)

  zakkor

  authored
  2fa02b4

  Copy full SHA for 2fa02b4

Loading