Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Mar 15, 2026

• feat(core): add verbose debug logging to longest_token_prefix fast paths

  Show description for 90d46dc
  JamePeng

  committed
  90d46dcView commit details

  Copy full SHA for 90d46dc

  View code at this pointBrowse repository at this point

Commits on Mar 10, 2026

• perf(cache): optimize LlamaDiskCache I/O and fix LRU behavior

  Show description for a36e8d2
  JamePeng

  committed
  a36e8d2View commit details

  Copy full SHA for a36e8d2

  View code at this pointBrowse repository at this point

• perf(cache): upgrade `LlamaRAMCache` to O(1) eviction and set `LlamaTrieCache` as default

  Show description for 5c8e056
  JamePeng

  committed
  5c8e056View commit details

  Copy full SHA for 5c8e056

  View code at this pointBrowse repository at this point

Commits on Mar 9, 2026

• fix(cache): fix namespace shadowing to prevent AttributeError

  Show description for 5e285fe
  JamePeng

  committed
  5e285feView commit details

  Copy full SHA for 5e285fe

  View code at this pointBrowse repository at this point

Commits on Mar 7, 2026

• perf(hybrid): eliminate PCIe I/O latency for single-turn workflows

  Show description for 7289b54
  JamePeng

  committed
  7289b54View commit details

  Copy full SHA for 7289b54

  View code at this pointBrowse repository at this point

Commits on Feb 26, 2026

• fix(HybridCheckpointCache): ValueError: bytes must be in range(0, 256)

  JamePeng

  committed
  781790fView commit details

  Copy full SHA for 781790f

  View code at this pointBrowse repository at this point

• fix(cache): add safety guards to checkpoint restore and optimize API calls

  Show description for 29b9522
  JamePeng

  committed
  29b9522View commit details

  Copy full SHA for 29b9522

  View code at this pointBrowse repository at this point

• Remove redundant seq_id and add resource cleanup

  Show description for 5776f15
  JamePeng

  committed
  5776f15View commit details

  Copy full SHA for 5776f15

  View code at this pointBrowse repository at this point

• feat(cache): implement HybridCheckpointCache for hybrid/recurrent models

  Show description for f6dda38
  JamePeng

  committed
  f6dda38View commit details

  Copy full SHA for f6dda38

  View code at this pointBrowse repository at this point

Commits on Nov 2, 2025

• Implement LlamaTrieCache into llama_cache.py: Optimize LlamaCache lookup from O(N) to O(K) using a Trie

  JamePeng

  committed
  2419dc2View commit details

  Copy full SHA for 2419dc2

  View code at this pointBrowse repository at this point

Commits on Sep 19, 2024

• misc: Format

  abetlen

  committed
  9b64bb5View commit details

  Copy full SHA for 9b64bb5

  View code at this pointBrowse repository at this point

Commits on Jul 9, 2024

• fix(misc): Format

  abetlen

  committed
  c1ae815View commit details

  Copy full SHA for c1ae815

  View code at this pointBrowse repository at this point

Commits on Jan 17, 2024

• Move cache classes to llama_cache submodule.

  abetlen

  committed
  3b92419View commit details

  Copy full SHA for 3b92419

  View code at this pointBrowse repository at this point

Loading