Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Aug 7, 2025

• fix: rename op_offloat to op_offload in llama.py (#2046)

  sergey21000

  authored
  30ddd56

  Copy full SHA for 30ddd56

Commits on Jul 5, 2025

• fix: Update reference to in Llama.embed. Closes #2037

  abetlen

  committed
  9e5a4ea

  Copy full SHA for 9e5a4ea

Commits on Jul 1, 2025

• fix(minor): Fix type hint for older versions of python

  abetlen

  committed
  5a635f4

  Copy full SHA for 5a635f4

• misc: Fix support for new parameters, deprecate rpc_servers parameter

  abetlen

  committed
  51dce74

  Copy full SHA for 51dce74

• feat: Update llama.cpp

  abetlen

  committed
  0d475d7

  Copy full SHA for 0d475d7

Commits on Jan 29, 2025

• fix: error showing time spent in llama perf context print (#1898)

  Show description for 4442ff8
  

  shakalaca

  and

  abetlen

  authored
  4442ff8

  Copy full SHA for 4442ff8

• feat: Update llama.cpp

  abetlen

  committed
  80be68a

  Copy full SHA for 80be68a

Commits on Dec 6, 2024

• fix logit-bias type hint (#1802)

  Show description for fa04cdc
  ddh0

  authored
  fa04cdc

  Copy full SHA for fa04cdc

• fix: Fix pickling of Llama class by setting seed from _seed member. Closes #1769

  abetlen

  committed
  2523472

  Copy full SHA for 2523472

Commits on Oct 31, 2024

• feat: Update llama.cpp

  abetlen

  committed
  e712cff

  Copy full SHA for e712cff

Commits on Sep 26, 2024

• fix: Additional fixes for speculative decoding

  abetlen

  committed
  e975dab

  Copy full SHA for e975dab

• misc: Rename all_text to remaining_text (#1658)

  Show description for 11d9562
  

  xu-song

  and

  abetlen

  authored
  11d9562

  Copy full SHA for 11d9562

• fix: Fix speculative decoding

  abetlen

  committed
  9992c50

  Copy full SHA for 9992c50

Commits on Sep 20, 2024

• feat: Add option to configure n_ubatch

  abetlen

  committed
  6c44a3f

  Copy full SHA for 6c44a3f

Commits on Sep 19, 2024

• feat: Add loading sharded GGUF files from HuggingFace with Llama.from_pretrained(additional_files=[...]) . Closes #1341

  Show description for 84c0920
  

  Gnurro

  and

  abetlen

  authored
  84c0920

  Copy full SHA for 84c0920

• fix: Don't store scores internally unless logits_all=True. Reduces memory requirements for large context. Closes #1542

  abetlen

  committed
  29afcfd

  Copy full SHA for 29afcfd

• fix: Fix memory allocation of ndarray (#1704)

  Show description for 22cedad
  

  xu-song

  and

  abetlen

  authored
  22cedad

  Copy full SHA for 22cedad

• misc: Format

  abetlen

  committed
  9b64bb5

  Copy full SHA for 9b64bb5

• feat: Update sampling API for llama.cpp (#1742)

  Show description for f8fcb3e
  abetlen

  authored
  f8fcb3e

  Copy full SHA for f8fcb3e

Commits on Aug 31, 2024

• feat: Update llama.cpp

  abetlen

  committed
  9769e57

  Copy full SHA for 9769e57

Commits on Aug 29, 2024

• feat: Enable detokenizing special tokens with `special=True` (#1596)

  Show description for d981d32
  

  benniekiss

  and

  abetlen

  authored
  d981d32

  Copy full SHA for d981d32

Commits on Aug 15, 2024

• fix: Llama.close didn't free lora adapter (#1679)

  jkawamoto

  authored
  3c7501b

  Copy full SHA for 3c7501b

• feat: Update llama.cpp

  abetlen

  committed
  63d65ac

  Copy full SHA for 63d65ac

Commits on Aug 12, 2024

• fix: only print 'cache saved' in verbose mode (#1668)

  Show description for 9bab46f
  

  lsorber

  and

  abetlen

  authored
  9bab46f

  Copy full SHA for 9bab46f

Commits on Aug 8, 2024

• fix: typo

  abetlen

  committed
  7aaf701

  Copy full SHA for 7aaf701

Commits on Aug 7, 2024

• feat: Enable recursive search of HFFS.ls when using `from_pretrained` (#1656)

  Show description for 5e39a85
  

  benHeid

  and

  abetlen

  authored
  5e39a85

  Copy full SHA for 5e39a85

• feat: Add more detailed log for prefix-match (#1659)

  Show description for e966f3b
  

  xu-song

  and

  abetlen

  authored
  e966f3b

  Copy full SHA for e966f3b

Commits on Jul 31, 2024

• fix : Missing LoRA adapter after API change (#1630)

  shamitv

  authored
  1f0b9a2

  Copy full SHA for 1f0b9a2

Commits on Jul 18, 2024

• fix: Change repeat_penalty to 1.0 to match llama.cpp defaults (#1590)

  Show description for 0700476
  

  ddh0

  and

  abetlen

  authored
  0700476

  Copy full SHA for 0700476

Commits on Jul 17, 2024

• feat: Update llama.cpp

  abetlen

  committed
  7613d23

  Copy full SHA for 7613d23

Commits on Jul 9, 2024

• fix(minor): Minor ruff fixes

  abetlen

  committed
  08f2bb3

  Copy full SHA for 08f2bb3

• fix(misc): Format

  abetlen

  committed
  c1ae815

  Copy full SHA for c1ae815

Commits on Jun 19, 2024

• fix: Make destructor to automatically call .close() method on Llama class.

  abetlen

  committed
  4c1d74c

  Copy full SHA for 4c1d74c

Commits on Jun 13, 2024

• feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)

  Show description for 320a5d7
  

  jkawamoto

  and

  abetlen

  authored
  320a5d7

  Copy full SHA for 320a5d7

• feat: Support SPM infill (#1492)

  Show description for dbcf64c
  

  CISC

  and

  abetlen

  authored
  dbcf64c

  Copy full SHA for dbcf64c