Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jul 8, 2023

• Upgrade fastapi to 0.100.0 and pydantic v2

  abetlen

  committed
  52753b7

  Copy full SHA for 52753b7

Commits on Jul 7, 2023

• perf: avoid allocating new buffers during sampling

  abetlen

  committed
  11eae75

  Copy full SHA for 11eae75

• perf: assign to candidates data structure instead

  abetlen

  committed
  a14d8a9

  Copy full SHA for a14d8a9

• Add setting to control request interruption

  abetlen

  committed
  57d8ec3

  Copy full SHA for 57d8ec3

• Add interruptible streaming requests for llama-cpp-python server. Closes #183

  abetlen

  committed
  4c7cdcc

  Copy full SHA for 4c7cdcc

Commits on Jul 6, 2023

• Update llama.cpp

  abetlen

  committed
  98ae4e5

  Copy full SHA for 98ae4e5

Commits on Jul 5, 2023

• Update llama.cpp

  abetlen

  committed
  b994296

  Copy full SHA for b994296

Commits on Jun 29, 2023

• Update llama.cpp

  abetlen

  committed
  c67f786

  Copy full SHA for c67f786

• Hotfix: logits_all bug

  abetlen

  committed
  e34f441

  Copy full SHA for e34f441

• Load logits directly into scores buffer

  abetlen

  committed
  a2ede37

  Copy full SHA for a2ede37

• Use pre-allocated buffers to store input_ids and scores

  abetlen

  committed
  b95b0ff

  Copy full SHA for b95b0ff

• Free model when llama is unloaded. Closes #434

  abetlen

  committed
  a5e059c

  Copy full SHA for a5e059c

Commits on Jun 26, 2023

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  3379dc4

  Copy full SHA for 3379dc4

• Update llama.cpp

  abetlen

  committed
  9522284

  Copy full SHA for 9522284

• Update type signature

  abetlen

  committed
  b4a3db3

  Copy full SHA for b4a3db3

• Merge branch 'main' into fix-state-pickle

  abetlen

  authored
  5eb4ebb

  Copy full SHA for 5eb4ebb

Commits on Jun 24, 2023

• Only concatenate after all batches are done

  samfundev

  committed
  d788fb4

  Copy full SHA for d788fb4

Commits on Jun 23, 2023

• Merge branch 'main' into fix-state-pickle

  abetlen

  authored
  877ca6d

  Copy full SHA for 877ca6d

Commits on Jun 22, 2023

• server: pass seed param from command line to llama

  lexin4ever

  authored
  282698b

  Copy full SHA for 282698b

Commits on Jun 20, 2023

• Update llama.cpp

  abetlen

  committed
  e377987

  Copy full SHA for e377987

Commits on Jun 17, 2023

• Update docs. Closes #386

  abetlen

  committed
  d410f12

  Copy full SHA for d410f12

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  9f528f4

  Copy full SHA for 9f528f4

• Update llama.cpp

  abetlen

  committed
  d7153ab

  Copy full SHA for d7153ab

Commits on Jun 16, 2023

• Update llama.py: Added how many input tokens in ValueError exception

  nb-programmer

  authored
  fd9f294

  Copy full SHA for fd9f294

Commits on Jun 15, 2023

• Add low_vram to server settings

  abetlen

  committed
  1e20be6

  Copy full SHA for 1e20be6

• Add low_vram parameter

  abetlen

  committed
  44b83ca

  Copy full SHA for 44b83ca

• Format server options

  abetlen

  committed
  f7c5cfa

  Copy full SHA for f7c5cfa

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  9c41a3e

  Copy full SHA for 9c41a3e

• Merge pull request #351 from player1537-forks/th/add-logits-bias-parameter

  Show description for f568bae
  abetlen

  authored
  f568bae

  Copy full SHA for f568bae

• Add additional verbose logs for cache

  abetlen

  committed
  f27393a

  Copy full SHA for f27393a

• Merge branch 'main' of github.com:abetlen/llama_cpp_python into main

  abetlen

  committed
  4cefb70

  Copy full SHA for 4cefb70

• Update llama.cpp

  abetlen

  committed
  715f98c

  Copy full SHA for 715f98c

Commits on Jun 13, 2023

• fix: Make LLamaState pickable for disk cache

  Show description for 10b0cb7
  Okabintaro

  committed
  10b0cb7

  Copy full SHA for 10b0cb7

Commits on Jun 11, 2023

• correction to add back environment variable support <3 docker

  Orfeous

  committed
  3129a0e

  Copy full SHA for 3129a0e

Commits on Jun 10, 2023

• fixes abetlen/llama-cpp-python #358

  Orfeous

  committed
  3ea3193

  Copy full SHA for 3ea3193