root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-09 02:01:44 +00:00
Code Issues Actions 9 Packages Projects Releases Wiki Activity

Commit Graph

  • ff348be22e Consistently catch and throw only exceptions deriving from std::exception mgroeber9110 2023-05-26 12:29:58 +0200
  • 3abc987f2a
         Merge pull request #9 from plurigrid/babashka ajasibley 2023-05-26 03:11:41 -0700
  • f519e81995 convert.py: add mapping for safetensors bf16 Aarni Koskela 2023-05-26 13:02:05 +0300
  • 3c8f404243 integrated token probability viewer in debugmode Concedo 2023-05-26 16:40:26 +0800
  • 991002b28e add some info in loading Liu Ming 2023-05-26 16:18:49 +0800
  • 66874d4fbc
         Some improvements to loading the session with --prompt-cache (#1550) master-66874d4 Kerfuffle 2023-05-25 20:18:01 -0600
  • 4c8b3fb107
         add configurable vars Henri Vasserman 2023-05-26 01:08:53 +0300
  • 30d921af3e
         and makefile Henri Vasserman 2023-05-26 01:03:56 +0300
  • a593a4f6c2
         Add missing parameters Henri Vasserman 2023-05-26 00:55:28 +0300
  • 174bf6a86d
         Merge 'origin/master' into hipblas Henri Vasserman 2023-05-26 00:44:23 +0300
  • 1fcdcc28b1
         cuda : performance optimizations (#1530) master-1fcdcc2 Johannes Gäßler 2023-05-25 23:07:29 +0200
  • c2b55cc917
         Added LoRA Loading Randall Fitzgerald 2023-05-25 12:53:05 -0700
  • 19d318946b Updated install_openssl.sh to properly set homebrew shell profile. Added message to just file promting user to restart shell following sucefull installation. Updated README to include steps for loging in to cosmonic and launching wasmCloust host. ajasibley 2023-05-25 12:23:07 -0700
  • e09c67d141 Merge branch 'master' of github.com:liangmanlai/llama.cpp liang 2023-05-25 23:08:30 +0800
  • 0fc6170173 In the function , add the cuda error bypass. liang 2023-05-25 23:03:14 +0800
  • 207389d91a Added support in update_source.sh for device with no zshrc made. ajasibley 2023-05-25 03:15:36 -0700
  • d54795176c Fixed syntac error in update_source.sh. ajasibley 2023-05-25 02:46:49 -0700
  • 943ad39016 Fixed typo cuasing path shell source to not be reloaded in justfile. ajasibley 2023-05-25 02:41:03 -0700
  • fa8bc623c8 Fixed typo in install-cosmo just recipe. ajasibley 2023-05-25 02:32:20 -0700
  • 6cdc1f6aa9 Updated installation check in install-rust just recipe. ajasibley 2023-05-25 02:27:08 -0700
  • 90c750a6ad Added automatic path setting to install-cosmo just recipe. ajasibley 2023-05-25 02:24:43 -0700
  • aeacc57d3b
         Fixes for model conversion Henri Vasserman 2023-05-25 12:15:33 +0300
  • 4905366fe8 Merge branch 'master' of github.com:baijiafan/llama.cpp Liu Ming 2023-05-25 17:13:56 +0800
  • 18b778b967 update Liu Ming 2023-05-25 17:13:50 +0800
  • 61cd6685f4 Fixed syntax error in update_path.sh ajasibley 2023-05-25 02:13:01 -0700
  • 1fdd8ac615 update grpc impl 刘铭 2023-05-25 17:12:26 +0800
  • 28491b7515 fixed syntax error in install_nix.sh. ajasibley 2023-05-25 02:04:14 -0700
  • 1c1245535a fixed syntax error in nix just recipe. ajasibley 2023-05-25 01:58:07 -0700
  • 5bd0c41792 Added automatic Nix install if not present on system. ajasibley 2023-05-25 01:47:57 -0700
  • 0f4c13fc43 Updated justfile, added script to set shell path, and fixed Cargo.toml version issue. ajasibley 2023-05-25 01:19:57 -0700
  • 8b8f2f4cf5 up ver to 1.25.1 Concedo 2023-05-25 14:49:30 +0800
  • 156d70b82b Always set RNG seed when restoring cached prompt in main example. KerfuffleV2 2023-05-25 00:00:54 -0600
  • 76c73987bf Use the initial value of params.seed to determine if user supplied seed KerfuffleV2 2023-05-24 02:55:30 -0600
  • e1ec489ef2 Use existing session behavior when in instruct or interact first mode KerfuffleV2 2023-05-23 07:05:44 -0600
  • 2d79928982 Apply clang suggestions. KerfuffleV2 2023-05-21 05:38:01 -0600
  • de5bf5bf68 Some improvements to loading the session with --prompt-cache KerfuffleV2 2023-05-21 05:20:56 -0600
  • e6eeb234f1 Merge branch 'master' into concedo_experimental Concedo 2023-05-25 10:34:43 +0800
  • d2da155661 upgraded clblast Concedo 2023-05-25 10:18:12 +0800
  • 875b385d79
         Update README.md ajasibley 2023-05-24 17:37:37 -0700
  • 9580a547d9 Updated README. ajasibley 2023-05-24 16:56:17 -0700
  • 5d66c80d99 Cleaner up shell.nix by removing bash commands and replacing them with just recipes. ajasibley 2023-05-24 15:07:33 -0700
  • f80ce7a4e0
         Merge branch 'origin/master' into hipblas Henri Vasserman 2023-05-25 00:02:50 +0300
  • ff99507049
         [wip] open_llama_3b support Henri Vasserman 2023-05-24 21:35:46 +0300
  • 37a34deaa0 added a second pyinstaller for my own use that uses a different python version. don't use this. Concedo 2023-05-24 23:34:11 +0800
  • bf482d1786 revert klite newline bug, trying to add win7 support Concedo 2023-05-24 22:21:01 +0800
  • 844f92688a subpattern fix Concedo 2023-05-24 16:48:39 +0800
  • 2d727e69c1
         Update common.cpp CRGBS 2023-05-24 16:38:28 +0800
  • ac7876ac20
         Update CLBlast to 1.6.0 (#1580) master-ac7876a Henri Vasserman 2023-05-24 10:30:09 +0300
  • d04b3bbe5e disable mmap when failsafe mode selected from GUI Concedo 2023-05-24 15:04:17 +0800
  • 04ff4fda39
         Update common.cpp CRGBS 2023-05-24 14:39:25 +0800
  • 943e5471cd
         Update common.cpp CRGBS 2023-05-24 14:28:35 +0800
  • c31bbe934b
         readme : add docs for chat-persistent.sh (#1568) Evan Jones 2023-05-24 02:24:01 -0400
  • 1359b6aba5
         chat-persistent.sh : use bracket expressions in grep (#1564) Senemu 2023-05-24 06:16:22 +0000
  • d973514da5
         Update common.cpp CRGBS 2023-05-24 14:12:47 +0800
  • c826d5221c
         Update main.cpp CRGBS 2023-05-24 14:10:48 +0800
  • dcdc11a493
         Update build.yml CRGBS 2023-05-24 13:27:49 +0800
  • 9e14714e67
         Update main.cpp CRGBS 2023-05-24 13:26:53 +0800
  • c0e8da7912
         Update README.md ajasibley 2023-05-24 04:41:50 +0000
  • e8ef92a738
         Update README.md ajasibley 2023-05-24 04:30:05 +0000
  • 988dd73d82
         Merge pull request #7 from plurigrid/cosmonic ajasibley 2023-05-24 04:28:26 +0000
  • 2df76d9064 Removed Vespa project. Aja Sibley 2023-05-24 04:26:59 +0000
  • 74ac17d3ad
         Merge pull request #5 from plurigrid/cosmonic barton ⊛ 2023-05-24 04:11:22 +0000
  • b314cbfb60 updated lite to support variable streaming lengths Concedo 2023-05-24 11:28:35 +0800
  • 025f974d68 Updated readme ajasibley 2023-05-23 20:24:13 -0700
  • 5f727081bc Fixed env error ajasibley 2023-05-23 19:15:11 -0700
  • 7a91429897 try to do grpc completion Liu Ming 2023-05-24 10:13:31 +0800
  • 0549bf3c09 Merge remote-tracking branch 'origin/master' Liu Ming 2023-05-24 08:49:38 +0800
  • 968f310eb7 Merge commit '2e6cd4b02549e343bef3768e6b946f999c82e823' Liu Ming 2023-05-24 08:49:27 +0800
  • 3d6d096ab8 Update shell.nix ajasibley 2023-05-23 23:10:25 +0000
  • e28bb0559c
         fix Henri Vasserman 2023-05-24 01:53:31 +0300
  • b3329f5ca4
         rename path Henri Vasserman 2023-05-24 01:48:44 +0300
  • 1b2d6f3d52
         Update CLBlast to 1.6.0 Henri Vasserman 2023-05-24 01:41:14 +0300
  • b45efa3239 Updated nix.shell ajasibley 2023-05-23 22:20:17 +0000
  • 75649f44b6
         Change CMake files Henri Vasserman 2023-05-24 01:14:04 +0300
  • 8502d5178e fix args zrm 2023-05-23 17:09:52 -0400
  • 2c1b5ae197 silence robot zrm 2023-05-23 17:08:37 -0400
  • 8d7b28c28d
         Fixed some types in the params. Randall Fitzgerald 2023-05-23 13:35:12 -0700
  • 3537ad1821
         Merge branch 'ggerganov:master' into master Randall Fitzgerald 2023-05-23 13:31:14 -0400
  • c97e10c50c Merge branch 'master' into concedo_experimental Concedo 2023-05-24 00:36:30 +0800
  • abb9ad789c fixed other arch Concedo 2023-05-24 00:20:43 +0800
  • 7d873811f3
         Fix handling of "invalid property" when creating OpenCL command queue (#1565) master-7d87381 Maarten ter Huurne 2023-05-23 18:01:15 +0200
  • 0c0009e4b4 updated lite Concedo 2023-05-23 23:18:52 +0800
  • add5f1bdc9
         Update examples/server/server.cpp Randall Fitzgerald 2023-05-23 07:34:41 -0700
  • 421e66b330
         Update examples/server/server.cpp Randall Fitzgerald 2023-05-23 07:34:36 -0700
  • 355007b019 added sampler seed Concedo 2023-05-23 21:52:26 +0800
  • cd4012c3ed minor fixes to debug logging, fixed a typo, added a new failsafe mode Concedo 2023-05-23 21:31:42 +0800
  • 2071d730fa
         Forgot to remove some testing code. Randall Fitzgerald 2023-05-23 06:22:30 -0700
  • 1c3fdf8cfd
         Add all generation parameters to server.cpp and allow resetting context Randall Fitzgerald 2023-05-23 06:16:54 -0700
  • 5bf9784381 Merge branch 'master' into concedo_experimental Concedo 2023-05-23 18:19:16 +0800
  • c645f1e8c1 add grpc server 刘铭 2023-05-23 17:07:50 +0800
  • d45df1b1f4 Renamed DMMV X/Y compilation options JohannesGaessler 2023-05-23 08:55:01 +0200
  • 98bfee013b Fewer iters, more ops per iter JohannesGaessler 2023-05-21 12:01:14 +0200
  • e199938a3a Define GGML_CUDA_DMMV_BLOCK_Y if not defined JohannesGaessler 2023-05-20 19:37:11 +0200
  • 5d0cf9928b Removed hipblas compatibility code JohannesGaessler 2023-05-20 14:36:26 +0200
  • 17dc4c52d3 Fixed cmake LLAMA_CUDA_BY option JohannesGaessler 2023-05-20 14:31:11 +0200
  • 82cf01f897 loop unrolling JohannesGaessler 2023-05-19 20:26:49 +0200
  • 1a787101cc block y dim JohannesGaessler 2023-05-19 17:24:05 +0200
  • fbf5588abc xor hack JohannesGaessler 2023-05-19 12:59:37 +0200
  • ba000f9941
         Update README.md Evan Jones 2023-05-22 23:46:30 -0400
  • 6a93b9f1a3 readme : add docs for chat-persistent.sh Evan Jones 2023-05-22 23:38:52 -0400