Commit Graph

3932 Commits

Author SHA1 Message Date
Olivier Chafik
7f2429e6b0 tool-calls: fix grammar regression 2024-10-22 11:49:50 +01:00
ochafik
b53362a148 Update test-tool-call.cpp 2024-10-22 10:54:48 +01:00
ochafik
9f5ab97756 tool-calls: add generic tool call style as default 2024-10-22 10:53:21 +01:00
ochafik
fa8462ffd3 fix root 2024-10-22 10:53:01 +01:00
ochafik
75764871e6 tool-call: fix grammar roots 2024-10-22 10:50:52 +01:00
ochafik
e753f15229 agent: move openapi helpers to their own file 2024-10-08 01:34:12 +01:00
ochafik
332506910f tool-call: accept {"type": "function", "name": "fn" for llama 3.x 2024-10-07 02:23:37 +01:00
ochafik
241acc2488 agent: disable brave_search when BRAVE_SEARCH_API_KEY unset 2024-10-07 02:22:52 +01:00
ochafik
a151ddcd5a agent: handle function errors and dont' stringify str outputs 2024-10-04 04:06:00 +01:00
Olivier Chafik
21a3c90a1c agent: tool tweaks (remove ansi escapes from python output, update env keys + provider docs) 2024-10-03 22:20:34 +01:00
Olivier Chafik
366efc8a18 tool-call: fix llama 3.x tc parsing when there are spaces before "name" 2024-10-03 21:46:41 +01:00
Olivier Chafik
da02397f7f agent: support more providers (+ extract serve_tools_inside_docker.sh)
update readme
2024-10-03 19:23:32 +01:00
Olivier Chafik
b4fc1e8ba7 tool-call: adjust triggers to most common tool call variations from Llama-3.1-8B and Llama-3.2-3B 2024-10-03 19:23:08 +01:00
Olivier Chafik
ece12b074f antiprompts: ensure partial match is at end of string (or else server stops sending replies) 2024-10-03 19:23:08 +01:00
Olivier Chafik
fa8df0c350 agent: drop fastify.py -> simpler serve_tools.py, and expose other tools to python interpreter 2024-10-02 19:51:23 +01:00
Olivier Chafik
6b4a454735 agent: hard-code max_results=10 in brave_search 2024-10-02 19:13:28 +01:00
Olivier Chafik
26e76f9704 agent: allow interactive chat by default, and don't reuse sessions 2024-10-02 19:12:57 +01:00
Olivier Chafik
6f2191d99e agent: remove *lots* of cruft from tool definitions derived from FastAPI catalog (and remove wait* tools which can be implemented in Python anyway) 2024-10-02 17:54:20 +01:00
Olivier Chafik
e2a9ab68a3 agent: --openai flag (auto-fetches OPENAI_API_KEY), improved logging 2024-10-02 17:15:55 +01:00
Olivier Chafik
2428b73853 agent: ditch openai dependency, use cache_prompt and expose seed 2024-10-02 16:26:45 +01:00
Olivier Chafik
b559d64ecc Update README.md 2024-10-02 15:19:27 +01:00
Olivier Chafik
9e502e89a5 tool-call: promote getting chat templates w/ dedicated script rather than rely on test resources 2024-10-02 15:03:08 +01:00
Olivier Chafik
f3538e755b update tools 2024-10-02 14:57:25 +01:00
Olivier Chafik
5b01402655 agent: add brave_search & fetch_page tools + move to examples/agent/tools/ 2024-10-02 14:29:45 +01:00
Olivier Chafik
c76b14501e tool-call: fix Makefile 2024-10-02 00:06:42 +01:00
Olivier Chafik
c36a196f53 tool-call: prepare possible externalization of minja + factor tool call style out of template 2024-10-01 23:12:24 +01:00
ochafik
d9451fd647 antiprompts: avoid c++20 struct initializers in test 2024-09-30 04:08:55 +01:00
ochafik
0fc5ad7ae1 minja: avoid c++20 struct initializers in test 2024-09-30 03:51:48 +01:00
ochafik
277f38536c minja: attempt to handle windows' crlf 2024-09-30 03:45:50 +01:00
ochafik
9ac4b04aa2 tool-call: add fs_list_files to common, w/ win32 impl for msys2 build 2024-09-29 00:42:52 +01:00
ochafik
cb7912ee74 chat-template: add phi-3.5-vision-instruct 2024-09-29 00:33:19 +01:00
ochafik
8738d94bbd minja: qualify std::nullptr_t type for msys2 build 2024-09-29 00:18:22 +01:00
ochafik
c87c12168a tool-call: fix memory leak in test 2024-09-28 23:44:28 +01:00
ochafik
22493c8e9e tests: fix test-chat-template run from build 2024-09-28 23:31:23 +01:00
ochafik
ad6719e2a7 tests: fix typo 2024-09-28 23:26:19 +01:00
ochafik
a072f30a8d tests: attempt to find assets for tests run from build subfolder 2024-09-28 23:15:36 +01:00
ochafik
bc3e0c0830 tool-call: Qwen 2.5 Instruct also requires object arguments 2024-09-28 23:05:35 +01:00
ochafik
b10ef04d8d chat-template: tweak --chat-template error message when --jinja is set 2024-09-28 22:36:38 +01:00
ochafik
dbda025f87 tool-call: test messages -> template -> grammar -> tool call parser 2024-09-28 22:32:47 +01:00
ochafik
0ae1112faa agent: try to fix pyright lint 2024-09-28 20:10:08 +01:00
ochafik
1b32ac129f chat-template: fix test-arg 2024-09-28 20:06:10 +01:00
ochafik
9358d1f62c minja: fix gcc8 build of test 2024-09-28 19:50:08 +01:00
ochafik
e6be59c2a0 antiprompts: fix gcc8 build (avoid recursive struct) 2024-09-28 19:39:52 +01:00
ochafik
ef2a020276 tool-call: make agent async 2024-09-28 19:11:09 +01:00
ochafik
05bbba9f8a tool-call: only match json eagerly for Llama 3.2 2024-09-28 19:05:10 +01:00
ochafik
6e0053a81b chat-template: enumerate files w/ C API rather than private using std::__fs::filesystem 2024-09-28 18:47:11 +01:00
ochafik
c657857e21 tool-call: cleanup tools.py 2024-09-28 18:33:40 +01:00
ochafik
55cf337560 tool-call: better error reporting for server tests 2024-09-28 18:33:40 +01:00
ochafik
7cef90cf9c tool-call: more eager function call parsing for Functionary & Llama (give a chance to 3B model) 2024-09-28 18:33:40 +01:00
ochafik
8b2cf3509f tool-call: fix grammar trigger crash 2024-09-28 18:30:01 +01:00