349 Commits

Author	SHA1	Message	Date
Olivier Chafik	7f2429e6b0	tool-calls: fix grammar regression	2024-10-22 11:49:50 +01:00
ochafik	9f5ab97756	tool-calls: add generic tool call style as default	2024-10-22 10:53:21 +01:00
ochafik	fa8462ffd3	fix root	2024-10-22 10:53:01 +01:00
ochafik	75764871e6	tool-call: fix grammar roots	2024-10-22 10:50:52 +01:00
ochafik	332506910f	tool-call: accept {"type": "function", "name": "fn" for llama 3.x	2024-10-07 02:23:37 +01:00
Olivier Chafik	366efc8a18	tool-call: fix llama 3.x tc parsing when there are spaces before "name"	2024-10-03 21:46:41 +01:00
Olivier Chafik	b4fc1e8ba7	tool-call: adjust triggers to most common tool call variations from Llama-3.1-8B and Llama-3.2-3B	2024-10-03 19:23:08 +01:00
Olivier Chafik	ece12b074f	antiprompts: ensure partial match is at end of string (or else server stops sending replies)	2024-10-03 19:23:08 +01:00
Olivier Chafik	c36a196f53	tool-call: prepare possible externalization of minja + factor tool call style out of template	2024-10-01 23:12:24 +01:00
ochafik	277f38536c	minja: attempt to handle windows' crlf	2024-09-30 03:45:50 +01:00
ochafik	9ac4b04aa2	tool-call: add fs_list_files to common, w/ win32 impl for msys2 build	2024-09-29 00:42:52 +01:00
ochafik	8738d94bbd	minja: qualify std::nullptr_t type for msys2 build	2024-09-29 00:18:22 +01:00
ochafik	bc3e0c0830	tool-call: Qwen 2.5 Instruct also requires object arguments	2024-09-28 23:05:35 +01:00
ochafik	b10ef04d8d	chat-template: tweak --chat-template error message when --jinja is set	2024-09-28 22:36:38 +01:00
ochafik	dbda025f87	tool-call: test messages -> template -> grammar -> tool call parser	2024-09-28 22:32:47 +01:00
ochafik	1b32ac129f	chat-template: fix test-arg	2024-09-28 20:06:10 +01:00
ochafik	e6be59c2a0	antiprompts: fix gcc8 build (avoid recursive struct)	2024-09-28 19:39:52 +01:00
ochafik	05bbba9f8a	tool-call: only match json eagerly for Llama 3.2	2024-09-28 19:05:10 +01:00
ochafik	7cef90cf9c	tool-call: more eager function call parsing for Functionary & Llama (give a chance to 3B model)	2024-09-28 18:33:40 +01:00
ochafik	d983516f40	tool-call: let the tool call handler expand chat template, moving builtin_tools down as extra_context	2024-09-28 17:46:36 +01:00
ochafik	0c85bc7a8f	tool-call: test tool call style detection	2024-09-28 17:43:09 +01:00
ochafik	701b664551	minja: add indent filter to support command-r-plus's chat templates	2024-09-27 19:00:14 +01:00
ochafik	0093a5e527	minja: fix identifiers parsing (when start w/ not/is/etc) and lstrip_blocks corner case (needed by DeepSeek-V2.5	2024-09-27 18:30:44 +01:00
ochafik	e62b5de3cf	tool-call: fix functionary-small-3.2 (first tool starts w/ name\n, subsequent are >>>name\n)	2024-09-27 07:06:33 +01:00
ochafik	e33b342da7	tool-call: fix passing of tools to template + allow agent to finish	2024-09-27 06:24:22 +01:00
ochafik	f62e688387	tool-call: fix crash / test non-tool call case (added llama_sampler_is_grammar_empty)	2024-09-27 06:04:41 +01:00
ochafik	27cd07a056	json: fix grammar conversion typo	2024-09-27 03:57:48 +01:00
ochafik	f9c1743bb5	minja: fix iterables	2024-09-27 03:36:49 +01:00
ochafik	c88c932d98	fix gcc error + lint	2024-09-26 19:18:40 +01:00
ochafik	5840e10069	tool-call: merge & fix jinja template tests into test-chat-template	2024-09-26 19:05:00 +01:00
ochafik	50685f837f	minja: add str.title()	2024-09-26 19:03:59 +01:00
ochafik	9cfe4d7202	tool-call: refactor llama_chat_template class + use in validate_model_chat_template	2024-09-26 18:06:03 +01:00
ochafik	cf7bece6a7	tool-call: factor chat template away from legacy API	2024-09-26 17:19:29 +01:00
ochafik	d7ec84f78c	tool-call: allow <|python_tag|> in functionary-medium-3.1	2024-09-26 06:52:34 +01:00
ochafik	3d2650ce65	fix gcc build	2024-09-26 06:52:34 +01:00
ochafik	0c870133d8	tool-call: test/fix functionary-medium-v3.1's template (can "look" like llama3.1 template)	2024-09-26 05:56:15 +01:00
ochafik	8e4a9bad8a	minja: allow none input to selectattr, and add safe passthrough filter	2024-09-26 05:53:12 +01:00
ochafik	5f5be9cde7	minja: gcc tweaks	2024-09-26 05:06:11 +01:00
ochafik	059babdd9b	minja: try to please gcc	2024-09-26 03:58:18 +01:00
ochafik	595e11cb11	tool-call: fix/test functionary v3	2024-09-26 03:42:05 +01:00
ochafik	c124ab48ea	minja: add str.endswith	2024-09-26 03:21:23 +01:00
ochafik	1b6280102b	fix editorconfig lints	2024-09-26 02:27:46 +01:00
ochafik	a774093a99	tool-call: add server tests for llama 3.1	2024-09-26 02:17:30 +01:00
ochafik	45b243b4a5	minja: fix llama_chat_apply_template + adde use_jinja param to validate_model_chat_template	2024-09-26 02:14:42 +01:00
ochafik	e983c9d0de	tool-call: fix llama_chat_apply_template signature / test-chat-template	2024-09-25 22:02:58 +01:00
ochafik	33ea20edd1	Merge remote-tracking branch 'origin/master' into tool-call	2024-09-25 18:58:54 +01:00
ochafik	4706bdbae1	tool-call: support Functionary v3 vs. v3-llama3.1 variants	2024-09-25 17:33:00 +01:00
ochafik	41103c0ed6	server: add --chat-template-file	2024-09-25 16:14:46 +01:00
ochafik	e309c6a47f	tool-call: integrate minja & tool-call to server when --jinja is set	2024-09-25 16:14:46 +01:00
ochafik	3cfc21ea71	tool-call: basic Functionary 3.2, Llama 3.1, Hermes 2 Pro grammar generators + parsers	2024-09-25 16:14:22 +01:00