23 Commits

Author	SHA1	Message	Date
Olivier Chafik	7f2429e6b0	tool-calls: fix grammar regression	2024-10-22 11:49:50 +01:00
ochafik	9f5ab97756	tool-calls: add generic tool call style as default	2024-10-22 10:53:21 +01:00
ochafik	fa8462ffd3	fix root	2024-10-22 10:53:01 +01:00
ochafik	75764871e6	tool-call: fix grammar roots	2024-10-22 10:50:52 +01:00
ochafik	332506910f	tool-call: accept {"type": "function", "name": "fn" for llama 3.x	2024-10-07 02:23:37 +01:00
Olivier Chafik	366efc8a18	tool-call: fix llama 3.x tc parsing when there are spaces before "name"	2024-10-03 21:46:41 +01:00
Olivier Chafik	b4fc1e8ba7	tool-call: adjust triggers to most common tool call variations from Llama-3.1-8B and Llama-3.2-3B	2024-10-03 19:23:08 +01:00
Olivier Chafik	c36a196f53	tool-call: prepare possible externalization of minja + factor tool call style out of template	2024-10-01 23:12:24 +01:00
ochafik	dbda025f87	tool-call: test messages -> template -> grammar -> tool call parser	2024-09-28 22:32:47 +01:00
ochafik	05bbba9f8a	tool-call: only match json eagerly for Llama 3.2	2024-09-28 19:05:10 +01:00
ochafik	7cef90cf9c	tool-call: more eager function call parsing for Functionary & Llama (give a chance to 3B model)	2024-09-28 18:33:40 +01:00
ochafik	d983516f40	tool-call: let the tool call handler expand chat template, moving builtin_tools down as extra_context	2024-09-28 17:46:36 +01:00
ochafik	e62b5de3cf	tool-call: fix functionary-small-3.2 (first tool starts w/ name\n, subsequent are >>>name\n)	2024-09-27 07:06:33 +01:00
ochafik	f62e688387	tool-call: fix crash / test non-tool call case (added llama_sampler_is_grammar_empty)	2024-09-27 06:04:41 +01:00
ochafik	cf7bece6a7	tool-call: factor chat template away from legacy API	2024-09-26 17:19:29 +01:00
ochafik	d7ec84f78c	tool-call: allow <|python_tag|> in functionary-medium-3.1	2024-09-26 06:52:34 +01:00
ochafik	3d2650ce65	fix gcc build	2024-09-26 06:52:34 +01:00
ochafik	0c870133d8	tool-call: test/fix functionary-medium-v3.1's template (can "look" like llama3.1 template)	2024-09-26 05:56:15 +01:00
ochafik	595e11cb11	tool-call: fix/test functionary v3	2024-09-26 03:42:05 +01:00
ochafik	1b6280102b	fix editorconfig lints	2024-09-26 02:27:46 +01:00
ochafik	a774093a99	tool-call: add server tests for llama 3.1	2024-09-26 02:17:30 +01:00
ochafik	4706bdbae1	tool-call: support Functionary v3 vs. v3-llama3.1 variants	2024-09-25 17:33:00 +01:00
ochafik	3cfc21ea71	tool-call: basic Functionary 3.2, Llama 3.1, Hermes 2 Pro grammar generators + parsers	2024-09-25 16:14:22 +01:00