mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-12-27 03:44:35 +00:00
9a913110cf
* convert chameleon hf to gguf * add chameleon tokenizer tests * fix lint * implement chameleon graph * add swin norm param * return qk norm weights and biases to original format * implement swin norm * suppress image token output * rem tabs * add comment to conversion * fix ci * check for k norm separately * adapt to new lora implementation * fix layer input for swin norm * move swin_norm in gguf writer * add comment regarding special token regex in chameleon pre-tokenizer * Update src/llama.cpp Co-authored-by: compilade <git@compilade.net> * fix punctuation regex in chameleon pre-tokenizer (@compilade) Co-authored-by: compilade <git@compilade.net> * fix lint * trigger ci --------- Co-authored-by: compilade <git@compilade.net>
47 lines
3.0 KiB
Plaintext
47 lines
3.0 KiB
Plaintext
17245 16604 16403 16604 33583 18355
|
|
16421 51153
|
|
|
|
16604
|
|
16650
|
|
16650 16604
|
|
16581
|
|
16582
|
|
16582 16582
|
|
16582 16582 16582
|
|
16581 16582
|
|
31596 17394
|
|
34926 17394
|
|
31596 18671
|
|
34926 18671
|
|
34926 18671 16384
|
|
31596 16395 17394 16384
|
|
34926 16395 17394 16384
|
|
16811 16704 20410 16483 16631 16397 52854
|
|
16470 16399 16403 16407 16604 16406 35764 38185 51595 22592 26639
|
|
29479 23955 17012 20103 25527 27670 17408 19005 21473 24774
|
|
54254 42231 48084 29409 16617 61889 29409 16608 21954 16628 21954 16499 58445 29409 16607 58445 21954 16479 42231 21954 16611 21954 16607 21954 16633 21954 16611 29409 16607 21954 16615
|
|
52351 16604 16391 25825 16392 23686 16498 39161 18885 16618 16488 30853 16604 16391 54124 17153 25134 16656 18476 26169 16895 16392 62193 16611 16604 16391 24664 17153 57169 16721 16872 17073 17304 28729 16392
|
|
31596
|
|
34926
|
|
16650 31596
|
|
16650 34926
|
|
16696 31596
|
|
16696 31596 16582 16696 31596
|
|
16604 16391
|
|
16582 16604 16412
|
|
16390 22623
|
|
31596 16395 16712 16390 16828 16384 17674 16769 16732 23686 16607 16604 16414 24427 16623 41809 16495 28999 36469 45292 30197 16400 16402 16400 16403 16400 16404 16400 43969 65211 16636
|
|
16384 16384 16384 16384 16384 16384
|
|
16402
|
|
16402 16402
|
|
16402 16402 16402
|
|
16402 16402 16402 16402
|
|
16402 16402 16402 16402 16402
|
|
16402 16402 16402 16402 16402 16402
|
|
16402 16402 16402 16402 16402 16402 16402
|
|
16402 16402 16402 16402 16402 16402 16402 16402
|
|
16402 16402 16402 16402 16402 16402 16402 16402 16402
|
|
16418 19038 16639 16448 24315 33727 16467
|
|
18765 17981
|
|
16582 16604 16582 16582 16604 16582 16582 16582 16604 16581 16604 16581 16581 16604 16581 16582 16650 16582 16650 16604 16582 16696 16582 16696 16604 16582 52351 16604 16391 25825 16392 23686 16498 39161 18885 16618 16488 30853 16604 16391 54124 17153 25134 16656 18476 26169 16895 16392 62193 16611 20410 16483 16631 18885 16483 16631 16604 16402 16604 16402 16402 16604 16402 16402 16402 16604 16402 16402 16402 16402 16604 16402 16402 16402 16402 16402 16604 16402 16402 16402 16402 16402 16402 16604 16402 16402 16402 16402 16402 16402 16402 16604 16402 16402 16402 16402 16402 16402 16402 16402 16604 16402 16397 16402 16604 16402 16397 16397 16402 16604 16402 16397 16397 16397 16402 16604 54254 42231 48084 29409 16617 61889 29409 16608 21954 16628 21954 16499 58445 29409 16607 58445 21954 16479 42231 21954 16611 27683 16607 16604 16414 24427 16623 41809 16495 28999 36469 45292 30197 16400 16402 16400 16403 16400 16404 16400 43969 65211 16636 16604 16396 16396 16396 16396 16396 16396 16412 16412 16412 16412 16412 16412 16412 27268 23955 17012 20103 25527 27670 17408 19005 21473 24774 16604 16390 16390 16390 16390 16390 16390 16447 16447 16447 16447 16447 16447 16447 16385 16385 16385 16385 16397 16397 16397 16397 16397 16397 16384 16384 16384 16384 16384 16384 16414 16414 16414 16414 16414 16414 16687 16390 16690 16992 16604 16390 61797 16733 16390 16466 16986 16395 16604 16390 17879 16732 17811 16414 16604 16390 16428 16804 17811 16687 16390 16683 17190 16728 16395 16604 16390 16419 16732 16945 16991 25251 16414 17119 16390 38127 16641 16390 16459 16427
|