mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2025-01-13 12:10:18 +00:00
ba1cb19cdd
* Barebone Qwen2VL LLM convertor * Add Qwen2VL cli entrypoint * [WIP] add qwen2vl arch * Verify m-rope output * Add vl-rope/2d-rope support for qwen2vl ViT * update qwen2vl cli tool * update 5D tensor op workaround * [WIP] qwen2vl vision model * make batch and clip utils compatible with qwen2vl * [WIP] create inference workflow, gguf convert script but fix * correcting vision-rope behavior, add the missing last layer back to ViT * add arg parser to qwen2vl_surgery * replace variable size array with vector * cuda-gdb cmake preset * add fp32 mrope, vision rope kernel * add fp16 support for qwen2vl and m-rope * add `GGML_ROPE_TYPE_MROPE`, `GGML_ROPE_TYPE_VISION` * fix rope op mode switching, out dated func args * update `llama_hparams` * update to keep up stream changes * resolve linter, test errors * add makefile entry, update speical image padding token * add mrope unit test, fix few compiler warnings * rename `mrope` related function, params * minor updates on debug util, bug fixs * add `m-rope` testcase to `test-backend-ops` * Apply suggestions from code review Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * fix traililng whitespce * store `llama_hparams.rope_sections` with fixed size array * update position id tensor size check in GGML_OP_ROPE * minor updates * update `ggml_backend_*_supports_op` of unsupported backends * remote old `rope_section` compare operator --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> |
||
|---|---|---|
| .. | ||
| dpct | ||
| backend.hpp | ||
| CMakeLists.txt | ||
| common.cpp | ||
| common.hpp | ||
| concat.cpp | ||
| concat.hpp | ||
| conv.cpp | ||
| conv.hpp | ||
| convert.cpp | ||
| convert.hpp | ||
| dequantize.hpp | ||
| dmmv.cpp | ||
| dmmv.hpp | ||
| element_wise.cpp | ||
| element_wise.hpp | ||
| gemm.hpp | ||
| ggml-sycl.cpp | ||
| im2col.cpp | ||
| im2col.hpp | ||
| mmq.cpp | ||
| mmq.hpp | ||
| mmvq.cpp | ||
| mmvq.hpp | ||
| norm.cpp | ||
| norm.hpp | ||
| outprod.cpp | ||
| outprod.hpp | ||
| presets.hpp | ||
| rope.cpp | ||
| rope.hpp | ||
| softmax.cpp | ||
| softmax.hpp | ||
| tsembd.cpp | ||
| tsembd.hpp | ||
| vecdotq.hpp | ||
| wkv6.cpp | ||
| wkv6.hpp | ||