llama.cpp/examples/embedding/README.md

22 lines
564 B
Markdown
Raw Permalink Normal View History

2023-09-21 08:57:40 +00:00
# llama.cpp/example/embedding
2023-09-21 08:57:40 +00:00
This example demonstrates generate high-dimensional embedding vector of a given text with llama.cpp.
## Quick Start
To get started right away, run the following command, making sure to use the correct path for the model you have:
### Unix-based systems (Linux, macOS, etc.):
```bash
./embedding -m ./path/to/model --log-disable -p "Hello World!" 2>/dev/null
```
### Windows:
```powershell
embedding.exe -m ./path/to/model --log-disable -p "Hello World!" 2>$null
```
The above command will output space-separated float values.