llama.cpp/run.h
Thiago Padilha bf44faa0ee
Remove direct access to std streams from "run"
The goal is to allow running "run" while connected to other streams,
such as TCP sockets.

Signed-off-by: Thiago Padilha <thiago@padilha.cc>
2023-03-22 14:34:18 -03:00

11 lines
193 B
C++

#pragma once
#include "llama.h"
#include "utils.h"
int run(llama_context * ctx,
gpt_params params,
std::istream & instream,
FILE *outstream,
FILE *errstream);