llama.cpp/run.h

#pragma once

#include "llama.h"
#include "utils.h"

int run(llama_context * ctx,
        gpt_params params,
        std::istream & instream,
        FILE *outstream,
        FILE *errstream);
Add main.cpp back and invoke "run" from it Signed-off-by: Thiago Padilha <thiago@padilha.cc> 2023-03-22 12:16:33 +00:00			`#pragma once`

Move llama_context setup + perplexity back to main.cpp Signed-off-by: Thiago Padilha <thiago@padilha.cc> 2023-03-22 12:39:25 +00:00			`#include "llama.h"`
			`#include "utils.h"`

Remove direct access to std streams from "run" The goal is to allow running "run" while connected to other streams, such as TCP sockets. Signed-off-by: Thiago Padilha <thiago@padilha.cc> 2023-03-22 12:55:45 +00:00			`int run(llama_context * ctx,`
			`gpt_params params,`
			`std::istream & instream,`
			`FILE *outstream,`
			`FILE *errstream);`