llama.cpp/ggml/src/ggml-cuda/sumrows.cuh
Georgi Gerganov 231cff5f6f sync : ggml
2024-08-27 22:41:27 +03:00

6 lines
213 B
Plaintext

#include "common.cuh"
void sum_rows_f32_cuda(const float * x, float * dst, const int ncols, const int nrows, cudaStream_t stream);
void ggml_cuda_op_sum_rows(ggml_backend_cuda_context & ctx, ggml_tensor * dst);