Tue, Dec 10, 2024

How to build llama.cpp on my laptop

mkdir build
cd build
cmake .. -DGGML_CUDA=ON -DBUILD_SHARED_LIBS=OFF
cmake --build . --config Release -j
sudo cmake --install .

Next - Previous