GGUF PR has officially been merged into master!
GGUF PR has officially been merged into master!
github.com
GGUF by ggerganov · Pull Request #2398 · ggerganov/llama.cpp
ref: ggerganov/ggml#302 #1991 This PR paves the way for integrating more models into llama.cpp. It changes the file format in which we convert the models by extending it with key-value pairs meta......
They still consider it a beta but there we go! It's happening :D