GGUF
Articles covering GGUF.
-
[Local LLM 07] Use GGUF Models and the API in LM Studio
Load a compatible GGUF model in LM Studio, inspect resource settings and test its local API with the selected model.
-
[Local LLM 27] Compare GGUF and CPU/GPU Options in llama.cpp
Run a GGUF model with llama.cpp and compare CPU and GPU settings while keeping the model and request conditions recorded.