GGUF

About

GGUF is a file format designed for storing and distributing large language models, primarily used with llama.cpp.

Key Features

• Single file format
• Metadata storage
• Extensibility

Pros

• Easy to use
• Improved metadata handling
• Simplifies model management

Cons

• Relatively new
• Limited tooling outside llama.cpp