A common file format for quantized local LLM weights.
Reviewed:
Full definition
A common file format for quantized local LLM weights.
This short alias entry points to the related topic local-ai for full explanation, examples, and sources.
Related encyclopedia topic
Local AI
— Local AI runs models on devices or private infrastructure you control, reducing reliance on third-party cloud inference for privacy, offline use, or cost…
