Q4_K_M
A commonly available lower-memory GGUF variant; the listed memory input is an estimate, not the repository file size.
- Bits per weight
- 4.5
Model catalog
Qwen's 14.8B general-purpose Qwen3 model, filling the size range between the existing 8B and 27B entries.
Lower-bit quantizations generally use less memory. The compatibility calculator uses these candidates and its transparent approximate memory assumptions; it does not make a performance guarantee.
A commonly available lower-memory GGUF variant; the listed memory input is an estimate, not the repository file size.
A higher-memory GGUF variant where listed by the conversion repository; the listed memory input remains approximate.
Weight estimates are approximate and include a runtime overhead. Real requirements vary with context length, runtime, drivers, and other system use. A model page cannot determine compatibility without your hardware profile; use the calculator for that assessment.
Qwen3 14B publisher model card; verified value, last verified 2026-09-24. Parameter count, Apache-2.0 license, and native 32K context come from the publisher. The separate GGUF candidates are from bartowski's community conversion; extended YaRN context is not included. View source