Q4_K_M
A commonly available lower-memory GGUF variant; the listed memory input is an estimate, not the repository file size.
- Bits per weight
- 4.5
Model catalog
Google's largest Gemma 3 instruction variant, useful for exploring high-memory local configurations.
Lower-bit quantizations generally use less memory. The compatibility calculator uses these candidates and its transparent approximate memory assumptions; it does not make a performance guarantee.
A commonly available lower-memory GGUF variant; the listed memory input is an estimate, not the repository file size.
A higher-memory GGUF variant where listed by the conversion repository; the listed memory input remains approximate.
Weight estimates are approximate and include a runtime overhead. Real requirements vary with context length, runtime, drivers, and other system use. A model page cannot determine compatibility without your hardware profile; use the calculator for that assessment.
Google Gemma 3 27B IT model card; verified value, last verified 2026-09-23. Publisher metadata; multimodal encoder memory is outside the text-weight estimate. GGUF availability is documented separately by ggml-org. View source