Model catalog

Qwen2.5-Coder 7B Instruct

A code-focused instruction model, adding a distinct software-development use case to the catalog.

Check this model on your hardware See what your PC can run

Model overview

Family: Qwen2.5-Coder
Provider: Qwen
Architecture: Qwen2
Parameters: 7.6B
Formats: gguf, safetensors
Runtimes: llama.cpp
License: Apache-2.0
Maximum context: 131,072 tokens

Available quantizations

Lower-bit quantizations generally use less memory. The compatibility calculator uses these candidates and its transparent approximate memory assumptions; it does not make a performance guarantee.

Q4_K_M

A commonly available lower-memory GGUF variant; the listed memory input is an estimate, not the repository file size.

Bits per weight: 4.5
Source: Qwen/Qwen2.5-Coder-7B-Instruct-GGUF GGUF repository

Q8_0

A higher-memory GGUF variant where listed by the conversion repository; the listed memory input remains approximate.

Bits per weight: 8
Source: Qwen/Qwen2.5-Coder-7B-Instruct-GGUF GGUF repository

Compatibility notes

Weight estimates are approximate and include a runtime overhead. Real requirements vary with context length, runtime, drivers, and other system use. A model page cannot determine compatibility without your hardware profile; use the calculator for that assessment.

Qwen2.5-Coder 7B Instruct publisher model card; verified value, last verified 2026-09-23. The publisher describes this as the 7B code-specialized variant. Parameter count is rounded to 7.6B for planning; Qwen separately publishes GGUF conversion files. View source