Edit Models filters

Model Tree

Qwen/Qwen2.5-0.5B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

220

Base only

Active filters: Qwen/Qwen2.5-0.5B-Instruct

llmware/qwen2.5-0.5b-instruct-ov

Updated Oct 31, 2024 • 19 • 2

QuantFactory/Reasoning-0.5b-GGUF

0.5B • Updated Oct 7, 2024 • 487 • 2

QuantFactory/Qwen2.5-0.5b-RBase-GGUF

0.5B • Updated Oct 7, 2024 • 45 • 2

QuantFactory/Vikhr-Qwen-2.5-0.5b-Instruct-GGUF

0.5B • Updated Oct 8, 2024 • 100 • 2

RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8

Text Generation • 0.6B • Updated Dec 9, 2024 • 278

ysn-rfd/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 25, 2024 • 37 • 1

marroyo777/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Oct 28, 2024 • 19

Volko76/Qwen2.5-0.5B-Instruct-Q5_K_M-GGUF

Text Generation • 0.5B • Updated Apr 28, 2025 • 12

Felladrin/gguf-Q8_0-Qwen2.5-0.5B-Instruct

0.5B • Updated Apr 28, 2025 • 8

ll3214/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Nov 2, 2024 • 4

Izhanjafry/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 5, 2024 • 9

tensorblock/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jan 27 • 116

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Nov 13, 2024 • 12.5k • 1

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Nov 13, 2024 • 374

teka38/vicuna_DocMental-0.5b-v3.1-gguf

0.5B • Updated Nov 13, 2024 • 4

osllmai-community/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Jan 24, 2025 • 3

sizhkhy/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • 0.5B • Updated Nov 18, 2024 • 3

ystemsrx/Qwen2.5-Interpreter

Text Generation • 0.5B • Updated Jan 18, 2025 • 59 • • 2

cgus/Qwen2.5-0.5B-Instruct-exl2

Text Generation • Updated Apr 28, 2025 • 11 • 1

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 28, 2024 • 10

OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc

0.2B • Updated Sep 11, 2025 • 19.7k

nyuuzyou/Qwen2.5-0.5B-Bluesky-Instruct

Text Generation • 0.5B • Updated Apr 28, 2025 • 13 • 3

Alcoft/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Apr 29, 2025 • 304

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-0cb1b

Text Generation • 46.4M • Updated Dec 17, 2024 • 4

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-104ce

Text Generation • 61.8M • Updated Dec 18, 2024 • 8

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-196c8

Text Generation • 77.3M • Updated Dec 18, 2024 • 3

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-8777b

Text Generation • 0.1B • Updated Dec 18, 2024 • 5

TheBlueObserver/Qwen2.5-0.5B-Instruct-MLX-393a7

Text Generation • 0.1B • Updated Dec 18, 2024 • 4

reach-vb/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • 61.8M • Updated Dec 24, 2024 • 9

Novaciano/Qwen2.5-0.5B-NSFW_Amoral_Christmas-GGUF

Text Generation • 0.5B • Updated Dec 25, 2024 • 99 • 1