Qwen3-VL 8B Instruct on Pi 5

Snapshot 2026-10-27 · ai-tier

Raspberry Pi 5 · 16 GB RAMAll performance measurements are for this device.

Capability shows how well the model answers the benchmark questions. Speed, response time and memory are measured on Raspberry Pi 5 · 16 GB.

Capability summarises instruction following, tool calling and finding information in long prompts. Speed and memory refer to the Raspberry Pi 5. — means unavailable.
Model	Capability / 100	Output tok/s	Prompt tok/s	First token · s	Task time · s	Peak memory · MiB	Parameters · B
Qwen3-VL 8B InstructQ4_K_M · 4,096 context · reasoning off	90	2.4	10.9	36.1	164.5	9,494	8.8

Benchmark breakdown

Instruction following · IFEval	Tool calling · BFCL	Finding information · RULER
86	86	98

Test configuration

Model publisher: Qwen
Model parameters: 8.767 billion total
Published input support: text, image, video (metadata; not device validation)
Quantization: Q4_K_M
Context capacity: 4,096 tokens
Reasoning mode: off
CPU threads / parallel requests: 4 / 1
Temperature / seed: 0 / 42
Measurement date: 2026-10-19T08:22:01.770878+00:00
Result ID: split-dec48ffd7d596479219e
Runtime revision: 620d2225cc436ab0b001e3200e590e3b286ef9ab
Artifact repository / revision: Qwen/Qwen3-VL-8B-Instruct-GGUF / f982a07559d4a2f6c8744d840bf6fccab30eea96
Artifact SHA256: 67d1659bfe71b89d50b45a4ad1a9e5b997e5bb16ce5da66a6a6167abd569e9e2
Dataset revision: a0fc00b6a07455d1efb70cc19d5ca94c5923c5261a0b41095083a41a1592a1f6
Configuration identity: 6465cc504abdfd5711f52edc2dad9d54b15be14eb8592b035f9ca99e61dc7d0e

Measurement limits

Speed tests read 256 input tokens and generate 128 output tokens, repeated ten times. The output speed test starts without a long conversation history. Answer time uses six fixed prompts with up to 128 output tokens, repeated three times. First-text time is measured from the application making the request. Peak memory includes the loaded model; it excludes other applications on the device. Longer prompts may need more memory. Capability uses a fixed selection of public questions, rather than the full official benchmarks.

All Pi 5 measurements Methodology Publisher model card ↗Pinned engine source ↗

Measured 2026-10-19T08:22:01.770878+00:00.