Tulu 3.1 Llama 3.1 8B on Pi 5
Raspberry Pi 5 · 16 GB RAMAll performance measurements are for this device.
Capability shows how well the model answers the benchmark questions. Speed, response time and memory are measured on Raspberry Pi 5 · 16 GB.
| Model | Capability / 100 | Output tok/s | Prompt tok/s | First token · s | Task time · s | Peak memory · MiB | Parameters · B |
|---|---|---|---|---|---|---|---|
| Tulu 3.1 Llama 3.1 8BQ4_K_M · 4,096 context · reasoning off | 79 | 2.6 | 11 | 37.1 | 162.4 | 9,348 | 8 |
Benchmark breakdown
| Instruction following · IFEval | Tool calling · BFCL | Finding information · RULER |
|---|---|---|
| 77 | 63 | 98 |
Test configuration
- Model publisher
- Allen Institute for AI
- Model parameters
- 8 billion total
- Published input support
- text (metadata; not device validation)
- Quantization
- Q4_K_M
- Context capacity
- 4,096 tokens
- Reasoning mode
- off
- CPU threads / parallel requests
- 4 / 1
- Temperature / seed
- 0 / 42
- Measurement date
- 2026-10-18T18:41:12.774331+00:00
- Result ID
- split-6c80743b243b24d791e9
- Runtime revision
- 620d2225cc436ab0b001e3200e590e3b286ef9ab
- Artifact repository / revision
- bartowski/allenai_Llama-3.1-Tulu-3.1-8B-GGUF / ff76e96ffddff3c0eb12f973241f5cfbad3cc543
- Artifact SHA256
- 5eae0f1a9bcdea7cad9f1d0d5ba7540bb3de3e2d72293c076a23f24db1c2c7da
- Dataset revision
- a0fc00b6a07455d1efb70cc19d5ca94c5923c5261a0b41095083a41a1592a1f6
- Configuration identity
- df48e49d494ad1ebd2ab6a180ee7daca5c2726b9a46f92556c581c8288a6fe81
Measurement limits
Speed tests read 256 input tokens and generate 128 output tokens, repeated ten times. The output speed test starts without a long conversation history. Answer time uses six fixed prompts with up to 128 output tokens, repeated three times. First-text time is measured from the application making the request. Peak memory includes the loaded model; it excludes other applications on the device. Longer prompts may need more memory. Capability uses a fixed selection of public questions, rather than the full official benchmarks.
Measured 2026-10-18T18:41:12.774331+00:00.