ai-tier/edge

Speech-to-text benchmarks

Measured results
Raspberry Pi 5 · 16 GB RAMAll performance measurements are for this device.

Overview

Capability & performance

Benchmark breakdown

Compare models

Word error rate ↓ · processing time ↓

Test details

Reading the results

Benchmark progress

    Researched models

    Models we plan to test. Results appear after their benchmarks finish.

    Results table · 21 configurations

    Overall recognition averages English word error rates from LibriSpeech clean, LibriSpeech other and FLEURS equally. German uses FLEURS alone. A Pi 5 processing factor below 1 means faster than playback. A dash means no matching measurement is available.

    All tested configurations. AI HAT results are labelled separately.
    ModelOverall English WER · % ↓Overall German WER · % ↓Pi 5 processing factor ↓Peak memory · MiB ↓
    Whisper Tiny14330.191963
    Moonshine Tiny11—0.054332
    Parakeet TDT 0.6B v35.47.90.1122,271
    Whisper Base9.6200.3651,516
    Moonshine Base8.8—0.097552
    Whisper Small6.3111.2553,767
    Underdog Bark 3.04.9———
    Fluid Speech Mini4.1—0.33480
    Whisper Tiny · AI HAT42580.154558
    Whisper Base · AI HAT29540.293608
    Gemma 4 E2B IT8.69.61.5915,654
    Gemma 4 E4B IT7.79.93.1848,231
    Qwen3-ASR 0.6B4.38.80.4932,601
    Qwen3-ASR 1.7B3.25.21.2175,016
    Voxtral Mini 3B572415.6296,281
    LFM2.5-Audio-1.5B4.4—0.7562,924
    Qwen2.5 Omni 3B12139.496,812
    Ultravox 0.5 1B25193—3,476
    Qwen2.5 Omni 7B5813516.5811,169
    LFM3-Audio-2B4.96.60.7153,100
    LFM3-Omni-2B4.87.10.7043,468

    Download full data · Download summary · Methodology