OMNIECHOBENCH-QA

Spatial intelligence.
Measured.

How well can a model understand the world through sound and sight?
Compare Audio & Vision performance across five spatial reasoning tasks.

Audio & VisionUpdated October 18, 2026
MODELS EVALUATED10models

One unified Audio & Vision table

HIGHEST OVERALL43.9%

Qwen3.8-omni-flash

OMNIECHO · OVERALL28.5%

FOA spatial audio + vision

BEST COGNITIVE MAP47.5%

OmniEcho

Audio & Vision

10 MODELS
Download CSV
Accuracy (%) · Higher is betterClick a metric to sort · Scroll horizontally on smaller screens
OmniEchoBench-QA Audio and Vision accuracy. Ten models ranked by reported overall accuracy. Percentages, higher is better.
#
01
Qwen3.8-omni-flash
74.147.928.637.439.543.9
02
Gemini3.8-flash
53.734.122.131.326.032.0
03
Gemini3.7-flash
45.332.824.433.426.231.4
04
muse-spark-1.2
55.034.219.629.625.231.3
05
OmniEcho OURS
Base: Qwen3-Omni-30B-A3B
41.722.614.224.747.528.5
06
doubao-seed-2-0-lite-260428
34.330.622.129.625.328.3
07
Qwen3.5-Omni-Plus
52.416.119.622.225.223.3
08
Qwen3-Omni-30B-A3B
Base: Qwen3-Omni-30B-A3B
32.716.37.720.922.318.5
09
Qwen2.5-Omni-7B
Base: Qwen2.5-Omni-7B
24.98.05.414.020.012.6
10
SO-7B
Base: Qwen2.5-Omni-7B
21.45.20.017.122.811.4
10 of 10 models●   Best in columnHighlighted row: OmniEchoRank: Overall ↓

Reading the results. All entries use audio and vision. Overall is reproduced as reported, rather than calculated as a simple mean of the five columns. Ranks remain based on Overall when sorting other metrics.

Data provenance. The Audio & Vision results from the OmniEcho paper are combined with additional results supplied by the project maintainer. OmniEcho uses the paper values (41.7 Camera Rotation; 14.2 3D Localization). Download the full data and notes ↗

BEHIND THE NUMBERS

Five ways to understand space.

01 / VIEWPOINT

Camera Rotation

Infer how the camera rotates from synchronized audio and visual cues.

02 / DIRECTION

Source Direction

Identify where a sound comes from, including sources outside the frame.

03 / POSITION

3D Localization

Estimate a sounding source’s position in three-dimensional space.

04 / MOVEMENT

Source Motion

Reason about the heading and motion of a source over time.

05 / SCENE LAYOUT

Cognitive Map

Connect heard directions to positions on a bird’s-eye map.

Discover the research behind the benchmark.

Real-world spatial audio, a dedicated FOA encoder, and embodied reasoning.

Explore OmniEcho