Music Technology

Before You Argue About How Something Sounds, This Site Makes You Prove You Can Hear It

The Audio Stuff's free ABX testing tool replaces gut-feeling audio comparisons with a real blind test and a p-value — 12 out of 16 correct gets you a verdict, not a shrug.

Every producer has had the argument: does this codec actually sound worse, or does it just feel like it should because you know it’s the cheaper option? Jakub Charkiewicz, of the audio-review site The Audio Stuff, built a free browser-based tool to settle that argument the way audio engineering actually settles it — with a double-blind ABX test, launched in a writeup on CDM on August 24.

How it actually works

The mechanics are the standard ABX protocol, just made frictionless: you’re given two known references, A and B, plus an unknown sample X that’s secretly assigned to match one or the other. You can switch between them as many times as you want — the tool preserves playback position across switches, which matters since auditory memory for subtle differences lasts only a few seconds — then commit to a guess. Do that enough times and the tool reports a p-value, so a run of 12-correct-out-of-16 gets an actual statistical verdict instead of a vibe. Six built-in test pairs cover a spread of difficulty, from an easy 0.5 dB level mismatch to a genuinely hard polarity-inverted pink-noise comparison, alongside more musically relevant tests like full-bandwidth audio versus a 16kHz low-pass and clean tone versus 1% THD distortion. Users can also upload their own files to test any comparison they’re actually curious about — two export settings, two plugins, two masters.

Why it fits here

Most music-technology coverage is about tools that make something — a synth, a sequencer, a generative system. This is a tool that makes you check your own claims before you make them, which is a rarer and arguably more useful kind of instrument: the number of forum arguments about “obviously audible” differences that don’t survive a real blind test is not small, and a free, no-signup way to find out which side of that line your ears actually fall on is worth knowing about.