I’ve been working on a music player that combines audio analysis and shaders to produce real-time music videos. These videos are similar to motion graphics/after effects style music videos that you can often find on youtube and the like, except done in real-time!
Yeah, it’s a desktop app made using electron and react.
Most of the effects are implemented as shader passes fed through the default EffectComposer, so basically a fancy post-processing pipeline. Audio analysis feeds values into uniforms to produce audio-reactive animations and transitions. There’s other stuff like the particles and the camera, but most of it is fairly basic and nothing too special