And here are the tutorials I mentioned a few days ago, to create this type of scene, where particles are driven by music:
part 1 (2min): Create Real time Particle Simulations From Music - introduction [part 1/4] - YouTube
quick summary where I show snippets of what this tutorial is about, namely how to use audio to drive elements like material properties, lights and forces applied to particles.
part 2 (16min): Create Real time Particle Simulations From Music - connect volume to any parameter [part 2/4] - YouTube
Here I show the basic on how to import and manipulate audio in Polygonjs.
part 3 (16min): Create Real time Particle Simulations From Music - use waveform data into shaders [part 3/4] - YouTube
this explains how to use waveform data inside a material.
part 4 (57min): Create Real time Particle Simulations From Music - connect FFT to particles [part 4/4] - YouTube
This last part explains how to use FFT audio analysis to drive particles.
Hope that’s interesting. Feel free to let me know if anybody has other experiences or techniques to use audio to drive WebGL elements.