Our goal is to implement a fluid-based music analyzer that allows user interaction. To achieve this goal, we based our project on the Real-Time Fluid Dynamics for Games paper written by Jos Stam, which suggests using a modified version of the Navier-Stokes Equations which is able to simulate the fluid in real-time while making the fluid look realistic.
Previous work with fluid-based music renderings have performed real-time simulation, but have lacked clarity into the current state of given frequencies. Without an understanding of where to look and what to look for, users will be unable to make proper use of a music analyzer. Our approach is to use a strict mapping between both the frequency and the location as well as the frequency and the color. This will enable users to know where to look to understand what’s happening with a given frequency as well as what colors to look for to understand the amplitude of a given frequency.
Play around with our simulation here !