iPhone X Face as Interface

Dear in_thread, I am experimenting of using face scan of iPhone X to deliver some rapid inputs to Sonic Pi.

Super awful noisy result here, but it has potential.

Ok I realized I have not made much effort but basically we have some 51 face shapes emotions expressions muscle of face, normalized between 0-1, and supposedly I want them to make some kind of sense.

I am looking for some ideas and inputs. What is the quick code that “trigger” a beat if value is reaching a certain threshold.

In this case, the way I set the up, it is going to be a non stop rapid inputs from the iPhone X. Ideally I would really just want to trigger a sound when the coefficient is reaching > 0.5 for example.

I wonder what kind of sound will it makes based on me reading a certain poem or something… it’s gonna be pretty abstract.