Hi Leo
It should be possible to make progress with this. I have done several projects where external input is sent to Sonic Pi to trigger sounds. It is fairly easy to do using OSC messages. I have not used javascript much but a quick google shows that there are OSC libraries available.
It is also possible to run Sonic Pi in the background see Sonic Pi for standalone installations
However it will use quite a lot of resources, so you may find if you add a game on top that it is not ideal on a Raspberry Pi.
1 Like