quartz composer

I want to make grass ground space which is interacted with audience's motion and sounds.

Now, I can just make it interacted with the 

- sounds (like music and crapping hands -> it interacted with light) and 

- grass graphics just have one color. 

It can be interacted other motion (jumping or step) and  showing the other images as the sounds on the screen. if the project need, i will use other materials like arduino or something, not only quartz composer.

actually this vedio reacted with music, but i can not recorded with the sounds :(

quartz composer

sketch!!!!