The effect I want to achieve would be like this :
An interactive instrument / game.
I can use my body in the screen to touch the balls on the screen and affect their movement(it looks just like I hit some balls in reality).
Then, use OSC to send this messages in openFramewors to Max/Msp/Jitter.
And use Max/Msp/Jitter to generate some melodies and beats, that is when I hit the balls, or when the balls hit the boundaries of the screen, it will play different melodies and beats.
Software: Max/Msp/Jitter; openFrameworks.
I made openFrameworks talk to Max/Msp, now I can use openFrameworks to control the sound data in Max/Msp. Now I gonna connect it with openCV, and use openCV to control the data in Max/Msp.
STILL WORKING ON IT.
TO BE CONTINUED..