I have done a fair amount of this sort of thing. I work with a mix of Isadora, Quartz Composer, and TouchDesigner depending on the project. Imaging is usually some combination of Kinects, high frame rate IR cameras, and high frame rate visible light cameras. I have also used thermal imaging cameras, embedded encoders in scenic elements, pressure mats, and TOF depth cameras for various projects.