Sound recording using optical marker-based motion tracking system: Relation between various constraints

Optical marker-based motion tracking system is the device that can record the motion of moving object using multiple high-speed infrared (IR) cameras. Recent development of the motion capture device enables capturing the detailed motions with high spatial precision of sub-millimeter and high sampling rate up to 10 kHz. Currently, the motion tracking cameras can record the local vibrating movement of an acoustic instrument, which makes it possible to retrieve sound from the visual domain. In this study, two constraints in using marker-based motion tracking cameras for the sound recording are discussed. One is the temporal constraint where high sampling rates cause the detectability problem of the retro-reflective marker. When the cameras are operated with high speed, the cameras cannot radiate sufficient IR light and makes it hard to detect. The other is the amplitude constraint where the low camera calibration accuracy increases the signal-to-noise ratio. The effect of these constraints is observed using ...