A system for tracking whisker kinematics and whisker shape in three dimensions

Abstract

Quantification of behaviour is essential for systems neuroscience. Since the whisker system is a major model system for investigating the neural basis of behaviour, it is important to have methods for measuring whisker movements from behaving animals. Here, we developed a high-speed imaging system that measures whisker movements simultaneously from two vantage points. We developed an algorithm that uses the ‘stereo’ video data to track multiple whiskers by fitting 3D curves to the basal section of each target whisker. By using temporal information to constrain the fits, the algorithm is able to track multiple whiskers in parallel with low error rate. We used the output of the tracker to produce a 3D description of each tracked whisker, including its 3D orientation and 3D shape, as well as bending-related mechanical force. In conclusion, we present an automatic system to track whiskers in 3D from high-speed video, creating the opportunity for comprehensive 3D analysis of sensorimotor behaviour and its neural basis.