Deformable Template Tracking in 1ms (Oral)

We address the problem of real-time deformable template tracking. Our approach relies on linear predictors which establish a linear relation between the image intensity differences of a template and the corresponding template transformation parameters. Up to this work, linear predictors have only been used to handle linear transformations such as homographies to track planar surfaces. In this paper, we introduce a method to learn non-linear template transformations that allows us to track surfaces that undergo non-rigid deformations. These deformations are mathematically modelled using 2D Free Form Deformations. Moreover, the simplicity of our approach allows us to track deformable surfaces at extremely high speed of approximately 1 ms per frame that has never been shown before.     «

We address the problem of real-time deformable template tracking. Our approach relies on linear predictors which establish a linear relation between the image intensity differences of a template and the corresponding template transformation parameters. Up to this work, linear predictors have only been used to handle linear transformations such as homographies to track planar surfaces. In this paper, we introduce a method to learn non-linear template transformations that allows us to track surfac...     »