This article describes an original method to track 2D templates in a video sequence. This approach is based on robust modelling of the interaction between pattern movement and grey level variations in the image using fuzzy bimodal rules. Movement estimation is performed by inverting these rules and polling the results in a quasi-continuous histogram. Some experimental results are given to illustrate the performance of this algorithm.