Nonrigid Optical Flow Ground Truth
for Real-World Scenes with Time-Varying Shading Effects


Our Ground Truth

In this work we present a dense ground truth dataset of nonrigidly deforming real-world scenes. Our dataset contains both long and short video sequences, and enables the quantitatively evaluation for RGB based tracking and registration methods. To construct ground truth for the RGB sequences, we simultaneously capture Near-Infrared (NIR) image sequences where dense markers - visible only in NIR - represent ground truth positions. This allows for comparison with automatically tracked RGB positions and the formation of error metrics. Most previous datasets containing nonrigidly deforming sequences are based on synthetic data. Our capture protocol enables us to acquire real-world deforming objects with realistic photometric effects - such as blur and illumination change - as well as occlusion and complex deformations. A public evaluation website is constructed to allow for ranking of RGB image based optical flow and other dense tracking algorithms, with various statistical measures.

Citation

W. Li, D. Cosker, Z. Lv, M. Brown, "Nonrigid Optical Flow Ground Truth for Real-World Scenes with Time-Varying Shading Effects". IEEE Robotics and Automation Letters (RA-L), 0, 0 (2016), 8.

Bibtex

Dataset and Public Evaluation (Coming Soon)

Test Sequences

Training Data

Submit Your Flow Fields

Results and Evaluation