 |
    |
Optical Flow Estimation with Channel Constancy
Laura Sevilla-Lara1, Deqing Sun2, Erik G. Learned-Miller1, and Michael J. Black3
1School of Computer Science, University of Massachusetts, Amherst, MA, USA
lsevilla@cs.umass.edu
elm@cs.umass.edu
2School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA
dqsun@seas.harvard.edu
3Max Planck Institute for Intelligent Systems, Tübingen, Germany
black@tuebingen.mpg.de
Abstract. Large motions remain a challenge for current optical flow algorithms. Traditionally, large motions are addressed using multi-resolution representations like Gaussian pyramids. To deal with large displacements, many pyramid levels are needed and, if an object is small, it may be invisible at the highest levels. To address this we decompose images using a channel representation (CR) and replace the standard brightness constancy assumption with a descriptor constancy assumption. CRs can be seen as an over-segmentation of the scene into layers based on some image feature. If the appearance of a foreground object differs from the background then its descriptor will be different and they will be represented in different layers. We create a pyramid by smoothing these layers, without mixing foreground and background or losing small objects. Our method estimates more accurate flow than the baseline on the MPI-Sintel benchmark, especially for fast motions and near motion boundaries.
Keywords: Optical flow, channel representation, pyramids, large motions
LNCS 8689, p. 423 ff.
lncs@springer.com
© Springer International Publishing Switzerland 2014