 |
    |
Generalized Background Subtraction Using Superpixels with Label Integrated Motion Estimation
Jongwoo Lim1 and Bohyung Han2
1Division of Computer Science and Engineering, Hanyang University, Seoul, Korea
jlim@hanyang.ac.kr
2Department of Computer Science and Engineering, POSTECH, Korea
bhhan@postech.ac.kr
Abstract. We propose an online background subtraction algorithm with superpixel-based density estimation for videos captured by moving camera. Our algorithm maintains appearance and motion models of foreground and background for each superpixel, computes foreground and background likelihoods for each pixel based on the models, and determines pixelwise labels using binary belief propagation. The estimated labels trigger the update of appearance and motion models, and the above steps are performed iteratively in each frame. After convergence, appearance models are propagated through a sequential Bayesian filtering, where predictions rely on motion fields of both labels whose computation exploits the segmentation mask. Superpixel-based modeling and label integrated motion estimation make propagated appearance models more accurate compared to existing methods since the models are constructed on visually coherent regions and the quality of estimated motion is improved by avoiding motion smoothing across regions with different labels. We evaluate our algorithm with challenging video sequences and present significant performance improvement over the state-of-the-art techniques quantitatively and qualitatively.
Keywords: generalized background subtraction, superpixel segmentation, density propagation, layered optical flow estimation
LNCS 8693, p. 173 ff.
lncs@springer.com
© Springer International Publishing Switzerland 2014