ROBUST AND GENERIC APPROACHES FOR VIDEOSEGMENTATION

K. Mahesh; K. Kuppusamy; P. Pandi selvi

Authors

K. Mahesh Associate Professor, Department of Computer Science and Engg Alagappa University, Karaikudi,TN,India Author
K. Kuppusamy Associate Professor, Department of Computer Science and Engg Alagappa University, Karaikudi,TN,India Author
P. Pandi selvi Department of Computer Science and Engineering Alagappa University, Karaikudi,TN, India Author

Keywords:

Ensemble clustering, motion segmentation, object-based video segmentation, point tracking, video coding, reality-based 3-D models

Abstract

The survey describes an approach for object –oriented video segmentation based on motion coherence. Using a tracking process ,2-D motion patterns are identified with an ensemble clustering approach. Particles are clustered to obtain a pixel-wise segmentation in space and time domains. The limitation of the segmentation method concerning with complex 3-D spatial motion can be solved by using reality-based 3-D models. The reality-based 3-D models are produced with range-based, image-based or CAD modeling techniques. Each 3-D model can contain different levels of geometry and need therefore to be semantically segmented and organized in different ways.

References

T. Boult and L. G. Brown, “Factorization-based segmentation of motions,” in Proc. IEEE Workshop Visual Motion, 1991, pp. 179–186.

Costeira and Kanade, “A multibody factorization method for independently moving objects,” Int. J. Comput. Vis., vol. 29, pp. 159–179, 1998.

K. Kanatani, “Motion segmentation by subspace separation and model selection,” in Proc. 8th IEEE Int. Conf. Computer Vision, 2001, vol. 2, pp. 586–591.

A. Gruber and Y. Weiss, “Multibody factorization with uncertainty and missing data using the em algorithm,” in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2004, vol. 1, pp. I-707–I-714.

Yan and Pollefeys, “A general framework for motion segmentation: Independent, articulated, rigid, non-rigid, degenerate and non-degenerate,” presented at the ECCV, 2006.

R. Vidal and R. Hartley, “Motion segmentation with missing data using powerfactorization and gpca,” in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2004, vol. 2, pp. II-310–II-316.

A. Mitiche, R. El-Feghali, and A.-R. Mansouri, “Motion tracking as spatio-temporal motion boundary detection,” Robot. Autonom. Syst., vol. 43, no. 1, pp. 39–50, 2003.

R. Feghali and A. Mitiche, “Spatiotemporal motion boundary detection and motion boundary velocity estimation for tracking moving objects with a moving camera: a level sets pdes approach with concurrent camera motion compensation,” IEEE Trans. Image Process., vol. 13, no. 11, pp. 1473–1490, Nov. 2004.

D. Cremers and S. Soatto, “Variational space-time motion segmentation,” in Proc. 9th IEEE Int. Conf. Computer Vision, 2003, vol. 2, pp. 886–893.

M. Ristivojevic and J. Konrad, “Space-time image sequence analysis: Object tunnels and occlusion volumes,” IEEE Trans. Image Process., vol. 15, pp. 364–376, 2006.

L. Torres, M. Kunt, and F. Pereira, “Second generation video coding schemes and their role in mpeg-4,” in Proc. MPEG-4 Eur. Conf. Multimedia Applications, Services and Techniques, 1996, pp. 799–824.

M. Irani and P. Anandan, “About direct methods,” in Proc. Int. Workshop on Vision Algorithms: Theory and Practice, 2000, pp. 267–277.

R. Tron and R. Vidal, “A benchmark for the comparison of 3-d motion segmentation algorithms,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007, pp. 1–8.

H. Sekkati and A. Mitiche, “Concurrent 3-d motion segmentation and 3-D interpretation of temporal sequences of monocular images,” IEEE Trans. Image Process., vol. 15, no. 3, pp. 641–653, Mar. 2006.

R. Lublinerman, O. Camps, and M. Sznaier, “Dynamics based robust motion segmentation,” in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2006, vol. 1, pp. 1176–1184.

R. Vidal, S. Sastry, and Y. Ma, “Generalized principal component analysis (gpca),” IEEE Trans. Pattern Anal. Mach. Intell., pp. 1945–1959, 2005.

H. Sekkati and A. Mitiche, “Joint optical flow estimation, segmentation, and 3D interpretation with level sets,” Comput. Vis. Image Understand., pp. 89–100, Aug. 2006.

A. Mitiche and H. Sekkati, “Optical flow3Dsegmentation and interpretation: A variational method with active curve evolution and level sets,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 11, pp. 1818–1829, Nov. 2006.

K. Schindler, U. James, and H. Wang, “Perspective n-view multibody structure-and-motion through model selection,” in Proc. 9th Eur. Conf. Computer Vision, 2006, pp. 606–619.

T. Li, D. Singaraju, R. Vidal, and V. Kallem, “Projective factorization of multiple rigid-body motions,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007, pp. 1–6.

P. H. S. Torr and A. Zisserman, “Feature based methods for structure and motion estimation,” in Proc. Int. Workshop on Vision Algorithms: Theory and Practice, 2000, pp. 278– 294.

D. Cremers, T. Kohlberger, and C. Schnörr, A. Heyden, Ed. et al., “Nonlinear shape statistics in mumford-shah based segmentation,” in Proc. Eur. Conf. Computer Vision, Copenhagen, Denmark, May 2002, vol. 2351, pp. 93–108.

D. Cremers, S. J. Osher, and S. Soatto, “Kernel density estimation and intrinsic alignment for shape priors in level set segmentation,” Int. J. Comput. Vis., vol. 69, no. 3, pp. 335–351, Sep. 2006.

D. Cremers, “Dynamical statistical shape priors for level set based tracking,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1262–1273, Aug. 2006.

H. Sekkati and A. Mitiche, “Joint dense 3D interpretation and multiple motion segmentation of temporal image sequences: A variational framework with active curve evolution and level sets,” Image Process., vol. 1, pp. 553–556, 2004.

N. Ichimura, “A robust and efficient motion segmentation based on orthogonal projection matrix of shape space,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000, vol. 2, pp. 446–452.

Y. Li, D. Hatzinakos, and A. Venetsanopoulos, “A multi-frame, regionfeature based technique for motion segmentation,” in Proc. Int. Conf. Image Processing, 1999, vol. 1, pp. 11–15.

S. Smith and J. Brady, “Asset-2: Real-time motion segmentation and shape tracking,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 814–820, Aug. 1995.

C. Harris and M. Stephens, “A combined corner and edge detector,” in Proc. 4th Alvey Vision Conf., 1988, pp. 147–151.

J. Shi, J. Shi, C. Tomasi, and C. Tomasi, “Good features to track,” in Proc. IEEE Computer Society Computer Vision and Pattern Recognition, 1994, pp. 593–600.

D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” Int. J. Comput. Vis., pp. 91–110, Nov. 2004.

M. Gelgon, P. Bouthemy, and J.-P. Le Cadre, “Recovery of the trajectories of multiple moving objects in an image sequence with a PMHT approach,” Int. J. Comput. Vis., vol. 23, no. 1, pp. 19–31, 2005.

B. K. P. Horn, Robot Vision (MIT Electrical Engineering and Computer Science). Cambridge, MA: The MIT Press, 1986.

P. Sand and S. Teller, “Particle video: Long-range motion estimation using point trajectories,” Comput. Vis. Pattern Recognit., vol. 2, pp. 2195–2202, 2006.

J. Wang, G. Eude, Q. Liu, and H. Lu, “Moving object segmentation using graph cuts,” in Proc. ICSP 7th Int. Conf. Signal Processing, 2004, vol. 1, pp. 777–780.

H. Xu, M. Kabuka, and A. Younis, “Automatic moving object extraction for content-based applications,” IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 6, pp. 796–812, Jun. 2004.

P. Viswanath and K. Jayasurya, “A fast and efficient ensemble clustering method,” in Proc. 18th Int. Conf. Pattern Recognition, 2006, vol. 2, pp. 720–723.

A. Strehl and J. Ghosh, “Cluster ensembles—A knowledge reuse framework for combining multiple partitions,” J. Mach. Learn. Res, vol. 3, pp. 583–617, 2003.

A. Fred and A. Jain, “Combining multiple clusterings using evidence accumulation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, pp. 835–850, 2005.

D. Comaniciu and P. Meer, “Mean shift: A robust approach toward feature space analysis,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, pp. 603–619, 2002.

A. K. Jain, M. N. Murty, and P. J. Flynn, “Data clustering: A review,” ACM Comput. Surv., vol. 31, pp. 264–323, 1999.

T. Meier and K. Ngan, “Automatic segmentation of moving objects for video object plane generation,” IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 525–538, 1998.

Y. Nie and K.-K. Ma, “Adaptive rood pattern search for fast blockmatching motion estimation,” IEEE Trans. Image Process., vol. 11, pp. 1442–1449, 2002.

Gruen, A.: Reality-based generation of virtual environments for digital earth. International Journal of Digital Earth 1(1) (2008)

Remondino, F., El-Hakim, S.: Image-based 3d modelling: a review. The Photogrammetric Record 21(115), 269–291 (2006)

Blais, F.: A review of 20 years of range sensors development. Journal of Electronic Imaging 13(1), 231–240 (2004)

Vosselman, G., Maas, H.-G.: Airborne and terrestrial laser scanning, p. 320. CRC Press, Boca Raton (2010)

Yin, X., Wonka, P., Razdan, A.: Generating 3d building models from architectural drawings: A survey. IEEE Computer Graphics and Applications 29(1), 20–30 (2009)

Stamos, I., Liu, L., Chen, C., Woldberg, G., Yu, G., Zokai, S.: Integrating automated range registration with multiview geometry for photorealistic modelling of large-scale scenes. International Journal of Computer Vision 78(2-3), 237–260 (2008)

Guidi, G., Remondino, F., Russo, M., Menna, F., Rizzi, A., Ercoli, S.: A multi-resolution methodology for the 3d modeling of large and complex archaeological areas. International Journal of Architectural Computing 7(1), 40–55 (2009).

Remondino, F., El-Hakim, S., Girardi, S., Rizzi, A., Benedetti, S., Gonzo, L.: 3D virtual reconstruction and visualization of complex architectures - The 3d-arch project. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 38(5/W10), on CD-ROM (2009)

Mueller, P., Wonka, P., Haegler, S., Ulmer, A., Van Gool, L.: Procedural modeling of buildings. ACM Transactions on Graphics 25(3), 614–623 (2006)

Agarwal, S., Snavely, N., Simon, I., Seitz, S., Szelinski, R.: Building Rome in a day. In: Proc. ICCV 2009, Kyoto, Japan (2009)

Remondino, F., El-Hakim, S., Gruen, A., Zhang, L.: Development and performance analysis of image matching for detailed surface reconstruction of heritage objects. IEEE Signal Processing Magazine 25(4), 55–65 (2008)

Hirschmueller, H.: Stereo processing by semi-global matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(2), 328–341 (2008)

Hiep, V.H., Keriven, R., Labatut, P., Pons, J.P.: Towards high-resolution large-scale multiview stereo. In: Proc. CVPR 2009, Kyoto, Japan (2009)

Patias, P., Grussenmeyer, P., Hanke, K.: Applications in cultural heritage documentation. Advances in Photogrammetry, Remote Sensing and Spatial Information Sciences. In: 2008 ISPRS Congress Book, vol. 7, pp. 363–384 (2008)

Barazzetti, L., Remondino, F., Scaioni, M.: Automation in 3D reconstruction: results on different kinds of close-range blocks. In: ISPRS Commission V Symposium Int. Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Newcastle upon Tyne, UK, vol. 38(5) (2010)

Nagel, C., Stadler, A., Kolbe, T.H.: Conceptual Requirements for the Automatic Reconstruction of Building Information Models from Uninterpreted 3D Models. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 38(3-4/C3) (2009) 124 A.M. Manferdini and F. Remondino

Attene, M., Katz, S., Mortara, M., Patané, G., Spagnuolo, M., Tal, A.: Mesh segmentation - a comparative study. In: Proc. IEEE International Conference on Shape Modeling and Applications 2006, p. 12. IEEE Computer Society, Washington (2006).

Shamir, A.: A survey on mesh segmentation techniques. Computer Graphics Forum 27(6), 1539–1556 (2008)

Benhabiles, H., Vandeborre, J.-P., Lavoué, G., Daoudi, M.: A framework for the objective evaluation of segmentation algorithms using a ground-truth of human segmented 3D models. In: Proc. IEEE Intern. Conference on Shape Modeling and Applications 2009, p. 8. IEEE Computer Society, Washington (2009)

Chen, X., Golovinskiy, A., Funkhouser, T.: A Benchmark for 3D Mesh Segmentation. Proc. ACM Transactions on Graphics 28(3), 12 (2009)

Robbiano, F., Attene, M., Spagnuolo, M., Falcidieno, B.: Part-based annotation of virtual 3d shapes. In: Proc. of the International Conference on Cyberworlds, pp. 427–436. IEEE Computer Society, Washington (2007)

Image Fast Template Matching Algorithm Based on Projection and Sequential Similarity Detecting Liyong Ma, Yude Sun, Naizhang Feng, Zheng Liu School of Information Science and Engineering Harbin Institute of Technology at Weihai Weihai, China maly@hitwh.edu.cn, sun-yd@163.com, fengnz@hitwh.edu.cn, withitren@yahoo.com.cn (2010)