Document Type

Journal Article

Department/Unit

Department of Computer Science

Title

A local region based approach to lip tracking

Language

English

Abstract

Lip tracking has played a significant role in a lip reading system. In this paper, we present a local region based approach to lip tracking, which consists of two phases: (i) lip contour extraction for the first lip frame, and followed by (ii) lip tracking in the subsequent lip frames. Initially, we construct a localized color active color model provided that the foreground and background regions around the object are locally different in color space. In the first phase, we find a combined semi-ellipse around the lip as the initial evolving curve and compute the localized energies for curve evolution such that the lip image is separated into lip and non-lip regions. Then, we utilize a 16-point deformable model (Wang et al., 2004 [20]) with geometric constraint to achieve lip contour extraction. In the second phase, we present a dynamic selection of the radius of local regions associated with the extracted lip contour of the previous frame to realize lip tracking. The proposed approach not only adapts to the lip movement, but it is also robust against the appearance of teeth, tongue and black hole. Extensive experiments show the efficiency of the proposed lip tracking algorithm in comparison with the existing methods. © 2012 Elsevier Ltd. All rights reserved.

Keywords

Deformable model, Lip tracking, Local region, Localized color active contour model, Semi-ellipse

Publication Date

2012

Source Publication Title

Pattern Recognition

Volume

45

Issue

9

Start Page

3336

End Page

3347

Publisher

Elsevier

DOI

10.1016/j.patcog.2012.02.024

Link to Publisher's Edition

http://dx.doi.org/10.1016/j.patcog.2012.02.024

ISSN (print)

00313203

This document is currently not available here.

Link to Publisher's Version

Share

COinS