Karthik Hariharakrishnan

US Patent:

7142600, Nov 28, 2006

Filed:

Apr 21, 2003

Appl. No.:

10/249577

Inventors:

Dan Schonfeld - Glenview IL, US
Karthik Hariharakrishnan - Chicago IL, US
Philippe Raffy - Sunnyvale CA, US
Fathy Yassa - Soquel CA, US

Assignee:

NeoMagic Corp. - Santa Clara CA

International Classification:

H04N 7/12
H04N 11/02
H04N 11/04
H04B 1/66

US Classification:

37524016

Abstract:

An object in a video sequence is tracked by object masks generated for frames in the sequence. Macroblocks are motion compensated to predict the new object mask. Large differences between the next frame and the current frame detect suspect regions that may be obscured in the next frame. The motion vectors in the object are clustered using a K-means algorithm. The cluster centroid motion vectors are compared to an average motion vector of each suspect region. When the motion differences are small, the suspect region is considered part of the object and removed from the object mask as an occlusion. Large differences between the prior frame and the current frame detect suspected newly-uncovered regions. The average motion vector of each suspect region is compared to cluster centroid motion vectors. When the motion differences are small, the suspect region is added to the object mask as a disocclusion.

US Patent:

RE42790, Oct 4, 2011

Filed:

Nov 26, 2008

Appl. No.:

12/324481

Inventors:

Dan Schonfeld - Chicago IL, US
Karthik Hariharakrishnan - Chicago IL, US
Philippe Raffy - Edina MN, US
Fathy Yassa - Soquel CA, US

Assignee:

NeoMagic Corporation - Santa Clara CA

International Classification:

H04N 7/12
H04N 11/02
H04N 11/04
H04B 1/66

US Classification:

37524016

Abstract:

An object in a video sequence is tracked by object masks generated for frames in the sequence. Macroblocks are motion compensated to predict the new object mask. Large differences between the next frame and the current frame detect suspect regions that may be obscured in the next frame. The motion vectors in the object are clustered using a K-means algorithm. The cluster centroid motion vectors are compared to an average motion vector of each suspect region. When the motion differences are small, the suspect region is considered part of the object and removed from the object mask as an occlusion. Large differences between the prior frame and the current frame detect suspected newly-uncovered regions. The average motion vector of each suspect region is compared to cluster centroid motion vectors. When the motion differences are small, the suspect region is added to the object mask as a disocclusion.

US Patent:

7095786, Aug 22, 2006

Filed:

Jan 11, 2003

Appl. No.:

10/248348

Inventors:

Dan Schonfeld - Glenview IL, US
Karthik Hariharakrishnan - Chicago IL, US
Philippe Raffy - Sunnyvale CA, US
Fathy Yassa - Soquel CA, US

Assignee:

Neo Magic Corp. - Santa Clara CA

International Classification:

H04N 7/12

US Classification:

37524016, 382236

Abstract:

An object in a video sequence of frames is tracked by object masks generated for frames in the sequence. Macroblocks are motion compensated. Blocks matching entirely within a prior-frame object mask are used to generate an average object motion. When the average motion is below a motion threshold, frames are skipped at larger intervals, but more frequent frames are processed when high motion occurs. When the macroblock best matches a prior-frame block that has the object's boundary passing through the block, the macroblock is uncertain and is sub-divided into smaller sub-blocks that are again motion compensated. Sub-blocks matching blocks within the object mask in the base frame are added to the new object mask for the current frame while sub-blocks matching a block containing the object boundary are uncertain and can again be sub-divided to further refine the object boundary. Frame skipping and adaptive-size blocks on the object boundary reduce computational load.