Patents by Inventor Chiao-fe Shu

Chiao-fe Shu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 8971580
    Abstract: An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising: identifying one or more pixel regions from the plurality of pixel regions containing trajectory data; performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and generating a transition chain code based on the multi-point neighborhood scan. Embodiments further generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code, and generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.
    Type: Grant
    Filed: May 28, 2013
    Date of Patent: March 3, 2015
    Assignee: International Business Machines Corporation
    Inventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
  • Patent number: 8965042
    Abstract: The present invention relates to the measurement of human activities through video, particularly in retail environments. A method for measuring retail display effectiveness in accordance with an embodiment of the present invention includes: detecting a moving object in a field of view of an imaging device, the imaging device obtaining image data of a product display; tracking the object in the field of view of the imaging device to obtain a track; and obtaining statistics for the track with regard to the product display.
    Type: Grant
    Filed: March 20, 2007
    Date of Patent: February 24, 2015
    Assignee: International Business Machines Corporation
    Inventors: Sergio Borger, Christopher R. Carlson, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu
  • Patent number: 8655016
    Abstract: Methods and apparatus are provided for example-based object retrieval that can retrieve objects from video images in real-time. An object of interest is identified in a sequence of images by obtaining an identification from a user of an example object having at least one attribute of interest; generating a query object based on the identified example object, wherein the query object has a substantially similar viewpoint as objects in the sequence of images and wherein the query object comprises a plurality of attributes that are substantially similar as the example object; and processing the sequence of images to identify the object of interest based on a similarity metric to the query object.
    Type: Grant
    Filed: July 29, 2011
    Date of Patent: February 18, 2014
    Assignee: International Business Machines Corporation
    Inventors: Lisa M. Brown, Frederik C. M. Kjeldsen, Chiao-Fe Shu
  • Publication number: 20140028845
    Abstract: An approach for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of a trajectory of an object for an event within video image data; generate a lossless compressed contour-coded blob to encode the trajectory data of the trajectory of the object for the event within video image data; generate a lossy searchable code of the trajectory of the object for the event within the video image data; convert a region of interest within the video image data to a lossy query code, the region of interest corresponding to a sub-section of a visual display output of the video image data; and compare the lossy query code to the lossy searchable code within a relational database to identify a corresponding lossless trajectory data of the trajectory of the object for the event within the video image data.
    Type: Application
    Filed: September 30, 2013
    Publication date: January 30, 2014
    Applicant: International Business Machines Corporation
    Inventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
  • Patent number: 8619140
    Abstract: A solution for monitoring an area while accounting for camera motion and/or monitoring tasks is provided. For example, a physical area corresponding to a new field of view can be estimated for a camera for which motion is detected. The physical area can be estimated using a set of reference images previously captured by the camera, each of which comprises a unique field of view previously captured by the camera. Based on the physical area, a status for a monitoring task of the camera (e.g., an alert) can be updated and/or a location of an area for the monitoring task within an image captured by the camera can be updated. Further, based on the update(s), a field of view for a second camera can be automatically adjusted and/or a status for the monitoring task on the second camera can be automatically updated.
    Type: Grant
    Filed: July 30, 2007
    Date of Patent: December 31, 2013
    Assignee: International Business Machines Corporation
    Inventors: Lisa M. Brown, Jonathan H. Connell, II, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu, Ying-Li Tian
  • Patent number: 8614744
    Abstract: A solution for monitoring an area includes using a region schema for the area. The region schema can include a set of prototypical tracks, each of which includes a start location, an end location, and a trajectory. The trajectory comprises an expected path an object will travel between the start location and the end location and can include variation information that defines an amount that an object can vary from the trajectory. The region schema can be generated by obtaining training object tracking data for the area for an initialization time period and evaluating the object tracking data to identify the set of prototypical tracks. While monitoring the area, monitored object tracking data is obtained for a monitored object in the area, and abnormal behavior of the monitored object is identified when the monitored object tracking data for the monitored object does not follow at least one of the set of prototypical tracks in the region schema.
    Type: Grant
    Filed: July 21, 2008
    Date of Patent: December 24, 2013
    Assignee: International Business Machines Corporation
    Inventors: Lisa M. Brown, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu, Ying-li Tian
  • Patent number: 8601494
    Abstract: Multiple event types are monitored for events, and surveillance data is stored for each event. Surveillance data for a primary event of one event type can be presented to a user, and surveillance data for a set of related events corresponding to another event type can be presented based on a set of relatedness criteria and the surveillance data for the primary event. A user can adjust the relatedness criteria to filter/adjust the surveillance data presented for the related event(s). A user interface can enable the user to simultaneously view the surveillance data for both events and adjust the relatedness criteria. In an illustrative application, the invention is utilized to detect fraudulent merchandise returns in a retail store.
    Type: Grant
    Filed: January 14, 2008
    Date of Patent: December 3, 2013
    Assignee: International Business Machines Corporation
    Inventors: Lisa M. Brown, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu, Yun Zhai
  • Patent number: 8576342
    Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation is disclosed. Certain embodiments utilize a hierarchical processing technique. A first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds can be user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.
    Type: Grant
    Filed: January 30, 2012
    Date of Patent: November 5, 2013
    Assignee: Virage, Inc.
    Inventors: Arun Hampapur, Mojgan Monika Gorkani, Chiao-Fe Shu, Amarnath Gupta
  • Patent number: 8553778
    Abstract: An invention for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, generate a lossless compressed contour-coded blob to encode the trajectory data of the event within video image data, and generate a lossy searchable code to enable searching of a relational database based on the trajectory data of the event within the video image data.
    Type: Grant
    Filed: March 19, 2009
    Date of Patent: October 8, 2013
    Assignee: International Business Machines Corporation
    Inventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
  • Publication number: 20130259316
    Abstract: An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising: identifying one or more pixel regions from the plurality of pixel regions containing trajectory data; performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and generating a transition chain code based on the multi-point neighborhood scan. Embodiments further generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code, and generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.
    Type: Application
    Filed: May 28, 2013
    Publication date: October 3, 2013
    Applicant: International Business Machines Corporation
    Inventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
  • Patent number: 8537219
    Abstract: An invention for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, and generate a set of compressed spatial representation of the trajectory data of the event within the video image data. A database component is configured to input the set of compressed spatial representations into a relational database, and a search component is configured to search the relational database to identify a spatial location of the event within the video image data.
    Type: Grant
    Filed: March 19, 2009
    Date of Patent: September 17, 2013
    Assignee: International Business Machines Corporation
    Inventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
  • Publication number: 20130028468
    Abstract: Methods and apparatus are provided for example-based object retrieval that can retrieve objects from video images in real-time. An object of interest is identified in a sequence of images by obtaining an identification from a user of an example object having at least one attribute of interest; generating a query object based on the identified example object, wherein the query object has a substantially similar viewpoint as objects in the sequence of images and wherein the query object comprises a plurality of attributes that are substantially similar as the example object; and processing the sequence of images to identify the object of interest based on a similarity metric to the query object.
    Type: Application
    Filed: July 29, 2011
    Publication date: January 31, 2013
    Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Lisa M. Brown, Frederik C. M. Kjeldsen, Chiao-fe Shu
  • Publication number: 20120128242
    Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation is disclosed. Certain embodiments utilize a hierarchical processing technique. A first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds can be user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.
    Type: Application
    Filed: January 30, 2012
    Publication date: May 24, 2012
    Applicant: Virage, Inc.
    Inventors: Arun Hampapur, Mojgan Monika Gorkani, Chiao-Fe Shu, Amarnath Gupta
  • Patent number: 8134457
    Abstract: A system and method for monitoring events includes defining alert events based on primitive event types in an environment monitored by monitoring devices. Alert parameters are set for each alert event, and alert events are combined to create a composite alert event based on a plurality of alert events. A plurality of engines is monitored to determine if multiple events comprising the composite alert event have occurred.
    Type: Grant
    Filed: June 4, 2008
    Date of Patent: March 13, 2012
    Assignee: International Business Machines Corporation
    Inventors: Senem Velipasalar, Lisa Marie Brown, Arun Hampapur, Chiao-Fe Shu
  • Patent number: 8107015
    Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation. The method utilizes a hierarchical processing technique. The first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds are user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.
    Type: Grant
    Filed: June 6, 1997
    Date of Patent: January 31, 2012
    Assignee: Virage, Incorporated
    Inventors: Arun Hampapur, Mojgan Monika Gorkani, Chiao-Fe Shu, Amarnath Gupta
  • Patent number: 8054330
    Abstract: Systems and methods are disclosed for implementing and managing distributed video surveillance systems. Systems and methods in accordance with the present invention provide a well-organized structure for describing and implementing distributed video surveillance systems and service protocols for managing the surveillance activities of clusters of video surveillance cameras. In particular, the service protocols provide a high degree of control over the surveillance activities of video surveillance cameras. In addition, the service protocols also provide a great deal of flexibility in selecting and managing a wide range of analytical and managerial tools for available for analyzing and organizing video track information.
    Type: Grant
    Filed: October 14, 2004
    Date of Patent: November 8, 2011
    Assignee: International Business Machines Corporation
    Inventors: Chiao-Fe Shu, Arun Hampapur
  • Publication number: 20110211070
    Abstract: Systems and methods are disclosed for analyzing, managing and cataloguing video tracks generated by a video surveillance system. Systems and methods operating in accordance with the present invention receive video tracks from a video surveillance system; analyze them for particular categories of, for example, objects or events, assign unique identifying tags to the video tracks; and save them in highly-cross-referenced databases so that video tracks containing, for example, particular objects or events can be easily searched for and recalled. In addition, the present invention provides browsing facilities for viewing events that have just elapsed, events that are occurring in near real-time.
    Type: Application
    Filed: March 31, 2011
    Publication date: September 1, 2011
    Applicant: International Business Machines Corporation
    Inventors: Chiao-Fe Shu, Arun Hampapur, Max Lu
  • Publication number: 20100238285
    Abstract: An invention for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, and generate a set of compressed spatial representation of the trajectory data of the event within the video image data. A database component is configured to input the set of compressed spatial representations into a relational database, and a search component is configured to search the relational database to identify a spatial location of the event within the video image data.
    Type: Application
    Filed: March 19, 2009
    Publication date: September 23, 2010
    Applicant: International Business Machines Corporation
    Inventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
  • Publication number: 20100239016
    Abstract: An invention for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, generate a lossless compressed contour-coded blob to encode the trajectory data of the event within video image data, and generate a lossy searchable code to enable searching of a relational database based on the trajectory data of the event within the video image data.
    Type: Application
    Filed: March 19, 2009
    Publication date: September 23, 2010
    Applicant: International Business Machines Corporation
    Inventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
  • Patent number: 7791466
    Abstract: The present invention includes a method, system, and program product for detecting an event that includes receiving at least one data input stream from one or more sensors, selecting a data input stream from one of the one or more sensors, recording the data input stream on a recordable medium, specifying a rule comprising an event in the data input stream, and detecting at least one event in the data input stream based upon the rule.
    Type: Grant
    Filed: January 11, 2008
    Date of Patent: September 7, 2010
    Assignee: International Business Machines Corporation
    Inventors: Lalit Agarwalla, Sergio Borger, Lisa M. Brown, Christopher R. Carlson, Raymond A. Cooke, Barry Gottlieb, Arun Hampapur, Christopher A. LoGiudice, Linda C. Owen, Andrew W. Senior, Chiao-Fe Shu