Patents by Inventor Chiao-fe Shu
Chiao-fe Shu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 8971580Abstract: An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising: identifying one or more pixel regions from the plurality of pixel regions containing trajectory data; performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and generating a transition chain code based on the multi-point neighborhood scan. Embodiments further generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code, and generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.Type: GrantFiled: May 28, 2013Date of Patent: March 3, 2015Assignee: International Business Machines CorporationInventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
-
Patent number: 8965042Abstract: The present invention relates to the measurement of human activities through video, particularly in retail environments. A method for measuring retail display effectiveness in accordance with an embodiment of the present invention includes: detecting a moving object in a field of view of an imaging device, the imaging device obtaining image data of a product display; tracking the object in the field of view of the imaging device to obtain a track; and obtaining statistics for the track with regard to the product display.Type: GrantFiled: March 20, 2007Date of Patent: February 24, 2015Assignee: International Business Machines CorporationInventors: Sergio Borger, Christopher R. Carlson, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu
-
Patent number: 8655016Abstract: Methods and apparatus are provided for example-based object retrieval that can retrieve objects from video images in real-time. An object of interest is identified in a sequence of images by obtaining an identification from a user of an example object having at least one attribute of interest; generating a query object based on the identified example object, wherein the query object has a substantially similar viewpoint as objects in the sequence of images and wherein the query object comprises a plurality of attributes that are substantially similar as the example object; and processing the sequence of images to identify the object of interest based on a similarity metric to the query object.Type: GrantFiled: July 29, 2011Date of Patent: February 18, 2014Assignee: International Business Machines CorporationInventors: Lisa M. Brown, Frederik C. M. Kjeldsen, Chiao-Fe Shu
-
Publication number: 20140028845Abstract: An approach for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of a trajectory of an object for an event within video image data; generate a lossless compressed contour-coded blob to encode the trajectory data of the trajectory of the object for the event within video image data; generate a lossy searchable code of the trajectory of the object for the event within the video image data; convert a region of interest within the video image data to a lossy query code, the region of interest corresponding to a sub-section of a visual display output of the video image data; and compare the lossy query code to the lossy searchable code within a relational database to identify a corresponding lossless trajectory data of the trajectory of the object for the event within the video image data.Type: ApplicationFiled: September 30, 2013Publication date: January 30, 2014Applicant: International Business Machines CorporationInventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
-
Patent number: 8619140Abstract: A solution for monitoring an area while accounting for camera motion and/or monitoring tasks is provided. For example, a physical area corresponding to a new field of view can be estimated for a camera for which motion is detected. The physical area can be estimated using a set of reference images previously captured by the camera, each of which comprises a unique field of view previously captured by the camera. Based on the physical area, a status for a monitoring task of the camera (e.g., an alert) can be updated and/or a location of an area for the monitoring task within an image captured by the camera can be updated. Further, based on the update(s), a field of view for a second camera can be automatically adjusted and/or a status for the monitoring task on the second camera can be automatically updated.Type: GrantFiled: July 30, 2007Date of Patent: December 31, 2013Assignee: International Business Machines CorporationInventors: Lisa M. Brown, Jonathan H. Connell, II, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu, Ying-Li Tian
-
Patent number: 8614744Abstract: A solution for monitoring an area includes using a region schema for the area. The region schema can include a set of prototypical tracks, each of which includes a start location, an end location, and a trajectory. The trajectory comprises an expected path an object will travel between the start location and the end location and can include variation information that defines an amount that an object can vary from the trajectory. The region schema can be generated by obtaining training object tracking data for the area for an initialization time period and evaluating the object tracking data to identify the set of prototypical tracks. While monitoring the area, monitored object tracking data is obtained for a monitored object in the area, and abnormal behavior of the monitored object is identified when the monitored object tracking data for the monitored object does not follow at least one of the set of prototypical tracks in the region schema.Type: GrantFiled: July 21, 2008Date of Patent: December 24, 2013Assignee: International Business Machines CorporationInventors: Lisa M. Brown, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu, Ying-li Tian
-
Patent number: 8601494Abstract: Multiple event types are monitored for events, and surveillance data is stored for each event. Surveillance data for a primary event of one event type can be presented to a user, and surveillance data for a set of related events corresponding to another event type can be presented based on a set of relatedness criteria and the surveillance data for the primary event. A user can adjust the relatedness criteria to filter/adjust the surveillance data presented for the related event(s). A user interface can enable the user to simultaneously view the surveillance data for both events and adjust the relatedness criteria. In an illustrative application, the invention is utilized to detect fraudulent merchandise returns in a retail store.Type: GrantFiled: January 14, 2008Date of Patent: December 3, 2013Assignee: International Business Machines CorporationInventors: Lisa M. Brown, Arun Hampapur, Andrew W. Senior, Chiao-Fe Shu, Yun Zhai
-
Patent number: 8576342Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation is disclosed. Certain embodiments utilize a hierarchical processing technique. A first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds can be user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.Type: GrantFiled: January 30, 2012Date of Patent: November 5, 2013Assignee: Virage, Inc.Inventors: Arun Hampapur, Mojgan Monika Gorkani, Chiao-Fe Shu, Amarnath Gupta
-
Patent number: 8553778Abstract: An invention for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, generate a lossless compressed contour-coded blob to encode the trajectory data of the event within video image data, and generate a lossy searchable code to enable searching of a relational database based on the trajectory data of the event within the video image data.Type: GrantFiled: March 19, 2009Date of Patent: October 8, 2013Assignee: International Business Machines CorporationInventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
-
Publication number: 20130259316Abstract: An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising: identifying one or more pixel regions from the plurality of pixel regions containing trajectory data; performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and generating a transition chain code based on the multi-point neighborhood scan. Embodiments further generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code, and generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.Type: ApplicationFiled: May 28, 2013Publication date: October 3, 2013Applicant: International Business Machines CorporationInventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
-
Patent number: 8537219Abstract: An invention for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, and generate a set of compressed spatial representation of the trajectory data of the event within the video image data. A database component is configured to input the set of compressed spatial representations into a relational database, and a search component is configured to search the relational database to identify a spatial location of the event within the video image data.Type: GrantFiled: March 19, 2009Date of Patent: September 17, 2013Assignee: International Business Machines CorporationInventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Carl P. Mercier, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
-
Publication number: 20130028468Abstract: Methods and apparatus are provided for example-based object retrieval that can retrieve objects from video images in real-time. An object of interest is identified in a sequence of images by obtaining an identification from a user of an example object having at least one attribute of interest; generating a query object based on the identified example object, wherein the query object has a substantially similar viewpoint as objects in the sequence of images and wherein the query object comprises a plurality of attributes that are substantially similar as the example object; and processing the sequence of images to identify the object of interest based on a similarity metric to the query object.Type: ApplicationFiled: July 29, 2011Publication date: January 31, 2013Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Lisa M. Brown, Frederik C. M. Kjeldsen, Chiao-fe Shu
-
Publication number: 20120128242Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation is disclosed. Certain embodiments utilize a hierarchical processing technique. A first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds can be user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.Type: ApplicationFiled: January 30, 2012Publication date: May 24, 2012Applicant: Virage, Inc.Inventors: Arun Hampapur, Mojgan Monika Gorkani, Chiao-Fe Shu, Amarnath Gupta
-
Method and system for spatio-temporal event detection using composite definitions for camera systems
Patent number: 8134457Abstract: A system and method for monitoring events includes defining alert events based on primitive event types in an environment monitored by monitoring devices. Alert parameters are set for each alert event, and alert events are combined to create a composite alert event based on a plurality of alert events. A plurality of engines is monitored to determine if multiple events comprising the composite alert event have occurred.Type: GrantFiled: June 4, 2008Date of Patent: March 13, 2012Assignee: International Business Machines CorporationInventors: Senem Velipasalar, Lisa Marie Brown, Arun Hampapur, Chiao-Fe Shu -
Patent number: 8107015Abstract: A system and method that processes video to extract a keyframe-based adequate visual representation. The method utilizes a hierarchical processing technique. The first stage in the hierarchy extracts a chromatic difference metric from a pair of video frames. An initial set of frames is chosen based on the chromatic metric and a threshold. A structural difference measurement is extracted from this initial set of frames. A second threshold is used to select key frames from the initial set. The first and second thresholds are user selectable. The output of this process is the visual representation. The method is extensible to any number of metrics and any number of levels.Type: GrantFiled: June 6, 1997Date of Patent: January 31, 2012Assignee: Virage, IncorporatedInventors: Arun Hampapur, Mojgan Monika Gorkani, Chiao-Fe Shu, Amarnath Gupta
-
Patent number: 8054330Abstract: Systems and methods are disclosed for implementing and managing distributed video surveillance systems. Systems and methods in accordance with the present invention provide a well-organized structure for describing and implementing distributed video surveillance systems and service protocols for managing the surveillance activities of clusters of video surveillance cameras. In particular, the service protocols provide a high degree of control over the surveillance activities of video surveillance cameras. In addition, the service protocols also provide a great deal of flexibility in selecting and managing a wide range of analytical and managerial tools for available for analyzing and organizing video track information.Type: GrantFiled: October 14, 2004Date of Patent: November 8, 2011Assignee: International Business Machines CorporationInventors: Chiao-Fe Shu, Arun Hampapur
-
Publication number: 20110211070Abstract: Systems and methods are disclosed for analyzing, managing and cataloguing video tracks generated by a video surveillance system. Systems and methods operating in accordance with the present invention receive video tracks from a video surveillance system; analyze them for particular categories of, for example, objects or events, assign unique identifying tags to the video tracks; and save them in highly-cross-referenced databases so that video tracks containing, for example, particular objects or events can be easily searched for and recalled. In addition, the present invention provides browsing facilities for viewing events that have just elapsed, events that are occurring in near real-time.Type: ApplicationFiled: March 31, 2011Publication date: September 1, 2011Applicant: International Business Machines CorporationInventors: Chiao-Fe Shu, Arun Hampapur, Max Lu
-
Publication number: 20100238285Abstract: An invention for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, and generate a set of compressed spatial representation of the trajectory data of the event within the video image data. A database component is configured to input the set of compressed spatial representations into a relational database, and a search component is configured to search the relational database to identify a spatial location of the event within the video image data.Type: ApplicationFiled: March 19, 2009Publication date: September 23, 2010Applicant: International Business Machines CorporationInventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
-
Publication number: 20100239016Abstract: An invention for generating a coding schema for identifying a spatial location of an event within video image data is provided. In one embodiment, there is a spatial representation tool, including a compression component configured to receive trajectory data of an event within video image data, generate a lossless compressed contour-coded blob to encode the trajectory data of the event within video image data, and generate a lossy searchable code to enable searching of a relational database based on the trajectory data of the event within the video image data.Type: ApplicationFiled: March 19, 2009Publication date: September 23, 2010Applicant: International Business Machines CorporationInventors: Michael J. Desimone, Arun Hampapur, Zuoxuan Lu, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Chek K. Tan
-
Patent number: 7791466Abstract: The present invention includes a method, system, and program product for detecting an event that includes receiving at least one data input stream from one or more sensors, selecting a data input stream from one of the one or more sensors, recording the data input stream on a recordable medium, specifying a rule comprising an event in the data input stream, and detecting at least one event in the data input stream based upon the rule.Type: GrantFiled: January 11, 2008Date of Patent: September 7, 2010Assignee: International Business Machines CorporationInventors: Lalit Agarwalla, Sergio Borger, Lisa M. Brown, Christopher R. Carlson, Raymond A. Cooke, Barry Gottlieb, Arun Hampapur, Christopher A. LoGiudice, Linda C. Owen, Andrew W. Senior, Chiao-Fe Shu