Patents by Inventor Yun Zhai

Yun Zhai has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20170091563
    Abstract: In an approach to tracking at least one target subject in a camera network, a search is started to find a target subject on a camera within a camera network. Features are extracted from the target subject and search queries are initiated in other nearby cameras within the camera network. Search queries attempt to detect target subjects and present the finds in a ranked order. Application of aggregate searches in multiple cameras and prior search results are used to improve matching results in the camera network; propagate a search of the target subject to discover the full pathway in the camera network; and project future occurrences of the target subject in subsequent cameras in the camera network.
    Type: Application
    Filed: November 23, 2016
    Publication date: March 30, 2017
    Inventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
  • Patent number: 9594963
    Abstract: Foreground feature data and motion feature data is determined for frames of video data acquired from an object region of interest. The frames are labeled as “object present” if the determined foreground feature data value meets a threshold value, else as “object absent; and as “motion present” if the motion feature data meets a motion threshold, else as “static.” The labels are used to classify segments of the video data comprising groups of consecutive video frames, namely as within a “no object present” segment for groups with “object absent” and “static” labels; within a “object present and in transition” segment for groups “object present” and “motion present” labels; and within a “object present and stopped” segment for groups with “object present” and “static” labels. The presence or motion state of an object at a time of inquiry is thereby determined from the respective segment classification.
    Type: Grant
    Filed: September 29, 2016
    Date of Patent: March 14, 2017
    Assignee: International Business Machines Corporation
    Inventors: Russell P. Bobbitt, Rogerio S. Feris, Yun Zhai
  • Publication number: 20170046596
    Abstract: Embodiments are directed to an object detection system having at least one processor circuit configured to receive a series of image regions and apply to each image region in the series a detector, which is configured to determine a presence of a predetermined object in the image region. The object detection system performs a method of selecting and applying the detector from among a plurality of foreground detectors and a plurality of background detectors in a repeated pattern that includes sequentially selecting a selected one of the plurality of foreground detectors; sequentially applying the selected one of the plurality of foreground detectors to one of the series of image regions until all of the plurality of foreground detectors have been applied; selecting a selected one of the plurality of background detectors; and applying the selected one of the plurality of background detectors to one of the series of image regions.
    Type: Application
    Filed: August 12, 2015
    Publication date: February 16, 2017
    Inventors: Russell P. Bobbitt, Rogerio S. Feris, Chiao-Fe Shu, Yun Zhai
  • Publication number: 20170046587
    Abstract: Embodiments are directed to an object detection system having at least one processor circuit configured to receive a series of image regions and apply to each image region in the series a detector, which is configured to determine a presence of a predetermined object in the image region. The object detection system performs a method of selecting and applying the detector from among a plurality of foreground detectors and a plurality of background detectors in a repeated pattern that includes sequentially selecting a selected one of the plurality of foreground detectors; sequentially applying the selected one of the plurality of foreground detectors to one of the series of image regions until all of the plurality of foreground detectors have been applied; selecting a selected one of the plurality of background detectors; and applying the selected one of the plurality of background detectors to one of the series of image regions.
    Type: Application
    Filed: December 8, 2015
    Publication date: February 16, 2017
    Inventors: Russell P. Bobbitt, Rogerio S. Feris, Chiao-Fe Shu, Yun Zhai
  • Patent number: 9569672
    Abstract: Transaction units of video data and transaction data captured from different checkout lanes are prioritized as a function of lane priority values of respective ones of the different checkout lanes from which the transaction units are acquired. Each of the checkout lanes has a different lane priority value. The individual transaction units are processed in the prioritized processing order to automatically detect irregular activities indicated by the transaction unit video and the transaction data of the processed individual transaction units.
    Type: Grant
    Filed: October 16, 2015
    Date of Patent: February 14, 2017
    Assignee: International Business Machines Corporation
    Inventors: Russell P. Bobbitt, Quanfu Fan, Sachiko Miyazawa, Sharathchandra U. Pankanti, Yun Zhai
  • Publication number: 20170024889
    Abstract: A method to automatically calibrate a static camera in a vehicle is provided. The method may include receiving a captured image file. The method may also include detecting a plurality of vehicles in the captured image file. The method may further include determining a 2D projected shape, size, location, direction of travel, and a plurality of features for each vehicle at various locations in the captured image file. The method may additionally include inferring a plurality of geometry scenes associated with the captured image file, whereby the plurality of geometry scenes is inferred based on the determined 2D projected shape, size, location, direction of travel, and the plurality of features of each vehicle within the detected plurality of vehicles as projected onto the captured image file. The method may include calibrating the static camera based on the inferred plurality of geometry scenes associated with the captured image file.
    Type: Application
    Filed: July 23, 2015
    Publication date: January 26, 2017
    Inventors: Lisa M. Brown, Quanfu Fan, Yun Zhai
  • Publication number: 20170017845
    Abstract: Foreground feature data and motion feature data is determined for frames of video data acquired from an object region of interest. The frames are labeled as “object present” if the determined foreground feature data value meets a threshold value, else as “object absent; and as “motion present” if the motion feature data meets a motion threshold, else as “static.” The labels are used to classify segments of the video data comprising groups of consecutive video frames, namely as within a “no object present” segment for groups with “object absent” and “static” labels; within a “object present and in transition” segment for groups “object present” and “motion present” labels; and within a “object present and stopped” segment for groups with “object present” and “static” labels. The presence or motion state of an object at a time of inquiry is thereby determined from the respective segment classification.
    Type: Application
    Filed: September 29, 2016
    Publication date: January 19, 2017
    Inventors: RUSSELL P. BOBBITT, ROGERIO S. FERIS, YUN ZHAI
  • Patent number: 9532012
    Abstract: In an approach to tracking at least one target subject in a camera network, a search is started to find a target subject on a camera within a camera network. Features are extracted from the target subject and search queries are initiated in other nearby cameras within the camera network. Search queries attempt to detect target subjects and present the finds in a ranked order. Application of aggregate searches in multiple cameras and prior search results are used to improve matching results in the camera network; propagate a search of the target subject to discover the full pathway in the camera network; and project future occurrences of the target subject in subsequent cameras in the camera network.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: December 27, 2016
    Assignee: International Business Machines Corporation
    Inventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
  • Publication number: 20160371560
    Abstract: Long-term understanding of background modeling includes determining first and second dimension gradient model derivatives of image brightness data of an image pixel along respective dimensions of two-dimensional, single channel image brightness data of a static image scene. The determined gradients are averaged with previous determined gradients of the image pixels, and with gradients of neighboring pixels as a function of their respective distances to the image pixel, the averaging generating averaged pixel gradient models for each of a plurality of pixels of the video image data of the static image scene that each have mean values and weight values. Background models for the static image scene are constructed as a function of the averaged pixel gradients and weights, wherein the background model pixels are represented by averaged pixel gradient models having similar orientation and magnitude and weights meeting a threshold weight requirement.
    Type: Application
    Filed: August 31, 2016
    Publication date: December 22, 2016
    Inventors: ROGERIO S. FERIS, YUN ZHAI
  • Publication number: 20160350600
    Abstract: Methods and system are provided for monitoring a queue. A method includes receiving by sensors a non-visual identifier at predefined locations of a queue. Further, the method includes capturing by image capture devices images of an object possessing the non-visual identifier at the predefined locations of the queue. Further, the method includes visually tracking another object in the queue based on transformations of a predefined feature extracted from the images of the object possessing the non-visual identifier at the predefined locations.
    Type: Application
    Filed: August 9, 2016
    Publication date: December 1, 2016
    Inventors: Ira L. ALLEN, Russell P. BOBBITT, Rogerio S. FERIS, Yun ZHAI
  • Publication number: 20160335798
    Abstract: Objects within two-dimensional video data are modeled by three-dimensional models as a function of object type and motion through manually calibrating a two-dimensional image to the three spatial dimensions of a three-dimensional modeling cube. Calibrated three-dimensional locations of an object in motion in the two-dimensional image field of view of a video data input are determined and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the determined three-dimensional locations. The two-dimensional object image is replaced in the video data input with an object-type three-dimensional polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.
    Type: Application
    Filed: July 29, 2016
    Publication date: November 17, 2016
    Inventors: ANKUR DATTA, ROGERIO S. FERIS, YUN ZHAI
  • Patent number: 9495763
    Abstract: In an approach to tracking at least one target subject in a camera network, a search is started to find a target subject on a camera within a camera network. Features are extracted from the target subject and search queries are initiated in other nearby cameras within the camera network. Search queries attempt to detect target subjects and present the finds in a ranked order. Application of aggregate searches in multiple cameras and prior search results are used to improve matching results in the camera network; propagate a search of the target subject to discover the full pathway in the camera network; and project future occurrences of the target subject in subsequent cameras in the camera network.
    Type: Grant
    Filed: September 28, 2015
    Date of Patent: November 15, 2016
    Assignee: International Business Machines Corporation
    Inventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
  • Patent number: 9495599
    Abstract: Foreground feature data and motion feature data is determined for frames of video data acquired from a train track area region of interest. The frames are labeled as “train present” if the determined foreground feature data value meets a threshold value, else as “train absent; and as “motion present” if the motion feature data meets a motion threshold, else as “static.” The labels are used to classify segments of the video data comprising groups of consecutive video frames, namely as within a “no train present” segment for groups with “train absent” and “static” labels; within a “train present and in transition” segment for groups “train present” and “motion present” labels; and within a “train present and stopped” segment for groups with “train present” and “static” labels. The presence or motion state of a train at a time of inquiry is thereby determined from the respective segment classification.
    Type: Grant
    Filed: May 14, 2015
    Date of Patent: November 15, 2016
    Assignee: International Business Machines Corporation
    Inventors: Russell P. Bobbitt, Rogerio S. Feris, Yun Zhai
  • Patent number: 9460349
    Abstract: Long-term understanding of background modeling includes determining first and second dimension gradient model derivatives of image brightness data of an image pixel along respective dimensions of two-dimensional, single channel image brightness data of a static image scene. The determined gradients are averaged with previous determined gradients of the image pixels, and with gradients of neighboring pixels as a function of their respective distances to the image pixel, the averaging generating averaged pixel gradient models for each of a plurality of pixels of the video image data of the static image scene that each have mean values and weight values. Background models for the static image scene are constructed as a function of the averaged pixel gradients and weights, wherein the background model pixels are represented by averaged pixel gradient models having similar orientation and magnitude and weights meeting a threshold weight requirement.
    Type: Grant
    Filed: August 11, 2015
    Date of Patent: October 4, 2016
    Assignee: International Business Machines Corporation
    Inventors: Rogerio S. Feris, Yun Zhai
  • Patent number: 9454884
    Abstract: In an approach to tracking at least one target subject in a camera network, a search is started to find a target subject on a camera within a camera network. Features are extracted from the target subject and search queries are initiated in other nearby cameras within the camera network. Search queries attempt to detect target subjects and present the finds in a ranked order. Application of aggregate searches in multiple cameras and prior search results are used to improve matching results in the camera network; propagate a search of the target subject to discover the full pathway in the camera network; and project future occurrences of the target subject in subsequent cameras in the camera network.
    Type: Grant
    Filed: February 25, 2016
    Date of Patent: September 27, 2016
    Assignee: International Business Machines Corporation
    Inventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
  • Patent number: 9443148
    Abstract: Methods and system are provided for monitoring a queue. A method includes receiving by sensors a non-visual identifier at predefined locations of a queue. Further, the method includes capturing by image capture devices images of an object possessing the non-visual identifier at the predefined locations of the queue. Further, the method includes visually tracking another object in the queue based on transformations of a predefined feature extracted from the images of the object possessing the non-visual identifier at the predefined locations.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: September 13, 2016
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Ira L. Allen, Russell P. Bobbitt, Rogerio S. Feris, Yun Zhai
  • Patent number: 9430874
    Abstract: Objects within two-dimensional video data are modeled by three-dimensional models as a function of object type and motion through manually calibrating a two-dimensional image to the three spatial dimensions of a three-dimensional modeling cube. Calibrated three-dimensional locations of an object in motion in the two-dimensional image field of view of a video data input are determined and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the determined three-dimensional locations. The two-dimensional object image is replaced in the video data input with an object-type three-dimensional polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.
    Type: Grant
    Filed: September 9, 2015
    Date of Patent: August 30, 2016
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Rogerio S. Feris, Yun Zhai
  • Publication number: 20160203611
    Abstract: A camera at a fixed vertical height positioned above a reference plane, with an axis of a camera lens at an acute angle with respect to a perpendicular of the reference plane. One or more processors receive camera images of a multiplicity of people of unknown height and vertical axis of the images are transformed into pixel counts. The known heights of people from a known statistical distribution of heights of people are received by one or more processors and transformed to a normalized measurement of pixel counts, based in part on a focal length of the camera lens, the angle of the camera, and an objective function summing differences between pixel counts of the known heights of people and the unknown heights of people. The fixed vertical height of the camera is determined by adjusting the estimated camera height to minimize the objective function.
    Type: Application
    Filed: March 22, 2016
    Publication date: July 14, 2016
    Inventors: Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
  • Patent number: 9342594
    Abstract: An approach that indexes and searches according to a set of attributes of a person is provided. In one embodiment, there is an extensible indexing and search tool, including an extraction component configured to extract a set of attributes of a person monitored by a set of sensors in a zone of interest. An index component is configured to index each of the set of attributes of the person within an index of an extensible indexing and search tool. A search component is configured to enable a search of the index of the extensible indexing and search tool according to at least one of the set of attributes of the person.
    Type: Grant
    Filed: October 29, 2008
    Date of Patent: May 17, 2016
    Assignee: International Business Machines Corporation
    Inventors: Lisa M. Brown, Raymond A. Cooke, Rogerio S. Feris, Arun Hampapur, Frederik C. M. Kjeldsen, Christopher S. Milite, Stephen R. Russo, Chiao-Fe Shu, Ying-li Tian, Yun Zhai, Zuoxuan Lu
  • Patent number: 9322647
    Abstract: A camera at a fixed vertical height positioned above a reference plane, with an axis of a camera lens at an acute angle with respect to a perpendicular of the reference plane. One or more processors receive images of different people. The vertical measurement values of the images of different people are determined. The one or more processors determine a first statistical measure associated with a statistical distribution of the vertical measurement values. The known heights of people from a known statistical distribution of heights of people are transformed to normalized measurements, based in part on a focal length of the camera lens, the angle of the camera, and a division operator in an objective function of differences between the normalized measurements and the vertical measurement values. The fixed vertical height of the camera is determined, based at least on minimizing the objective function.
    Type: Grant
    Filed: March 28, 2013
    Date of Patent: April 26, 2016
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai