Patents by Inventor Yun Zhai

Yun Zhai has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10275608
    Abstract: Techniques are described for video redaction. In one aspect, techniques include receiving a video for redaction; analyzing the video to generate an appearance model for the video, providing a user interface (UI) allowing a user to modify the appearance model, and responsive to a user selecting an object from the appearance model, extending and completing a trajectory of the selected object with enhanced marking based on the user input.
    Type: Grant
    Filed: October 15, 2016
    Date of Patent: April 30, 2019
    Assignee: International Business Machines Corporation
    Inventors: Russell P Bobbitt, Curtis H Brobst, Rogerio S Feris, Yun Zhai
  • Patent number: 10169661
    Abstract: Machine logic that pre-processes and post-processes images for visual object detection by performing the following steps: receiving a set of image(s); filtering the set of image(s) using a set of multimodal integral filter(s), thereby removing at least a portion of the set of image(s) and resulting in a filtered set of image(s); performing object detection on the filtered set of image(s) to generate a set of object-detected image(s); assembling a first plurality of object-detected image(s) from the set of object-detected image(s); and upon assembling the first plurality of object-detected image(s), performing non-maximum suppression on the assembled first plurality of object-detected image(s).
    Type: Grant
    Filed: March 23, 2015
    Date of Patent: January 1, 2019
    Assignee: International Business Machines Corporation
    Inventors: Russell P. Bobbitt, Lisa M. Brown, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
  • Publication number: 20180357492
    Abstract: Methods and system are provided for monitoring a queue. A method includes receiving by sensors a non-visual identifier at predefined locations of a queue. Further, the method includes capturing by image capture devices images of an object possessing the non-visual identifier at the predefined locations of the queue. Further, the method includes visually tracking another object in the queue based on transformations of a predefined feature extracted from the images of the object possessing the non-visual identifier at the predefined locations.
    Type: Application
    Filed: August 21, 2018
    Publication date: December 13, 2018
    Inventors: Ira L. ALLEN, Russell P. BOBBITT, Rogerio S. FERIS, Yun ZHAI
  • Publication number: 20180322654
    Abstract: A method, a computer program product, and a computer system for determining a location using street view images. A mobile device obtains an image captured by the mobile device, obtains a set of street view images, and obtains a first graph of the image captured by the mobile device and a plurality of second graphs of the set of the street view images. The first graph includes nodes representing interest points in the image captured by the mobile device, and the plurality of the second graphs includes nodes representing interest points in the set of the street view images. The mobile device determines a location of the mobile device, based on relevance between the first graph and the plurality of the second graphs.
    Type: Application
    Filed: May 3, 2017
    Publication date: November 8, 2018
    Inventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
  • Patent number: 10102431
    Abstract: Methods and system are provided for monitoring a queue. A method includes receiving by sensors a non-visual identifier at predefined locations of a queue. Further, the method includes capturing by image capture devices images of an object possessing the non-visual identifier at the predefined locations of the queue. Further, the method includes visually tracking another object in the queue based on transformations of a predefined feature extracted from the images of the object possessing the non-visual identifier at the predefined locations.
    Type: Grant
    Filed: August 9, 2016
    Date of Patent: October 16, 2018
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Ira L. Allen, Russell P. Bobbitt, Rogerio S. Feris, Yun Zhai
  • Patent number: 10089551
    Abstract: Embodiments are directed to an object detection system having at least one processor circuit configured to receive a series of image regions and apply to each image region in the series a detector, which is configured to determine a presence of a predetermined object in the image region. The object detection system performs a method of selecting and applying the detector from among a plurality of foreground detectors and a plurality of background detectors in a repeated pattern that includes sequentially selecting a selected one of the plurality of foreground detectors; sequentially applying the selected one of the plurality of foreground detectors to one of the series of image regions until all of the plurality of foreground detectors have been applied; selecting a selected one of the plurality of background detectors; and applying the selected one of the plurality of background detectors to one of the series of image regions.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: October 2, 2018
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Russell P. Bobbitt, Rogerio S. Feris, Chiao-Fe Shu, Yun Zhai
  • Patent number: 10029622
    Abstract: A method to automatically calibrate a static camera in a vehicle is provided. The method may include receiving a captured image file. The method may also include detecting a plurality of vehicles in the captured image file. The method may further include determining a 2D projected shape, size, location, direction of travel, and a plurality of features for each vehicle at various locations in the captured image file. The method may additionally include inferring a plurality of geometry scenes associated with the captured image file, whereby the plurality of geometry scenes is inferred based on the determined 2D projected shape, size, location, direction of travel, and the plurality of features of each vehicle within the detected plurality of vehicles as projected onto the captured image file. The method may include calibrating the static camera based on the inferred plurality of geometry scenes associated with the captured image file.
    Type: Grant
    Filed: July 23, 2015
    Date of Patent: July 24, 2018
    Assignee: International Business Machines Corporation
    Inventors: Lisa M. Brown, Quanfu Fan, Yun Zhai
  • Patent number: 10007991
    Abstract: A system for detecting a change in object positioning by processing images by detecting a first entity tagged with a first visually unique identifier, and detecting a second entity tagged with a second visually unique identifier distinguishable from the first visually unique identifier. The system receives a first image, from a first image capturing device, containing the first visually unique identifier and the second visually unique identifier. The system analyzes the first image to determine a distance between the first visually unique identifier and the second visually unique identifier. The system receives a second image containing the first visually unique identifier. The system analyzes the second image to determine a location of the second visually unique identifier relative to the first visually unique identifier to form a distance assessment. Based on the distance assessment, the system determines a change in proximity between the first entity and the second entity.
    Type: Grant
    Filed: January 29, 2016
    Date of Patent: June 26, 2018
    Assignee: International Business Machines Corporation
    Inventors: Bruce H. Hyre, Chiao-Fe Shu, Yun Zhai
  • Publication number: 20180107830
    Abstract: Techniques are described for video redaction. In one aspect, techniques include receiving a video for redaction; analyzing the video to generate an appearance model for the video, providing a user interface (UI) allowing a user to modify the appearance model, and responsive to a user selecting an object from the appearance model, extending and completing a trajectory of the selected object with enhanced marking based on the user input.
    Type: Application
    Filed: October 15, 2016
    Publication date: April 19, 2018
    Inventors: Russell P. Bobbitt, Curtis H. Brobst, Rogerio S. Feris, Yun Zhai
  • Publication number: 20180107881
    Abstract: Aspects determining anomalous events, wherein processors determine a trajectory of tracked movement of an object through an image field of a camera partitioned into a matrix grid of different local units. The aspects generate anomaly confidence decision values for image features extracted from video data of the tracked movement of the object as a function of fitting extracted image features to normal patterns of local motion pattern models defined by dominant distributions of extracted image features. The aspects further extract trajectory features from the video data relative to the trajectory of the tracked movement of the object, and generate global anomaly confidence decision values for the object trajectory as a function of fitting the extracted trajectory features to a normal learned motion trajectory model. The aspects determine anomalous events as a function of the generated global anomaly confidence decision value and the anomaly confidence decision values.
    Type: Application
    Filed: December 7, 2017
    Publication date: April 19, 2018
    Inventors: ANKUR DATTA, BALAMANOHAR PALURI, SHARATHCHANDRA U. PANKANTI, YUN ZHAI
  • Patent number: 9946951
    Abstract: Embodiments are directed to an object detection system having at least one processor circuit configured to receive a series of image regions and apply to each image region in the series a detector, which is configured to determine a presence of a predetermined object in the image region. The object detection system performs a method of selecting and applying the detector from among a plurality of foreground detectors and a plurality of background detectors in a repeated pattern that includes sequentially selecting a selected one of the plurality of foreground detectors; sequentially applying the selected one of the plurality of foreground detectors to one of the series of image regions until all of the plurality of foreground detectors have been applied; selecting a selected one of the plurality of background detectors; and applying the selected one of the plurality of background detectors to one of the series of image regions.
    Type: Grant
    Filed: August 12, 2015
    Date of Patent: April 17, 2018
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Russell P. Bobbitt, Rogerio S. Feris, Chiao-Fe Shu, Yun Zhai
  • Patent number: 9928423
    Abstract: Local models learned from anomaly detection are used to rank detected anomalies. The local model patterns are defined from image feature values extracted from an image field of video image data with respect to different predefined spatial and temporal local units, wherein anomaly results are determined by fitting extracted image features to the local model patterns. Image features values extracted from the image field local units associated with anomaly results are normalized, and image feature values extracted from the image field local units are clustered. Weights for anomaly results are learned as a function of the relations of the normalized extracted image feature values to the clustered image feature values. The normalized values are multiplied by the learned weights to generate ranking values to rank the anomalies.
    Type: Grant
    Filed: September 4, 2015
    Date of Patent: March 27, 2018
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Balamanohar Paluri, Sharathchandra U. Pankanti, Yun Zhai
  • Patent number: 9885568
    Abstract: A camera at a fixed vertical height positioned above a reference plane, with an axis of a camera lens at an acute angle with respect to a perpendicular of the reference plane. One or more processors receive camera images of a multiplicity of people of unknown height and vertical axis of the images are transformed into pixel counts. The known heights of people from a known statistical distribution of heights of people are received by one or more processors and transformed to a normalized measurement of pixel counts, based in part on a focal length of the camera lens, the angle of the camera, and an objective function summing differences between pixel counts of the known heights of people and the unknown heights of people. The fixed vertical height of the camera is determined by adjusting the estimated camera height to minimize the objective function.
    Type: Grant
    Filed: March 22, 2016
    Date of Patent: February 6, 2018
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
  • Patent number: 9858483
    Abstract: Long-term understanding of background modeling includes determining first and second dimension gradient model derivatives of image brightness data of an image pixel along respective dimensions of two-dimensional, single channel image brightness data of a static image scene. The determined gradients are averaged with previous determined gradients of the image pixels, and with gradients of neighboring pixels as a function of their respective distances to the image pixel, the averaging generating averaged pixel gradient models for each of a plurality of pixels of the video image data of the static image scene that each have mean values and weight values. Background models for the static image scene are constructed as a function of the averaged pixel gradients and weights, wherein the background model pixels are represented by averaged pixel gradient models having similar orientation and magnitude and weights meeting a threshold weight requirement.
    Type: Grant
    Filed: August 31, 2016
    Date of Patent: January 2, 2018
    Assignee: International Business Machines Corporation
    Inventors: Rogerio S. Feris, Yun Zhai
  • Patent number: 9805505
    Abstract: Objects within two-dimensional video data are modeled by three-dimensional models as a function of object type and motion through manually calibrating a two-dimensional image to the three spatial dimensions of a three-dimensional modeling cube. Calibrated three-dimensional locations of an object in motion in the two-dimensional image field of view of a video data input are determined and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the determined three-dimensional locations. The two-dimensional object image is replaced in the video data input with an object-type three-dimensional polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: October 31, 2017
    Assignee: International Business Machines Corproation
    Inventors: Ankur Datta, Rogerio S. Feris, Yun Zhai
  • Publication number: 20170221192
    Abstract: A system for detecting a change in object positioning by processing images by detecting a first entity tagged with a first visually unique identifier, and detecting a second entity tagged with a second visually unique identifier distinguishable from the first visually unique identifier. The system receives a first image, from a first image capturing device, containing the first visually unique identifier and the second visually unique identifier. The system analyzes the first image to determine a distance between the first visually unique identifier and the second visually unique identifier. The system receives a second image containing the first visually unique identifier. The system analyzes the second image to determine a location of the second visually unique identifier relative to the first visually unique identifier to form a distance assessment. Based on the distance assessment, the system determines a change in proximity between the first entity and the second entity.
    Type: Application
    Filed: January 29, 2016
    Publication date: August 3, 2017
    Applicant: International Business Machines Corporation
    Inventors: Bruce H. HYRE, Chiao-Fe SHU, Yun ZHAI
  • Patent number: 9710924
    Abstract: Field of view overlap among multiple cameras are automatically determined as a function of the temporal overlap of object tracks determined within their fields-of-view. Object tracks with the highest similarity value are assigned into pairs, and portions of the assigned object track pairs having a temporally overlapping period of time are determined. Scene entry points are determined from object locations on the tracks at a beginning of the temporally overlapping period of time, and scene exit points from object locations at an ending of the temporally overlapping period of time. Boundary lines for the overlapping fields-of-view portions within the corresponding camera fields-of-view are defined as a function of the determined entry and exit points in their respective fields-of-view.
    Type: Grant
    Filed: September 14, 2015
    Date of Patent: July 18, 2017
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
  • Patent number: 9704046
    Abstract: In an approach to tracking at least one target subject in a camera network, a search is started to find a target subject on a camera within a camera network. Features are extracted from the target subject and search queries are initiated in other nearby cameras within the camera network. Search queries attempt to detect target subjects and present the finds in a ranked order. Application of aggregate searches in multiple cameras and prior search results are used to improve matching results in the camera network; propagate a search of the target subject to discover the full pathway in the camera network; and project future occurrences of the target subject in subsequent cameras in the camera network.
    Type: Grant
    Filed: November 23, 2016
    Date of Patent: July 11, 2017
    Assignee: International Business Machines Corporation
    Inventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
  • Patent number: 9659238
    Abstract: A system comprises an input component, a feature extractor, an object classifier, an adaptation component and a calibration tool. The input component is configured to receive one or more images, and the feature extractor is configured to extract features for one or more objects in the one or more images, the extracted features comprising at least one view-independent feature. The object classifier is configured to classify the one or more objects based at least in part on the extracted features and one or more object classification parameters, and the adaptation component is configured to adjust the classification of at least one of the objects based on one or more contextual parameters. The calibration tool is configured to adjust one or more of the object classification parameters based on likelihoods for characteristics associated with one or more object classes.
    Type: Grant
    Filed: April 15, 2014
    Date of Patent: May 23, 2017
    Assignee: International Business Machines Corporation
    Inventors: Lisa Marie Brown, Longbin Chen, Rogerio Schmidt Feris, Arun Hampapur, Yun Zhai
  • Patent number: 9652863
    Abstract: Multi-mode video event indexing includes determining a quality of object distinctiveness with respect to images from a video stream input. A high-quality analytic mode is selected from multiple modes and applied to video input images via a hardware device to determine object activity within the video input images if the determined level of detected quality of object distinctiveness meets a threshold level of quality, else a low-quality analytic mode is selected and applied to the video input images via a hardware device to determine object activity within the video input images, wherein the low-quality analytic mode is different from the high-quality analytic mode.
    Type: Grant
    Filed: August 19, 2015
    Date of Patent: May 16, 2017
    Assignee: International Business Machines Corporation
    Inventors: Russell P. Bobbitt, Lisa M. Brown, Rogerio S. Feris, Arun Hampapur, Yun Zhai