Patents by Inventor Yun Zhai
Yun Zhai has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10275608Abstract: Techniques are described for video redaction. In one aspect, techniques include receiving a video for redaction; analyzing the video to generate an appearance model for the video, providing a user interface (UI) allowing a user to modify the appearance model, and responsive to a user selecting an object from the appearance model, extending and completing a trajectory of the selected object with enhanced marking based on the user input.Type: GrantFiled: October 15, 2016Date of Patent: April 30, 2019Assignee: International Business Machines CorporationInventors: Russell P Bobbitt, Curtis H Brobst, Rogerio S Feris, Yun Zhai
-
Patent number: 10169661Abstract: Machine logic that pre-processes and post-processes images for visual object detection by performing the following steps: receiving a set of image(s); filtering the set of image(s) using a set of multimodal integral filter(s), thereby removing at least a portion of the set of image(s) and resulting in a filtered set of image(s); performing object detection on the filtered set of image(s) to generate a set of object-detected image(s); assembling a first plurality of object-detected image(s) from the set of object-detected image(s); and upon assembling the first plurality of object-detected image(s), performing non-maximum suppression on the assembled first plurality of object-detected image(s).Type: GrantFiled: March 23, 2015Date of Patent: January 1, 2019Assignee: International Business Machines CorporationInventors: Russell P. Bobbitt, Lisa M. Brown, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
-
Publication number: 20180357492Abstract: Methods and system are provided for monitoring a queue. A method includes receiving by sensors a non-visual identifier at predefined locations of a queue. Further, the method includes capturing by image capture devices images of an object possessing the non-visual identifier at the predefined locations of the queue. Further, the method includes visually tracking another object in the queue based on transformations of a predefined feature extracted from the images of the object possessing the non-visual identifier at the predefined locations.Type: ApplicationFiled: August 21, 2018Publication date: December 13, 2018Inventors: Ira L. ALLEN, Russell P. BOBBITT, Rogerio S. FERIS, Yun ZHAI
-
Publication number: 20180322654Abstract: A method, a computer program product, and a computer system for determining a location using street view images. A mobile device obtains an image captured by the mobile device, obtains a set of street view images, and obtains a first graph of the image captured by the mobile device and a plurality of second graphs of the set of the street view images. The first graph includes nodes representing interest points in the image captured by the mobile device, and the plurality of the second graphs includes nodes representing interest points in the set of the street view images. The mobile device determines a location of the mobile device, based on relevance between the first graph and the plurality of the second graphs.Type: ApplicationFiled: May 3, 2017Publication date: November 8, 2018Inventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
-
Patent number: 10102431Abstract: Methods and system are provided for monitoring a queue. A method includes receiving by sensors a non-visual identifier at predefined locations of a queue. Further, the method includes capturing by image capture devices images of an object possessing the non-visual identifier at the predefined locations of the queue. Further, the method includes visually tracking another object in the queue based on transformations of a predefined feature extracted from the images of the object possessing the non-visual identifier at the predefined locations.Type: GrantFiled: August 9, 2016Date of Patent: October 16, 2018Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Ira L. Allen, Russell P. Bobbitt, Rogerio S. Feris, Yun Zhai
-
Patent number: 10089551Abstract: Embodiments are directed to an object detection system having at least one processor circuit configured to receive a series of image regions and apply to each image region in the series a detector, which is configured to determine a presence of a predetermined object in the image region. The object detection system performs a method of selecting and applying the detector from among a plurality of foreground detectors and a plurality of background detectors in a repeated pattern that includes sequentially selecting a selected one of the plurality of foreground detectors; sequentially applying the selected one of the plurality of foreground detectors to one of the series of image regions until all of the plurality of foreground detectors have been applied; selecting a selected one of the plurality of background detectors; and applying the selected one of the plurality of background detectors to one of the series of image regions.Type: GrantFiled: December 8, 2015Date of Patent: October 2, 2018Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Russell P. Bobbitt, Rogerio S. Feris, Chiao-Fe Shu, Yun Zhai
-
Patent number: 10029622Abstract: A method to automatically calibrate a static camera in a vehicle is provided. The method may include receiving a captured image file. The method may also include detecting a plurality of vehicles in the captured image file. The method may further include determining a 2D projected shape, size, location, direction of travel, and a plurality of features for each vehicle at various locations in the captured image file. The method may additionally include inferring a plurality of geometry scenes associated with the captured image file, whereby the plurality of geometry scenes is inferred based on the determined 2D projected shape, size, location, direction of travel, and the plurality of features of each vehicle within the detected plurality of vehicles as projected onto the captured image file. The method may include calibrating the static camera based on the inferred plurality of geometry scenes associated with the captured image file.Type: GrantFiled: July 23, 2015Date of Patent: July 24, 2018Assignee: International Business Machines CorporationInventors: Lisa M. Brown, Quanfu Fan, Yun Zhai
-
Patent number: 10007991Abstract: A system for detecting a change in object positioning by processing images by detecting a first entity tagged with a first visually unique identifier, and detecting a second entity tagged with a second visually unique identifier distinguishable from the first visually unique identifier. The system receives a first image, from a first image capturing device, containing the first visually unique identifier and the second visually unique identifier. The system analyzes the first image to determine a distance between the first visually unique identifier and the second visually unique identifier. The system receives a second image containing the first visually unique identifier. The system analyzes the second image to determine a location of the second visually unique identifier relative to the first visually unique identifier to form a distance assessment. Based on the distance assessment, the system determines a change in proximity between the first entity and the second entity.Type: GrantFiled: January 29, 2016Date of Patent: June 26, 2018Assignee: International Business Machines CorporationInventors: Bruce H. Hyre, Chiao-Fe Shu, Yun Zhai
-
Publication number: 20180107830Abstract: Techniques are described for video redaction. In one aspect, techniques include receiving a video for redaction; analyzing the video to generate an appearance model for the video, providing a user interface (UI) allowing a user to modify the appearance model, and responsive to a user selecting an object from the appearance model, extending and completing a trajectory of the selected object with enhanced marking based on the user input.Type: ApplicationFiled: October 15, 2016Publication date: April 19, 2018Inventors: Russell P. Bobbitt, Curtis H. Brobst, Rogerio S. Feris, Yun Zhai
-
Publication number: 20180107881Abstract: Aspects determining anomalous events, wherein processors determine a trajectory of tracked movement of an object through an image field of a camera partitioned into a matrix grid of different local units. The aspects generate anomaly confidence decision values for image features extracted from video data of the tracked movement of the object as a function of fitting extracted image features to normal patterns of local motion pattern models defined by dominant distributions of extracted image features. The aspects further extract trajectory features from the video data relative to the trajectory of the tracked movement of the object, and generate global anomaly confidence decision values for the object trajectory as a function of fitting the extracted trajectory features to a normal learned motion trajectory model. The aspects determine anomalous events as a function of the generated global anomaly confidence decision value and the anomaly confidence decision values.Type: ApplicationFiled: December 7, 2017Publication date: April 19, 2018Inventors: ANKUR DATTA, BALAMANOHAR PALURI, SHARATHCHANDRA U. PANKANTI, YUN ZHAI
-
Patent number: 9946951Abstract: Embodiments are directed to an object detection system having at least one processor circuit configured to receive a series of image regions and apply to each image region in the series a detector, which is configured to determine a presence of a predetermined object in the image region. The object detection system performs a method of selecting and applying the detector from among a plurality of foreground detectors and a plurality of background detectors in a repeated pattern that includes sequentially selecting a selected one of the plurality of foreground detectors; sequentially applying the selected one of the plurality of foreground detectors to one of the series of image regions until all of the plurality of foreground detectors have been applied; selecting a selected one of the plurality of background detectors; and applying the selected one of the plurality of background detectors to one of the series of image regions.Type: GrantFiled: August 12, 2015Date of Patent: April 17, 2018Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Russell P. Bobbitt, Rogerio S. Feris, Chiao-Fe Shu, Yun Zhai
-
Patent number: 9928423Abstract: Local models learned from anomaly detection are used to rank detected anomalies. The local model patterns are defined from image feature values extracted from an image field of video image data with respect to different predefined spatial and temporal local units, wherein anomaly results are determined by fitting extracted image features to the local model patterns. Image features values extracted from the image field local units associated with anomaly results are normalized, and image feature values extracted from the image field local units are clustered. Weights for anomaly results are learned as a function of the relations of the normalized extracted image feature values to the clustered image feature values. The normalized values are multiplied by the learned weights to generate ranking values to rank the anomalies.Type: GrantFiled: September 4, 2015Date of Patent: March 27, 2018Assignee: International Business Machines CorporationInventors: Ankur Datta, Balamanohar Paluri, Sharathchandra U. Pankanti, Yun Zhai
-
Patent number: 9885568Abstract: A camera at a fixed vertical height positioned above a reference plane, with an axis of a camera lens at an acute angle with respect to a perpendicular of the reference plane. One or more processors receive camera images of a multiplicity of people of unknown height and vertical axis of the images are transformed into pixel counts. The known heights of people from a known statistical distribution of heights of people are received by one or more processors and transformed to a normalized measurement of pixel counts, based in part on a focal length of the camera lens, the angle of the camera, and an objective function summing differences between pixel counts of the known heights of people and the unknown heights of people. The fixed vertical height of the camera is determined by adjusting the estimated camera height to minimize the objective function.Type: GrantFiled: March 22, 2016Date of Patent: February 6, 2018Assignee: International Business Machines CorporationInventors: Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
-
Patent number: 9858483Abstract: Long-term understanding of background modeling includes determining first and second dimension gradient model derivatives of image brightness data of an image pixel along respective dimensions of two-dimensional, single channel image brightness data of a static image scene. The determined gradients are averaged with previous determined gradients of the image pixels, and with gradients of neighboring pixels as a function of their respective distances to the image pixel, the averaging generating averaged pixel gradient models for each of a plurality of pixels of the video image data of the static image scene that each have mean values and weight values. Background models for the static image scene are constructed as a function of the averaged pixel gradients and weights, wherein the background model pixels are represented by averaged pixel gradient models having similar orientation and magnitude and weights meeting a threshold weight requirement.Type: GrantFiled: August 31, 2016Date of Patent: January 2, 2018Assignee: International Business Machines CorporationInventors: Rogerio S. Feris, Yun Zhai
-
Patent number: 9805505Abstract: Objects within two-dimensional video data are modeled by three-dimensional models as a function of object type and motion through manually calibrating a two-dimensional image to the three spatial dimensions of a three-dimensional modeling cube. Calibrated three-dimensional locations of an object in motion in the two-dimensional image field of view of a video data input are determined and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the determined three-dimensional locations. The two-dimensional object image is replaced in the video data input with an object-type three-dimensional polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.Type: GrantFiled: July 29, 2016Date of Patent: October 31, 2017Assignee: International Business Machines CorproationInventors: Ankur Datta, Rogerio S. Feris, Yun Zhai
-
Publication number: 20170221192Abstract: A system for detecting a change in object positioning by processing images by detecting a first entity tagged with a first visually unique identifier, and detecting a second entity tagged with a second visually unique identifier distinguishable from the first visually unique identifier. The system receives a first image, from a first image capturing device, containing the first visually unique identifier and the second visually unique identifier. The system analyzes the first image to determine a distance between the first visually unique identifier and the second visually unique identifier. The system receives a second image containing the first visually unique identifier. The system analyzes the second image to determine a location of the second visually unique identifier relative to the first visually unique identifier to form a distance assessment. Based on the distance assessment, the system determines a change in proximity between the first entity and the second entity.Type: ApplicationFiled: January 29, 2016Publication date: August 3, 2017Applicant: International Business Machines CorporationInventors: Bruce H. HYRE, Chiao-Fe SHU, Yun ZHAI
-
Patent number: 9710924Abstract: Field of view overlap among multiple cameras are automatically determined as a function of the temporal overlap of object tracks determined within their fields-of-view. Object tracks with the highest similarity value are assigned into pairs, and portions of the assigned object track pairs having a temporally overlapping period of time are determined. Scene entry points are determined from object locations on the tracks at a beginning of the temporally overlapping period of time, and scene exit points from object locations at an ending of the temporally overlapping period of time. Boundary lines for the overlapping fields-of-view portions within the corresponding camera fields-of-view are defined as a function of the determined entry and exit points in their respective fields-of-view.Type: GrantFiled: September 14, 2015Date of Patent: July 18, 2017Assignee: International Business Machines CorporationInventors: Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti, Yun Zhai
-
Patent number: 9704046Abstract: In an approach to tracking at least one target subject in a camera network, a search is started to find a target subject on a camera within a camera network. Features are extracted from the target subject and search queries are initiated in other nearby cameras within the camera network. Search queries attempt to detect target subjects and present the finds in a ranked order. Application of aggregate searches in multiple cameras and prior search results are used to improve matching results in the camera network; propagate a search of the target subject to discover the full pathway in the camera network; and project future occurrences of the target subject in subsequent cameras in the camera network.Type: GrantFiled: November 23, 2016Date of Patent: July 11, 2017Assignee: International Business Machines CorporationInventors: Xiao Long Chen, Na Lv, Zhe Yan, Yun Zhai, Zhuo Zhao
-
Patent number: 9659238Abstract: A system comprises an input component, a feature extractor, an object classifier, an adaptation component and a calibration tool. The input component is configured to receive one or more images, and the feature extractor is configured to extract features for one or more objects in the one or more images, the extracted features comprising at least one view-independent feature. The object classifier is configured to classify the one or more objects based at least in part on the extracted features and one or more object classification parameters, and the adaptation component is configured to adjust the classification of at least one of the objects based on one or more contextual parameters. The calibration tool is configured to adjust one or more of the object classification parameters based on likelihoods for characteristics associated with one or more object classes.Type: GrantFiled: April 15, 2014Date of Patent: May 23, 2017Assignee: International Business Machines CorporationInventors: Lisa Marie Brown, Longbin Chen, Rogerio Schmidt Feris, Arun Hampapur, Yun Zhai
-
Patent number: 9652863Abstract: Multi-mode video event indexing includes determining a quality of object distinctiveness with respect to images from a video stream input. A high-quality analytic mode is selected from multiple modes and applied to video input images via a hardware device to determine object activity within the video input images if the determined level of detected quality of object distinctiveness meets a threshold level of quality, else a low-quality analytic mode is selected and applied to the video input images via a hardware device to determine object activity within the video input images, wherein the low-quality analytic mode is different from the high-quality analytic mode.Type: GrantFiled: August 19, 2015Date of Patent: May 16, 2017Assignee: International Business Machines CorporationInventors: Russell P. Bobbitt, Lisa M. Brown, Rogerio S. Feris, Arun Hampapur, Yun Zhai