Patents by Inventor Jilin Tu

Jilin Tu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220254137
    Abstract: A computing system for detecting objects in an image can perform operations including generating an image pyramid that includes a first level corresponding with the image at a first resolution and a second level corresponding with the image at a second resolution. The operations can include tiling the first level and the second level by dividing the first level into a first plurality of tiles and the second level into a second plurality of tiles; inputting the first plurality of tiles and the second plurality of tiles into a machine-learned object detection model; receiving, as an output of the machine-learned object detection model, object detection data that includes bounding boxes respectively defined with respect to individual ones of the first plurality of tiles and the second plurality of tiles; and generating image object detection output by mapping the object detection data onto an image space of the image.
    Type: Application
    Filed: August 5, 2019
    Publication date: August 11, 2022
    Inventors: Jilin Tu, Jiang Wang, Huizhong Chen, Xiangxin Zhu, Shengyang Dai
  • Patent number: 11373069
    Abstract: An analogy generating system includes one or more image databases that include a first set of images depicting a first symbolic class and a second set of images depicting a second symbolic class and an autoencoder that receive images from the first set of images and the second set of images; determines a first characteristic shared between the first symbolic class and the second symbolic class using a first node from multiple nodes on a neural network; determine a second characteristic shared between the first symbolic class and the second symbolic class using a second node from multiple nodes on the neural network; and exchange the first characteristic and the second characteristic between the first node and the second node to establish an analogy between the first symbolic class and the second symbolic class.
    Type: Grant
    Filed: March 20, 2020
    Date of Patent: June 28, 2022
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Peter Henry Tu, Tao Gao, Alexander S-Ban Chen, Jilin Tu
  • Publication number: 20210295102
    Abstract: An analogy generating system includes one or more image databases that include a first set of images depicting a first symbolic class and a second set of images depicting a second symbolic class and an autoencoder that receive images from the first set of images and the second set of images; determines a first characteristic shared between the first symbolic class and the second symbolic class using a first node from multiple nodes on a neural network; determine a second characteristic shared between the first symbolic class and the second symbolic class using a second node from multiple nodes on the neural network; and exchange the first characteristic and the second characteristic between the first node and the second node to establish an analogy between the first symbolic class and the second symbolic class.
    Type: Application
    Filed: March 20, 2020
    Publication date: September 23, 2021
    Inventors: Peter Henry Tu, Tao Gao, Alexander S-Ban Chen, Jilin Tu
  • Patent number: 10970586
    Abstract: A method and system, the method including receive image data representations of a set of images of a physical asset; receive a data model of at least one asset, the data model of each of the at least one assets including a semantic description of the respective modeled asset and at least one operation associated with the respective modeled asset; determine a match between the received image data and the data model of one of the at least one assets based on a correspondence therebetween; generate, for the data model determined to be a match with the received image data, an operation plan based on the at least one operation included in matched data model; execute, in response to the generation of the operation plan, the generated operation plan by the physical asset.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: April 6, 2021
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Huan Tan, Gyeong Woo Cheon, Jilin Tu, Li Zhang
  • Patent number: 10937150
    Abstract: A method and system, the method including receiving semantic descriptions of features of an asset extracted from a first set of images; receiving a model of the asset, the model constructed based on a second set of a plurality images of the asset; receiving, based on an optical flow-based motion estimation, an indication of a motion for the features in the first set of images; determining a set of candidate regions of interest for the asset; determining a region of interest in the first set of images; iteratively determining a matching of features in the set of candidate regions of interest and the determined region of interest in the first set of images to generate a record of matches in features between two images in the first set of images; and displaying a visualization of the matches in features between two images in the first set of images.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: March 2, 2021
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Huan Tan, Arpit Jain, Gyeong Woo Cheon, Ghulam Ali Baloch, Jilin Tu, Weina Ge, Li Zhang
  • Patent number: 10865985
    Abstract: A method for operating a combustion chamber is provided. The method includes obtaining a carbon monoxide reading at an exit of the combustion chamber via a carbon monoxide sensor, and deriving an oxygen set point trim based at least in part on the carbon monoxide reading and a carbon monoxide set point via a controller. The method further includes determining a stability status of the combustion chamber via a combustion stability sensor, and adjusting an oxygen set point of the combustion chamber with the oxygen set point trim based at least in part on the stability status via the controller. The oxygen set point defines a desired oxygen level at the exit of the combustion chamber.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: December 15, 2020
    Assignee: GENERAL ELECTRIC TECHNOLOGY GMBH
    Inventors: Shizhong Yang, Robert Frederick Murphy, Jilin Tu, Xiaoleinmn Shi, Dayu Huang
  • Patent number: 10775314
    Abstract: An asset inspection system includes a robot and a server. The robot collects inspection data corresponding to an asset. The server, includes a user interface, a processor, and a memory. The memory includes instructions that, when executed by the processor, cause the processor to receive the inspection data from the robot, display the inspection data via the user-interface, receive feedback on the inspection data via the user interface, generate a human-assisted inspection based on the received feedback, analyze the inspection data via a trained model, generate an automated inspection based on the analysis by the trained model, combine the automated inspection and the human-assisted inspection to generate an inspection report, and transmit the inspection report for review.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: September 15, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Huan Tan, Li Zhang, Romano Patrick, Arpit Jain, Guangliang Zhao, Jilin Tu
  • Patent number: 10579785
    Abstract: An authentication system includes a processor, a non-transitory computer readable medium, and one or more programs stored on the computer readable medium, where the processor, under control of the programs implements at least one neural network trained to produce first feature vectors from facial features extracted from a population of first facial images and, after training, configured to produce a second feature vector from facial features extracted from a second facial image, a discriminative classifier trained to identify closely matching ones of the first feature vectors and configured to identify whether at least one first feature vector and the second feature vector meet a correlation threshold. The authentication system may also include an access interface configured to allow access if the correlation threshold is met.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: March 3, 2020
    Assignee: General Electric Company
    Inventors: Jimmie Beacham, Tao Jia, Jilin Tu, Peter Tu, Zhiguang Wang
  • Publication number: 20200005444
    Abstract: A method and system, the method including receiving semantic descriptions of features of an asset extracted from a first set of images; receiving a model of the asset, the model constructed based on a second set of a plurality images of the asset; receiving, based on an optical flow-based motion estimation, an indication of a motion for the features in the first set of images; determining a set of candidate regions of interest for the asset; determining a region of interest in the first set of images; iteratively determining a matching of features in the set of candidate regions of interest and the determined region of interest in the first set of images to generate a record of matches in features between two images in the first set of images; and displaying a visualization of the matches in features between two images in the first set of images.
    Type: Application
    Filed: June 28, 2018
    Publication date: January 2, 2020
    Inventors: Huan TAN, Arpit JAIN, Gyeong Woo CHEON, Ghulam Ali BALOCH, Jilin TU, Weina GE, Li ZHANG
  • Publication number: 20200005072
    Abstract: A method and system, the method including receive image data representations of a set of images of a physical asset; receive a data model of at least one asset, the data model of each of the at least one assets including a semantic description of the respective modeled asset and at least one operation associated with the respective modeled asset; determine a match between the received image data and the data model of one of the at least one assets based on a correspondence therebetween; generate, for the data model determined to be a match with the received image data, an operation plan based on the at least one operation included in matched data model; execute, in response to the generation of the operation plan, the generated operation plan by the physical asset.
    Type: Application
    Filed: June 28, 2018
    Publication date: January 2, 2020
    Inventors: Huan TAN, Gyeong Woo CHEON, Jilin TU, Li ZHANG
  • Patent number: 10445565
    Abstract: Provided are techniques for assessing individual or crowd level behavior based on image data analysis. For example, in one embodiment, the techniques may include generating signatures representative of an observed behavior based on video data and performing pairwise matching by determining whether the first signature matches a second signature indicative of a query behavior.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: October 15, 2019
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
  • Publication number: 20190257519
    Abstract: A method for operating a combustion chamber is provided. The method includes obtaining a carbon monoxide reading at an exit of the combustion chamber via a carbon monoxide sensor, and deriving an oxygen set point trim based at least in part on the carbon monoxide reading and a carbon monoxide set point via a controller. The method further includes determining a stability status of the combustion chamber via a combustion stability sensor, and adjusting an oxygen set point of the combustion chamber with the oxygen set point trim based at least in part on the stability status via the controller. The oxygen set point defines a desired oxygen level at the exit of the combustion chamber.
    Type: Application
    Filed: February 20, 2018
    Publication date: August 22, 2019
    Applicant: GENERAL ELECTRIC TECHNOLOGY GMBH
    Inventors: SHIZHONG YANG, ROBERT FREDERICK MURPHY, JILIN TU, XIAOLEINMN SHI, DAYU HUANG
  • Publication number: 20190145902
    Abstract: An asset inspection system includes a robot and a server. The robot collects inspection data corresponding to an asset. The server, includes a user interface, a processor, and a memory. The memory includes instructions that, when executed by the processor, cause the processor to receive the inspection data from the robot, display the inspection data via the user-interface, receive feedback on the inspection data via the user interface, generate a human-assisted inspection based on the received feedback, analyze the inspection data via a trained model, generate an automated inspection based on the analysis by the trained model, combine the automated inspection and the human-assisted inspection to generate an inspection report, and transmit the inspection report for review.
    Type: Application
    Filed: November 10, 2017
    Publication date: May 16, 2019
    Inventors: Huan Tan, Li Zhang, Romano Patrick, Arpit Jain, Guangliang Zhao, Jilin Tu
  • Publication number: 20190139438
    Abstract: A social interaction system and of operation thereof for interpreting social cues and using such analysis to improve social interaction via the providing of a suggested response is provided. The social interaction system includes one or more sensors to obtain social indicator data of one or more individuals in an environment during a social interaction, the social indicator data related to a behavior of the one or more individuals. The social interaction system also includes a processing system configured to determine a social state of the one or more individuals using the social indicator data and determine an optimal social response of a person to the social interaction based on an analysis of the social state. The social interaction system further includes a feedback system to indicate the optimal social response to the person.
    Type: Application
    Filed: November 9, 2017
    Publication date: May 9, 2019
    Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
  • Publication number: 20190102528
    Abstract: An authentication system includes a processor, a non-transitory computer readable medium, and one or more programs stored on the computer readable medium, where the processor, under control of the programs implements at least one neural network trained to produce first feature vectors from facial features extracted from a population of first facial images and, after training, configured to produce a second feature vector from facial features extracted from a second facial image, a discriminative classifier trained to identify closely matching ones of the first feature vectors and configured to identify whether at least one first feature vector and the second feature vector meet a correlation threshold. The authentication system may also include an access interface configured to allow access if the correlation threshold is met.
    Type: Application
    Filed: September 29, 2017
    Publication date: April 4, 2019
    Inventors: Jimmie Beacham, Tao Jia, JILIN TU, PETER TU, Zhiguang Wang
  • Patent number: 10216983
    Abstract: A security monitoring technique includes receiving data related to one or more individuals from one or more cameras in an environment. Based on the input data from the cameras, agent-based simulators are executed that each operate to generate a model of behavior of a respective individual, wherein an output of each model is symbolic sequences representative of internal experiences of the respective individual during simulation. Based on the symbolic sequences, a subsequent behavior for each of the respective individuals is predicted when the symbolic sequences match a query symbolic sequence for a query behavior.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: February 26, 2019
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
  • Publication number: 20180157902
    Abstract: A security monitoring technique includes receiving data related to one or more individuals from one or more cameras in an environment. Based on the input data from the cameras, agent-based simulators are executed that each operate to generate a model of behavior of a respective individual, wherein an output of each model is symbolic sequences representative of internal experiences of the respective individual during simulation. Based on the symbolic sequences, a subsequent behavior for each of the respective individuals is predicted when the symbolic sequences match a query symbolic sequence for a query behavior.
    Type: Application
    Filed: December 6, 2016
    Publication date: June 7, 2018
    Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
  • Publication number: 20180157903
    Abstract: Provided are techniques for assessing individual or crowd level behavior based on image data analysis. For example, in one embodiment, the techniques may include generating signatures representative of an observed behavior based on video data and performing pairwise matching by determining whether the first signature matches a second signature indicative of a query behavior.
    Type: Application
    Filed: December 6, 2016
    Publication date: June 7, 2018
    Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
  • Patent number: 9483820
    Abstract: A method and system for detecting a damaged machine component during operation of the machine are provided. The damaged machine component detection system includes one or more processors, one or more memory devices communicatively coupled to the one or more processors, an image capture device configured to generate a stream of temporally-spaced images of a scene including a machine component of interest, the images generated in real-time, and a grouping model configured to compare features of a current image of the stream of images to features of previously captured images sorted into a plurality of groups of images having similar features, generate an alert if predetermined features of the current image deviate from corresponding features of the grouped images by a predetermined amount, and update the groups with the current image if the predetermined features of the current image are similar to corresponding features of the grouped images by a predetermined amount.
    Type: Grant
    Filed: May 20, 2014
    Date of Patent: November 1, 2016
    Assignee: General Electric Company
    Inventors: Ser Nam Lim, Jilin Tu, Li Guan, Craig Ronald Hoffmann
  • Patent number: 9465997
    Abstract: A method implemented using a processor based device is disclosed. The method includes receiving a video stream comprising a plurality of image frames having at least one moving object, determining a difference between at least two image frames among the plurality of image frames and generating a difference image comprising a plurality of image blobs corresponding to the at least one moving object. The method further includes generating a plurality of bounding boxes, each bounding box surrounding at least one corresponding image blob among the plurality of image blobs, and determining a subset of bounding boxes among the plurality of bounding boxes, associated with the corresponding moving object, using a fuzzy technique based on a perceptual characterization of the subset of bounding boxes. The method also includes merging the subset of bounding boxes to generate a merged bounding box enclosing the subset of bounding boxes to detect the moving object.
    Type: Grant
    Filed: September 26, 2012
    Date of Patent: October 11, 2016
    Assignee: General Electric Company
    Inventors: Jilin Tu, Yi Xu, Ana Isabel Del Amo, Thomas Baby Sebastian