Patents by Inventor Jilin Tu
Jilin Tu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20220254137Abstract: A computing system for detecting objects in an image can perform operations including generating an image pyramid that includes a first level corresponding with the image at a first resolution and a second level corresponding with the image at a second resolution. The operations can include tiling the first level and the second level by dividing the first level into a first plurality of tiles and the second level into a second plurality of tiles; inputting the first plurality of tiles and the second plurality of tiles into a machine-learned object detection model; receiving, as an output of the machine-learned object detection model, object detection data that includes bounding boxes respectively defined with respect to individual ones of the first plurality of tiles and the second plurality of tiles; and generating image object detection output by mapping the object detection data onto an image space of the image.Type: ApplicationFiled: August 5, 2019Publication date: August 11, 2022Inventors: Jilin Tu, Jiang Wang, Huizhong Chen, Xiangxin Zhu, Shengyang Dai
-
Patent number: 11373069Abstract: An analogy generating system includes one or more image databases that include a first set of images depicting a first symbolic class and a second set of images depicting a second symbolic class and an autoencoder that receive images from the first set of images and the second set of images; determines a first characteristic shared between the first symbolic class and the second symbolic class using a first node from multiple nodes on a neural network; determine a second characteristic shared between the first symbolic class and the second symbolic class using a second node from multiple nodes on the neural network; and exchange the first characteristic and the second characteristic between the first node and the second node to establish an analogy between the first symbolic class and the second symbolic class.Type: GrantFiled: March 20, 2020Date of Patent: June 28, 2022Assignee: GENERAL ELECTRIC COMPANYInventors: Peter Henry Tu, Tao Gao, Alexander S-Ban Chen, Jilin Tu
-
Publication number: 20210295102Abstract: An analogy generating system includes one or more image databases that include a first set of images depicting a first symbolic class and a second set of images depicting a second symbolic class and an autoencoder that receive images from the first set of images and the second set of images; determines a first characteristic shared between the first symbolic class and the second symbolic class using a first node from multiple nodes on a neural network; determine a second characteristic shared between the first symbolic class and the second symbolic class using a second node from multiple nodes on the neural network; and exchange the first characteristic and the second characteristic between the first node and the second node to establish an analogy between the first symbolic class and the second symbolic class.Type: ApplicationFiled: March 20, 2020Publication date: September 23, 2021Inventors: Peter Henry Tu, Tao Gao, Alexander S-Ban Chen, Jilin Tu
-
Patent number: 10970586Abstract: A method and system, the method including receive image data representations of a set of images of a physical asset; receive a data model of at least one asset, the data model of each of the at least one assets including a semantic description of the respective modeled asset and at least one operation associated with the respective modeled asset; determine a match between the received image data and the data model of one of the at least one assets based on a correspondence therebetween; generate, for the data model determined to be a match with the received image data, an operation plan based on the at least one operation included in matched data model; execute, in response to the generation of the operation plan, the generated operation plan by the physical asset.Type: GrantFiled: June 28, 2018Date of Patent: April 6, 2021Assignee: GENERAL ELECTRIC COMPANYInventors: Huan Tan, Gyeong Woo Cheon, Jilin Tu, Li Zhang
-
Patent number: 10937150Abstract: A method and system, the method including receiving semantic descriptions of features of an asset extracted from a first set of images; receiving a model of the asset, the model constructed based on a second set of a plurality images of the asset; receiving, based on an optical flow-based motion estimation, an indication of a motion for the features in the first set of images; determining a set of candidate regions of interest for the asset; determining a region of interest in the first set of images; iteratively determining a matching of features in the set of candidate regions of interest and the determined region of interest in the first set of images to generate a record of matches in features between two images in the first set of images; and displaying a visualization of the matches in features between two images in the first set of images.Type: GrantFiled: June 28, 2018Date of Patent: March 2, 2021Assignee: GENERAL ELECTRIC COMPANYInventors: Huan Tan, Arpit Jain, Gyeong Woo Cheon, Ghulam Ali Baloch, Jilin Tu, Weina Ge, Li Zhang
-
Patent number: 10865985Abstract: A method for operating a combustion chamber is provided. The method includes obtaining a carbon monoxide reading at an exit of the combustion chamber via a carbon monoxide sensor, and deriving an oxygen set point trim based at least in part on the carbon monoxide reading and a carbon monoxide set point via a controller. The method further includes determining a stability status of the combustion chamber via a combustion stability sensor, and adjusting an oxygen set point of the combustion chamber with the oxygen set point trim based at least in part on the stability status via the controller. The oxygen set point defines a desired oxygen level at the exit of the combustion chamber.Type: GrantFiled: February 20, 2018Date of Patent: December 15, 2020Assignee: GENERAL ELECTRIC TECHNOLOGY GMBHInventors: Shizhong Yang, Robert Frederick Murphy, Jilin Tu, Xiaoleinmn Shi, Dayu Huang
-
Patent number: 10775314Abstract: An asset inspection system includes a robot and a server. The robot collects inspection data corresponding to an asset. The server, includes a user interface, a processor, and a memory. The memory includes instructions that, when executed by the processor, cause the processor to receive the inspection data from the robot, display the inspection data via the user-interface, receive feedback on the inspection data via the user interface, generate a human-assisted inspection based on the received feedback, analyze the inspection data via a trained model, generate an automated inspection based on the analysis by the trained model, combine the automated inspection and the human-assisted inspection to generate an inspection report, and transmit the inspection report for review.Type: GrantFiled: November 10, 2017Date of Patent: September 15, 2020Assignee: GENERAL ELECTRIC COMPANYInventors: Huan Tan, Li Zhang, Romano Patrick, Arpit Jain, Guangliang Zhao, Jilin Tu
-
Patent number: 10579785Abstract: An authentication system includes a processor, a non-transitory computer readable medium, and one or more programs stored on the computer readable medium, where the processor, under control of the programs implements at least one neural network trained to produce first feature vectors from facial features extracted from a population of first facial images and, after training, configured to produce a second feature vector from facial features extracted from a second facial image, a discriminative classifier trained to identify closely matching ones of the first feature vectors and configured to identify whether at least one first feature vector and the second feature vector meet a correlation threshold. The authentication system may also include an access interface configured to allow access if the correlation threshold is met.Type: GrantFiled: September 29, 2017Date of Patent: March 3, 2020Assignee: General Electric CompanyInventors: Jimmie Beacham, Tao Jia, Jilin Tu, Peter Tu, Zhiguang Wang
-
Publication number: 20200005444Abstract: A method and system, the method including receiving semantic descriptions of features of an asset extracted from a first set of images; receiving a model of the asset, the model constructed based on a second set of a plurality images of the asset; receiving, based on an optical flow-based motion estimation, an indication of a motion for the features in the first set of images; determining a set of candidate regions of interest for the asset; determining a region of interest in the first set of images; iteratively determining a matching of features in the set of candidate regions of interest and the determined region of interest in the first set of images to generate a record of matches in features between two images in the first set of images; and displaying a visualization of the matches in features between two images in the first set of images.Type: ApplicationFiled: June 28, 2018Publication date: January 2, 2020Inventors: Huan TAN, Arpit JAIN, Gyeong Woo CHEON, Ghulam Ali BALOCH, Jilin TU, Weina GE, Li ZHANG
-
Publication number: 20200005072Abstract: A method and system, the method including receive image data representations of a set of images of a physical asset; receive a data model of at least one asset, the data model of each of the at least one assets including a semantic description of the respective modeled asset and at least one operation associated with the respective modeled asset; determine a match between the received image data and the data model of one of the at least one assets based on a correspondence therebetween; generate, for the data model determined to be a match with the received image data, an operation plan based on the at least one operation included in matched data model; execute, in response to the generation of the operation plan, the generated operation plan by the physical asset.Type: ApplicationFiled: June 28, 2018Publication date: January 2, 2020Inventors: Huan TAN, Gyeong Woo CHEON, Jilin TU, Li ZHANG
-
Patent number: 10445565Abstract: Provided are techniques for assessing individual or crowd level behavior based on image data analysis. For example, in one embodiment, the techniques may include generating signatures representative of an observed behavior based on video data and performing pairwise matching by determining whether the first signature matches a second signature indicative of a query behavior.Type: GrantFiled: December 6, 2016Date of Patent: October 15, 2019Assignee: GENERAL ELECTRIC COMPANYInventors: Peter Henry Tu, Tao Gao, Jilin Tu
-
Publication number: 20190257519Abstract: A method for operating a combustion chamber is provided. The method includes obtaining a carbon monoxide reading at an exit of the combustion chamber via a carbon monoxide sensor, and deriving an oxygen set point trim based at least in part on the carbon monoxide reading and a carbon monoxide set point via a controller. The method further includes determining a stability status of the combustion chamber via a combustion stability sensor, and adjusting an oxygen set point of the combustion chamber with the oxygen set point trim based at least in part on the stability status via the controller. The oxygen set point defines a desired oxygen level at the exit of the combustion chamber.Type: ApplicationFiled: February 20, 2018Publication date: August 22, 2019Applicant: GENERAL ELECTRIC TECHNOLOGY GMBHInventors: SHIZHONG YANG, ROBERT FREDERICK MURPHY, JILIN TU, XIAOLEINMN SHI, DAYU HUANG
-
Publication number: 20190145902Abstract: An asset inspection system includes a robot and a server. The robot collects inspection data corresponding to an asset. The server, includes a user interface, a processor, and a memory. The memory includes instructions that, when executed by the processor, cause the processor to receive the inspection data from the robot, display the inspection data via the user-interface, receive feedback on the inspection data via the user interface, generate a human-assisted inspection based on the received feedback, analyze the inspection data via a trained model, generate an automated inspection based on the analysis by the trained model, combine the automated inspection and the human-assisted inspection to generate an inspection report, and transmit the inspection report for review.Type: ApplicationFiled: November 10, 2017Publication date: May 16, 2019Inventors: Huan Tan, Li Zhang, Romano Patrick, Arpit Jain, Guangliang Zhao, Jilin Tu
-
Publication number: 20190139438Abstract: A social interaction system and of operation thereof for interpreting social cues and using such analysis to improve social interaction via the providing of a suggested response is provided. The social interaction system includes one or more sensors to obtain social indicator data of one or more individuals in an environment during a social interaction, the social indicator data related to a behavior of the one or more individuals. The social interaction system also includes a processing system configured to determine a social state of the one or more individuals using the social indicator data and determine an optimal social response of a person to the social interaction based on an analysis of the social state. The social interaction system further includes a feedback system to indicate the optimal social response to the person.Type: ApplicationFiled: November 9, 2017Publication date: May 9, 2019Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
-
Publication number: 20190102528Abstract: An authentication system includes a processor, a non-transitory computer readable medium, and one or more programs stored on the computer readable medium, where the processor, under control of the programs implements at least one neural network trained to produce first feature vectors from facial features extracted from a population of first facial images and, after training, configured to produce a second feature vector from facial features extracted from a second facial image, a discriminative classifier trained to identify closely matching ones of the first feature vectors and configured to identify whether at least one first feature vector and the second feature vector meet a correlation threshold. The authentication system may also include an access interface configured to allow access if the correlation threshold is met.Type: ApplicationFiled: September 29, 2017Publication date: April 4, 2019Inventors: Jimmie Beacham, Tao Jia, JILIN TU, PETER TU, Zhiguang Wang
-
Patent number: 10216983Abstract: A security monitoring technique includes receiving data related to one or more individuals from one or more cameras in an environment. Based on the input data from the cameras, agent-based simulators are executed that each operate to generate a model of behavior of a respective individual, wherein an output of each model is symbolic sequences representative of internal experiences of the respective individual during simulation. Based on the symbolic sequences, a subsequent behavior for each of the respective individuals is predicted when the symbolic sequences match a query symbolic sequence for a query behavior.Type: GrantFiled: December 6, 2016Date of Patent: February 26, 2019Assignee: GENERAL ELECTRIC COMPANYInventors: Peter Henry Tu, Tao Gao, Jilin Tu
-
Publication number: 20180157902Abstract: A security monitoring technique includes receiving data related to one or more individuals from one or more cameras in an environment. Based on the input data from the cameras, agent-based simulators are executed that each operate to generate a model of behavior of a respective individual, wherein an output of each model is symbolic sequences representative of internal experiences of the respective individual during simulation. Based on the symbolic sequences, a subsequent behavior for each of the respective individuals is predicted when the symbolic sequences match a query symbolic sequence for a query behavior.Type: ApplicationFiled: December 6, 2016Publication date: June 7, 2018Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
-
Publication number: 20180157903Abstract: Provided are techniques for assessing individual or crowd level behavior based on image data analysis. For example, in one embodiment, the techniques may include generating signatures representative of an observed behavior based on video data and performing pairwise matching by determining whether the first signature matches a second signature indicative of a query behavior.Type: ApplicationFiled: December 6, 2016Publication date: June 7, 2018Inventors: Peter Henry Tu, Tao Gao, Jilin Tu
-
Patent number: 9483820Abstract: A method and system for detecting a damaged machine component during operation of the machine are provided. The damaged machine component detection system includes one or more processors, one or more memory devices communicatively coupled to the one or more processors, an image capture device configured to generate a stream of temporally-spaced images of a scene including a machine component of interest, the images generated in real-time, and a grouping model configured to compare features of a current image of the stream of images to features of previously captured images sorted into a plurality of groups of images having similar features, generate an alert if predetermined features of the current image deviate from corresponding features of the grouped images by a predetermined amount, and update the groups with the current image if the predetermined features of the current image are similar to corresponding features of the grouped images by a predetermined amount.Type: GrantFiled: May 20, 2014Date of Patent: November 1, 2016Assignee: General Electric CompanyInventors: Ser Nam Lim, Jilin Tu, Li Guan, Craig Ronald Hoffmann
-
Patent number: 9465997Abstract: A method implemented using a processor based device is disclosed. The method includes receiving a video stream comprising a plurality of image frames having at least one moving object, determining a difference between at least two image frames among the plurality of image frames and generating a difference image comprising a plurality of image blobs corresponding to the at least one moving object. The method further includes generating a plurality of bounding boxes, each bounding box surrounding at least one corresponding image blob among the plurality of image blobs, and determining a subset of bounding boxes among the plurality of bounding boxes, associated with the corresponding moving object, using a fuzzy technique based on a perceptual characterization of the subset of bounding boxes. The method also includes merging the subset of bounding boxes to generate a merged bounding box enclosing the subset of bounding boxes to detect the moving object.Type: GrantFiled: September 26, 2012Date of Patent: October 11, 2016Assignee: General Electric CompanyInventors: Jilin Tu, Yi Xu, Ana Isabel Del Amo, Thomas Baby Sebastian