Patents by Inventor Huan Tan

Huan Tan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • MODEL SHARING AMONG EDGE DEVICES
    Publication number: 20200160208
    Abstract: The example embodiments are directed to a system and method for sharing machine learning model parameters among edge devices in a clustered group of edge devices sensing data about an industrial asset. In one example, the method may include one or more of storing unique parameters of a machine learning (ML) model associated with an industrial asset which are unique with respect to unique parameters of other edge systems in the group of edge systems, receiving common parameter information from the group of edge systems which is shared among the group of edge systems, generating updated parameter values for an ML model based on a combination of the unique parameters and the received common parameter information, and executing the updated ML model based on incoming data from the industrial asset to generate predictive information about the industrial asset.
    Type: Application
    Filed: November 15, 2018
    Publication date: May 21, 2020
    Inventors: Huan TAN, Colin PARRIS, Xiao BIAN, Shaopeng LIU, Kiersten RALSTON, Guiju SONG, Dayu HUANG
  • AUTOMATED MODEL UPDATE BASED ON MODEL DETERIORATION
    Publication number: 20200160207
    Abstract: The example embodiments are directed to a system and methods for determining to update a machine learning model based on model degradation. In one example, the method may include one or more of receiving data acquired at an edge of an Internet of things (IoT) network from an industrial asset, executing a machine learning model with the received data as input to generate a predictive output associated with the industrial asset, determining that a performance of the machine learning model on the edge has degraded based on the generated predictive output of the machine learning model, and transmitting information about the degraded performance of the machine learning model to a central server within the IoT network.
    Type: Application
    Filed: November 15, 2018
    Publication date: May 21, 2020
    Inventors: Guiju SONG, Colin PARRIS, Xiao BIAN, Huan TAN, Kiersten RALSTON, Shaopeng LIU, Dayu HUANG
  • MODEL UPDATE BASED ON CHANGE IN EDGE DATA
    Publication number: 20200160227
    Abstract: The example embodiments are directed to a system for triggering a model update for an edge device in an IIoT network. In one example, the method may include one or more of receiving data of an operation performed by an industrial asset, the received data comprising input for a machine learning (ML) model associated with the industrial asset, determining that the received data comprises a change in data pattern with respect to a training data set which was used to previously train the ML model, storing the received data comprising the change in data pattern in a new data set, and in response to the new data set reaching a minimum threshold size, at least one of updating the ML model based on the new data set and transmitting a request to update the ML model based on the new data set.
    Type: Application
    Filed: November 15, 2018
    Publication date: May 21, 2020
    Inventors: Shaopeng LIU, Colin PARRIS, Xiao BIAN, Huan TAN, Kiersten RALSTON, Guiju SONG, Dayu HUANG
  • SELECTIVE DATA FEEDBACK FOR INDUSTRIAL EDGE SYSTEM
    Publication number: 20200159195
    Abstract: The example embodiments are directed to a system and method for optimizing data the is transmitted from an edge device to a central server such as the cloud platform. In one example, the method may include one or more of receiving incoming data which is associated with an industrial asset positioned at an edge of an Internet of Things (IoT) network, transforming the incoming data into a pattern of data points within a feature space based on a machine learning model configured to detect patterns within the data, selecting a subset of data points from the pattern based on a distance between data points in the pattern of data points with respect to a previous pattern of data points in a previous dataset associated with the industrial asset, and transmitting the selected subset of data points to a central platform via the IoT network.
    Type: Application
    Filed: November 16, 2018
    Publication date: May 21, 2020
    Inventors: Xiao BIAN, Colin PARRIS, Dayu HUANG, Huan TAN, Kiersten RALSTON, Shaopeng LIU, Guiju SONG
  • Three-dimensional robotic inspection system
    Patent number: 10633093
    Abstract: Provided are systems and methods for monitoring an asset via an autonomous model-driven inspection. In an example, the method may include storing an inspection plan including a virtually created three-dimensional (3D) model of a travel path with respect to a virtual asset that is created in virtual space, converting the virtually created 3D model of the travel path about the virtual asset into a physical travel path about a physical asset corresponding to the virtual asset, autonomously controlling vertical and lateral movement of the unmanned robot in three dimensions with respect to the physical asset based on the physical travel path and capturing data at one or more regions of interest, and capturing data at one or more regions of interest, and storing information concerning the captured data about the asset.
    Type: Grant
    Filed: May 5, 2017
    Date of Patent: April 28, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Mauricio Castillo-Effen, Ching-Ling Huang, Raju Venkataramana, Roberto Silva Filho, Alex Tepper, Steven Gray, Yakov Polishchuk, Viktor Holovashchenko, Charles Theurer, Yang Zhao, Ghulam Ali Baloch, Douglas Forman, Shiraj Sen, Huan Tan, Arpit Jain
  • Robot system path planning for asset health management
    Patent number: 10618168
    Abstract: A robotic system includes a processing system comprising at least one processor. The processor generates a plan to monitor the asset. The plan comprises one or more tasks to be performed by the at least one robot. The processor receives sensor data from at least one sensor indicating one or more characteristics of the asset. The processor adjusts the plan to monitor the asset by adjusting or adding one or more tasks to the plan based on one or both of the quality of the acquired data or a potential defect of the asset. The adjusted plan causes the at least one robot to acquire additional data related to the asset when executed.
    Type: Grant
    Filed: March 29, 2017
    Date of Patent: April 14, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Eric Michael Gros, Huan Tan, Mauricio Castillo-Effen, Charles Burton Theurer
  • System and methods for robotic autonomous motion planning and navigation
    Patent number: 10612934
    Abstract: The present approach relates to navigation (e.g., route planning and movement) of robots in an indoor environment shared with humans. The present approach includes detecting human activity over time, including but not limited to human motion; modeling human activities using the historical human activity, and using the modeled human activity to plan robotic motion or movement.
    Type: Grant
    Filed: January 12, 2018
    Date of Patent: April 7, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Huan Tan, Lynn Ann DeRose, Yi Xu, Yang Zhao
  • Automated and adaptive three-dimensional robotic site surveying
    Patent number: 10607406
    Abstract: A method for generating a three-dimensional model of an asset includes receiving input parameters corresponding to constraints of a mission plan for operating an unmanned vehicle around an asset, generating the mission plan based on the input parameters including information of a representative asset type, wherein the mission plan includes waypoints identifying locations and orientations of one or more image sensors of the unmanned vehicle, generating a flight path for the unmanned vehicle connecting the waypoints that satisfy one or more predefined criteria, monitoring a vehicle state of the unmanned vehicle during execution of the flight path from one waypoint to the next waypoint, determining, at each waypoint, a local geometry of the asset sensed by the one or more image sensors, changing the mission plan on-the-fly based on the local geometry, and capturing images of the asset along waypoints of the changed mission plan.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: March 31, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Shiraj Sen, Steven Robert Gray, Arpit Jain, Huan Tan, Douglas Forman, Judith Ann Guzzo
  • CONTROL SYSTEM WITH TASK MANAGER
    Publication number: 20200094411
    Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.
    Type: Application
    Filed: November 22, 2019
    Publication date: March 26, 2020
    Inventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick
  • ROBOTIC SYSTEM AND METHOD FOR CONTROL AND MANIPULATION
    Publication number: 20200039076
    Abstract: A robotic system is provided that includes a base, an articulable arm, a visual acquisition unit, and a controller. The articulable arm may extend from a base and is movable toward a target. The visual acquisition unit can be mounted to the arm or the base and to acquire image data. The controller is operably coupled to the arm and the visual acquisition unit, and can derive from the image data environmental information corresponding to at least one of the arm or the target. The controller further can generate at least one planning scheme using the environmental information to translate the arm toward the target, select at least one planning scheme for implementation, and control movement of the arm toward the target using the at least one selected planning scheme.
    Type: Application
    Filed: October 8, 2019
    Publication date: February 6, 2020
    Inventors: Huan Tan, Balajee Kannan, Yonatan Gefen, Romano Patrick, Omar Al Assad, Douglas Forman, Charles Theurer, John Lizzi, Bradford Wayne Miller, James D. Brooks, Neeraja Subrahmaniyan
  • SYSTEMS AND METHODS OF FEATURE CORRESPONDENCE ANALYSIS
    Publication number: 20200005444
    Abstract: A method and system, the method including receiving semantic descriptions of features of an asset extracted from a first set of images; receiving a model of the asset, the model constructed based on a second set of a plurality images of the asset; receiving, based on an optical flow-based motion estimation, an indication of a motion for the features in the first set of images; determining a set of candidate regions of interest for the asset; determining a region of interest in the first set of images; iteratively determining a matching of features in the set of candidate regions of interest and the determined region of interest in the first set of images to generate a record of matches in features between two images in the first set of images; and displaying a visualization of the matches in features between two images in the first set of images.
    Type: Application
    Filed: June 28, 2018
    Publication date: January 2, 2020
    Inventors: Huan TAN, Arpit JAIN, Gyeong Woo CHEON, Ghulam Ali BALOCH, Jilin TU, Weina GE, Li ZHANG
  • SYSTEMS AND METHODS OF 3D SCENE SEGMENTATION AND MATCHING FOR ROBOTIC OPERATIONS
    Publication number: 20200005072
    Abstract: A method and system, the method including receive image data representations of a set of images of a physical asset; receive a data model of at least one asset, the data model of each of the at least one assets including a semantic description of the respective modeled asset and at least one operation associated with the respective modeled asset; determine a match between the received image data and the data model of one of the at least one assets based on a correspondence therebetween; generate, for the data model determined to be a match with the received image data, an operation plan based on the at least one operation included in matched data model; execute, in response to the generation of the operation plan, the generated operation plan by the physical asset.
    Type: Application
    Filed: June 28, 2018
    Publication date: January 2, 2020
    Inventors: Huan TAN, Gyeong Woo CHEON, Jilin TU, Li ZHANG
  • Systems and methods for control of robotic manipulation
    Patent number: 10471595
    Abstract: A robot system is provided that includes a base, an articulable arm, a visual acquisition unit, and at least one processor. The articulable arm extends from the base and is configured to be moved toward a target. The visual acquisition unit is mounted to the arm or the base, and acquires environmental information. The at least one processor is operably coupled to the arm and the visual acquisition unit, the at least one processor configured to: generate an environmental model using the environmental information; select, from a plurality of planning schemes, using the environmental model, at least one planning scheme to translate the arm toward the target; plan movement of the arm toward the target using the selected at least one planning scheme; and control movement of the arm toward the target using the at least one selected planning scheme.
    Type: Grant
    Filed: October 14, 2016
    Date of Patent: November 12, 2019
    Assignee: GE GLOBAL SOURCING LLC
    Inventors: Huan Tan, Balajee Kannan, Yonatan Gefen, Romano Patrick, Omar Al Assad, Douglas Forman, Charles Theurer, John Lizzi
  • METHOD AND ROBOTIC SYSTEM FOR MANIPLUATING INSTRUMENTS
    Publication number: 20190321969
    Abstract: The disclosed approach relates to manipulation of tools or instruments in the performance of a task by a robot. In accordance with this approach, sensor data is acquired and processed to identify a subset of instruments initially susceptible to manipulation. The instruments are then manipulated in the performance of the task based on the processed sensor data.
    Type: Application
    Filed: April 23, 2018
    Publication date: October 24, 2019
    Inventors: Huan Tan, Weston Blaine Griffin, Lynn Ann DeRose, Yi Xu, Ying Mao, Balajee Kannan
  • ARCHITECTURE AND METHODS FOR ROBOTIC MOBILE MANIPLUATION SYSTEM
    Publication number: 20190321977
    Abstract: The present approach relates to integrated planning of robot navigation and manipulator motion in performing tasks. In particular, as discussed herein sensor information, such as visual information, may be used for the robot to locate a target object when it arrives at a working location. Adjustments may be made based on this information that may include moving the robot and planning a manipulator arm motion.
    Type: Application
    Filed: April 23, 2018
    Publication date: October 24, 2019
    Inventors: Huan Tan, Weston Blaine Griffin, Lynn Ann DeRose, Yi Xu, Ying Mao, Balajee Kannan
  • Self-localized mobile sensor network for autonomous robotic inspection
    Patent number: 10452078
    Abstract: Provided are systems and methods for autonomous robotic localization. In one example, the method includes receiving ranging measurements from a plurality of fixed anchor nodes that each have a fixed position and height with respect to the asset, receiving another ranging measurement from an aerial anchor node attached to an unmanned robot having a dynamically adjustable position and height different than the fixed position and height of each of the plurality of anchor nodes, and determining a location of the autonomous robot with respect to the asset based on the ranging measurements received from the fixed anchor nodes and the aerial anchor node, and autonomously moving the autonomous robot about the asset based on the determined location.
    Type: Grant
    Filed: May 10, 2017
    Date of Patent: October 22, 2019
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Yang Zhao, Mauricio Castillo-Effen, Ghulam Ali Baloch, Huan Tan, Douglas Forman
  • SYSTEM AND METHOD FOR DETERMINING VEHICLE ORIENTATION IN A VEHICLE CONSIST
    Publication number: 20190263430
    Abstract: A system and method includes determining, with a sensor assembly disposed onboard a first aerial vehicle, a direction in which a fluid flows within or through the first aerial vehicle, and determining an orientation of the first aerial vehicle relative to a second aerial vehicle based at least in part on the direction in which the fluid flows within or through the first aerial vehicle.
    Type: Application
    Filed: May 14, 2019
    Publication date: August 29, 2019
    Inventors: Eugene Smith, Ajith Kuttannair Kumar, Wolfgang Daum, Martin Paget, Daniel Rush, Sameh Fahmy, Brad Thomas Costa, Seneca Snyder, Jerry Duncan, Mark Bradshaw Kraeling, Michael Scott Miner, Shannon Joseph Clouse, Anwarul Azam, Matthew Lawrence Blair, Nidhi Naithani, Dattaraj Jagdish Rao, Anju Bind, Sreyashi Dey Chaki, Scott Daniel Nelson, Nikhil Uday Naphade, Wing Yeung Chung, Daniel Malachi Ballesty, Glenn Robert Shaffer, Jeffret James Kisak, Dale Martin DiDomenico, Suresh Govindappa, Manibabu Pippalla, Sethu Madhavan, Jared Klineman Cooper, Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick, Brad Thomas Costa, James D. Brooks, Micahel Scott Miner, Harry Kirk Matthews, JR., Bradford Wayne Miller, Neeraja Subrahmaniyan, Brian Joseph McManus, Frank Wawrzyniak, Ralph C. Haddock, III, Robert James Foy, James Glen Corry, Steven Andrew Kellner, Joseph Mario Nazareth, Brian William Schroeck, Shawn Arthur McClintic
  • CONTROL SYSTEM WITH TASK MANAGER
    Publication number: 20190232498
    Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.
    Type: Application
    Filed: April 10, 2019
    Publication date: August 1, 2019
    Inventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick
  • AUTOMATED AND ADAPTIVE THREE-DIMENSIONAL ROBOTIC SITE SURVEYING
    Publication number: 20190228573
    Abstract: A method for generating a three-dimensional model of an asset includes receiving input parameters corresponding to constraints of a mission plan for operating an unmanned vehicle around an asset, generating the mission plan based on the input parameters including information of a representative asset type, wherein the mission plan includes waypoints identifying locations and orientations of one or more image sensors of the unmanned vehicle, generating a flight path for the unmanned vehicle connecting the waypoints that satisfy one or more predefined criteria, monitoring a vehicle state of the unmanned vehicle during execution of the flight path from one waypoint to the next waypoint, determining, at each waypoint, a local geometry of the asset sensed by the one or more image sensors, changing the mission plan on-the-fly based on the local geometry, and capturing images of the asset along waypoints of the changed mission plan.
    Type: Application
    Filed: January 25, 2018
    Publication date: July 25, 2019
    Inventors: Shiraj SEN, Steven Robert GRAY, Arpit JAIN, Huan TAN, Douglas FORMAN, Judith Ann GUZZO
  • CONTROLLING AND COMMANDING AN UNMANNED ROBOT USING NATURAL INTERFACES
    Publication number: 20190224849
    Abstract: The example embodiments are directed to a system and method for controlling and commanding an unmanned robot using natural interfaces. In one example, the method includes receiving a plurality of sensory inputs from a user via one or more natural interfaces, wherein each sensory input is associated with an intention of the user for an unmanned robot to perform a task, processing each of the plurality of sensory inputs using a plurality of channels of processing to produce a first recognition result and a second recognition result, combining the first recognition result and the second recognition result to determine a recognized command, and generating a task plan assignable to the unmanned robot based on the recognized command and predefined control primitives.
    Type: Application
    Filed: January 23, 2018
    Publication date: July 25, 2019
    Inventors: Huan TAN, Ghulam Ali BALOCH, Yang ZHAO, Mauricio CASTILLO-EFFEN