Patents by Inventor Balajee Kannan
Balajee Kannan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240091953Abstract: A method for controlling a robotic system includes determining a location and/or a pose of a power system component based on data received from one or more sensors, and determining a mapping of a location of a robotic system within a model of an external environment of the robotic system based on the data. The model of the external environment provides locations of objects external to the robotic system. A sequence of movements of components of the robotic system is determined to perform maintenance on the power system component based on the locations of the objects external to the robotic system and/or the location or pose of the power system component. One or more control signals are communicated to remotely control movement of the components of the robotic system based on the sequence or movements of the components to perform maintenance on the power system component.Type: ApplicationFiled: November 30, 2023Publication date: March 21, 2024Inventors: Romano Patrick, Shiraj Sen, Arpit Jain, Huan Tan, Yonatan Gefen, Shuai Li, Shubao Liu, Pramod Sharma, Balajee Kannan, Viktor Holovashchenko, Douglas Forman, John Michael Lizzi, Charles Burton Theurer, Omar Al Assad, Ghulam Ali Baloch, Frederick Wilson Wheeler, Tai-Peng Tian
-
Patent number: 11927969Abstract: A system includes a robotic vehicle having a propulsion and a manipulator configured to perform designated tasks. The system also including a local controller disposed onboard the robotic vehicle and configured to receive input signals from an off-board controller. Responsive to receiving an input signal for moving in an autonomous mode, the local controller is configured to move the robotic vehicle toward one of the different final destinations by autonomously and iteratively determining a series of waypoints until the robotic vehicle has reached the one final destination. For each iteration, the local controller is configured to determine a next waypoint between a current location of the robotic vehicle and the final destination, determine movement limitations of the robotic vehicle, and generate control signals in accordance with the movement limitations.Type: GrantFiled: July 21, 2020Date of Patent: March 12, 2024Assignee: Transportation IP Holdings, LLCInventors: Ghulam Ali Baloch, Huan Tan, Balajee Kannan, Charles Theurer
-
Patent number: 11865726Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.Type: GrantFiled: October 27, 2022Date of Patent: January 9, 2024Assignee: TRANSPORTATION IP HOLDINGS, LLCInventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick
-
Patent number: 11865732Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.Type: GrantFiled: April 30, 2021Date of Patent: January 9, 2024Assignee: Transportation IP Holdings, LLCInventors: Romano Patrick, Shiraj Sen, Arpit Jain, Huan Tan, Yonatan Gefen, Shuai Li, Shubao Liu, Pramod Sharma, Balajee Kannan, Viktor Holovashchenko, Douglas Forman, John Michael Lizzi, Charles Burton Theurer, Omar Al Assad, Ghulam Ali Baloch, Frederick Wilson Wheeler, Tai-Peng Tian
-
Publication number: 20230249351Abstract: A fastener system and method includes a controller having one or more processors that obtain image information associated with a tie plate. The tie plate includes one or more holes, and each hole is configured to receive a fastener. A fastener driving unit drives the fastener into at least one of the one or more holes. The controller controls movement of the fastener driving unit to move the fastener driving unit to a location corresponding to the at least one hole, and the controller controls movement of the fastener driving unit to drive the fastener into the at least one hole.Type: ApplicationFiled: April 12, 2023Publication date: August 10, 2023Inventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick, Mark Bachman, Michael VanderLinden, Mark Bradshaw Kraeling, Norman Wellings, Eric Kuiper, Dan Derosia, Julio Payan, James Maki, Matthew Orvedahl, Ozan Emsun, Mark David
-
Patent number: 11660756Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.Type: GrantFiled: April 10, 2019Date of Patent: May 30, 2023Assignee: Transportation IP Holdings, LLCInventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick
-
Publication number: 20230122689Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.Type: ApplicationFiled: October 27, 2022Publication date: April 20, 2023Inventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick
-
Publication number: 20220241975Abstract: A control system includes a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks, with the sub-tasks having one or more capability requirements. The task manager selects and assigns a first sequence of sub-tasks to a first robotic machine that has a first set of capabilities and operates according to a first mode of operation. The task manager selects and assigns a second sequence of sub-tasks to a second robotic machine that has a second set of capabilities and operates according to a second mode of operation. The task manager selects the first robotic machine based on the first set of capabilities and the first mode of operation of the first robotic machine, and selects the second robotic machine based on the second set of capabilities and the second mode of operation.Type: ApplicationFiled: April 22, 2022Publication date: August 4, 2022Inventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick, Mark Bachman, Michael VanderLinden, Mark Bradshaw Kraeling, Norman Wellings
-
Patent number: 11312018Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.Type: GrantFiled: November 22, 2019Date of Patent: April 26, 2022Assignee: TRANSPORTATION IP HOLDINGS, LLCInventors: John Michael Lizzi, Huan Tan, Charles Burton Theurer, Balajee Kannan, Romano Patrick
-
Publication number: 20210252712Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.Type: ApplicationFiled: April 30, 2021Publication date: August 19, 2021Inventors: Romano Patrick, Shiraj Sen, Arpit Jain, Huan Tan, Yonatan Gefen, Shuai Li, Shubao Liu, Pramod Sharma, Balajee Kannan, Viktor Holovashchenko, Douglas Forman, John Michael Lizzi, Charles Burton Theurer, Omar Al Assad, Ghulam Ali Baloch, Frederick Wilson Wheeler, Tai-Peng Tian
-
Patent number: 11020859Abstract: A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.Type: GrantFiled: January 4, 2019Date of Patent: June 1, 2021Assignee: TRANSPORTATION IP HOLDINGS, LLCInventors: Romano Patrick, Shiraj Sen, Arpit Jain, Huan Tan, Yonatan Gefen, Shuai Li, Shubao Liu, Pramod Sharma, Balajee Kannan, Viktor Holovashchenko, Douglas Forman, John Michael Lizzi, Charles Burton Theurer, Omar Al Assad, Ghulam Ali Baloch, Frederick Wilson Wheeler, Tai-Peng Tian
-
Patent number: 10933526Abstract: An approach relates to manipulation of tools or instruments in the performance of a task by a robot. In accordance with this approach, sensor data is acquired and processed to identify a subset of instruments initially susceptible to manipulation. The instruments are then manipulated in the performance of the task based on the processed sensor data.Type: GrantFiled: April 23, 2018Date of Patent: March 2, 2021Assignee: GENERAL ELECTRIC COMPANYInventors: Huan Tan, Weston Blaine Griffin, Lynn Ann DeRose, Yi Xu, Ying Mao, Balajee Kannan
-
Publication number: 20200348686Abstract: A system includes a robotic vehicle having a propulsion and a manipulator configured to perform designated tasks. The system also including a local controller disposed onboard the robotic vehicle and configured to receive input signals from an off-board controller. Responsive to receiving an input signal for moving in an autonomous mode, the local controller is configured to move the robotic vehicle toward one of the different final destinations by autonomously and iteratively determining a series of waypoints until the robotic vehicle has reached the one final destination. For each iteration, the local controller is configured to determine a next waypoint between a current location of the robotic vehicle and the final destination, determine movement limitations of the robotic vehicle, and generate control signals in accordance with the movement limitations.Type: ApplicationFiled: July 21, 2020Publication date: November 5, 2020Inventors: Ghulam Ali Baloch, Huan Tan, Balajee Kannan, Charles Theurer
-
Patent number: 10759051Abstract: The present approach relates to integrated planning of robot navigation and manipulator motion in performing tasks. In particular, as discussed herein sensor information, such as visual information, may be used for the robot to locate a target object when it arrives at a working location. Adjustments may be made based on this information that may include moving the robot and planning a manipulator arm motion.Type: GrantFiled: April 23, 2018Date of Patent: September 1, 2020Assignee: GENERAL ELECTRIC COMPANYInventors: Huan Tan, Weston Blaine Griffin, Lynn Ann DeRose, Yi Xu, Ying Mao, Balajee Kannan
-
Patent number: 10675765Abstract: Systems and methods are provided for an automation system. The systems and methods calculate a motion trajectory of a manipulator and an end-effector. The end-effector is configured to grasp a target object. The motion trajectory defines successive positions of the manipulator and the end-effector along a plurality of via-points toward the target object. The systems and methods further acquire force/torque (F/T) data from an F/T sensor associated with the end-effector, and adjusts the motion trajectory based on the F/T data.Type: GrantFiled: March 4, 2019Date of Patent: June 9, 2020Assignee: GENERAL ELECTRIC COMPANYInventors: Huan Tan, John Michael Lizzi, Douglas Forman, Charles Burton Theurer, Omar Al Assad, Romano Patrick, Balajee Kannan, Yonatan Gefen
-
Publication number: 20200094411Abstract: A system includes a first robotic machine having a first set of capabilities for interacting with a target object; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.Type: ApplicationFiled: November 22, 2019Publication date: March 26, 2020Inventors: Huan Tan, John Michael Lizzi, Charles Burton Theurer, Balajee Kannan, Romano Patrick
-
Publication number: 20200039076Abstract: A robotic system is provided that includes a base, an articulable arm, a visual acquisition unit, and a controller. The articulable arm may extend from a base and is movable toward a target. The visual acquisition unit can be mounted to the arm or the base and to acquire image data. The controller is operably coupled to the arm and the visual acquisition unit, and can derive from the image data environmental information corresponding to at least one of the arm or the target. The controller further can generate at least one planning scheme using the environmental information to translate the arm toward the target, select at least one planning scheme for implementation, and control movement of the arm toward the target using the at least one selected planning scheme.Type: ApplicationFiled: October 8, 2019Publication date: February 6, 2020Inventors: Huan Tan, Balajee Kannan, Yonatan Gefen, Romano Patrick, Omar Al Assad, Douglas Forman, Charles Theurer, John Lizzi, Bradford Wayne Miller, James D. Brooks, Neeraja Subrahmaniyan
-
Patent number: 10493629Abstract: A robotic system includes one or more optical sensors configured to separately obtain two dimensional (2D) image data and three dimensional (3D) image data of a brake lever of a vehicle, a manipulator arm configured to grasp the brake lever of the vehicle, and a controller configured to compare the 2D image data with the 3D image data to identify one or more of a location or a pose of the brake lever of the vehicle. The controller is configured to control the manipulator arm to move toward, grasp, and actuate the brake lever of the vehicle based on the one or more of the location or the pose of the brake lever.Type: GrantFiled: January 5, 2017Date of Patent: December 3, 2019Assignee: GE GLOBAL SOURCING LLCInventors: Arpit Jain, Charles Burton Theurer, Balajee Kannan, Shiraj Sen, Pramod Sharma, Shuai Li, Shubao Liu
-
Patent number: 10471595Abstract: A robot system is provided that includes a base, an articulable arm, a visual acquisition unit, and at least one processor. The articulable arm extends from the base and is configured to be moved toward a target. The visual acquisition unit is mounted to the arm or the base, and acquires environmental information. The at least one processor is operably coupled to the arm and the visual acquisition unit, the at least one processor configured to: generate an environmental model using the environmental information; select, from a plurality of planning schemes, using the environmental model, at least one planning scheme to translate the arm toward the target; plan movement of the arm toward the target using the selected at least one planning scheme; and control movement of the arm toward the target using the at least one selected planning scheme.Type: GrantFiled: October 14, 2016Date of Patent: November 12, 2019Assignee: GE GLOBAL SOURCING LLCInventors: Huan Tan, Balajee Kannan, Yonatan Gefen, Romano Patrick, Omar Al Assad, Douglas Forman, Charles Theurer, John Lizzi
-
Publication number: 20190321977Abstract: The present approach relates to integrated planning of robot navigation and manipulator motion in performing tasks. In particular, as discussed herein sensor information, such as visual information, may be used for the robot to locate a target object when it arrives at a working location. Adjustments may be made based on this information that may include moving the robot and planning a manipulator arm motion.Type: ApplicationFiled: April 23, 2018Publication date: October 24, 2019Inventors: Huan Tan, Weston Blaine Griffin, Lynn Ann DeRose, Yi Xu, Ying Mao, Balajee Kannan