Patents by Inventor Thong T. Nguyen
Thong T. Nguyen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12242256Abstract: A tangible, non-transitory, computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive user input indicative of a selection of a user experience of a plurality of user experiences. The plurality of user experiences include a first user experience associated with a first event that occurred in an industrial automation system at a first time prior to receiving the user input and a second user experience associated with a second event expected to occur in the industrial automation system at a second time after receiving the user input. When executed, the instructions also cause the processing circuitry to determine, based on the user input, output representative data associated with the industrial automation system and instruct an extended reality device to present the output representative data.Type: GrantFiled: September 22, 2021Date of Patent: March 4, 2025Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Publication number: 20250054501Abstract: An illustrative method includes a voice agent system establishing a plurality of user-agent conversations, wherein each user-agent conversation between a user and the voice agent system is established in response to the user speaking a trigger word and the plurality of user-agent conversations continue simultaneously in a same physical area, detecting an utterance in an audio stream associated with the physical area, determining, based on the utterance, that the utterance potentially belongs to a particular user-agent conversation among the plurality of user-agent conversations and determining a confidence score that the utterance belongs to the particular user-agent conversation, identifying a candidate action to be performed by the voice agent system based on the utterance, determining an overall confidence score of the candidate action based on the confidence score that the utterance belongs to the particular user-agent conversation, and performing an operation based on the overall confidence score of theType: ApplicationFiled: August 9, 2023Publication date: February 13, 2025Inventors: Aaron J. Neustedter, Thong T. Nguyen, Paul D. Schmirler
-
Patent number: 12056924Abstract: A non-transitory computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive, from first sensors, first sensory datasets associated with an industrial automation system, receive, from second sensors, second sensory datasets associated with a machine configured to perform mechanical operations, determine a position of the machine relative to the industrial automation system based on the first sensory datasets and the second sensory datasets, determine output representative data associated with the industrial automation system based on the first sensory datasets and the second sensory datasets and in accordance with the position of the machine relative to the industrial automation system, instruct an extended reality device to present the output representative data, determine movement of components of the machine, and instruct the extended reality device to present feedback based on the movement of the components.Type: GrantFiled: September 22, 2021Date of Patent: August 6, 2024Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Patent number: 12039106Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.Type: GrantFiled: November 21, 2022Date of Patent: July 16, 2024Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy
-
Patent number: 11829126Abstract: A non-transitory computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system from sensors, receive positioning data via an extended reality device associated with a user, determine a first virtual positioning of the user in a virtual coordinate system based on the positioning data, determine a second virtual positioning of an industrial automation system in the virtual coordinate system based on the sensory datasets, determine output representative data to be presented by the extended reality device based on the plurality of sensory datasets and in accordance to the first virtual positioning relative to the second virtual positioning, and instruct the extended reality device to present the output representative data.Type: GrantFiled: September 22, 2021Date of Patent: November 28, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Patent number: 11688107Abstract: A tangible, non-transitory, computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system, determine context information based on a sensory dataset and representative of an environmental condition, predict an intent of a user to complete a task associated with the industrial automation system based on the sensory datasets and the context information, present first output representative data via an extended reality device based on the intent and a setting, the setting including a data presentation format for presenting the sensory datasets, receive inputs indicative of changes to the data presentation format, present second output representative data via the extended reality device in response to receiving the inputs, and update the setting based on the inputs and historical data indicative of users changing the data presentation format of the first output rType: GrantFiled: September 22, 2021Date of Patent: June 27, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Patent number: 11669156Abstract: Techniques for employing augmented reality or virtual reality information are presented. An information management component (IMC) of an augmented reality device (ARD) can monitor and detect user activities and conditions in area in proximity to ARD. Based on user activities and conditions, IMC can determine augmented reality information that can enhance user experience, performance of user activities, or security and safety of user. IMC can present, via an interface component of ARD, the augmented reality information to the user. The augmented reality information can relate to user location; navigation by the user; tasks to be performed by the user; product assembly; maintenance work; system or product design or configuration; remote control of assembly, maintenance, design, or configuration; environmental and/or hazardous conditions; security, identification, and authentication of users; or training the user to perform tasks. IMC can translate information from a language to a different language of the user.Type: GrantFiled: April 27, 2022Date of Patent: June 6, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, John M. Van Hecke, Alex L. Nicoll, Paul D. Schmirler, Mark Bjerke
-
Patent number: 11651528Abstract: A tangible, non-transitory, computer-readable medium includes instructions.Type: GrantFiled: September 22, 2021Date of Patent: May 16, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Publication number: 20230091778Abstract: A tangible, non-transitory, computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system, determine context information based on a sensory dataset and representative of an environmental condition, predict an intent of a user to complete a task associated with the industrial automation system based on the sensory datasets and the context information, present first output representative data via an extended reality device based on the intent and a setting, the setting including a data presentation format for presenting the sensory datasets, receive inputs indicative of changes to the data presentation format, present second output representative data via the extended reality device in response to receiving the inputs, and update the setting based on the inputs and historical data indicative of users changing the data presentation format of the first output rType: ApplicationFiled: September 22, 2021Publication date: March 23, 2023Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Publication number: 20230089251Abstract: A non-transitory computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive, from first sensors, first sensory datasets associated with an industrial automation system, receive, from second sensors, second sensory datasets associated with a machine configured to perform mechanical operations, determine a position of the machine relative to the industrial automation system based on the first sensory datasets and the second sensory datasets, determine output representative data associated with the industrial automation system based on the first sensory datasets and the second sensory datasets and in accordance with the position of the machine relative to the industrial automation system, instruct an extended reality device to present the output representative data, determine movement of components of the machine, and instruct the extended reality device to present feedback based on the movement of the components.Type: ApplicationFiled: September 22, 2021Publication date: March 23, 2023Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Publication number: 20230092405Abstract: A tangible, non-transitory, computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive user input indicative of a selection of a user experience of a plurality of user experiences. The plurality of user experiences include a first user experience associated with a first event that occurred in an industrial automation system at a first time prior to receiving the user input and a second user experience associated with a second event expected to occur in the industrial automation system at a second time after receiving the user input. When executed, the instructions also cause the processing circuitry to determine, based on the user input, output representative data associated with the industrial automation system and instruct an extended reality device to present the output representative data.Type: ApplicationFiled: September 22, 2021Publication date: March 23, 2023Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Publication number: 20230092938Abstract: A non-transitory computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system from sensors, receive positioning data via an extended reality device associated with a user, determine a first virtual positioning of the user in a virtual coordinate system based on the positioning data, determine a second virtual positioning of an industrial automation system in the virtual coordinate system based on the sensory datasets, determine output representative data to be presented by the extended reality device based on the plurality of sensory datasets and in accordance to the first virtual positioning relative to the second virtual positioning, and instruct the extended reality device to present the output representative data.Type: ApplicationFiled: September 22, 2021Publication date: March 23, 2023Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Publication number: 20230093660Abstract: A tangible, non-transitory, computer-readable medium includes instructions.Type: ApplicationFiled: September 22, 2021Publication date: March 23, 2023Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Kristopher J. Holley, Susan J. Lovas
-
Publication number: 20230091359Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.Type: ApplicationFiled: November 21, 2022Publication date: March 23, 2023Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy
-
Patent number: 11609345Abstract: A system includes a computing system configured to communicatively couple to a database configured to store a virtual coordinate system and a plurality of features associated with a representative environment associated with the virtual coordinate system. The computing system is configured to receive a first input indicative of a physical positioning of a user in a physical environment, determine a virtual positioning of the user in the virtual coordinate system based on the first input, receive a second input indicative of an updated physical positioning of the user in the physical environment, determine an updated virtual positioning of the user in the virtual coordinate system based on the second input, and output a first signal to a computing device in response to determining the updated virtual positioning of the user in the virtual coordinate system.Type: GrantFiled: February 20, 2020Date of Patent: March 21, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Alex L. Nicoll
-
Patent number: 11586852Abstract: A system includes a training system configured to display first image data and a remote expert system configured to display second image data that corresponds to the first image data, receive feedback data associated with the second image data, and transmit a command to the training system based on the feedback data. The command is configured to modify the first image data presented via the training system.Type: GrantFiled: September 4, 2019Date of Patent: February 21, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Hannah M. Schermerhorn, Jingbo Liu
-
Patent number: 11586946Abstract: A non-transitory computer-readable medium includes computer-executable instructions that, when executed by at least one processor, are configured to cause the at least one processor to receive an inquiry from a training system, in which the inquiry includes a request for assistance to perform a first operation, retrieve a training profile for the first operation from a database based on the inquiry, and transmit the training profile to the training system, in which the training system is configured to present image data, audio data, or both regarding the first operation based on the training profile. The computer-executable instructions are also configured to cause the at least one processor to receive variant feedback from the training system, generate an updated training profile based on the variant feedback, store the updated training profile in the database.Type: GrantFiled: September 4, 2019Date of Patent: February 21, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Paul D. Schmirler, Thong T. Nguyen, Hannah M. Schermerhorn, Timothy T. Duffy, Alex L. Nicoll, Jingbo Liu
-
Patent number: 11520317Abstract: A system may include audio devices that output sound waves. The system also includes a control system having a processor. The control system may receive a first plurality of operation parameters associated with a plurality of components in an industrial automation system from one or more sensors. The control system may also determine a plurality of audio tones based on the plurality of operation parameters. Further still, the control system may send one or more control signals to one or more audio devices in response to detecting the plurality of operation parameters, wherein the one or more audio devices are configured to produce the plurality of audio tones in response to receiving of the one or more control signals.Type: GrantFiled: February 5, 2021Date of Patent: December 6, 2022Assignee: Rockwell Automation Technologies, Inc.Inventors: Natalie A. Tremblay, Kristopher J. Holley, Louisa A. Wood, Thong T. Nguyen, Paul D. Schmirler
-
Patent number: 11507195Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.Type: GrantFiled: February 24, 2021Date of Patent: November 22, 2022Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy
-
Patent number: 11500915Abstract: A non-transitory computer-readable medium includes computer-executable instructions that, when executed by at least one processor, may cause the at least one processor to retrieve a first training profile of a plurality of training profiles from a database, identify a plurality of index keywords in a respective training content of the first training profile, in which the respective training content includes audio data, video data, or both, and divide the first training profile into a plurality of sections based on the plurality of index keywords. Each of the plurality of sections is selectable for playback.Type: GrantFiled: September 4, 2019Date of Patent: November 15, 2022Assignee: Rockwell Automation Technologies, Inc.Inventors: Thong T. Nguyen, Paul D. Schmirler, Timothy T. Duffy, Hannah M. Schermerhorn, Jingbo Liu