Patents by Inventor Thomas Marshall Miller, IV
Thomas Marshall Miller, IV has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11823316Abstract: Systems and methods for displaying a virtual character in a mixed reality environment are disclosed. In some embodiments, a view of the virtual character is based on an animation rig comprising primary joints and helper joints. The animation rig may be in a pose defined by spatial relationships between the primary joints and helper joints. The virtual character may be moving in the mixed reality environment. In some instances, the virtual character may be moving based on a comparison of interestingness values associated with elements in the mixed reality environment. The spatial relationship transformation associated with the movement may be indicated by movement information. In some embodiments, the movement information is received from a neural network.Type: GrantFiled: November 21, 2022Date of Patent: November 21, 2023Assignee: Magic Leap, Inc.Inventors: Thomas Marshall Miller, IV, Nafees Bin Zafar, Sean Michael Comer, James Jonathan Bancroft
-
Patent number: 11798215Abstract: Examples of the disclosed systems and methods may provide for improved and more realistic rendering of virtual characters and a more realistic interaction between a user and virtual characters. For example, the systems and methods describe techniques for mathematically generating a map used for animating facial expressions in a multidimensional animation blendspace. As another example, the systems and methods describe a transition system for dynamically transitioning facial expressions across a face of the virtual character. As another example, realistic physical movements can be added to a virtual character's facial expressions to provide interactivity with other virtual characters.Type: GrantFiled: November 3, 2022Date of Patent: October 24, 2023Assignee: MAGIC LEAP, INC.Inventors: Thomas Marshall Miller, IV, The Hung Quach, Jeffrey Lin
-
Patent number: 11763510Abstract: Real-time animation of a virtual character can be provided by pre-calculating a control policy that identifies a suitable animation clip to animate the next movement of the virtual character. The control policy can be calculated using a Markov decision process (MDP) and can specify an action to take (e.g., a movement) when the virtual character is in a particular state (e.g., in a particular position or pose). The control policy can be determined based on a discounted set of rewards or punishments associated with various actions that can occur in each state. The control policies can be pre-calculated, offline from a runtime animation engine (e.g., in an augmented reality display). The runtime animation engine can use the control policies to select an animation clip to move the virtual character through an environment in real time.Type: GrantFiled: January 7, 2022Date of Patent: September 19, 2023Assignee: MAGIC LEAP, INC.Inventor: Thomas Marshall Miller, IV
-
Publication number: 20230290031Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.Type: ApplicationFiled: May 19, 2023Publication date: September 14, 2023Inventors: Thomas Marshall Miller, IV, Josh Anon, Frank Alexander Hamilton, IV, Cole Parker Heiner, Victor Ng-Thow-Hing, Rodrigo Cano, Karen Stolzenberg, Lorena Pazmino, Gregory Minh Tran, Stephane Antoine Joseph Imbert, Anthony Marinello
-
Publication number: 20230258942Abstract: A user may interact and view virtual elements such as avatars and objects and/or real world elements in three-dimensional space in an augmented reality (AR) session. The system may allow one or more spectators to view from a stationary or dynamic camera a third person view of the users AR session. The third person view may be synchronized with the user view and the virtual elements of the user view may be composited onto the third person view.Type: ApplicationFiled: April 20, 2023Publication date: August 17, 2023Inventors: Thomas Marshall Miller, IV, Takashi Kuribayashi, John Monos
-
Patent number: 11699255Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.Type: GrantFiled: June 6, 2022Date of Patent: July 11, 2023Assignee: Magic Leap, Inc.Inventors: Thomas Marshall Miller, IV, Josh Anon, Frank Alexander Hamilton, IV, Cole Parker Heiner, Victor Ng-Thow-Hing, Rodrigo Cano, Karen Stolzenberg, Lorena Pazmino, Gregory Minh Tran, Stephane Antoine Joseph Imbert, Anthony Marinello
-
Patent number: 11662588Abstract: A user may interact and view virtual elements such as avatars and objects and/or real world elements in three-dimensional space in an augmented reality (AR) session. The system may allow one or more spectators to view from a stationary or dynamic camera a third person view of the users AR session. The third person view may be synchronized with the user view and the virtual elements of the user view may be composited onto the third person view.Type: GrantFiled: January 20, 2022Date of Patent: May 30, 2023Assignee: MAGIC LEAP, INC.Inventors: Thomas Marshall Miller, IV, Takashi Kuribayashi, John Monos
-
Publication number: 20230087227Abstract: Systems and methods for displaying a virtual character in a mixed reality environment are disclosed. In some embodiments, a view of the virtual character is based on an animation rig comprising primary joints and helper joints. The animation rig may be in a pose defined by spatial relationships between the primary joints and helper joints. The virtual character may be moving in the mixed reality environment. In some instances, the virtual character may be moving based on a comparison of interestingness values associated with elements in the mixed reality environment. The spatial relationship transformation associated with the movement may be indicated by movement information. In some embodiments, the movement information is received from a neural network.Type: ApplicationFiled: November 21, 2022Publication date: March 23, 2023Inventors: Thomas Marshall MILLER, IV, Nafees BIN ZAFAR, Sean Michael COMER, James Jonathan BANCROFT
-
Publication number: 20230073991Abstract: Examples of the disclosed systems and methods may provide for improved and more realistic rendering of virtual characters and a more realistic interaction between a user and virtual characters. For example, the systems and methods describe techniques for mathematically generating a map used for animating facial expressions in a multidimensional animation blendspace. As another example, the systems and methods describe a transition system for dynamically transitioning facial expressions across a face of the virtual character. As another example, realistic physical movements can be added to a virtual character's facial expressions to provide interactivity with other virtual characters.Type: ApplicationFiled: November 3, 2022Publication date: March 9, 2023Inventors: Thomas Marshall Miller, IV, The Hung Quach, Jeffrey Lin
-
Patent number: 11544888Abstract: Systems and methods for displaying a virtual character in a mixed reality environment are disclosed. In some embodiments, a view of the virtual character is based on an animation rig comprising primary joints and helper joints. The animation rig may be in a pose defined by spatial relationships between the primary joints and helper joints. The virtual character may be moving in the mixed reality environment. In some instances, the virtual character may be moving based on a comparison of interestingness values associated with elements in the mixed reality environment. The spatial relationship transformation associated with the movement may be indicated by movement information. In some embodiments, the movement information is received from a neural network.Type: GrantFiled: September 16, 2021Date of Patent: January 3, 2023Assignee: Magic Leap, Inc.Inventors: Thomas Marshall Miller, IV, Nafees Bin Zafar, Sean Michael Comer, James Jonathan Bancroft
-
Patent number: 11527031Abstract: Examples of the disclosed systems and methods may provide for improved and more realistic rendering of virtual characters and a more realistic interaction between a user and virtual characters. For example, the systems and methods describe techniques for mathematically generating a map used for animating facial expressions in a multidimensional animation blendspace. As another example, the systems and methods describe a transition system for dynamically transitioning facial expressions across a face of the virtual character. As another example, realistic physical movements can be added to a virtual character's facial expressions to provide interactivity with other virtual characters.Type: GrantFiled: July 26, 2021Date of Patent: December 13, 2022Assignee: Magic Leap, Inc.Inventors: Thomas Marshall Miller, IV, The Hung Quach, Jeffrey Lin
-
Publication number: 20220366626Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.Type: ApplicationFiled: June 6, 2022Publication date: November 17, 2022Inventors: Thomas Marshall Miller, IV, Josh Anon, Frank Alexander Hamilton, IV, Cole Parker Heiner, Victor Ng-Thow-Hing, Rodrigo Cano, Karen Stolzenberg, Lorena Pazmino, Gregory Minh Tran, Stephane Antoine Joseph Imbert, Anthony Marinello
-
Publication number: 20220270316Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically select avatar characteristics that optimize gaze perception by the user, based on context parameters associated with the virtual environment.Type: ApplicationFiled: April 29, 2022Publication date: August 25, 2022Inventors: Joelle Zimmermann, Thomas Marshall Miller, IV, John Monos
-
Patent number: 11380039Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.Type: GrantFiled: December 3, 2018Date of Patent: July 5, 2022Assignee: Magic Leap, Inc.Inventors: Thomas Marshall Miller, IV, Victor Ng-Thow-Hing, Josh Anon, Frank Alexander Hamilton, IV, Cole Parker Heiner, Rodrigo Cano, Karen Stolzenberg, Lorena Pazmino, Gregory Minh Tran, Stephane Antoine Joseph Imbert, Anthony Marinello
-
Patent number: 11348300Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically select avatar characteristics that optimize gaze perception by the user, based on context parameters associated with the virtual environment.Type: GrantFiled: March 31, 2021Date of Patent: May 31, 2022Assignee: Magic Leap, Inc.Inventors: Joelle Zimmermann, Thomas Marshall Miller, IV, John Monos
-
Publication number: 20220146833Abstract: A user may interact and view virtual elements such as avatars and objects and/or real world elements in three-dimensional space in an augmented reality (AR) session. The system may allow one or more spectators to view from a stationary or dynamic camera a third person view of the users AR session. The third person view may be synchronized with the user view and the virtual elements of the user view may be composited onto the third person view.Type: ApplicationFiled: January 20, 2022Publication date: May 12, 2022Inventors: Thomas Marshall Miller, IV, Takashi Kuribayashi, John Monos
-
Publication number: 20220130094Abstract: Real-time animation of a virtual character can be provided by pre-calculating a control policy that identifies a suitable animation clip to animate the next movement of the virtual character. The control policy can be calculated using a Markov decision process (MDP) and can specify an action to take (e.g., a movement) when the virtual character is in a particular state (e.g., in a particular position or pose). The control policy can be determined based on a discounted set of rewards or punishments associated with various actions that can occur in each state. The control policies can be pre-calculated, offline from a runtime animation engine (e.g., in an augmented reality display). The runtime animation engine can use the control policies to select an animation clip to move the virtual character through an environment in real time.Type: ApplicationFiled: January 7, 2022Publication date: April 28, 2022Inventor: Thomas Marshall Miller, IV
-
Publication number: 20220076475Abstract: Systems and methods for displaying a virtual character in a mixed reality environment are disclosed. In some embodiments, a view of the virtual character is based on an animation rig comprising primary joints and helper joints. The animation rig may be in a pose defined by spatial relationships between the primary joints and helper joints. The virtual character may be moving in the mixed reality environment. In some instances, the virtual character may be moving based on a comparison of interestingness values associated with elements in the mixed reality environment. The spatial relationship transformation associated with the movement may be indicated by movement information. In some embodiments, the movement information is received from a neural network.Type: ApplicationFiled: September 16, 2021Publication date: March 10, 2022Inventors: Thomas Marshall MILLER, IV, Nafees BIN ZAFAR, Sean Michael COMER, James Jonathan BANCROFT
-
Patent number: 11262588Abstract: A user may interact and view virtual elements such as avatars and objects and/or real world elements in three-dimensional space in an augmented reality (AR) session. The system may allow one or more spectators to view from a stationary or dynamic camera a third person view of the users AR session. The third person view may be synchronized with the user view and the virtual elements of the user view may be composited onto the third person view.Type: GrantFiled: March 8, 2021Date of Patent: March 1, 2022Assignee: Magic Leap, Inc.Inventors: Thomas Marshall Miller, IV, Takashi Kuribayashi, John Monos
-
Patent number: 11257268Abstract: Real-time animation of a virtual character can be provided by pre-calculating a control policy that identifies a suitable animation clip to animate the next movement of the virtual character. The control policy can be calculated using a Markov decision process (MDP) and can specify an action to take (e.g., a movement) when the virtual character is in a particular state (e.g., in a particular position or pose). The control policy can be determined based on a discounted set of rewards or punishments associated with various actions that can occur in each state. The control policies can be pre-calculated, offline from a runtime animation engine (e.g., in an augmented reality display). The runtime animation engine can use the control policies to select an animation clip to move the virtual character through an environment in real time.Type: GrantFiled: April 8, 2019Date of Patent: February 22, 2022Inventor: Thomas Marshall Miller, IV