Patents by Inventor Will Welch
Will Welch has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12002139Abstract: Implementations described herein relate to methods, systems, and computer-readable media to generate animations for a 3D avatar from input video captured at a client device. A camera may capture video of a face while a trained face detection model and a trained regression model output a set of FACS weights, head poses, and facial landmarks to be translated into the animations of the 3D avatar. Additionally, a higher level-of-detail may be intelligently selected based upon user preferences and/or computing conditions at the client device.Type: GrantFiled: February 22, 2022Date of Patent: June 4, 2024Assignee: Roblox CorporationInventors: Inaki Navarro, Dario Kneubuhler, Tijmen Verhulsdonck, Eloi Du Bois, Will Welch, Vivek Verma, Ian Sachs, Kiran Bhat
-
Patent number: 11551393Abstract: Systems and methods for animating from audio in accordance with embodiments of the invention are illustrated. One embodiment includes a method for generating animation from audio. The method includes steps for receiving input audio data, generating an embedding for the input audio data, and generating several predictions for several tasks from the generated embedding. The several predictions includes at least one of blendshape weights, event detection, and/or voice activity detection. The method includes steps for generating a final prediction from the several predictions, where the final prediction includes a set of blendshape weights, and generating an output based on the generated final prediction.Type: GrantFiled: July 23, 2020Date of Patent: January 10, 2023Assignee: LoomAi, Inc.Inventors: Chong Shang, Eloi Henri Homere Du Bois, Inaki Navarro, Will Welch, Rishabh Battulwar, Ian Sachs, Vivek Verma, Kiran Bhat
-
Publication number: 20220270314Abstract: Implementations described herein relate to methods, systems, and computer-readable media to generate animations for a 3D avatar from input video captured at a client device. A camera may capture video of a face while a trained face detection model and a trained regression model output a set of FACS weights, head poses, and facial landmarks to be translated into the animations of the 3D avatar. Additionally, a higher level-of-detail may be intelligently selected based upon user preferences and/or computing conditions at the client device.Type: ApplicationFiled: February 22, 2022Publication date: August 25, 2022Applicant: Roblox CorporationInventors: Inaki NAVARRO, Dario KNEUBUHLER, Tijmen VERHULSDONCK, Eloi DU BOIS, Will WELCH, Vivek VERMA, Ian SACHS, Kiran BHAT
-
Publication number: 20210027511Abstract: Systems and methods for animating from audio in accordance with embodiments of the invention are illustrated. One embodiment includes a method for generating animation from audio. The method includes steps for receiving input audio data, generating an embedding for the input audio data, and generating several predictions for several tasks from the generated embedding. The several predictions includes at least one of blendshape weights, event detection, and/or voice activity detection. The method includes steps for generating a final prediction from the several predictions, where the final prediction includes a set of blendshape weights, and generating an output based on the generated final prediction.Type: ApplicationFiled: July 23, 2020Publication date: January 28, 2021Applicant: LoomAi, Inc.Inventors: Chong Shang, Eloi Henri Homere Du Bois, Inaki Navarro, Will Welch, Rishabh Battulwar, Ian Sachs, Vivek Verma, Kiran Bhat
-
Patent number: 10559111Abstract: System and methods for computer animations of 3D models of heads generated from images of faces is disclosed. A 2D captured image that includes an image of a face can be received and used to generate a static 3D model of a head. A rig can be fit to the static 3D model to generate an animation-ready 3D generative model. Sets of rigs can be parameters that each map to particular sounds or particular facial movement observed in a video. These mappings can be used to generate a playlists of sets of rig parameters based upon received audio or video content. The playlist may be played in synchronization with an audio rendition of the audio content. Methods can receive a captured image, identify taxonomy attributes from the captured image, select a template model for the captured image, and perform a shape solve for the selected template model based on the identified taxonomy attributes.Type: GrantFiled: December 14, 2018Date of Patent: February 11, 2020Assignee: LoomAi, Inc.Inventors: Ian Sachs, Kiran Bhat, Dominic Monn, Senthil Radhakrishnan, Will Welch
-
Publication number: 20190122411Abstract: System and methods for computer animations of 3D models of heads generated from images of faces is disclosed. A 2D captured image that includes an image of a face can be received and used to generate a static 3D model of a head. A rig can be fit to the static 3D model to generate an animation-ready 3D generative model. Sets of rigs can be parameters that each map to particular sounds or particular facial movement observed in a video. These mappings can be used to generate a playlists of sets of rig parameters based upon received audio or video content. The playlist may be played in synchronization with an audio rendition of the audio content. Methods can receive a captured image, identify taxonomy attributes from the captured image, select a template model for the captured image, and perform a shape solve for the selected template model based on the identified taxonomy attributes.Type: ApplicationFiled: December 14, 2018Publication date: April 25, 2019Applicant: LoomAi, Inc.Inventors: Ian Sachs, Kiran Bhat, Dominic Monn, Senthil Radhakrishnan, Will Welch
-
Patent number: 10169905Abstract: System and methods for computer animations of 3D models of heads generated from images of faces is disclosed. A 2D captured image that includes an image of a face can be received and used to generate a static 3D model of a head. A rig can be fit to the static 3D model to generate an animation-ready 3D generative model. Sets of rigs can be parameters that each map to particular sounds. These mappings can be used to generate a playlists of sets of rig parameters based upon received audio content. The playlist may be played in synchronization with an audio rendition of the audio content.Type: GrantFiled: January 31, 2018Date of Patent: January 1, 2019Assignee: LoomAi, Inc.Inventors: Kiran Bhat, Akash Garg, Michael Daniel Flynn, Will Welch
-
Patent number: 10062198Abstract: System and methods for computer animations of 3D models of heads generated from images of faces is disclosed. A 2D captured image that includes an image of a face can be received and used to generate a static 3D model of a head. A rig can be fit to the static 3D model to generate an animation-ready 3D generative model. Sets of rigs can be parameters that each map to particular sounds. These mappings can be used to generate a playlists of sets of rig parameters based upon received audio content. The playlist may be played in synchronization with an audio rendition of the audio content.Type: GrantFiled: June 23, 2017Date of Patent: August 28, 2018Assignee: LoomAi, Inc.Inventors: Kiran Bhat, Akash Garg, Michael Daniel Flynn, Will Welch
-
Publication number: 20180174348Abstract: System and methods for computer animations of 3D models of heads generated from images of faces is disclosed. A 2D captured image that includes an image of a face can be received and used to generate a static 3D model of a head. A rig can be fit to the static 3D model to generate an animation-ready 3D generative model. Sets of rigs can be parameters that each map to particular sounds. These mappings can be used to generate a playlists of sets of rig parameters based upon received audio content. The playlist may be played in synchronization with an audio rendition of the audio content.Type: ApplicationFiled: January 31, 2018Publication date: June 21, 2018Inventors: Kiran Bhat, Akash Garg, Michael Daniel Flynn, Will Welch
-
Publication number: 20170372505Abstract: System and methods for computer animations of 3D models of heads generated from images of faces is disclosed. A 2D captured image that includes an image of a face can be received and used to generate a static 3D model of a head. A rig can be fit to the static 3D model to generate an animation-ready 3D generative model. Sets of rigs can be parameters that each map to particular sounds. These mappings can be used to generate a playlists of sets of rig parameters based upon received audio content. The playlist may be played in synchronization with an audio rendition of the audio content.Type: ApplicationFiled: June 23, 2017Publication date: December 28, 2017Applicant: LoomAi, Inc.Inventors: Kiran Bhat, Akash Garg, Michael Daniel Flynn, Will Welch
-
Patent number: 9786084Abstract: System and methods for computer animations of 3D models of heads generated from images of faces is disclosed. A 2D captured image that includes an image of a face can be received and used to generate a static 3D model of a head. A rig can be fit to the static 3D model to generate an animation-ready 3D generative model. Sets of rigs can be parameters that each map to particular sounds. These mappings can be used to generate a playlists of sets of rig parameters based upon received audio content. The playlist may be played in synchronization with an audio rendition of the audio content.Type: GrantFiled: June 27, 2017Date of Patent: October 10, 2017Assignee: LoomAi, Inc.Inventors: Kiran Bhat, Akash Garg, Michael Daniel Flynn, Will Welch