Patents by Inventor Michael Koperwas
Michael Koperwas has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11128984Abstract: A method may include causing first content to be displayed on a display device; causing second content to be rendered irrespective of a location of a mobile device relative to the display device; and causing the second content to be displayed on the mobile device such that the second content is layered over the first content. When the second content has moved a predetermined distance from the screen, The method may also include causing the second content to be rendered based on the location of the mobile device relative to the display device; and causing the second content to be displayed on the mobile device such that the second content is layered over the first content.Type: GrantFiled: October 25, 2019Date of Patent: September 21, 2021Assignee: LUCASFILM ENIERTAINMENT COMPANY LTD.Inventors: John Gaeta, Michael Koperwas, Nicholas Rasmussen
-
Patent number: 10964083Abstract: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of one or more expressions of an object. Each of the representations includes position information attained from one or more images of the object. The method also includes producing an animation model from one or more groups of controls that respectively define each of the one or more expressions of the object as provided by the multiple representations. Each control of each group of controls has an adjustable value that defines the geometry of at least one shape of a portion of the respective expression of the object. Producing the animation model includes producing one or more corrective shapes if the animation model is incapable of accurately presenting the one or more expressions of the object as provided by the multiple representations.Type: GrantFiled: April 10, 2019Date of Patent: March 30, 2021Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Kiran S. Bhat, Michael Koperwas, Rachel M. Rose, Jung-Seung Hong, Frederic P. Pighin, Christopher David Twigg, Cary Phillips, Steve Sullivan
-
Patent number: 10846920Abstract: Implementations of the disclosure are directed to generating shadows in the physical world that correspond to virtual objects displayed on MR displays. In some implementations, a method includes: synchronously presenting a version of a scene on each of a MR display system and a projector display system, where during presentation: the MR display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the MR display. In some implementations, the method includes: loading in a memory of the MR display system, a first version of the scene including the virtual object; and loading in a memory of the projector display system a second version of the scene including a virtual surface onto which the virtual object casts a shadow.Type: GrantFiled: February 20, 2019Date of Patent: November 24, 2020Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD. LLCInventors: Michael Koperwas, Lutz Latta
-
Patent number: 10825225Abstract: Some implementations of the disclosure are directed to a pipeline that enables real time engines such as gaming engines to leverage high quality simulations generated offline via film grade simulation systems. In one implementation, a method includes: obtaining simulation data and skeletal mesh data of a character, the simulation data and skeletal mesh data including the character in the same rest pose; importing the skeletal mesh data into a real-time rendering engine; and using at least the simulation data and the imported skeletal mesh data to derive from the simulation data a transformed simulation vertex cache that is usable by the real-time rendering engine during runtime to be skinned in place of the rest pose.Type: GrantFiled: March 20, 2019Date of Patent: November 3, 2020Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD. LLCInventors: Ronald Radeztsky, Michael Koperwas
-
Publication number: 20200265638Abstract: Implementations of the disclosure are directed to generating shadows in the physical world that correspond to virtual objects displayed on MR displays. In some implementations, a method includes: synchronously presenting a version of a scene on each of a MR display system and a projector display system, where during presentation: the MR display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the MR display. In some implementations, the method includes: loading in a memory of the MR display system, a first version of the scene including the virtual object; and loading in a memory of the projector display system a second version of the scene including a virtual surface onto which the virtual object casts a shadow.Type: ApplicationFiled: February 20, 2019Publication date: August 20, 2020Applicant: Lucasfilm Entertainment Company Ltd. LLCInventors: Michael Koperwas, Lutz Latta
-
Patent number: 10692288Abstract: A method may include capturing a first image of a physical environment using a mobile device. The mobile device may include a physical camera and a display. The method may also include receiving a second image from a content provider system. The second image may be generated by the content provider system by rendering a view from a virtual camera in a virtual environment. The virtual environment may represent at least a portion of the physical environment. A location of the virtual camera in the virtual environment may correspond to a location of the physical camera in the physical environment. The second image may include a view of a computer-generated object. The method may additionally include generating a third image by compositing the first image and the second image, and causing the third image to be displayed on the display of the mobile device.Type: GrantFiled: June 27, 2017Date of Patent: June 23, 2020Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Nicholas Rasmussen, Michael Koperwas, Earle M. Alexander, IV
-
Patent number: 10489958Abstract: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.Type: GrantFiled: August 1, 2017Date of Patent: November 26, 2019Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ronald Mallet, Yuting Ye, Michael Koperwas, Adrian R. Goldenthal, Kiran S. Bhat
-
Patent number: 10484824Abstract: A method may include causing first content to be displayed on a display device. The method may also include determining a location of a mobile device relative to the display device. In some embodiments, the mobile device may be positioned such that the first content is visible to a viewer of the mobile device. The method may additionally include causing second content to be displayed on the mobile device such that the second content is layered over the first content.Type: GrantFiled: June 27, 2016Date of Patent: November 19, 2019Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: John Gaeta, Michael Koperwas, Nicholas Rasmussen
-
Patent number: 10269165Abstract: A system includes a computing device that includes a memory and a processor configured to execute instructions to perform a method that includes receiving multiple representations of one or more expressions of an object. Each representation includes position information attained from one or more images of the object. The method also includes producing an animation model from one or more groups of controls that respectively define each of the one or more expressions of the object as provided by the multiple representations. Each control of each group of controls has an adjustable value that defines the geometry of at least one shape of a portion of the respective expression of the object. Producing the animation model includes producing one or more corrective shapes if the animation model is incapable of accurately presenting the one or more expressions of the object as provided by the multiple representations.Type: GrantFiled: January 30, 2012Date of Patent: April 23, 2019Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Kiran S. Bhat, Michael Koperwas, Rachel M. Rose, Jung-Seung Hong, Frederic P. Pighin, Christopher David Twigg, Cary Phillips, Steve Sullivan
-
Patent number: 10147219Abstract: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model.Type: GrantFiled: February 3, 2017Date of Patent: December 4, 2018Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Kiran Bhat, Michael Koperwas, Jeffery Yost, Ji Hun Yu, Sheila Santos
-
Patent number: 10078917Abstract: A method may include rendering a first view of a three-dimensional (3-D) virtual scene comprising a view of first content being displayed on a virtual display device from a location in the 3-D virtual scene. The method may also include rendering a second view comprising one or more content objects. The second view may be rendered from the location in the 3-D virtual scene, and the second scene may include a view of the display device as would be seen through a pair of augmented-reality glasses that display the one or more content objects. The method may additionally include generating a composite view by combing the first view and the second view. The method may further include causing the composite view to be displayed on a virtual-reality headset.Type: GrantFiled: October 10, 2016Date of Patent: September 18, 2018Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: John Gaeta, Michael Koperwas, Nicholas Rasmussen
-
Patent number: 10055874Abstract: In some embodiments a method of transferring facial expressions from a subject to a computer-generated character is provided where the method includes receiving positional information from a motion capture session of the subject representing a performance having facial expressions to be transferred to the computer-generated character, receiving a first animation model that represents the subject, and receiving a second animation model that represents the computer-generated character. Each of the first and second animation models can include a plurality of adjustable controls that define geometries of the model and that can be adjusted to present different facial expressions on the model, and where the first and second animation models are designed so that setting the same values for the same set of adjustable controls in each model generates a similar facial poses on the models.Type: GrantFiled: August 20, 2015Date of Patent: August 21, 2018Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ji Hun Yu, Michael Koperwas, Jeffrey Bruce Yost, Sheila Santos, Kiran S. Bhat
-
Patent number: 9747716Abstract: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.Type: GrantFiled: March 15, 2013Date of Patent: August 29, 2017Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ronald Mallet, Yuting Ye, Michael Koperwas, Adrian R. Goldenthal, Kiran S. Bhat
-
Publication number: 20170148201Abstract: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model.Type: ApplicationFiled: February 3, 2017Publication date: May 25, 2017Applicant: Lucasfilm Entertainment Company Ltd.Inventors: Kiran Bhat, Michael Koperwas, Jeffery Yost, Ji Hun Yu, Sheila Santos
-
Patent number: 9600742Abstract: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model.Type: GrantFiled: May 5, 2015Date of Patent: March 21, 2017Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Kiran Bhat, Michael Koperwas, Jeffery Yost, Ji Hun Yu, Sheila Santos
-
Publication number: 20170053663Abstract: In some embodiments a method of transferring facial expressions from a subject to a computer-generated character is provided where the method includes receiving positional information from a motion capture session of the subject representing a performance having facial expressions to be transferred to the computer-generated character, receiving a first animation model that represents the subject, and receiving a second animation model that represents the computer-generated character. Each of the first and second animation models can include a plurality of adjustable controls that define geometries of the model and that can be adjusted to present different facial expressions on the model, and where the first and second animation models are designed so that setting the same values for the same set of adjustable controls in each model generates a similar facial poses on the models.Type: ApplicationFiled: August 20, 2015Publication date: February 23, 2017Inventors: Ji Hun Yu, Michael Koperwas, Jeffrey Bruce Yost, Sheila Santos, Kiran S. Bhat
-
Publication number: 20160328628Abstract: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model.Type: ApplicationFiled: May 5, 2015Publication date: November 10, 2016Inventors: Kiran Bhat, Michael Koperwas, Jeffery Yost, Ji Hun Yu, Sheila Santos
-
Patent number: 9256973Abstract: A system includes a computer system capable of representing one or more animated characters. The computer system includes a blendshape manager that combines multiple blendshapes to produce the animated character. The computer system also includes an expression manager to respectively adjust one or more control parameters associated with each of the plurality of blendshapes for adjusting an expression of the animated character. The computer system also includes a corrective element manager that applies one or more corrective elements to the combined blendshapes based upon at least one of the control parameters. The one or more applied corrective elements are adjustable based upon one or more of the control parameters absent the introduction of one or more additional control parameters.Type: GrantFiled: December 23, 2013Date of Patent: February 9, 2016Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Michael Koperwas, Frederic P. Pighin, Cary Phillips, Steve Sullivan, Eduardo Hueso
-
Patent number: 9183660Abstract: A system includes a computing device that includes a memory for storing instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes combining, in a nonlinear manner, a first set of vertex displacements that represent the difference between a first animated expression and a neutral animated expression with a second set of vertex displacements that represent the difference between a second animated expression and the neutral animated expression. The number of vertices associated with the first set of vertex displacements of the first animated expression is equivalent to the number of vertices associated with the second set of vertex displacements of the second animated expression.Type: GrantFiled: November 26, 2013Date of Patent: November 10, 2015Assignee: Lucasfilm Entertainment Company Ltd.Inventors: Michael Koperwas, Frederic P. Pighin
-
Patent number: 8860731Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes receiving a model that represents the geometry of an animated character and represents a primary deformation applied the geometry of the character. The applied primary deformation is relative to a rest geometry of the character. The method also includes applying a secondary deformation to the geometry of the received character model. The applied secondary deformation is relative to the primary deformation applied to the geometry of the character.Type: GrantFiled: June 3, 2010Date of Patent: October 14, 2014Assignee: Lucasfilm Entertainment Company Ltd.Inventors: Julien F. Cohen Bengio, Frederic P. Pighin, Michael Koperwas