Patents by Inventor Jeremy RIVIERE
Jeremy RIVIERE has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230196664Abstract: Various embodiments include a system for rendering an object, such as human skin or a human head, from captured appearance data. The system includes a processor executing a near field lighting reconstruction module. The system determines at least one of a three-dimensional (3D) position or a 3D orientation of a lighting unit based on a plurality of captured images of a mirror sphere. For each point light source in a plurality of point light sources included in the lighting unit, the system determines an intensity associated with the point light source. The system determines captures appearance data of the object, where the object is illuminated by the lighting unit. The system renders an image of the object based on the appearance data and the intensities associated with each point light source in the plurality of point light sources.Type: ApplicationFiled: December 14, 2022Publication date: June 22, 2023Inventors: Paulo Fabiano URNAU GOTARDO, Derek Edward BRADLEY, Gaspard ZOSS, Jeremy RIVIERE, Prashanth CHANDRAN, Yingyan XU
-
Publication number: 20230196665Abstract: Various embodiments include a system for rendering an object, such as human skin or a human head, from captured appearance data comprising a plurality of texels. The system includes a processor executing a texture space indirect illumination module. The system determines texture coordinates of a vector originating from a first texel where the vector intersects a second texel. The system renders the second texel from the viewpoint of the first texel based on appearance data at the second texel. Based on the rendering of the second texel, the system determines an indirect lighting intensity incident to the first texel from the second texel. The system updates appearance data at the first texel based on a direct lighting intensity and the indirect lighting intensity. The system renders the first texel based on the updated appearance data at the first texel.Type: ApplicationFiled: December 14, 2022Publication date: June 22, 2023Inventors: Paulo Fabiano URNAU GOTARDO, Derek Edward BRADLEY, Gaspard ZOSS, Jeremy RIVIERE, Prashanth CHANDRAN, Yingyan XU
-
Publication number: 20230124117Abstract: One embodiment of the present invention sets forth a technique for performing appearance capture. The technique includes receiving a first sequence of images of an object, wherein the first sequence of images includes a first set of images interleaved with a second set of images, and wherein the first set of images is captured based on illumination of the object using a first lighting pattern and the second set of images is captured based on illumination of the object using one or more lighting patterns that are different from the first lighting pattern. The technique also includes generating a first set of appearance parameters associated with the object based on a first inverse rendering associated with the first sequence of images.Type: ApplicationFiled: October 20, 2021Publication date: April 20, 2023Inventors: Paulo Fabiano URNAU GOTARDO, Derek Edward BRADLEY, Jérémy RIVIERE
-
Publication number: 20220237751Abstract: Techniques are disclosed for generating photorealistic images of head portraits. A rendering application renders a set of images that include the skin of a face and corresponding masks indicating pixels associated with the skin in the images. An inpainting application performs a neural projection technique to optimize a set of parameters that, when input into a generator model, produces a set of projection images, each of which includes a head portrait in which (1) skin regions resemble the skin regions of the face in a corresponding rendered image; and (2) non-skin regions match the non-skin regions in the other projection images when the rendered set of images are standalone images, or transition smoothly between consecutive projection images in the case when the rendered set of images are frames of a video. The rendered images can then be blended with corresponding projection images to generate composite images that are photorealistic.Type: ApplicationFiled: November 29, 2021Publication date: July 28, 2022Inventors: Derek Edward BRADLEY, Prashanth CHANDRAN, Paulo Fabiano URNAU GOTARDO, Jeremy RIVIERE, Sebastian Valentin WINBERG, Gaspard ZOSS
-
Publication number: 20220092293Abstract: Techniques are disclosed for capturing facial appearance properties. In some examples, a facial capture system includes light source(s) that produce linearly polarized light, at least one camera that is cross-polarized with respect to the polarization of light produced by the light source(s), and at least one other camera that is not cross-polarized with respect to the polarization of the light produced by the light source(s). Images captured by the cross-polarized camera(s) are used to determine facial appearance properties other than specular intensity, such as diffuse albedo, while images captured by the camera(s) that are not cross-polarized are used to determine facial appearance properties including specular intensity. In addition, a coarse-to-fine optimization procedure is disclosed for determining appearance and detailed geometry maps based on images captured by the cross-polarized camera(s) and the camera(s) that are not cross-polarized.Type: ApplicationFiled: December 2, 2021Publication date: March 24, 2022Inventors: Jeremy RIVIERE, Paulo Fabiano URNAU GOTARDO, Abhijeet GHOSH, Derek Edward BRADLEY, Dominik Thabo BEELER
-
Publication number: 20220004741Abstract: Techniques are disclosed for capturing facial appearance properties. In some examples, a facial capture system includes light source(s) that produce linearly polarized light, at least one camera that is cross-polarized with respect to the polarization of light produced by the light source(s), and at least one other camera that is not cross-polarized with respect to the polarization of the light produced by the light source(s). Images captured by the cross-polarized camera(s) are used to determine facial appearance properties other than specular intensity, such as diffuse albedo, while images captured by the camera(s) that are not cross-polarized are used to determine facial appearance properties including specular intensity. In addition, a coarse-to-fine optimization procedure is disclosed for determining appearance and detailed geometry maps based on images captured by the cross-polarized camera(s) and the camera(s) that are not cross-polarized.Type: ApplicationFiled: July 2, 2020Publication date: January 6, 2022Inventors: Jeremy RIVIERE, Paulo Urnau GOTARDO, Abhijeet GHOSH, Derek Edward BRADLEY, Dominik Thabo BEELER
-
Patent number: 11216646Abstract: Techniques are disclosed for capturing facial appearance properties. In some examples, a facial capture system includes light source(s) that produce linearly polarized light, at least one camera that is cross-polarized with respect to the polarization of light produced by the light source(s), and at least one other camera that is not cross-polarized with respect to the polarization of the light produced by the light source(s). Images captured by the cross-polarized camera(s) are used to determine facial appearance properties other than specular intensity, such as diffuse albedo, while images captured by the camera(s) that are not cross-polarized are used to determine facial appearance properties including specular intensity. In addition, a coarse-to-fine optimization procedure is disclosed for determining appearance and detailed geometry maps based on images captured by the cross-polarized camera(s) and the camera(s) that are not cross-polarized.Type: GrantFiled: July 2, 2020Date of Patent: January 4, 2022Assignee: Disney Enterprises, Inc.Inventors: Jeremy Riviere, Paulo Urnau Gotardo, Abhijeet Ghosh, Derek Edward Bradley, Dominik Thabo Beeler
-
Patent number: 10818038Abstract: Embodiments of the present disclosure techniques for modeling and capturing the dynamic appearance of skin. These techniques can couple dynamic reflectance parameters for skin (albedo and specular reflectance) with dynamic geometry. The disclosed techniques allow for capture and modeling of the dynamic appearance of skin for an actor. The techniques can re-render the actor's face accurately to accurately model the appearance of skin including the albedo of skin that can change primarily due to blood flow. The techniques can also re-render the actor's face accurately under multiple different lighting conditions.Type: GrantFiled: December 5, 2018Date of Patent: October 27, 2020Assignee: DISNEY ENTERPRISES, INC.Inventors: Thabo Beeler, Abhijeet Ghosh, Derek Bradley, Jeremy Riviere, Paulo F. Urnau Gotardo
-
Publication number: 20200082572Abstract: Embodiments of the present disclosure techniques for modeling and capturing the dynamic appearance of skin. These techniques can couple dynamic reflectance parameters for skin (albedo and specular reflectance) with dynamic geometry. The disclosed techniques allow for capture and modeling of the dynamic appearance of skin for an actor. The techniques can re-render the actor's face accurately to accurately model the appearance of skin including the albedo of skin that can change primarily due to blood flow. The techniques can also re-render the actor's face accurately under multiple different lighting conditions.Type: ApplicationFiled: December 5, 2018Publication date: March 12, 2020Applicant: Disney Enterprises, Inc.Inventors: Thabo BEELER, Abhijeet GHOSH, Derek BRADLEY, Jeremy RIVIERE, Paulo F. URNAU GOTARDO