Patents by Inventor Ronald Mallet
Ronald Mallet has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10489958Abstract: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.Type: GrantFiled: August 1, 2017Date of Patent: November 26, 2019Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ronald Mallet, Yuting Ye, Michael Koperwas, Adrian R. Goldenthal, Kiran S. Bhat
-
Patent number: 10321117Abstract: A method of generating unrecorded camera views may include receiving a plurality of 2-D video sequences of a subject in a real 3-D space, where each 2-D video sequence may depict the subject from a different perspective. The method may also include generating a 3-D representation of the subject in a virtual 3-D space, where a geometry and texture of the 3-D representation may be generated based on the 2D video sequences, and the motion of the 3-D representation in the virtual 3-D space is based on motion of the subject in the real 3-D space. The method may additionally include generating a 2-D video sequence of the motion of the 3D representation using a virtual camera in the virtual 3-D space where the perspective of the virtual camera may be different than the perspectives of the plurality of 2-D video sequences.Type: GrantFiled: August 25, 2014Date of Patent: June 11, 2019Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Hilmar Koch, Ronald Mallet, Kim Libreri, Paige Warner, Mike Sanders, John Gaeta
-
Patent number: 9818201Abstract: Methods and systems efficiently apply known distortion, such as of a camera and lens, to source image data to produce data of an output image with the distortion. In an embodiment, an output image field is segmented into regions so that on each segment the distortion function is approximately linear, and segmentation data is stored in a quadtree. The distortion function is applied to the segmented image field to produce a segmented rendered distortion image (SRDI) and a corresponding look-up table. To distort a source image, a location in the output image field is selected, and the uniquely colored segment at the same location in the SRDI is found. The look-up table provides the local linear inverse of the distortion function, which is applied to determine from where in the source image to take image texture data for the distorted output image.Type: GrantFiled: December 22, 2014Date of Patent: November 14, 2017Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventor: Ronald Mallet
-
Patent number: 9792479Abstract: A method of motion capture may include accessing a 3D model of a subject, and associating the 3D model of the subject with a 2D representation of the subject in a plurality of frames. The method may also include identifying a change to the 2D representation of the subject between two or more of the plurality of frames, and deforming the 3D model in a virtual 3D space. In some embodiments, the deforming may be based on the identified change to the 2D representation and at least one constraint restricting how the 3D model can be deformed.Type: GrantFiled: January 29, 2014Date of Patent: October 17, 2017Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ronald Mallet, Kiran S. Bhat, Kevin Wooley
-
Patent number: 9747716Abstract: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.Type: GrantFiled: March 15, 2013Date of Patent: August 29, 2017Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ronald Mallet, Yuting Ye, Michael Koperwas, Adrian R. Goldenthal, Kiran S. Bhat
-
Patent number: 9672417Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.Type: GrantFiled: December 31, 2015Date of Patent: June 6, 2017Assignee: LUCASFILM ENTERTAINMENT COMPANY, LTD.Inventors: Kevin Wooley, Ronald Mallet
-
Patent number: 9641830Abstract: Methods and systems are disclosed for calibrating a camera using a calibration target apparatus that contains at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable. Parameters of the camera are inferred from at least one image of the calibration target apparatus. In some embodiments, pixel coordinates of identified fiducial markings in an image are used with geometric knowledge of the apparatus to calculate camera parameters.Type: GrantFiled: April 8, 2014Date of Patent: May 2, 2017Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ronald Mallet, Jason Snell, Jeff Saltzman, Douglas Moore, Paige Warner
-
Publication number: 20160180501Abstract: Methods and systems efficiently apply known distortion, such as of a camera and lens, to source image data to produce data of an output image with the distortion. In an embodiment, an output image field is segmented into regions so that on each segment the distortion function is approximately linear, and segmentation data is stored in a quadtree. The distortion function is applied to the segmented image field to produce a segmented rendered distortion image (SRDI) and a corresponding look-up table. To distort a source image, a location in the output image field is selected, and the uniquely colored segment at the same location in the SRDI is found. The look-up table provides the local linear inverse of the distortion function, which is applied to determine from where in the source image to take image texture data for the distorted output image.Type: ApplicationFiled: December 22, 2014Publication date: June 23, 2016Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.Inventor: RONALD MALLET
-
Patent number: 9369694Abstract: A computer-implemented method for adjusting stereo images includes receiving a video sequence associated with a recorded setting of a stereoscopic camera, the video sequence comprising pairs of left and right images. The method includes processing the pairs of left and right images to reduce influence of a discrepancy between the recorded setting and an actual configuration of the stereoscopic camera.Type: GrantFiled: September 5, 2013Date of Patent: June 14, 2016Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: John M. Levin, Brian Cantwell, Ronald Mallet, Jeffrey Saltzman
-
Publication number: 20160110594Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.Type: ApplicationFiled: December 31, 2015Publication date: April 21, 2016Inventors: Kevin Wooley, Ronald Mallet
-
Patent number: 9307231Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus comprises one or more planar surfaces. The apparatus includes at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable.Type: GrantFiled: April 8, 2014Date of Patent: April 5, 2016Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Ronald Mallet, Jason Snell, Jeff Saltzman, Douglas Moore, Paige Warner
-
Patent number: 9256778Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.Type: GrantFiled: December 15, 2014Date of Patent: February 9, 2016Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.Inventors: Kevin Wooley, Ronald Mallet
-
Publication number: 20150294492Abstract: A method of generating unrecorded camera views may include receiving a plurality of 2-D video sequences of a subject in a real 3-D space, where each 2-D video sequence may depict the subject from a different perspective. The method may also include generating a 3-D representation of the subject in a virtual 3-D space, where a geometry and texture of the 3-D representation may be generated based on the 2D video sequences, and the motion of the 3-D representation in the virtual 3-D space is based on motion of the subject in the real 3-D space. The method may additionally include generating a 2-D video sequence of the motion of the 3D representation using a virtual camera in the virtual 3-D space where the perspective of the virtual camera may be different than the perspectives of the plurality of 2-D video sequences.Type: ApplicationFiled: August 25, 2014Publication date: October 15, 2015Applicant: Lucasfilm Entertainment Co., Ltd.Inventors: Hilmar Koch, Ronald Mallet, Kim Libreri, Paige Warner, Mike Sanders, John Gaeta
-
Publication number: 20150288951Abstract: Methods and systems are disclosed for calibrating a camera using a calibration target apparatus that contains at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable. Parameters of the camera are inferred from at least one image of the calibration target apparatus. In some embodiments, pixel coordinates of identified fiducial markings in an image are used with geometric knowledge of the apparatus to calculate camera parameters.Type: ApplicationFiled: April 8, 2014Publication date: October 8, 2015Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.Inventors: RONALD MALLET, JASON SNELL, JEFF SALTZMAN, DOUGLAS MOORE, PAIGE WARNER
-
Publication number: 20150288956Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus comprises one or more planar surfaces. The apparatus includes at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable.Type: ApplicationFiled: April 8, 2014Publication date: October 8, 2015Applicant: LUCASFILM ENTERTAINMENT COMPANY, LTD.Inventors: RONALD MALLET, JASON SNELL, JEFF SALTZMAN, DOUGLAS MOORE, PAIGE WARNER
-
Publication number: 20150199562Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.Type: ApplicationFiled: December 15, 2014Publication date: July 16, 2015Inventors: Kevin Wooley, Ronald Mallet
-
Patent number: 8948447Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.Type: GrantFiled: July 12, 2011Date of Patent: February 3, 2015Assignee: Lucasfilm Entertainment Companyy, Ltd.Inventors: Kevin Wooley, Ronald Mallet
-
Publication number: 20140147014Abstract: A method of motion capture may include accessing a 3D model of a subject, and associating the 3D model of the subject with a 2D representation of the subject in a plurality of frames. The method may also include identifying a change to the 2D representation of the subject between two or more of the plurality of frames, and deforming the 3D model in a virtual 3D space. In some embodiments, the deforming may be based on the identified change to the 2D representation and at least one constraint restricting how the 3D model can be deformed.Type: ApplicationFiled: January 29, 2014Publication date: May 29, 2014Applicant: LucasFilm Entertainment Company Ltd.Inventors: Ronald Mallet, Kiran S. Bhat, Kevin Wooley
-
Patent number: 8666119Abstract: A first frame includes a first 2D image of a motion capture subject in the real 3D space. A 3D model is deformed into a first deformation and placing the deformed 3D model in a virtual 3D space in a first location so that the deformed 3D model corresponds to the first 2D image. A second frame includes a second 2D image of the motion capture subject in the real 3D space. 2D changes in the second 2D image relative to the first 2D image are tracked. The 2D changes are projected on the virtual 3D space as 3D constraints. Based on the second 2D image, the 3D model is again deformed into a second deformation and placing the 3D model in the virtual 3D space in a second location in conformance with the 3D constraints.Type: GrantFiled: November 29, 2011Date of Patent: March 4, 2014Assignee: Lucasfilm Entertainment Company Ltd.Inventors: Ronald Mallet, Kiran S. Bhat, Kevin Wooley
-
Publication number: 20140002452Abstract: A computer-implemented method for adjusting stereo images includes receiving a video sequence associated with a recorded setting of a stereoscopic camera, the video sequence comprising pairs of left and right images. The method includes processing the pairs of left and right images to reduce influence of a discrepancy between the recorded setting and an actual configuration of the stereoscopic camera.Type: ApplicationFiled: September 5, 2013Publication date: January 2, 2014Applicant: Lucasfilm Entertainment Company Ltd.Inventors: John M. Levin, Brian Cantwell, Ronald Mallet, Jeffrey Saltzman