Patents by Inventor Parag Havaldar
Parag Havaldar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10931927Abstract: Systems and methods are provided that allow for the rapid creation of multiple novel views for applications. These multiple views may allow for not only stereo views but also for different viewpoints of a stereographic scene to be presented, or for a time progression of the stereo scene to be presented, where a viewpoint is altered with respect to time. The systems and methods may be employed to create the content for auto-stereographic displays or multiple view systems that use a plurality of novel views to display stereo media. Such displays or multiple view systems may include those employing parallax barriers or lenticular lenses.Type: GrantFiled: January 31, 2013Date of Patent: February 23, 2021Assignees: Sony Pictures Technologies Inc., Sony CorporationInventors: Alan L. Davidson, Parag Havaldar, Peter H. Palombi
-
Patent number: 9621869Abstract: Systems and methods are provided for minimizing re-projection artifacts. From a re-projection method, a distortion map determines areas of excessive stretching or compressing of pixels, which are then rendered. The re-projection and render are composited to create a new stereo image. Systems and methods are also provided for a “depth layout” process, whereby a new offset view of a 2D plate is created, allowing a stereo pair of images. Custom geometry that approximates the scene is created and 2D rotoscoping is employed to cut out shapes from the geometry. A depth map is created, from which an offset image may be re-projected, resulting in a stereo pair. Systems and methods are also provided for a fast re-projection technique, which creates a novel view from an existing image. The process generates a disparity map and then a distortion map, which is then used to create the new view.Type: GrantFiled: October 11, 2012Date of Patent: April 11, 2017Assignees: SONY CORPORATION, SONY PICTURES TECHNOLOGIES INC.Inventors: Alan L. Davidson, Parag Havaldar, Peter H. Palombi, Josh Wills
-
Publication number: 20140341429Abstract: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.Type: ApplicationFiled: May 27, 2014Publication date: November 20, 2014Applicants: Sony Corporation, SONY PICTURES ENTERTAINMENT INC.Inventors: Parag Havaldar, Josh Wills, Demian Gordon, Josh Ochoa, Jianxia Xue
-
Patent number: 8842933Abstract: Capturing facial surface using marker patterns laid out on the facial surface by adapting the marker patterns to contours of the facial surface and motion range of a head including: generating a facial action coding system (FACS) matrix by capturing FACS poses; generating a pattern to wrap over the facial surface using the FACS poses as a guide; capturing and tracking marker motions of the pattern; stabilizing the marker motions of the pattern using a head stabilization transform to remove head motions from the marker motions; and generating and applying a plurality of FACS matrix weights to the stabilized marker motions.Type: GrantFiled: November 2, 2010Date of Patent: September 23, 2014Assignees: Sony Corporation, Sony Pictures Technologies IncInventor: Parag Havaldar
-
Publication number: 20140210810Abstract: Systems and methods are provided that allow for the rapid creation of multiple novel views for applications. These multiple views may allow for not only stereo views but also for different viewpoints of a stereographic scene to be presented, or for a time progression of the stereo scene to be presented, where a viewpoint is altered with respect to time. The systems and methods may be employed to create the content for auto-stereographic displays or multiple view systems that use a plurality of novel views to display stereo media. Such displays or multiple view systems may include those employing parallax barriers or lenticular lenses.Type: ApplicationFiled: January 31, 2013Publication date: July 31, 2014Applicants: Sony Pictures Technologies Inc., Sony CorporationInventors: Alan L. Davidson, Parag Havaldar, Peter H. Palombi
-
Patent number: 8736616Abstract: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.Type: GrantFiled: September 15, 2010Date of Patent: May 27, 2014Assignees: Sony Corporation, Sony Pictures Entertainment Inc.Inventors: Parag Havaldar, Josh Wills, Demian Gordon, Josh Ochoa, Jianxia Xue
-
Publication number: 20140105483Abstract: Systems and methods are provided for resolving artifacts in view-dependent components. The system and method apply a different stereo camera pair to view-dependent versus non-view-dependent or independent rays. In this way the lighting components may be independently dialed to art direct specular components versus diffuse components.Type: ApplicationFiled: October 11, 2012Publication date: April 17, 2014Inventors: Alan L. Davidson, Parag Havaldar, Peter H. Palombi
-
Publication number: 20140003706Abstract: Apparatus and methods are provided to implement a technique for adjusting images, such as for addressing lens distortions. In one implementation, a computer system uses un-warping to address differences between two camera lenses. After unwarping two stereo images, the images are re-warped but re-warped using a common set of parameters.Type: ApplicationFiled: January 31, 2013Publication date: January 2, 2014Applicants: Sony Pictures Technologies Inc., Sony CorporationInventors: Alan L. Davidson, Parag Havaldar, Peter H. Palombi
-
Publication number: 20130314501Abstract: Systems and methods are provided for minimizing re-projection artifacts. From a re-projection method, a distortion map determines areas of excessive stretching or compressing of pixels, which are then rendered. The re-projection and render are composited to create a new stereo image. Systems and methods are also provided for a “depth layout” process, whereby a new offset view of a 2D plate is created, allowing a stereo pair of images. Custom geometry that approximates the scene is created and 2D rotoscoping is employed to cut out shapes from the geometry. A depth map is created, from which an offset image may be re-projected, resulting in a stereo pair. Systems and methods are also provided for a fast re-projection technique, which creates a novel view from an existing image. The process generates a disparity map and then a distortion map, which is then used to create the new view.Type: ApplicationFiled: October 11, 2012Publication date: November 28, 2013Inventors: Alan L. Davidson, Parag Havaldar, Peter H. Palombi, Josh Wills
-
Patent number: 8279228Abstract: A method of animating a digital facial model, the method including: defining a plurality of action units; calibrating each action unit of the plurality of action units via an actor's performance; capturing first facial pose data; determining a plurality of weights, each weight of the plurality of weights uniquely corresponding to the each action unit, the plurality of weights characterizing a weighted combination of the plurality of action units, the weighted combination approximating the first facial pose data; generating a weighted activation by combining the results of applying the each weight to the each action unit; applying the weighted activation to the digital facial model; and recalibrating at least one action unit of the plurality of action units using input user adjustments to the weighted activation.Type: GrantFiled: January 6, 2011Date of Patent: October 2, 2012Assignees: Sony Corporation, Sony Pictures Entertainment Inc.Inventors: Parag Havaldar, Mark Sagar, Josh Ochoa
-
Patent number: 8218825Abstract: Capturing and processing facial motion data includes: coupling a plurality of sensors to target points on a facial surface of an actor; capturing frame by frame images of the plurality of sensors disposed on the facial surface of the actor using at least one motion capture camera disposed on a head-mounted system; performing, in the head-mounted system, a tracking function on the frame by frame images of the plurality of sensors to accurately map the plurality of sensors for each frame; and generating, in the head-mounted system, a modeled surface representing the facial surface of the actor.Type: GrantFiled: August 25, 2009Date of Patent: July 10, 2012Assignees: Sony Corporation, Sony Pictures Entertainment Inc.Inventors: Demian Gordon, Remington Scott, Parag Havaldar, Dennis J. Hauck, Jr.
-
Publication number: 20110175921Abstract: A method of animating a digital facial model, the method including: defining a plurality of action units; calibrating each action unit of the plurality of action units via an actor's performance; capturing first facial pose data; determining a plurality of weights, each weight of the plurality of weights uniquely corresponding to the each action unit, the plurality of weights characterizing a weighted combination of the plurality of action units, the weighted combination approximating the first facial pose data; generating a weighted activation by combining the results of applying the each weight to the each action unit; applying the weighted activation to the digital facial model; and recalibrating at least one action unit of the plurality of action units using input user adjustments to the weighted activation.Type: ApplicationFiled: January 6, 2011Publication date: July 21, 2011Applicants: SONY CORPORATION, SONY PICTURES ENTERTAINMENT INC.Inventors: Parag Havaldar, Mark Sagar, Josh Ochoa
-
Patent number: 7961947Abstract: A method of cleaning facial marker data, the method comprising: decimating frames of survey facial marker data into representative frames of key facial poses; generating a facial pose matrix using the representative frames of key facial poses; and cleaning incoming frames of facial marker data using the facial pose matrix.Type: GrantFiled: July 27, 2007Date of Patent: June 14, 2011Assignees: Sony Corporation, Sony Pictures Entertainment Inc.Inventors: Demian Gordon, Parag Havaldar
-
Publication number: 20110110561Abstract: Capturing facial surface using marker patterns laid out on the facial surface by adapting the marker patterns to contours of the facial surface and motion range of a head including: generating a facial action coding system (FACS) matrix by capturing FACS poses; generating a pattern to wrap over the facial surface using the FACS poses as a guide; capturing and tracking marker motions of the pattern; stabilizing the marker motions of the pattern using a head stabilization transform to remove head motions from the marker motions; and generating and applying a plurality of FACS matrix weights to the stabilized marker motions.Type: ApplicationFiled: November 2, 2010Publication date: May 12, 2011Applicants: SONY CORPORATION, SONY PICTURES TECHNOLOGIES INC.Inventor: Parag Havaldar
-
Publication number: 20110091070Abstract: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.Type: ApplicationFiled: September 15, 2010Publication date: April 21, 2011Applicants: SONY CORPORATION, SONY PICTURES ENTERTAINMENT INC.Inventors: Parag Havaldar, Josh Wills, Demian Gordon, Josh Ochoa, Jianxia Xue
-
Publication number: 20100315524Abstract: A method including: applying a marking material having a known pattern to a body and a face of an actor; configuring at least one first video motion capture camera to capture the marking material on the body of the actor; configuring at least one second video motion capture camera to capture the marking material on the face of the actor; substantially simultaneously capturing body motion data using the at least one first video motion capture camera and facial motion data using the at least one second video motion capture camera; and integrating the body motion data and the facial motion data.Type: ApplicationFiled: September 4, 2008Publication date: December 16, 2010Applicants: SONY CORPORATION, SONY PICTURES ENTERTAINMENT INC.Inventors: Demian Gordon, Parag Havaldar
-
Patent number: 7733346Abstract: A method, comprising: generating facial muscle activations from facial marker data; animating a computer graphics facial model using the facial muscle activations; generating a skin layer overlaying the computer graphics facial model; and animating the skin layer using the facial marker data.Type: GrantFiled: July 27, 2007Date of Patent: June 8, 2010Assignees: Sony Corporation, Sony Pictures Entertainment Inc.Inventors: Demian Gordon, Parag Havaldar
-
Publication number: 20100045680Abstract: A method of animating a digital facial model, the method including: defining a plurality of action units; calibrating each action unit of the plurality of action units via an actor's performance; capturing first facial pose data; determining a plurality of weights, each weight of the plurality of weights uniquely corresponding to the each action unit, the plurality of weights characterizing a weighted combination of the plurality of action units, the weighted combination approximating the first facial pose data; generating a weighted activation by combining the results of applying the each weight to the each action unit; applying the weighted activation to the digital facial model; and recalibrating at least one action unit of the plurality of action units using input user adjustments to the weighted activation.Type: ApplicationFiled: April 15, 2009Publication date: February 25, 2010Applicants: SONY CORPORATION, SONY PICTURES ENTERTAINMENT INC.Inventors: Parag Havaldar, Josh Ochoa
-
Publication number: 20090324017Abstract: Capturing and processing facial motion data includes: coupling a plurality of sensors to target points on a facial surface of an actor; capturing frame by frame images of the plurality of sensors disposed on the facial surface of the actor using at least one motion capture camera disposed on a head-mounted system; performing, in the head-mounted system, a tracking function on the frame by frame images of the plurality of sensors to accurately map the plurality of sensors for each frame; and generating, in the head-mounted system, a modeled surface representing the facial surface of the actor.Type: ApplicationFiled: August 25, 2009Publication date: December 31, 2009Applicants: SONY CORPORATION, SONY PICTURES ENTERTAINMENT INC.Inventors: Demian Gordon, Remington Scott, Parag Havaldar, Dennis J. Hauck Jr.
-
Patent number: 7606392Abstract: Capturing and processing facial motion data includes: coupling a plurality of sensors to target points on a facial surface of an actor; capturing frame by frame images of the plurality of sensors disposed on the facial surface of the actor using at least one motion capture camera disposed on a head-mounted system; performing, in the head-mounted system, a tracking function on the frame by frame images of the plurality of sensors to accurately map the plurality of sensors for each frame; and generating, in the head-mounted system, a modeled surface representing the facial surface of the actor.Type: GrantFiled: August 25, 2006Date of Patent: October 20, 2009Assignees: Sony Corporation, Sony Pictures Entertainment Inc.Inventors: Demian Gordon, Remington Scott, Parag Havaldar, Dennis J. Hauck, Jr.