Patents by Inventor Hernan Badino
Hernan Badino has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10795436Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.Type: GrantFiled: November 13, 2019Date of Patent: October 6, 2020Assignee: Facebook Technologies, LLCInventors: Shih-En Wei, Jason Saragih, Hernan Badino, Alexander Trenor Hypes, Mohsen Shahmohammadi, Dawei Wang, Michal Perdoch
-
Publication number: 20200201430Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.Type: ApplicationFiled: November 13, 2019Publication date: June 25, 2020Inventors: Shih-En Wei, Jason Saragih, Hernan Badino, Alexander Trenor Hypes, Mohsen Shahmohammadi, Dawei Wang, Michal Perdoch
-
Patent number: 10656710Abstract: An interactive system may include (1) a facial coupling subsystem configured to conduct a biopotential signal generated by a user's body, (2) a receiving subsystem electrically connected to the facial coupling subsystem and configured to receive, from the user's body via a compliant electrode of the facial coupling subsystem, the biopotential signal, and (3) a detection subsystem electrically connected to the receiving subsystem and configured to (a) determine a characteristic of the biopotential signal and (b) use the characteristic of the biopotential signal to determine a gaze direction of an eye of the user and/or a facial gesture of the user. In some examples, the facial coupling subsystem may include a plurality of compliant electrodes that each are configured to comply in a direction normal to a surface of the user's face. Various other apparatus, systems, and methods are also disclosed.Type: GrantFiled: July 16, 2018Date of Patent: May 19, 2020Assignee: Facebook Technologies, LLCInventors: Mohsen Shahmohammadi, Ying Yang, Yaser Sheikh, Hernan Badino, James David White
-
Patent number: 10636193Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes various image capture devices that capture images of portions of the user's face and body. Through image analysis, points of each portion of the user's face and body are identified from the images and their movement is tracked. The identified points are mapped to a three dimensional model of a face and to a three dimensional model of a body. From the identified points, animation parameters describing positioning of various points of the user's face and body are determined for each captured image. From the animation parameters and transforms mapping the captured images to three dimensions, the three dimensional model of the face and the three dimensional model of the body is altered to render movement of the user's face and body.Type: GrantFiled: June 29, 2018Date of Patent: April 28, 2020Assignee: Facebook Technologies, LLCInventors: Yaser Sheikh, Hernan Badino, Alexander Trenor Hypes, Dawei Wang, Mohsen Shahmohammadi, Michal Perdoch, Jason Saragih, Shih-En Wei
-
Patent number: 10636192Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes various facial sensors, such as cameras, that capture images of portions of the user's face outside of the HMD. For example, multiple facial sensors capture images of a portion of the user's face below the HMD. Through image analysis, points of the portion of the user's face are identified from the images and their movement is tracked. The identified points are mapped to a three dimensional model of a face. Additionally, a parametric representation of the user's face is determined for each captured image, resulting in various representations indicating the user's facial expressions. From the parametric representations and transforms mapping the captured images to three dimensions, a rendering model is used and applied to the three dimensional model of the face to render the user's facial expressions.Type: GrantFiled: June 29, 2018Date of Patent: April 28, 2020Assignee: Facebook Technologies, LLCInventors: Jason Saragih, Hernan Badino, Shih-En Wei
-
Patent number: 10529113Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes various image capture devices that capture images of portions of the user's face. Through image analysis, points of each portion of the user's face are identified from the images and their movement is tracked. The identified points are mapped to a three dimensional model of a face. From the identified points, a blendshape vector is determined for each captured image, resulting in various vectors indicating the user's facial expressions. A direct expression model that directly maps images to blendshape coefficients for a set of facial expressions based on captured information from a set of users may augment the blendshape vector in various embodiments. From the blendshape vectors and transforms mapping the captured images to three dimensions, the three dimensional model of the face is altered to render the user's facial expressions.Type: GrantFiled: January 4, 2019Date of Patent: January 7, 2020Assignee: Facebook Technologies, LLCInventors: Yaser Sheikh, Hernan Badino, Jason Saragih, Shih-En Wei, Alexander Trenor Hypes, Dawei Wang, Mohsen Shahmohammadi, Michal Perdoch
-
Patent number: 10509467Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.Type: GrantFiled: June 1, 2018Date of Patent: December 17, 2019Assignee: Facebook Technologies, LLCInventors: Shih-En Wei, Jason Saragih, Hernan Badino, Alexander Trenor Hypes, Mohsen Shahmohammadi, Dawei Wang, Michal Perdoch
-
Publication number: 20190369718Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.Type: ApplicationFiled: June 1, 2018Publication date: December 5, 2019Inventors: Shih-En Wei, Jason Saragih, Hernan Badino, Alexander Trenor Hypes, Mohsen Shahmohammadi, Dawei Wang, Michal Perdoch
-
Patent number: 10495882Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within and on the HMD to capture portions of a face of a user wearing the HMD. Multiple image capture devices are included within the HMD to capture different portions of the face of the user within the HMD, and one or more other image capture devices are positioned to capture portions of the face of the user external to the HMD. Captured images from various image capture devices may be communicated to a console or a controller that generates a graphical representation of the user's face based on the captured images.Type: GrantFiled: June 4, 2018Date of Patent: December 3, 2019Assignee: Facebook Technologies, LLCInventors: Hernan Badino, Yaser Sheikh, Alexander Trenor Hypes, Dawei Wang, Mohsen Shahmohammadi, Michal Perdoch, Jason Saragih, Shih-En Wei
-
Patent number: 10371561Abstract: A system is provided that can include a 3D sensor. The 3D sensor can be configured to detect an area of an elevator on a harvester. The 3D sensor can further be configured to transmit a first signal associated with the area. The system can also include a processing device in communication with the 3D sensor. The system can further include a memory device in which instructions executable by the processing device are stored for causing the processing device to receive the first signal and determine a volume of a material on the elevator based on the first signal.Type: GrantFiled: October 29, 2014Date of Patent: August 6, 2019Assignees: Iowa State University Research Foundation, Inc., Deere & Company, Carnegie Mellon UniversityInventors: Matthew J. Darr, Daniel Joseph Corbett, Herman Herman, Carlos Vallespi-Gonzalez, Bryan E. Dugas, Hernan Badino
-
Publication number: 20150124054Abstract: A system is provided that can include a 3D sensor. The 3D sensor can be configured to detect an area of an elevator on a harvester. The 3D sensor can further be configured to transmit a first signal associated with the area. The system can also include a processing device in communication with the 3D sensor. The system can further include a memory device in which instructions executable by the processing device are stored for causing the processing device to receive the first signal and determine a volume of a material on the elevator based on the first signal.Type: ApplicationFiled: October 29, 2014Publication date: May 7, 2015Inventors: MATTHEW J. DARR, DANIEL JOSEPH CORBETT, HERMAN HERMAN, CARLOS VALLESPI-GONZALEZ, BRYAN E. DUGAS, HERNAN BADINO
-
Patent number: 8548229Abstract: A method for detecting objects, wherein two images of a surrounding (1) are taken and a disparity image is determined by means of stereo image processing, wherein a depth map of the surrounding (1) is determined from the determined disparities, wherein a free space delimiting line (2) is identified, delimiting an unobstructed region of the surrounding (1), wherein outside and along the free space delimiting line (1) the depth card is segmented by segments (3) of a suitable width formed by pixels of the same or similar distance to an image plane, wherein a height of each segment (3) is estimated as part of an object (4.1 to 4.6) located outside of the unobstructed region in a way, such that each segment (3) is characterized by the two-dimensional position of the base (for example the distance and angle to the longitudinal axis of the vehicle) and the height thereof.Type: GrantFiled: February 4, 2010Date of Patent: October 1, 2013Assignee: Daimler AGInventors: Hernan Badino, Uwe Franke
-
Publication number: 20110311108Abstract: A method for detecting objects, wherein two images of a surrounding (1) are taken and a disparity image is determined by means of stereo image processing, wherein a depth map of the surrounding (1) is determined from the determined disparities, wherein a free space delimiting line (2) is identified, delimiting an unobstructed region of the surrounding (1), wherein outside and along the free space delimiting line (1) the depth card is segmented by segments (3) of a suitable width formed by pixels of the same or similar distance to an image plane, wherein a height of each segment (3) is estimated as part of an object (4.1 to 4.6) located outside of the unobstructed region in a way, such that each segment (3) is characterized by the two-dimensional position of the base (for example the distance and angle to the longitudinal axis of the vehicle) and the height thereof.Type: ApplicationFiled: February 4, 2010Publication date: December 22, 2011Applicant: DAIMLER AGInventors: Hernan Badino, Uwe Franke
-
Publication number: 20090297036Abstract: The invention relates to a method for detecting objects on a pixel plane. Said movable object detection is frequently possible only by tracking the pre-segmented objects or the parts thereof. in this relation, the spatially adjacent objects often provoke problems, in particular in the case when a camera system or more precisely an observer is movable. The inventive method consists in determining a two-dimensional position of the relevant pixels inside a first image and in determining an associated remote value for each relevant pixel. Said pixels are tracked and localized on two ore more successive images, wherein the two-dimensional position or the pixel offset and the associated remote value are again determined for each pixel. The position and movement of the relevant pixels are also determined with the aid of a suitable filter. Finally, the relevant pixels are combined into objects under predefined conditions with respect to the position, moving direction and motion ratio thereof.Type: ApplicationFiled: January 3, 2006Publication date: December 3, 2009Applicant: Daimler AGInventors: Hernan Badino, Uwe Franke, Stefan Gehrig, Clemens Rabe