Patents by Inventor Shahram Izadi
Shahram Izadi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11934586Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.Type: GrantFiled: June 29, 2022Date of Patent: March 19, 2024Assignee: GOOGLE LLCInventors: Dongeek Shin, Andrea Colaco, Stiven Guillaume Francois Morvan, Adam James Banfield, Shahram Izadi
-
Publication number: 20240004476Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.Type: ApplicationFiled: June 29, 2022Publication date: January 4, 2024Inventors: Dongeek Shin, Andrea Colaco, Stiven Guillaume Francois Morvan, Adam James Banfield, Shahram Izadi
-
Publication number: 20230419600Abstract: Example embodiments relate to techniques for volumetric performance capture with neural rendering. A technique may involve initially obtaining images that depict a subject from multiple viewpoints and under various lighting conditions using a light stage and depth data corresponding to the subject using infrared cameras. A neural network may extract features of the subject from the images based on the depth data and map the features into a texture space (e.g., the UV texture space). A neural renderer can be used to generate an output image depicting the subject from a target view such that illumination of the subject in the output image aligns with the target view. The neural render may resample the features of the subject from the texture space to an image space to generate the output image.Type: ApplicationFiled: November 5, 2020Publication date: December 28, 2023Inventors: Sean Ryan Francesco FANELLO, Abhi MEKA, Rohit Kumar PANDEY, Christian HAENE, Sergio Orts ESCOLANO, Christoph RHEMANN, Paul DEBEVEC, Sofien BOUAZIZ, Thabo BEELER, Ryan OVERBECK, Peter BARNUM, Daniel ERICKSON, Philip DAVIDSON, Yinda ZHANG, Jonathan TAYLOR, Chloe LeGENDRE, Shahram IZADI
-
Publication number: 20230393665Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.Type: ApplicationFiled: February 24, 2023Publication date: December 7, 2023Inventors: Dongeek Shin, Shahram Izadi, David Kim, Sofien Bouaziz, Steven Benjamin Goldberg, Ivan Poupyrev, Shwetak N. Patel
-
Patent number: 11810313Abstract: According to an aspect, a real-time active stereo system includes a capture system configured to capture stereo data, where the stereo data includes a first input image and a second input image, and a depth sensing computing system configured to predict a depth map. The depth sensing computing system includes a feature extractor configured to extract features from the first and second images at a plurality of resolutions, an initialization engine configured to generate a plurality of depth estimations, where each of the plurality of depth estimations corresponds to a different resolution, and a propagation engine configured to iteratively refine the plurality of depth estimations based on image warping and spatial propagation.Type: GrantFiled: February 19, 2021Date of Patent: November 7, 2023Assignee: GOOGLE LLCInventors: Vladimir Tankovich, Christian Haene, Sean Ryan Francesco Fanello, Yinda Zhang, Shahram Izadi, Sofien Bouaziz, Adarsh Prakash Murthy Kowdle, Sameh Khamis
-
Publication number: 20230350049Abstract: A method including transmitting, by a peripheral device communicatively coupled to a wearable device, a frequency-modulated continuous wave (FMCW), receiving, by the peripheral device, a reflected signal based on the FMCW, tracking, by the peripheral device, a movement associated with the peripheral device based on the reflected signal, and communicating, from the peripheral device to the wearable device, an information corresponding to the movement associated with the peripheral device.Type: ApplicationFiled: April 29, 2022Publication date: November 2, 2023Inventors: Anandghan Waghmare, Dongeek Shin, Ivan Poupyrev, Shwetak N. Patel, Shahram Izadi, Adarsh Prakash Murthy Kowdle
-
Patent number: 11710309Abstract: Camera or object pose calculation is described, for example, to relocalize a mobile camera (such as on a smart phone) in a known environment or to compute the pose of an object moving relative to a fixed camera. The pose information is useful for robotics, augmented reality, navigation and other applications. In various embodiments where camera pose is calculated, a trained machine learning system associates image elements from an image of a scene, with points in the scene's 3D world coordinate frame. In examples where the camera is fixed and the pose of an object is to be calculated, the trained machine learning system associates image elements from an image of the object with points in an object coordinate frame. In examples, the image elements may be noisy and incomplete and a pose inference engine calculates an accurate estimate of the pose.Type: GrantFiled: February 13, 2018Date of Patent: July 25, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Jamie Daniel Joseph Shotton, Benjamin Michael Glocker, Christopher Zach, Shahram Izadi, Antonio Criminisi, Andrew William Fitzgibbon
-
Publication number: 20230209036Abstract: An electronic device estimates a depth map of an environment based on matching reduced-resolution stereo depth images captured by depth cameras to generate a coarse disparity (depth) map. The electronic device downsamples depth images captured by the depth cameras and matches sections of the reduced-resolution images to each other to generate a coarse depth map. The electronic device upsamples the coarse depth map to a higher resolution and refines the upsampled depth map to generate a high-resolution depth map to support location-based functionality.Type: ApplicationFiled: February 17, 2023Publication date: June 29, 2023Inventors: Sameh KHAMIS, Yinda ZHANG, Christoph RHEMANN, Julien VALENTIN, Adarsh KOWDLE, Vladimir TANKOVICH, Michael SCHOENBERG, Shahram IZADI, Thomas FUNKHOUSER, Sean FANELLO
-
Patent number: 11687635Abstract: This document describes techniques and systems that enable automatic exposure and gain control for face authentication. The techniques and systems include a user device initializing a gain for a near-infrared camera system using a default gain. The user device ascertains patch-mean statistics of one or more regions-of-interest of a most-recently captured image that was captured by the near-infrared camera system. The user device computes an update in the initialized gain to provide an updated gain that is usable to scale the one or more regions-of-interest toward a target mean-luminance value. The user device dampens the updated gain by using hysteresis. Then, the user device sets the initialized gain for the near-infrared camera system to the dampened updated gain.Type: GrantFiled: September 25, 2019Date of Patent: June 27, 2023Assignee: Google PLLCInventors: Adarsh Prakash Murthy Kowdle, Ruben Manuel Velarde, Zhijun He, Xu Han, Kourosh Derakshan, Shahram Izadi
-
Publication number: 20230154051Abstract: Systems and methods are directed to encoding and/or decoding of the textures/geometry of a three-dimensional volumetric representation. An encoding computing system can obtain voxel blocks from a three-dimensional volumetric representation of an object. The encoding computing system can encode voxel blocks with a machine-learned voxel encoding model to obtain encoded voxel blocks. The encoding computing system can decode the encoded voxel blocks with a machine-learned voxel decoding model to obtain reconstructed voxel blocks. The encoding computing system can generate a reconstructed mesh representation of the object based at least in part on the one or more reconstructed voxel blocks. The encoding computing system can encode textures associated with the voxel blocks according to an encoding scheme and based at least in part on the reconstructed mesh representation of the object to obtain encoded textures.Type: ApplicationFiled: April 17, 2020Publication date: May 18, 2023Inventors: Danhang Tang, Saurabh Singh, Cem Keskin, Phillip Andrew Chou, Christian Haene, Mingsong Dou, Sean Ryan Francesco Fanello, Jonathan Taylor, Andrea Tagliasacchi, Philip Lindsley Davidson, Yinda Zhang, Onur Gonen Guleryuz, Shahram Izadi, Sofien Bouaziz
-
Patent number: 11638233Abstract: This document describes systems and techniques to generate refined location estimates using ultra-wideband (UWB) communication links. Mobile devices, such as smartphones, include location sensors to estimate their location. The accuracy of location sensors is generally about 3 meters (or about 10 feet). More accurate location data would allow mobile devices to provide new and improved functionality. The described systems and techniques determine the distance between nearby mobile devices using UWB communication links. A mobile device can then use the distance between the mobile devices to determine their relative locations. By comparing the relative locations of the mobile devices with their location estimates, the mobile device can generate a refined location estimate.Type: GrantFiled: March 9, 2021Date of Patent: April 25, 2023Assignee: Google LLCInventors: Dongeek Shin, Steven Benjamin Goldberg, Shahram Izadi
-
Patent number: 11592908Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.Type: GrantFiled: March 19, 2021Date of Patent: February 28, 2023Assignee: GOOGLE LLCInventors: Dongeek Shin, Shahram Izadi, David Kim, Sofien Bouaziz, Steven Benjamin Goldberg, Ivan Poupyrev, Shwetak N. Patel
-
Patent number: 11589031Abstract: An electronic device estimates a depth map of an environment based on matching reduced-resolution stereo depth images captured by depth cameras to generate a coarse disparity (depth) map. The electronic device downsamples depth images captured by the depth cameras and matches sections of the reduced-resolution images to each other to generate a coarse depth map. The electronic device upsamples the coarse depth map to a higher resolution and refines the upsampled depth map to generate a high-resolution depth map to support location-based functionality.Type: GrantFiled: September 24, 2019Date of Patent: February 21, 2023Assignee: GOOGLE LLCInventors: Sameh Khamis, Yinda Zhang, Christoph Rhemann, Julien Valentin, Adarsh Kowdle, Vladimir Tankovich, Michael Schoenberg, Shahram Izadi, Thomas Funkhouser, Sean Fanello
-
Patent number: 11543892Abstract: A computing device, such as a wearable device, may include at least two electrodes mounted on a body. The computing device may determine an electrical signal associated with a circuit that includes the at least two electrodes and the user. A pressure applied to at least one electrode of the at least two electrodes may be determined from the electrical signal, and at least one function of the computing device may be implemented, based on the pressure.Type: GrantFiled: April 28, 2021Date of Patent: January 3, 2023Assignee: GOOGLE LLCInventors: Dongeek Shin, Shahram Izadi, Shwetak N. Patel
-
Publication number: 20220350419Abstract: A computing device, such as a wearable device, may include at least two electrodes mounted on a body. The computing device may determine an electrical signal associated with a circuit that includes the at least two electrodes and the user. A pressure applied to at least one electrode of the at least two electrodes may be determined from the electrical signal, and at least one function of the computing device may be implemented, based on the pressure.Type: ApplicationFiled: April 28, 2021Publication date: November 3, 2022Inventors: Dongeek Shin, Shahram Izadi, Shwetak N. Patel
-
Publication number: 20220343525Abstract: Example implementations relate to joint depth prediction from dual cameras and dual pixels. An example method may involve obtaining a first set of depth information representing a scene from a first source and a second set of depth information representing the scene from a second source. The method may further involve determining, using a neural network, a joint depth map that conveys respective depths for elements in the scene. The neural network may determine the joint depth map based on a combination of the first set of depth information and the second set of depth information. In addition, the method may involve modifying an image representing the scene based on the joint depth map. For example, background portions of the image may be partially blurred based on the joint depth map.Type: ApplicationFiled: April 27, 2020Publication date: October 27, 2022Inventors: Rahul GARG, Neal WADHWA, Sean FANELLO, Christian HAENE, Yinda ZHANG, Sergio Orts ESCOLANO, Yael Pritch KNAAN, Marc LEVOY, Shahram IZADI
-
Publication number: 20220300082Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.Type: ApplicationFiled: March 19, 2021Publication date: September 22, 2022Inventors: Dongeek Shin, Shahram Izadi, David Kim, Sofien Bouaziz, Steven Benjamin Goldberg, Ivan Poupyrev, Shwetak N. Patel
-
Publication number: 20220295443Abstract: This document describes systems and techniques to generate refined location estimates using ultra-wideband (UWB) communication links. Mobile devices, such as smartphones, include location sensors to estimate their location. The accuracy of location sensors is generally about 3 meters (or about 10 feet). More accurate location data would allow mobile devices to provide new and improved functionality. The described systems and techniques determine the distance between nearby mobile devices using UWB communication links. A mobile device can then use the distance between the mobile devices to determine their relative locations. By comparing the relative locations of the mobile devices with their location estimates, the mobile device can generate a refined location estimate with greater accuracy.Type: ApplicationFiled: March 9, 2021Publication date: September 15, 2022Applicant: Google LLCInventors: Dongeek Shin, Steven Benjamin Goldberg, Shahram Izadi
-
Publication number: 20220196840Abstract: Detecting material properties such reflectivity, true color and other properties of surfaces in a real world environment is described in various examples using a single hand-held device. For example, the detected material properties are calculated using a photometric stereo system which exploits known relationships between lighting conditions, surface normals, true color and image intensity. In examples, a user moves around in an environment capturing color images of surfaces in the scene from different orientations under known lighting conditions. In various examples, surfaces normals of patches of surfaces are calculated using the captured data to enable fine detail such as human hair, netting, textured surfaces to be modeled. In examples, the modeled data is used to render images depicting the scene with realism or to superimpose virtual graphics on the real world in a realistic manner.Type: ApplicationFiled: December 29, 2021Publication date: June 23, 2022Inventors: Otmar HILLIGES, Malte Hanno WEISS, Shahram IZADI, David KIM, Carsten Curt Eckard ROTHER
-
Publication number: 20220191374Abstract: This document describes techniques and systems that enable automatic exposure and gain control for face authentication. The techniques and systems include a user device initializing a gain for a near-infrared camera system using a default gain. The user device ascertains patch-mean statistics of one or more regions-of-interest of a most-recently captured image that was captured by the near-infrared camera system. The user device computes an update in the initialized gain to provide an updated gain that is usable to scale the one or more regions-of-interest toward a target mean-luminance value. The user device dampens the updated gain by using hysteresis. Then, the user device sets the initialized gain for the near-infrared camera system to the dampened updated gain.Type: ApplicationFiled: September 25, 2019Publication date: June 16, 2022Applicant: Google LLCInventors: Adarsh Prakash Murthy Kowdle, Ruben Manuel Velarde, Zhijun He, Xu Han, Kourosh Derakshan, Shahram Izadi