Patents by Inventor Idris S. Aleem

Idris S. Aleem has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11536970
    Abstract: A wearable heads-up display (WHUD) obtains attribute data corresponding to an attribute of an item of interest and obtains environmental data of an environment surrounding the WHUD via one or more sensors of the WHUD. The WHUD compares the attribute data with the environmental data to detect the item of interest. In response to the detection, the WHUD obtains location data indicative of a location of the item of interest, stores the location data in association with a context of detection of the item of interest. In response to a trigger, such as a query by a user regarding the item of interest, the WHUD provides a location indication based on the location data, the location indication including, for example, a display of a description of the location of the item of interest, a display of the item of interest at the location, and the like.
    Type: Grant
    Filed: April 7, 2021
    Date of Patent: December 27, 2022
    Assignee: GOOGLE LLC
    Inventors: Sushant Kulkarni, Idris S. Aleem
  • Publication number: 20220142473
    Abstract: Systems and methods of detecting pupillary positions on a head of a subject are described. While a camera and a light source are positioned in front of the head of the subject, the camera is caused to capture image data representative of a frontal portion of the head of the subject. From the image data, a face of the subject is detected. Up to two eyes are identified from the detected face. A reflection of the light source on each identified eye is detected. A pupillary position of each identified eye is estimated based on a position of the detected light source reflection on the identified eye. One or more of interpupillary distance, left pupil distance, and right pupil distance may be determined from the estimated pupillary positions.
    Type: Application
    Filed: July 27, 2020
    Publication date: May 12, 2022
    Inventors: Ahmed Gawish, Idris S. Aleem
  • Patent number: 11307409
    Abstract: A method of tracking a gaze of an eye includes tracking the gaze of the eye in a first tracking mode. Glint data of at least one glint of the eye is obtained during at least a portion of tracking the gaze of the eye in the first tracking mode. The glint data is in a time domain and includes a time series of a spatial descriptor associated with the at least one glint. The glint data is transformed into a frequency domain to generate a glint frequency spectrum. A stability of the at least one glint is determined based on the glint frequency spectrum. If the at least one glint is determined to be unstable, tracking of the gaze of the eye is switched from the first tracking mode to a second tracking mode that is different from the first tracking mode.
    Type: Grant
    Filed: May 20, 2020
    Date of Patent: April 19, 2022
    Assignee: Google LLC
    Inventor: Idris S. Aleem
  • Patent number: 11238143
    Abstract: A method of operating a wearable heads-up display that in use is worn on a head of a user includes generating an infrared light, scanning the infrared light over an eye of the user, detecting reflections of infrared light from the eye of the user, and extracting test biometric identification data from at least a portion of the detected reflections and corresponding scan orientations. A similarity measure between the test biometric identification data and reference biometric identification data associated with the wearable heads-up display is determined. The user is authenticated based on the similarity measure.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: February 1, 2022
    Assignee: Google LLC
    Inventors: Bergen Fletcher, Idris S. Aleem
  • Patent number: 11157077
    Abstract: A method of tracking an eye of a user on a wearable heads-up display (WHUD) worn on the head of the user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. A motion parameter that is sensitive to motion of the WHUD is measured. Eye tracking is performed in a first mode that is based on glint for values of the motion parameter that fall within a first range of motion parameter values for which an error in measurement of glint position. Eye tracking is performed in a second mode that is based on glint-pupil vector for values of the motion parameter that fall within a second range of motion parameter values for which an error in measurement of glint position exceeds the error threshold. A head-mounted apparatus with eye tracking is disclosed.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: October 26, 2021
    Assignee: GOOGLE LLC
    Inventors: Idris S. Aleem, Andrew S. Logan, Mayank Bhargava
  • Patent number: 11093034
    Abstract: A method of tracking a gaze position of an eye in a target space in a field of view of the eye over an eye tracking period includes performing a plurality of scans of the eye with infrared light within the eye tracking period. Each scan includes generating infrared light signals over a scan period and projecting the infrared light signals from a plurality of virtual light projectors to the eye to form a plurality of illumination areas on the eye. Reflections of the infrared light signals from the eye are detected for each scan. The gaze position of the eye in the target space is determined from the detected reflections of the infrared light signals for each scan.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: August 17, 2021
    Assignee: Google LLC
    Inventors: Idris S. Aleem, Mayank Bhargava, Andrew S. Logan
  • Publication number: 20210223863
    Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.
    Type: Application
    Filed: April 7, 2021
    Publication date: July 22, 2021
    Inventors: Idris S. Aleem, Andrew S. Logan, Mayank Bhargava
  • Patent number: 11042031
    Abstract: An eye tracking system for tracking an eye of a user includes at least one infrared laser diode to output an infrared light and an optical scanner positioned to receive the infrared light outputted by the at least one infrared laser diode and controllable to scan the infrared light over a target area. A holographic optical element is positioned at the target area to receive the infrared light from the optical scanner and redirect the infrared light to the eye of the user. An infrared detector is aligned to detect at least a portion of the infrared light returned from the eye of the user. An infrared filter is disposed in a position to selectively block transmission of infrared wavelengths through the holographic optical element from a side of the holographic optical element. An eyeglass lens, a wearable heads-up display, and a method of eye tracking are also described.
    Type: Grant
    Filed: February 6, 2019
    Date of Patent: June 22, 2021
    Assignee: Google LLC
    Inventors: Idris S. Aleem, Andrew S. Logan
  • Patent number: 11009715
    Abstract: Systems and methods for fitting a wearable heads-up display (WHUD) to a subject are described. Imaging data representative of at least a portion of the subject's head with one or more gaze positions of the eyes is obtained from a plurality of cameras. One or more models representative of the subject's head are generated and a set of features is recognized in the one or more models. One or more models of the WHUD are also obtained based on WHUD data stored in memory. One or more simulations are performed positioning one or more WHUD models in proximity to at least one subject model based at least in part on the set of features recognized in the subject model. A fit of a WHUD to the subject is evaluated based at least in part on a determination regarding whether the simulation satisfies one or more of a set of criteria.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: May 18, 2021
    Assignee: Google LLC
    Inventors: Samuel Jewell Lochner, Sui Tong Tang, Kevin R. Moule, Lukas Rezek, Ehsan Parvizi, Idris S. Aleem
  • Patent number: 10976814
    Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: April 13, 2021
    Assignee: GOOGLE LLC
    Inventors: Idris S. Aleem, Andrew S. Logan, Mayank Bhargava
  • Patent number: 10936056
    Abstract: A method of tracking an eye of a user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. Shifts in a position of a wearable heads-up display (WHUD) worn on the head of the user are detected during at least a portion of the eye tracking period. Glints are identified from the detected reflections of the infrared light. A drift in a glint center position of an identified glint relative to a glint space is determined based on a detected shift in position of the WHUD corresponding in space to the identified glint. The glint center position is adjusted to compensate for the drift. The adjusted glint center position is transformed from the glint space to a gaze position in a display space in a field of view of the eye.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: March 2, 2021
    Assignee: Google LLC
    Inventors: Idris S. Aleem, Andrew S. Logan, Mayank Bhargava
  • Publication number: 20200371350
    Abstract: A method of tracking a gaze of an eye includes tracking the gaze of the eye in a first tracking mode. Glint data of at least one glint of the eye is obtained during at least a portion of tracking the gaze of the eye in the first tracking mode. The glint data is in a time domain and includes a time series of a spatial descriptor associated with the at least one glint. The glint data is transformed into a frequency domain to generate a glint frequency spectrum. A stability of the at least one glint is determined based on the glint frequency spectrum. If the at least one glint is determined to be unstable, tracking of the gaze of the eye is switched from the first tracking mode to a second tracking mode that is different from the first tracking mode.
    Type: Application
    Filed: May 20, 2020
    Publication date: November 26, 2020
    Inventor: Idris S. Aleem
  • Patent number: 10684692
    Abstract: Systems, devices, and methods adapt established concepts from natural language processing for use in gesture identification algorithms. A gesture identification system includes sensors, a processor, and a non-transitory processor-readable memory that stores data and/or instructions for performing gesture identification. A gesture identification system may include a wearable gesture identification device. The gesture identification process involves segmenting signals from the sensors into data windows, assigning a respective “window class” to each data window, and identifying a user-performed gesture based on the corresponding sequence of window classes. Each window class exclusively characterizes at least one data window property and is analogous to a “letter” of an alphabet. Under this model, each gesture is analogous to a “word” made up of a particular combination of window classes.
    Type: Grant
    Filed: December 22, 2017
    Date of Patent: June 16, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Idris S. Aleem, Pedram Ataee
  • Publication number: 20200142479
    Abstract: A method of tracking a gaze position of an eye in a target space in a field of view of the eye over an eye tracking period includes performing a plurality of scans of the eye with infrared light within the eye tracking period. Each scan includes generating infrared light signals over a scan period and projecting the infrared light signals from a plurality of virtual light projectors to the eye to form a plurality of illumination areas on the eye. Reflections of the infrared light signals from the eye are detected for each scan. The gaze position of the eye in the target space is determined from the detected reflections of the infrared light signals for each scan.
    Type: Application
    Filed: October 30, 2019
    Publication date: May 7, 2020
    Inventors: Idris S. Aleem, Mayank Bhargava, Andrew S. Logan
  • Patent number: 10606072
    Abstract: Systems, devices, and methods for laser eye tracking are described. Laser eye tracking involves scanning laser light over the eye and detecting diffuse reflections of the laser light with one or more photodetector(s). While conventional camera-based eye tracking techniques rely on detecting and identifying specific reflections (i.e., Purkinje images such as the “glint”), the laser eye tracking techniques described herein detect and identify a reduction in reflection intensity due to transmission of laser light through the pupil and/or increased diffusivity of reflections from the cornea relative to reflections from the sclera. This effect is referred to herein as the “corneal shadow” effect. Laser eye tracking uses considerably less power than conventional camera-based eye tracking techniques.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: March 31, 2020
    Assignee: North Inc.
    Inventors: Idris S. Aleem, Mélodie Vidal, Jake Chapeskie
  • Publication number: 20200081260
    Abstract: Systems and methods for fitting a wearable heads-up display (WHUD) to a subject are described. Imaging data representative of at least a portion of the subject's head with one or more gaze positions of the eyes is obtained from a plurality of cameras. One or more models representative of the subject's head are generated and a set of features is recognized in the one or more models. One or more models of the WHUD are also obtained based on WHUD data stored in memory. One or more simulations are performed positioning one or more WHUD models in proximity to at least one subject model based at least in part on the set of features recognized in the subject model. A fit of a WHUD to the subject is evaluated based at least in part on a determination regarding whether the simulation satisfies one or more of a set of criteria.
    Type: Application
    Filed: September 11, 2019
    Publication date: March 12, 2020
    Inventors: Samuel Jewell Lochner, Sui Tong Tang, Kevin R. Moule, Lukas Rezek, Ehsan Parvizi, Idris S. Aleem
  • Patent number: 10579141
    Abstract: Systems, methods and articles that provide dynamic calibration of eye tracking systems for wearable heads-up displays (WHUDs). The eye tracking system may determine a user's gaze location on a display of the WHUD utilizing a calibration point model that includes a plurality of calibration points. During regular use of the WHUD by the user, the calibration point model may be dynamically updated based on the user's interaction with user interface (UI) elements presented on the display. The UI elements may be specifically designed (e.g., shaped, positioned, displaced) to provide in-use and on-going dynamic calibration of the eye tracking system, which in at least some implementations may be unnoticeable to the user.
    Type: Grant
    Filed: July 16, 2018
    Date of Patent: March 3, 2020
    Assignee: North Inc.
    Inventors: Idris S. Aleem, Mayank Bhargava, Dylan Jacobs
  • Publication number: 20190370450
    Abstract: A method of operating a wearable heads-up display that in use is worn on a head of a user includes generating an infrared light, scanning the infrared light over an eye of the user, detecting reflections of infrared light from the eye of the user, and extracting test biometric identification data from at least a portion of the detected reflections and corresponding scan orientations. A similarity measure between the test biometric identification data and reference biometric identification data associated with the wearable heads-up display is determined. The user is authenticated based on the similarity measure.
    Type: Application
    Filed: May 15, 2019
    Publication date: December 5, 2019
    Inventors: Bergen Fletcher, Idris S. Aleem
  • Publication number: 20190369253
    Abstract: An edge detection circuit receives a detector signal from an infrared detector positioned and oriented to detect reflections of infrared light from a scan area including at least a portion of an eye, detects an edge of at least one feature of the eye from the detector signal, and outputs information about a position of the edge of the feature relative to the scan area.
    Type: Application
    Filed: May 13, 2019
    Publication date: December 5, 2019
    Inventors: Idris S. Aleem, Andrew S. Logan, Nicholas Ford, David Vandervies, Zachary R. MacLennan
  • Patent number: 10459220
    Abstract: Systems, devices, and methods that use elements of a scanning laser projector (“SLP”) to determine the gaze direction of a user of a wearable heads-up display (“WHUD”) are described. An infrared laser diode is added to an RGB SLP and an infrared photodetector is aligned to detect reflections of the infrared light from the eye. A scan mirror in the SLP sweeps through a range of orientations and the intensities of reflections of the infrared light are monitored by a processor to determine when a spectral reflection or “glint” is produced. The processor determines the orientation of the scan mirror that produced the glint and maps the scan mirror orientation to a region in the field of view of the eye of the user, such as a region in visible display content projected by the WHUD, to determine the gaze direction of the user.
    Type: Grant
    Filed: November 30, 2017
    Date of Patent: October 29, 2019
    Assignee: North Inc.
    Inventors: Idris S. Aleem, Mayank Bhargava