Using Photodetector Patents (Class 351/210)
  • Patent number: 11432776
    Abstract: The present disclosure provides for medical device administration and interaction by identifying a medical event affecting a first individual, a medical device associated with treating the medical event, and an initial attentiveness level of an administering individual; outputting a tutorial for how to use the medical device to treat the medical event with a first control level, wherein the first control level based on the initial attentiveness level of the administering individual; and in response to receiving a triggering event while outputting the tutorial: determining a current attentiveness level for the administering individual; and in response to the current attentiveness level indicating a change from the initial attentiveness level, adjusting the tutorial based on a second control level, different than the first control level, based on the change from the initial attentiveness level.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: September 6, 2022
    Assignee: International Business Machines Corporation
    Inventors: Paul R Bastide, Fang Lu, Ishwarya Rajendrababu, Sathyanarayanan Srinivasan
  • Patent number: 11426070
    Abstract: An apparatus to illuminate a target includes a lens having a lens side to be positioned in opposing relation to the target. The apparatus includes a lightguide that circumscribes at least a portion of the periphery of the lens. The lightguide has an input end to receive light and a length along which the receive light propagates. The apparatus includes outcoupling elements that are spaced out along the length of the lightguide. The outcoupling elements couple light out of the lightguide at respective positions along the length of the lightguide. The outcoupling elements are oriented to direct the outcoupled light towards the target when the lens side is positioned in opposing relation to the target. An eye tracking apparatus including the illumination apparatus and a method of eye tracking are disclosed.
    Type: Grant
    Filed: November 29, 2019
    Date of Patent: August 30, 2022
    Assignee: Google LLC
    Inventor: Douglas Raymond Dykaar
  • Patent number: 11419494
    Abstract: Provided is a portable, hand-held, self-powered, self-calibrated, easy-to-use “iCOBRA” system, a neural/neurological assessment tool for both operational decision-making in military, aerospace, sports, and other high-performance settings, and to assist in diagnostics in medical practice. The system harnesses multimodal 3D imaging technologies for robust, calibration free, head and eye tracking to allow for visual, vestibular, and oculomotor assessment of human neural health and performance.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: August 23, 2022
    Assignee: United States of America as Represented by the Administrator of NASA
    Inventors: Leland Scott Stone, Dorion Bryce Liston, Bernard Dov Adelstein, Mark Richard Anderson, Kenji Hiroshi Kato
  • Patent number: 11391967
    Abstract: The disclosed transparent circuit board may include a transparent substrate, a first conductive trace coupled to the transparent substrate, and an electrical component having a bottom surface facing the transparent substrate and a top surface facing away from the transparent substrate. The bottom surface may include a first electrical contact coupled to the first conductive trace, and the top surface may include a second electrical contact. The transparent circuit board may also include a second conductive trace electrically connected to the second electrical contact and a transparent encapsulation layer coupled to the transparent substrate and encapsulating the electrical component. Various other ophthalmic devices, systems, and methods are also disclosed.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: July 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Karol Constantine Hatzilias, Jeb Wu, Paul Armen Tchertchian, Robin Sharma, Christopher Yuan Ting Liao
  • Patent number: 11386290
    Abstract: A method for training an eye tracking model is disclosed, as well as a corresponding system and storage medium. The eye tracking model is adapted to predict eye tracking data based on sensor data from a first eye tracking sensor. The method comprises receiving sensor data obtained by the first eye tracking sensor at a time instance and receiving reference eye tracking data for the time instance generated by an eye tracking system comprising a second eye tracking sensor. The reference eye tracking data is generated by the eye tracking system based on sensor data obtained by the second eye tracking sensor at the time instance. The method comprises training the eye tracking model based on the sensor data obtained by the first eye tracking sensor at the time instance and the generated reference eye tracking data.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: July 12, 2022
    Assignee: Tobii AB
    Inventors: Carl Asplund, Patrik Barkman, Anders Dahl, Oscar Danielsson, Tommaso Martini, Mårten Nilsson
  • Patent number: 11353957
    Abstract: Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: June 7, 2022
    Assignee: Mentor Acquisition One, LLC
    Inventor: John N. Border
  • Patent number: 11353698
    Abstract: An eye is illuminated with infrared illumination light. Illuminating the eye includes illuminating a near-eye ellipsoidal lensing structure. A tracking image of Purkinje reflections of the infrared illumination light is captured by a camera. An eye position of the eye is determined in response to the tracking image.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: June 7, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Robin Sharma, Andrew John Ouderkirk
  • Patent number: 11344196
    Abstract: A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, and a control unit. The frame may be adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the at least one image sensor, and calibrate at least one illuminator, at least one image sensor, or an algorithm of the control unit.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: May 31, 2022
    Assignee: Tobii AB
    Inventors: Simon Gustafsson, Anders Kingbäck, Markus Cederlund
  • Patent number: 11300446
    Abstract: Disclosed are an optical detection method and an optical detection apparatus for a fatigue state of a user, and an optical detection device, this application relates to the field of detection technology, and is for improving accuracy of detection of the fatigue state. An optical detection method includes: irradiating eyes of the user with an infrared light; obtaining an intensity of an infrared light reflected by the eyes of the user; and determining whether the user is in a fatigue state based on the intensity of the reflected infrared light.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: April 12, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Pengfei Wei, Wei Sun, Zheng Jia, Xu Guan, Zhenwei Gao, Xue Gao, Ning Xie, Xingge Jia, Zongyuan Wang, Chuanhui Ma
  • Patent number: 11294455
    Abstract: Embodiments of the present disclosure provide a method and a device for determining a gaze placement and a computer readable storage medium. The method comprises acquiring an ocular image of a subject; determining at least one gaze characteristic vector based on an ocular image; determining a gaze placement of the subject, according to a gaze estimation model and the at least one characteristic vector. The characteristic vector comprises at least one of: a first characteristic vector from a first reference speckle center to a pupil center, wherein the first reference speckle is formed by a first reference source in the ocular image; a second characteristic vector from the pupil center to a second reference speckle center, wherein the second reference speckle is formed by a second reference source in the ocular image; a third characteristic vector from the second reference speckle center to the first reference speckle center.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: April 5, 2022
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Jiankang Sun, Hao Zhang, Lili Chen, Minglei Chu, Jian Sun, Ziqiang Guo, Guixin Yan, Yakun Wang
  • Patent number: 11272837
    Abstract: The invention relates to a method for performing a movement correction when measuring a human eye, in which the eye is scanned by a measurement beam in order to obtain a set of position values of an eye structure. Scanning extends over a measurement time interval, wherein the position values are each provided with a timestamp within the measurement time interval. A surface shape and a displacement function are determined, with the displacement function representing a movement pattern during the measurement time interval, and the surface shape and the displacement function being determined in such a way that the position values are approximated by the surface shape when the surface shape is moved according to the displacement function. Moreover, the invention relates to an associated measurement system.
    Type: Grant
    Filed: December 3, 2019
    Date of Patent: March 15, 2022
    Assignee: Haag-Streit AG
    Inventors: Jörg Wagner, Philippe Cattin, Lucio Robledo
  • Patent number: 11256087
    Abstract: The disclosure relates to an eye tracking device for tracking movements of an eye comprising, a viewing plane for displaying a projection of an image to the eye of a user, an image module placed on a same side of the viewing plane as the eye, at least one illuminator for illuminating the eye, a control unit adapted to receive an image captured by the image module, and calculate a viewing angle of the eye, a holographic optical element (HOE), wherein a HOE is placed between the eye and the viewing plane, wherein the image module is adapted to capture an image of the HOE, and wherein the HOE is adapted to direct at last a first portion of incident light reflected from the eye, in a first angle towards the image module, the first angle being different from an angle of the incidence of the incident light.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: February 22, 2022
    Assignee: Tobii Ab
    Inventors: Daniel Tornèus, Peter Schef, Magnus Arvidsson, Peter Blixt, Fredrik Mattinson
  • Patent number: 11243607
    Abstract: A method of identifying scleral reflections in an eye tracking system is disclosed. A glint is identified in an image from an image sensor, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: February 8, 2022
    Assignee: Tobii AB
    Inventors: Pravin Kumar Rana, Yimu Wang
  • Patent number: 11238598
    Abstract: A head mounted display comprises an eye tracking system configured to enable eye tracking using polarization. The eye tracking system includes one or more illumination sources and an optical detector comprising polarization sensitive pixels. The one or more illumination sources are configured to illuminate a user's eye and generate reflections directed towards the optical detector. The eye tracking system determines, for each polarization sensitive pixel in a subset of the polarization sensitive pixels, one or more estimation parameters. The eye tracking system determines, for the subset of the polarization sensitive pixels, depth information for one or more glints associated with one or more surfaces of the eye, based in part on the polarization of the reflections and the one or more estimation parameters. The determined depth information is used to update a model of the eye. The eye tracking system determines eye tracking information based on the updated model.
    Type: Grant
    Filed: May 12, 2020
    Date of Patent: February 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Michael Hall, Ruonan Yang
  • Patent number: 11234588
    Abstract: A concise representation illustrating essential elements of a subjective refraction eye test that includes choices of optics offered to a test subject, responses by the test subject indicating respective choices among the optics, and time durations of, between, or both of and between, responses by the test subject indicating the respective choices of optics. The concise representation includes a presentation that illustrates the essential elements of the eye test.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: February 1, 2022
    Inventor: Shui T Lai
  • Patent number: 11221671
    Abstract: A system includes a camera positioned in an environment to capture image data of a subject; a computing device communicatively coupled to the camera, the computing device comprising a processor and a non-transitory computer-readable memory; and a machine-readable instruction set stored in the non-transitory computer-readable memory. The machine-readable instruction set causes the computing device to perform at least the following when executed by the processor: receive the image data from the camera; analyze the image data captured by the camera using a neural network trained on training data generated from a 360-degree panoramic camera configured to collect image data of a subject and a visual target that is moved about an environment; and predict a gaze direction vector of the subject with the neural network.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: January 11, 2022
    Assignees: TOYOTA RESEARCH INSTITUTE, INC., MASSACHUSETTS INSTITUTE OF TECHNOLOGY
    Inventors: Simon A. I. Stent, Adrià Recasens, Petr Kellnhofer, Wojciech Matusik, Antonio Torralba
  • Patent number: 11216974
    Abstract: The disclosure relates to a method of determining a gaze distance, the method including obtaining a plurality of images by capturing each of both eyes of a user, determining, from each of the plurality of images, a corner point located at an edge of the eye, a location of a pupil, and an eye contour, determining each of gaze directions of both of the eyes based on a difference between a reference point and the location of the pupil, wherein the reference point is determined based on the eye contour and a location of the corner point, and determining a gaze distance based on a difference between the gaze directions of both of the eyes.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: January 4, 2022
    Assignees: SAMSUNG ELECTRONICS CO., LTD., SEOUL NATIONAL UNIVERSITY R&DB FOUNDATION
    Inventors: Chi-yul Yoon, Sang Yoon Han, Sang Hwa Lee, Yeongil Jang, Nam Ik Cho
  • Patent number: 11209898
    Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image collection can include displaying a graphic along a path connecting a plurality of eye pose regions. Eye images at a plurality of locations along the path can be obtained, and an iris code can be generated based at least partly on at least some of the obtained eye images.
    Type: Grant
    Filed: January 17, 2017
    Date of Patent: December 28, 2021
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Patent number: 11205426
    Abstract: An information processing device according to an aspect of the present technology includes a user information acquiring unit, an object information acquiring unit, and an output control unit. The user information acquiring unit acquires information related to a gaze position of a user while a substance of content is being automatically reproduced, in accordance with a first control amount, from an audio source located in a space in which the user is located. The object information acquiring unit acquires position information related to the audio source and position information related to a first object gazed at by the user. The output control unit performs first output control of providing the user with the substance of the content in accordance with a second control amount different from the first control amount in a case where the gaze position within the first object moves toward the audio source.
    Type: Grant
    Filed: January 19, 2018
    Date of Patent: December 21, 2021
    Assignee: SONY CORPORATION
    Inventors: Mari Saito, Kenji Sugihara
  • Patent number: 11181979
    Abstract: A system of eye tracking includes an infrared (IR) source to project IR light to an eye of a user, an IR holographic optical element (HOE) to change an angle of the IR light reflected from the eye of the user, and a sensor to receive the IR light. The system further includes a processor to use the IR light to determine a gaze vector of the user, in one embodiment.
    Type: Grant
    Filed: January 8, 2020
    Date of Patent: November 23, 2021
    Assignee: Avegant Corp.
    Inventors: Aaron Matthew Eash, Andrew John Gross, Christopher David Westra, Warren Cornelius Welch, III, Eric Richard David Frasch
  • Patent number: 11169374
    Abstract: Eyewear having an optical waveguide communicating infrared light from a remote infrared emitter in the eyewear to an optical output coupler that uniformly illuminates an eye for tracking eye movement of a user. An optical input coupler couples a light beam emitted by the remote infrared emitter into the waveguide. The remote infrared emitter simplifies industrial design and is a single light source. The remote infrared emitter is not in a peripheral vision of a user's eye and improves a cosmetic impact.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: November 9, 2021
    Assignee: Snap Inc.
    Inventors: Kenneth Kubala, Russell Douglas Patton, Jonathan M. Rodriguez, II
  • Patent number: 11157071
    Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image collection can include displaying a graphic along a path connecting a plurality of eye pose regions. Eye images at a plurality of locations along the path can be obtained, and an iris code can be generated based at least partly on at least some of the obtained eye images.
    Type: Grant
    Filed: January 17, 2017
    Date of Patent: October 26, 2021
    Assignee: Magic Leap, Inc.
    Inventor: Adrian Kaehler
  • Patent number: 11151828
    Abstract: A building access system for a building including a front facing camera system configured to capture one or more images of a face of a user, wherein one or more front facing camera processing circuits configured to detect and authenticate the user based on the one or more images captured by the front facing camera system and operate building equipment. The system further including a down facing camera system configured to capture one or more overhead images of the user from an overhead perspective, wherein one or more down facing camera processing circuits configured to detect whether a second user is tailgating the user based on the one or more overhead images captured by the down facing camera system and generate an alarm in response to a detection that the second user is tailgating the user.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: October 19, 2021
    Assignee: Johnson Controls Tyco IP Holdings LLP
    Inventors: Lior Kirsch, Yohai Falik, Igal Dvir
  • Patent number: 11138741
    Abstract: A method and system for monitoring the motion of one or both eyes, includes capturing a sequence of overlapping images of a subject's face including an eye and the corresponding non-eye region; identifying a plurality of keypoints in each image; mapping corresponding keypoints in two or more images of the sequence; assigning the keypoints to the eye and to the corresponding non-eye region; calculating individual velocities of the corresponding keypoints in the eye and the corresponding non-eye region to obtain a distribution of velocities; extracting at least one velocity measured for the eye and at least one velocity measured for the corresponding non-eye region; calculating the eye-in-head velocity for the eye based upon the measured velocity for the eye and the measured velocity for the corresponding non-eye region; and calculating the eye-in-head position based upon the eye-in-head velocity.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: October 5, 2021
    Assignee: Rochester Institute of Technology
    Inventors: Jeff B. Pelz, Dan Witzner Hansen
  • Patent number: 11126260
    Abstract: Embodiments of the present disclosure disclose a control method and apparatus of an intelligent device, and a storage medium. The control method includes: determining a state of a target function to acquire target function state information; detecting an operation of a user gazing at a local screen to acquire gazing operation information; and controlling the state of the target function to switch according to the gazing operation information and the target function state information.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: September 21, 2021
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Lu Qian, Gang Zhang, Shasha Wang, Mingwei Li, Yibo Chen, Fenglei Wang
  • Patent number: 11064881
    Abstract: A method for predicting abnormal eye convergence in a human or animal subject may involve tracking eye movement of at least one eye of the subject to generate eye tracking data for the subject and using the eye tracking data to predict whether the subject has abnormal eye convergence. A method for diagnosing a brain injury in a human or animal subject may involve tracking eye movement of at least one eye of the subject to generate eye tracking data for the subject, using the eye tracking data to predict whether the subject has abnormal eye convergence, and predicting whether a brain injury has occurred in the subject, based on the prediction of whether the subject has abnormal eye convergence.
    Type: Grant
    Filed: November 14, 2016
    Date of Patent: July 20, 2021
    Assignee: HENNEPIN HEALTHCARE SYSTEM, INC
    Inventors: Uzma Samadani, Abdullah Bin Zahid
  • Patent number: 11068056
    Abstract: Apparatus, systems and methods configured for eye tracking with slippage detection and correction are disclosed. In one example, a method comprises: obtaining a first image and a second image of a person's eye, with an imaging sensor; determining a position relationship between an eyeball center of the eye and the imaging sensor based on the first image and the second image.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: July 20, 2021
    Inventor: Xiaochun Nie
  • Patent number: 11067810
    Abstract: A head-mounted display apparatus according to an aspect of the present disclosure includes an imaging light generating device, a first deflection element including a first deflection section configured to deflect imaging light in a first direction and a second deflection section configured to deflect the imaging light in a second direction, a first diffraction element, and a second diffraction element. When a plane surrounded by the principal ray passing plane, the first principal ray, the second principal ray, and the first deflection section is taken as a first plane, and a plane surrounded by the second deflection section, the first principal ray, the second principal ray, and the first diffraction element is taken as a second plane, the first plane overlaps with at least a part of the second plane when viewed from the third direction and does not overlap with the second plane when viewed from the fourth direction.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: July 20, 2021
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Masatoshi Yonekubo, Mitsutaka Ide
  • Patent number: 11051005
    Abstract: A virtual reality device and the operation method of virtual reality device, and the method includes: the virtual reality device displays an image content according to a corresponding viewing angle of a user; and when the time of virtual reality device detects that the viewing elevation angle is greater than a predetermined angle for a time period which exceeds a predetermined time period, the virtual reality device enters a locking mode; in the locking mode, the virtual reality device displays the image content with a fixed main field, and the virtual reality device constrains the viewing angle of the image content from the movement or rotation of the user. The present invention can determine whether to enter the locking mode according to a preset condition, and provide the main image content of the fixed field of view in the locking mode in order to achieve user convenience and save power.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: June 29, 2021
    Assignee: SUZHOU RAKEN TECHNOLOGY LIMITED
    Inventors: Che-Chia Ho, Chia-Wei Lin
  • Patent number: 11045083
    Abstract: An apparatus for imaging an interior of an eye includes a light sensitive sensor, a plurality of light emitters (LEs) capable of outputting light, a plurality of nonvisible light emitters (NV-LEs) capable of outputting nonvisible light, and a controller. The controller is coupled to the plurality of LEs, the plurality of NV-LEs, and the light sensitive sensor, and the controller implements logic that when executed by the controller causes the apparatus to perform operations. The operations include illuminating the eye with the nonvisible light from the plurality of NV-LEs, and determining an amount of reflection of the nonvisible light from the eye for each of the NV-LEs in the plurality of NV-LEs. The operations also include illuminating the eye with selected one or more of the LEs in the plurality of LEs, and capturing, with the light sensitive sensor, a sequence of images of the interior of the eye while the eye is illuminated with the light from the LEs.
    Type: Grant
    Filed: October 3, 2018
    Date of Patent: June 29, 2021
    Assignee: Verily Life Sciences LLC
    Inventors: Corey Walsh, Eliezer Glik, Sam Kavusi
  • Patent number: 11042994
    Abstract: A system for determining the gaze direction of a subject includes a camera, a computing device and a machine-readable instruction set. The camera is positioned in an environment to capture image data of head of a subject. The computing device is communicatively coupled to the camera and the computing device includes a processor and a non-transitory computer-readable memory. The machine-readable instruction set is stored in the non-transitory computer-readable memory and causes the computing device to: receive image data from the camera, analyze the image data using a convolutional neural network trained on an image dataset comprising images of a head of a subject captured from viewpoints distributed around up to 360-degrees of head yaw, and predict a gaze direction vector of the subject based upon a combination of head appearance and eye appearance image data from the image dataset.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: June 22, 2021
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Simon Stent, Adria Recasens, Antonio Torralba, Petr Kellnhofer, Wojciech Matusik
  • Patent number: 11031120
    Abstract: A method of at-home monitoring of eye conditions using a head mounted display that is capable of establishing a visual model associated with a patient. The visual model may include data related to a quality of the patient's vision. The patient may use the system to establish a visual model periodically, such as daily, and the system may compare the visual model to previous visual models and send an alert to the patient's physician if changes meeting a given criteria are detected. This may allow the physician to immediately take steps to save the patient's eyesight where a delay in treatment may result in vision loss.
    Type: Grant
    Filed: January 17, 2021
    Date of Patent: June 8, 2021
    Assignee: RAYTRX, LLC
    Inventors: Richard C. Freeman, Michael H. Freeman, Mitchael C. Freeman, Chad Boss, Jordan Boss
  • Patent number: 11009699
    Abstract: An eye tracker comprises a light source; a detector; and first and second waveguides. The first waveguide comprises an input coupler for coupling source light into a waveguide path and a first grating for coupling light out of the waveguide path onto an eye. The second waveguide comprises a second grating for coupling light reflected from the eye into a waveguide path and an output coupler for coupling light out of the waveguide path onto the detector. The second grating is optically configured for imaging the eye onto the detector.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: May 18, 2021
    Assignee: DigiLens Inc.
    Inventors: Milan Momcilo Popovich, Jonathan David Waldern, Alastair John Grant
  • Patent number: 11003936
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: May 11, 2021
    Assignee: Tobii AB
    Inventors: Viktor Åberg, Anna Redz, Niklas Ollesson, Dineshkumar Muthusamy, Magnus Ivarsson
  • Patent number: 10996747
    Abstract: Validity of a line-of-sight direction detected by a gaze point detection unit is determined by using a positional difference that is a calibration value used for detecting a position of a corneal curvature center. Therefore, it is possible to easily and effectively determine the validity of the line-of-sight direction without additionally using a system or the like for detecting the validity of the line-of-sight direction. Consequently, it is possible to accurately detect line-of-sight directions of various subjects, such as a subject whose left and right eyeballs have different corneal curvature radii or a subject whose line-of-sight directions of left and right eyeballs are largely different due to the influence of strabismus or the like.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: May 4, 2021
    Assignee: JVCKENWOOD Corporation
    Inventor: Masaru Ninomiya
  • Patent number: 10990755
    Abstract: A method, computer program product, and visual display apparatus include a processor(s) obtaining data indicating that a user wearing the apparatus (which included an image capture device, and a projection device, communicatively coupled to the processor(s)), perceives displayed text with consistent character differences. The processor(s) obtains, from the image capture device, an image of a visual display within a visual range of the image capture device; the image includes textual elements. Based on the data, the processor(s) transforms the image into the new image that includes the textual elements with pre-defined character substitutions, based on the consistent character differences. The processor(s) displays, via the projection device, the new image, to the user, wherein based on viewing the new image, the user views the textual elements without the consistent character differences.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: April 27, 2021
    Assignee: International Business Machines Corporation
    Inventors: Dhandapani Shanmugam, Manjunatha D., Yethish G. Venkataramanachari, Siddique M. Adoni, Suman Mitra
  • Patent number: 10990756
    Abstract: A method, computer program product, and visual display apparatus include a processor(s) obtaining data indicating that a user wearing the apparatus (which included an image capture device, and a projection device, communicatively coupled to the processor(s)), perceives displayed text with consistent character differences. The processor(s) obtains, from the image capture device, an image of a visual display within a visual range of the image capture device; the image includes textual elements. Based on the data, the processor(s) transforms the image into the new image that includes the textual elements with pre-defined character substitutions, based on the consistent character differences. The processor(s) displays, via the projection device, the new image, to the user, wherein based on viewing the new image, the user views the textual elements without the consistent character differences.
    Type: Grant
    Filed: July 22, 2019
    Date of Patent: April 27, 2021
    Assignee: International Business Machines Corporation
    Inventors: Dhandapani Shanmugam, Manjunatha D., Yethish G. Venkataramanachari, Siddique M. Adoni, Suman Mitra
  • Patent number: 10973409
    Abstract: An objective testing of vergence dysfunction comprising the steps of: providing a head mounted goggle based stimulus generating eye tracking unit to the subject; presenting visual stimulus to the subject, wherein the visual stimulus is in the head mounted goggle based system and forms the optical target stimulus for at least one vergence test; obtaining objective physiologic response of the subject from the head mounted goggle unit based upon each of the visual stimulus presented to the subject in each test; and using the objective physiologic responses to diagnose the presence of vergence dysfunction. On objective portable head mounted goggle based stimulus generating eye tracking unit for vergence testing is discloses as is a method of method of vergence recovery convalescence.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: April 13, 2021
    Assignee: NEURO KINETICS
    Inventors: Alexander D. Kiderman, Robin C. Ashmore
  • Patent number: 10966605
    Abstract: Methods and systems for assessing a health state of a person via eye movement-driven biometric systems are provided. Examples of the health states that it would be possible to detect with such a system are but not limited to brain injuries (e.g., concussions), dementia, Parkinson's disease, post-traumatic stress syndrome, schizophrenia, fatigue, cybersickness, autism, Bipolar Disorder and other health conditions that manifest themselves in abnormal behavior of the human visual system. Described methods and systems can also detect influence of alcohol and/or drugs. The system extracts biometric template of a person by deriving features from the captured eye movement signal. The system may compare the difference between previous healthy state of a tested person and newly captured template or an averaged biometric template created from the records of multiple healthy people state of multiple people and a newly captured template from a person who needs to be tested.
    Type: Grant
    Filed: October 25, 2016
    Date of Patent: April 6, 2021
    Assignee: Texas State University—San Marcos
    Inventor: Oleg V. Komogortsev
  • Patent number: 10948984
    Abstract: A method for calibrating an eye tracker includes drawing the attention of a user to a calibration target. At least one positioning camera and at least one computer is employed to determine the position of the calibration target and the eye tracker coordinate system relative to each other. The calibration parameters of a gaze line are determined, to the calibration target, in a first coordinate system. The above steps are repeated, thereby providing a desired part of a gaze range and calibration targets distribution. The calibration data is then stored. A method of calibrating and using an eye tracker and a method of calibrating an eye tracker for use with a display are also provided.
    Type: Grant
    Filed: January 24, 2019
    Date of Patent: March 16, 2021
    Assignee: CONTROLRAD SYSTEMS INC.
    Inventors: Haim Melman, Nir Eden
  • Patent number: 10942564
    Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.
    Type: Grant
    Filed: May 17, 2018
    Date of Patent: March 9, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Andrew Young, Javier Fernandez Rico
  • Patent number: 10932695
    Abstract: This disclosure relates to systems and/or methods for detection of eye blinking using an active contact lens with multiple sensors and detecting orientation of the active contact lens.
    Type: Grant
    Filed: May 31, 2018
    Date of Patent: March 2, 2021
    Assignee: Verily Life Sciences LLC
    Inventors: Nathan Pletcher, Eric Teller, Babak Amirparviz
  • Patent number: 10936056
    Abstract: A method of tracking an eye of a user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. Shifts in a position of a wearable heads-up display (WHUD) worn on the head of the user are detected during at least a portion of the eye tracking period. Glints are identified from the detected reflections of the infrared light. A drift in a glint center position of an identified glint relative to a glint space is determined based on a detected shift in position of the WHUD corresponding in space to the identified glint. The glint center position is adjusted to compensate for the drift. The adjusted glint center position is transformed from the glint space to a gaze position in a display space in a field of view of the eye.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: March 2, 2021
    Assignee: Google LLC
    Inventors: Idris S. Aleem, Andrew S. Logan, Mayank Bhargava
  • Patent number: 10928900
    Abstract: In one aspect, a device includes a body, an arm, a camera, a support arm, an indicator support, and a plurality of indicators. The body is configured to mount to an eyeglass arm. The arm extends from the body. The camera is coupled to the arm and configured to capture images of at least one eye of a user. The support arm extends from the body. The indicator support is coupled to the support arm such that, when the body is mounted to the eyeglasses and the user is wearing the eyeglasses, the indicator support is positioned in the user's field of view. The plurality of indicators are coupled to the indicator support.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: February 23, 2021
    Assignee: TECHNOLOGY AGAINST ALS
    Inventors: Sandeep Rajaram Tungare, Milind Shrikrishna Gupte, Amitabh Patil, Bert Haberland
  • Patent number: 10902628
    Abstract: A method is provided for estimating the orientation of a user's eyes in a scene in a system-agnostic manner. The method approximates pose-invariant, user-independent feature vectors by transforming the input coordinate to a pose-invariant coordinate and then normalizing the data considering the statistical distributions of previously collected data used to create a learned mapping method. It then uses the learned mapping method to estimate the orientation of the user's eyes in the pose invariant coordinate system, and finalizes by transforming these to a world coordinate system.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: January 26, 2021
    Assignee: Mirametrix Inc.
    Inventors: Mohamad Kharboutly, Anh Tuan Nghiem, Nicolas Widynski
  • Patent number: 10888263
    Abstract: A method for non-invasive video oculographic measurement of eye movements as diagnostic support for (early) detection of neuropsychiatric diseases, using an indicator for a visual stimulus and a camera for video recording. A position of the camera is kept constant in relation to the display and a face of a test person is continuously recorded, at least in parts. A recognition algorithm is started which creates an eye template in which an absolute position of the eye and a pupil of the eye are continuously recorded in the image. Furthermore, a reference range, especially around the eye, is defined and, after selecting a predefined measurement paradigm of the pupil are continuously recorded and analyzed at the end of the stimulus.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: January 12, 2021
    Assignee: THOMAS RECORDING GMBH
    Inventors: Uwe Thomas, Stefan Dowiasch
  • Patent number: 10891873
    Abstract: A method and apparatus for monitoring learning and an electronic device are provided. The method for monitoring learning includes: acquiring a class image of a class student; recognizing the class image to acquire characteristic data of the class student, where the characteristic data includes at least one of the following: facial characteristic data of the class student, visual characteristic data of the class student, and body characteristic data of the class student; and determining, based on the characteristic data of the class student, a class status of the class student. The listening status of a student learning via a computer and the Internet in a class can be effectively and accurately monitored, and an effective reference is provided for subsequent learning and teaching to further improve the learning or teaching process.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: January 12, 2021
    Assignee: BEIJING YIZHEN XUESI EDUCATION TECHNOLOGY CO., LTD.
    Inventors: Guowei Fu, Gang Xue, Yuemei Li, Shan An, Mingxiu Meng, Yujia Song, Yangang Feng, Xu Meng
  • Patent number: 10882533
    Abstract: A drowsy driving management device includes: a processor configured to determine whether slow eye movement of a user occurs and whether there is no change in steering torque and to determine that the user drives while drowsy when the slow eye movement of the user occurs and when there is no change in the steering torque for a predetermined period of time; and a storage that stores information indicating whether the slow eye movement occurs and a result of determining whether there is no change in the steering torque.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: January 5, 2021
    Assignees: HYUNDAI MOTOR COMPANY, KIA MOTORS CORPORATION
    Inventors: Jin Kwon Kim, Byoung Joon Lee, Sam Yong Kim
  • Patent number: 10867391
    Abstract: Methods and systems are provided for tracking viewer engagement with a non-interactive display. Sensor data is obtained from one or more sensors, such as cameras, associated with a display device, and once a face is detected within the sensor data, a display sequence is initiated. The display sequence includes at least a first frame with a first visual feature and a second frame with a second visual feature. Using the sensor data obtained during presentation of the display sequence, viewer engagement with the sequence is tracked by determining eye movements and/or head movements. The detected eye movement and/or head movement is used to determine whether the person was actively engaged with the display sequence.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: December 15, 2020
    Assignee: ADOBE INC.
    Inventors: Max Gray Edell, David E. Benge
  • Patent number: 10867379
    Abstract: A method for optically inspecting a mold (10) for manufacturing ophthalmic lenses such as contact lenses for possible mold defects, including: generating a set of images of the mold (10) for different azimuthal illumination angles (?1, ?9) using an illumination system (20) and an imaging system (30), the latter being aligned such that its focal plane cuts through the mold (10) at a specific axial position along a center axis of the mold (10); generating a focal plane image by averaging pixelwise over the set of images after having masked out in each image those regions that include direct specular reflections from the mold (10); repeating the previous steps for one or a plurality of different axial positions of the focal plane such as to generate a plurality of different focal plane images; identifying one or more image features in the plurality of focal plane images indicative for a possible mold defect; determining for each identified image feature in which focal plane image the identified image feature app
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: December 15, 2020
    Assignee: Alcon Inc.
    Inventors: Fabian Etzold, Arno Florian Warken, Daniel Kiefhaber, Giovanni Campanelli