Using Photodetector Patents (Class 351/210)
  • Patent number: 9805516
    Abstract: A 3D holographic virtual object display controlling method and apparatus based on human-eye tracking are provided. The display controlling method comprises the following steps of: activating tracking of human eyes of a user; tracking motions of eyeballs of the user; controlling a 3D holographic virtual object presented in a display interface to rotate in response to the motions of the eyeballs of the user; and ending up the tracking of the human eyes of the user. Thereby, the present disclosure can control rotation of a 3D holographic virtual object presented in a display interface by tracking eyeballs and in response to the motions of the eyeballs, which makes the operations convenient and easy.
    Type: Grant
    Filed: January 13, 2015
    Date of Patent: October 31, 2017
    Assignee: SHENZHEN MAGIC EYE TECHNOLOGY CO., LTD.
    Inventors: Meihong Liu, Yihua Chen
  • Patent number: 9792710
    Abstract: A display device includes an image display section adapted to display an image so as to be able to be visually recognized together with an outside view, a camera, and a control section adapted to process taken image data of the camera, and the control section selects a mode as a processing condition, which corresponds to whether or not display is performed in the image display section based on taken image data, to process the taken image data.
    Type: Grant
    Filed: December 16, 2015
    Date of Patent: October 17, 2017
    Assignee: Seiko Epson Corporation
    Inventor: Fusashi Kimura
  • Patent number: 9778020
    Abstract: Efficient interferometer designs for optical coherence tomography (OCT) systems are presented. One example interferometer design includes two polarization dependent beamsplitters and a non-polarization dependent combiner. The first polarization dependent beamsplitter transmits light in a first polarization state to a sample arm of the OCT system and transmits light in a second polarization state different from the first polarization state to a reference arm of the system. The second polarization dependent beamsplitter transmits light returning from a sample to the non-polarization dependent combiner. The combiner combines light returned from the sample and the light that has passed through the reference arm, which is then detected at a detector. Another example interferometer design includes free space optics comprising a non-reciprocal beamsplitting element in a beam path from a light source to a sample.
    Type: Grant
    Filed: May 19, 2016
    Date of Patent: October 3, 2017
    Assignee: CARL ZEISS MEDITEC, INC.
    Inventors: Alexandre R. Tumlinson, Matthew J. Everett
  • Patent number: 9775512
    Abstract: A system for tracking the 3D position and gaze angles of the eyes over their full range of movement in space relative to a camera or relative to the head without the need for calibration or specialized image aquisition equipment. The eyes are tracked on the basis of surface features in relation to a geometrical 3D model of the eyes by means of a standard consumer device for recording the sequence of face images in conjunction with computing capability. The resultant eye positions and pupil diameters are used to control the information on a viewing screen or in another device. The system further allows for deriving the angular trajectories of the eye movements and for fitting model functions of these trajectories to characterize the degree of normality and deviation from normality of the binocular eye movement parameters.
    Type: Grant
    Filed: March 19, 2015
    Date of Patent: October 3, 2017
    Inventors: Christopher W. Tyler, Spero C. Nicholas, Lora T. Likova
  • Patent number: 9773169
    Abstract: The invention provides an image capture system, apparatus and method for capturing a biometric image in high ambient light environments. Reflections from ambient light can introduce unwanted environmental pattern noise that can interfere with extracting information from a captured biometric image. The invention performs attenuation of ambient light without requiring employment of shielding to prevent ambient light from reflecting off of a surface being imaged. As a result, the invention can be deployed into environments with varied indoor or outdoor lighting characteristics.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: September 26, 2017
    Assignee: CROSS MATCH TECHNOLOGIES, INC.
    Inventors: Christopher R. Fulmer, George W. McClurg, John M. Burgan, James L. Cambier, Donald E. Russ, Daniel H. Raguin
  • Patent number: 9770168
    Abstract: A device is for imaging an eye and is wearable on the object to be examined or otherwise able to be placed to the front of an eye or eyes. When the device is switched on, it automatically performs the imaging such that all images are useful. The device comprises a camera arrangement with optics and a camera sensor, and an illumination arrangement. The device comprises a control arrangement that switches the camera arrangement to take automatically one or more images of the eye, when the device is in front of the eye. The device comprises an image analyzing arrangement or a connection to an image analyzing arrangement that is provided for detecting a reflection in the image taken by the camera arrangement or in the image area of the camera arrangement and for transmitting the information about the detected reflection to the control arrangement which is provided thereby to repeat or decline imaging. When repeating the imaging the control arrangement alters the parameters of imaging.
    Type: Grant
    Filed: September 12, 2013
    Date of Patent: September 26, 2017
    Assignee: Trividi Oy
    Inventors: Petri Pohjanen, Nora Kaarela, Jukka Alasirnio
  • Patent number: 9747497
    Abstract: The present invention is a method and system for rating in-store media elements based on the measurement for behavior patterns and demographics of the audience in the vicinity of the media element, where a plurality of input images of the audience are captured by at least a means for capturing images in the vicinity of the media element. The input images are processed by automated video analytic algorithms in order to measure the behavior patterns and demographics of each person in the audience tied to the media element. The measurements for the behavior patterns and demographics of the audience from the target media elements are aggregated. A set of ratings for the media element is calculated based on the measurements. The measured media elements are sampled, and the audience measurement for the sample is extrapolated to other media elements for in-store locations or for a group of stores. The ratings are converted into a standardized output.
    Type: Grant
    Filed: April 21, 2009
    Date of Patent: August 29, 2017
    Assignee: VideoMining Corporation
    Inventors: Rajeev Sharma, Varij Saurabh, Namsoon Jung
  • Patent number: 9736373
    Abstract: Technologies for power optimization of light sources include an imaging device to generate a captured image of a subject. The imaging device analyzes the captured image to determine, in the captured image, a location of the subject's eye relative to the imaging device, an iris-pupil contrast of the subject's eye, and a glint intensity of glints present on the subject's eye. The imaging device determines, for each of a plurality of light sources, an illumination efficiency based on a distance between the camera and the subject's eye, a distance between the light source and the subject's eye, an incidence angle of the light source relative to the subject's eye, and a power profile of the light source. The imaging device determines an amount of power to supply to each light source to reduce a total cumulative power supplied to the light sources based on one or more power constraints.
    Type: Grant
    Filed: October 25, 2013
    Date of Patent: August 15, 2017
    Assignee: Intel Corporation
    Inventor: Nizan Horesh
  • Patent number: 9733703
    Abstract: A system and method are provided for performing eye gaze tracking. The system is configured for and the method comprises optimizing illumination of a scene for a single on-axis imaging apparatus, capturing an image using the single on-axis imaging apparatus under the optimized illumination, and processing the captured image to perform a gaze estimation. Dynamic illumination control, eye candidate detection and filtering, and gaze estimation techniques are also provided.
    Type: Grant
    Filed: February 19, 2015
    Date of Patent: August 15, 2017
    Assignee: Mirametrix Inc.
    Inventor: Nicholas J. Sullivan
  • Patent number: 9734510
    Abstract: Systems and methods for assessing human reaction to a stimulus using computer vision are described herein. A computer can compare a first facial image with a second facial image to identify a region of a subject's face where an expressional repositioning is evident. Based on the expressional repositioning, the computer can determine an emotion exhibited by the subject.
    Type: Grant
    Filed: July 11, 2012
    Date of Patent: August 15, 2017
    Assignee: Sensory Logic, Inc.
    Inventor: Daniel A. Hill
  • Patent number: 9723979
    Abstract: A method, an apparatus and a computer program product for positioning pupil are provided. A pupil contour is obtained from a pupil image after the pupil image is obtained. And an ellipse feature is obtained according to curvature information of the pupil contour, and then a sight direction is determined according to the ellipse feature.
    Type: Grant
    Filed: October 23, 2014
    Date of Patent: August 8, 2017
    Assignee: UTECHZONE CO., LTD.
    Inventors: Chia-Chun Tsou, Po-Tsung Lin
  • Patent number: 9727136
    Abstract: Examples relating calibrating an estimated gaze location are disclosed. One example method comprises monitoring the estimated gaze location of a viewer using gaze tracking data from a gaze tracking system. Image data for display via a display device is received and, without using input from the viewer, at least one target visual that may attract a gaze of the viewer and a target location of the target visual are identified within the image data. The estimated gaze location of the viewer is compared with the target location of the target visual. An offset vector is calculated based on the estimated gaze location and the target location. The gaze tracking system is calibrated using the offset vector.
    Type: Grant
    Filed: May 19, 2014
    Date of Patent: August 8, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Weerapan Wilairat, Vaibhav Thukral, David Nister, Morgan Kolya Venable, Bernard James Kerr, Chris Aholt
  • Patent number: 9713420
    Abstract: An ophthalmic apparatus for precisely positioning an optical instrument, such as a wavefront aberrometer, in three dimensions with respect to a patient's eye. The ophthalmic apparatus may include an optical instrument directed in a first direction toward a target area to receive light therefrom and a camera directed in a second direction toward the target area to receive light therefrom, the first and second directions being non-parallel. The camera may include imaging optics to form an optical image on a photodetector array using light reflected from the target area. The ophthalmic apparatus may also include a processor configured to correlate a position of the optical image on the photodetector array with the distance between the optical instrument and the target area.
    Type: Grant
    Filed: September 14, 2012
    Date of Patent: July 25, 2017
    Assignee: Novartis AG
    Inventors: Richard J. Michaels, Max Hall, Diego Cueto, T. Scott Rowe, Thomas Padrick
  • Patent number: 9715781
    Abstract: A system and method is disclosed for calibrating the location of a player's gaze at a video display of a gaming machine. The system and method includes capturing images of the player's gaze with a camera while displaying a plurality of reference symbols at locations on the display during serial display of game video content. Also, a processor creates control signals that represent the direction of the player's gaze relative to the location of the plurality of symbols on the display of the gaming machine. The processor develops a data set based on the control signals and the locations of the plurality of reference symbols to develop a data set. Further, the system and method includes calibrating the location of the player's gaze using the data set with the location s of the plurality of reference symbols on the display.
    Type: Grant
    Filed: September 26, 2014
    Date of Patent: July 25, 2017
    Assignee: Bally Gaming, Inc.
    Inventors: Martin S. Lyons, Bryan M. Kelly
  • Patent number: 9700203
    Abstract: A handheld testing device includes a focus light source, which can serve as a focal point for a subject being tested for nystagmus, and multiple timers, which can be used to control tactile and other feedback indications. The timers can include an Equal Tracking (ET) timer and Smooth Pursuit (SP) timer, each of which controls a series of tactile feedback indications that can assist a user in properly performing ET and SP portions of a Horizontal Gaze Nystagmus test. Other test timers configured to generate feedback indications for use in various medical examinations and drug evaluations are also included. The handheld device can include multiple light sources in addition to the focus light source, for example an ultra-violet (UV) source or a white light source. Various fixed interval timers can also be included in the handheld testing device.
    Type: Grant
    Filed: May 29, 2015
    Date of Patent: July 11, 2017
    Assignee: ToxOptix, LLC
    Inventor: Royger Harris
  • Patent number: 9696800
    Abstract: A menu selection apparatus using gaze tracking includes: a gaze tracker configured to track a gaze of a driver and to output time series gaze data; a timer included in the gaze tracker and configured to output a timing pulse; a buffer configured to store the time series gaze data; a counter configured to count the timing pulse to adjust synchronization with the timer; a button configured to output a click signal when being clicked by the driver; and a controller configured to extract the time series gaze data for a critical time based on button click timing as the click signal is output from the button and to then calculate an average of gaze vectors within each time series gaze data.
    Type: Grant
    Filed: March 26, 2015
    Date of Patent: July 4, 2017
    Assignee: Hyundai Motor Company
    Inventor: Il Yong Yoon
  • Patent number: 9655507
    Abstract: A corneal imaging device provided with an optical system for photographing a corneal portion of an eye, the optical system including an illumination optical system configured to irradiate illumination light toward a cornea and a light receiving optical system placed in a position inclined with respect to an optical axis of the illumination optical system configured to receive reflection light from the cornea by a photodetector, wherein the corneal imaging device includes light-limiting means provided in an optical path of the optical system for photographing the corneal portion of the eye and configured to limit light asymmetrically with respect to an optical axis.
    Type: Grant
    Filed: November 1, 2012
    Date of Patent: May 23, 2017
    Assignee: NIDEK CO., LTD.
    Inventor: Michihiro Takii
  • Patent number: 9652893
    Abstract: Embodiments are described herein for determining a stabilization plane to reduce errors that occur when a homographic transformation is applied to a scene including 3D geometry and/or multiple non-coplanar planes. Such embodiments can be used, e.g., when displaying an image on a head mounted display (HMD) device, but are not limited thereto. In an embodiment, a rendered image is generated, a gaze location of a user is determined, and a stabilization plane, associated with a homographic transformation, is determined based on the determined gaze location. This can involve determining, based on the user's gaze location, variables of the homographic transformation that define the stabilization plane. The homographic transformation is applied to the rendered image to thereby generate an updated image, and at least a portion of the updated image is then displayed.
    Type: Grant
    Filed: April 29, 2014
    Date of Patent: May 16, 2017
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Ashraf Ayman Michail, Roger Sebastian Kevin Sylvan, Quentin Simon Charles Miller, Alex Aben-Athar Kipman
  • Patent number: 9646207
    Abstract: At least one image registering unit records at least one series of images representing a subject. A control unit controls an operation sequence for the at least one image registering unit in such a manner that a subsequent data processing unit receives a repeating sequence of image frames there from, wherein each period contains at least one image frame of a first resolution and at least one image frame of a second resolution being different from the first resolution. Based on the registered image frames, the data processing unit produces eye/gaze tracking data with respect to the subject.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: May 9, 2017
    Assignee: TOBII AB
    Inventors: Mattias Kuldkepp, Marten Skogo, Mattias Hanqvist, Martin Brogren, Dineshkumar Muthusamy
  • Patent number: 9596983
    Abstract: Methods and systems for tracking a position and torsional orientation of a patient's eye. In one embodiment, the present invention provides methods and software for registering a first image of an eye with a second image of an eye. In another embodiment, the present invention provides methods and software for tracking a torsional movement of the eye. In a particular usage, the present invention tracks the torsional cyclorotation and translational movement of a patient's eye so as to improve the delivery of a laser energy to the patient's cornea.
    Type: Grant
    Filed: April 22, 2014
    Date of Patent: March 21, 2017
    Assignee: AMO Manufacturing USA, LLC
    Inventor: Dimitri Chernyak
  • Patent number: 9596401
    Abstract: The invention discloses a method and a portable device for focusing an image in the device (10), which device (10) comprises; a first image recording arrangement (24a) for recording images of an user (50) of the device (10); a second image recording arrangement (24b) comprising an autofocus arrangement for recording images of the environment surrounding the device (10); and a display arrangement (22) for reproducing the recorded images of the environment surrounding the device (10), which method comprises the step of: obtaining a plurality of gazing directions of the user (50) from images recorded by the first image recording arrangement (24a); selecting focusing areas depending on the obtained gazing directions; processing said at least one image of the environment so as to create a final image that is focused within areas defined by the focusing areas.
    Type: Grant
    Filed: June 27, 2014
    Date of Patent: March 14, 2017
    Assignees: Sony Corporation, Sony Mobile Communication AB
    Inventor: Ola Thorn
  • Patent number: 9594488
    Abstract: Implementations generally relate to providing an interactive display of high dynamic range images. In some implementations, a method includes receiving a plurality of images of a scene, where the images are captured at different exposure levels. The method further includes generating a high dynamic range image of the scene based on brightness level information associated with each portion of the scene. The method further includes providing a user interface that displays the high dynamic range image. The method further includes adjusting a brightness level of at least one portion of the high dynamic range image based on user interaction with the user interface.
    Type: Grant
    Filed: December 12, 2013
    Date of Patent: March 14, 2017
    Assignee: Google Inc.
    Inventors: Thomas Deselaers, Daniel Martin Keysers
  • Patent number: 9572371
    Abstract: The embodiments and methods described are directed to a solid-state laser module having a first end, a second end, and a surface between the first end and the second end. A mounting component is placed in communication with at least a portion of the surface of the laser module for selectively securing the laser module to a chamber wall of a chamber.
    Type: Grant
    Filed: August 23, 2011
    Date of Patent: February 21, 2017
    Inventor: Forrest Landry
  • Patent number: 9563993
    Abstract: Methods and systems are provided for checking authorization of users. A first electronic device may receive via close range contactless communication, photographic identification data associated with a user of a second electronic device. The photographic identification data may be displayed visually to enable a user of the first electronic device to compare an appearance of the user of the second electronic device for verifying authorization data associated with the user of the second electronic device. The displaying of the photographic identification data may be controlled based on input by the user of the first electronic device, wherein the controlling comprises modifying at least a portion of a displayed image corresponding to the photographic identification data.
    Type: Grant
    Filed: November 7, 2014
    Date of Patent: February 7, 2017
    Assignee: SWISSCOM AG
    Inventor: Rudolf Ritter
  • Patent number: 9557812
    Abstract: A software controlled user interface and calibration method for an eye gaze controlled device, designed to accommodate angular accuracy versus time averaging tradeoffs for eye gaze direction sensors. The method can scale between displaying a small to large number of different eye gaze target symbols at any given time, yet still transmit a large array of different symbols to outside devices with minimal user training. At least part of the method may be implemented by way of a virtual window onto the surface of a virtual cylinder, with eye gaze sensitive symbols that can be rotated by eye gaze thus bringing various groups of symbols into view, and then selected by continual gazing. Specific examples of use of this interface and method on an eyeglasses-like head-mountable, vision-controlled, device are disclosed, along with various operation examples including sending and receiving text messages, control of robotic devices and control of remote vehicles.
    Type: Grant
    Filed: October 29, 2013
    Date of Patent: January 31, 2017
    Inventor: Gregory A. Maltz
  • Patent number: 9554696
    Abstract: Systems and methods for measuring dysphotopsia are provided. These systems and methods can be used to objectively quantify positive and negative dysphotopsia. One embodiment provides a system and method for determining dysphotopsia that uses a first light source configured to provide light energy to illuminate a model eye, a refractor for refracting the light energy from the first light source and directing it into the model eye, a first electronic light sensor for measuring an amount of light in the model eye; a second light source configured to provide light energy to illuminate the model eye, wherein the light energy from the second light source is introduced at an angle from the first light source; and a second electronic light sensor for measuring the amount of light in the model eye, wherein the second electronic light sensor is capable of taking measurements from various points around the model eye. Data from these measurements can then analyzed to provide an objective measurement of dysphotopsia.
    Type: Grant
    Filed: November 26, 2014
    Date of Patent: January 31, 2017
    Assignee: Abbott Medical Optics Inc.
    Inventors: Huawei Zhao, Mihai State, Luuk Franssen, Patricia Ann Piers, Hendrik A. Weeber, Marrie Van Der Mooren
  • Patent number: 9549671
    Abstract: Improved optical coherence tomography (OCT) imaging systems are generally described. In an example, an OCT imaging system includes a tunable laser source, an interferometer, a splitter, and a detector. The tunable laser source is configured to provide a wavelength-scanned beam. The interferometer is configured to split the wavelength-scanned beam into a reference beam and an object beam. The splitter is configured to split the object beam into a first path corresponding to an anterior chamber imaging component and a second path corresponding to a retinal imaging component. The detector is configured to detect a signal caused by interference between the reference beam and at least a portion of the object beam reflected from the eye.
    Type: Grant
    Filed: January 21, 2015
    Date of Patent: January 24, 2017
    Assignee: SANTEC CORPORATION
    Inventor: Changho Chong
  • Patent number: 9545567
    Abstract: An apparatus and method for processing a virtual world. According to certain embodiments of the present disclosure, real-world biometric information on the user may be collected using a bio sensor, and the collected information may be controlled based on the sensor characteristics of the bio sensor, thereby enabling interaction between the real world and the virtual world, as well as between virtual worlds. In addition, an interactive game which is executed in the virtual world on the basis of the collected biometric information may be controlled to thereby produce a virtual world having enhanced realism. Moreover, the real-world health status of a user may be determined and displayed on the basis of the collected biometric information, thereby enabling the health status of the user to be seen.
    Type: Grant
    Filed: June 14, 2011
    Date of Patent: January 17, 2017
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seung Ju Han, Jae Joon Han, Won Chul Bang, Do Kyoon Kim
  • Patent number: 9538219
    Abstract: An interest degree estimating device, which estimates a degree of interest of a user in a video displayed on a screen, includes: an eye gaze detecting unit for detecting an eye gaze direction of the user; a saliency information obtaining unit for obtaining saliency information on a saliency area having salient attractiveness in the video; and a user response analyzing unit for calculating a correlation between the saliency area specified from the obtained saliency information and the detected eye gaze direction, and estimate the degree of interest of the user in the video, the degree of interest being higher as the calculated correlation is higher.
    Type: Grant
    Filed: January 26, 2012
    Date of Patent: January 3, 2017
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Kotaro Sakata, Shigenori Maeda, Ryo Yonetani, Hiroaki Kawashima, Takatsugu Hirayama, Takashi Matsuyama
  • Patent number: 9532709
    Abstract: According to one or more embodiments, the processes and systems disclosed allow a user of a mobile device to determine their distance from an object. The object may be an image of a pattern having a known size. The image may be displayed on a computer screen or other suitable medium such as a printed sheet. According to one or more embodiments, the disclosed processes and systems aid in determining or guiding a user to a distance at which an eye examination is conducted.
    Type: Grant
    Filed: June 5, 2015
    Date of Patent: January 3, 2017
    Assignee: JAND, INC.
    Inventors: Joseph Carrafa, Molly Rhodes
  • Patent number: 9525863
    Abstract: Imaging apparatus includes an image sensor, which acquires an image of a scene, and a scanner, which includes an optical transmitter, which emits a sequence of optical pulses toward the scene, and an optical receiver, which receives the optical pulses reflected from the scene and generates an output indicative of respective times of flight of the pulses. Scanning optics are configured to scan the optical pulses over the scene in a scan pattern that covers and is contained within a non-rectangular area within the scene. A processor identifies an object in the image of the scene, defines the non-rectangular area so as to contain the identified object, and processes the output of the optical receiver so as to extract a three-dimensional (3D) map of the object.
    Type: Grant
    Filed: April 29, 2015
    Date of Patent: December 20, 2016
    Assignee: APPLE INC.
    Inventors: Jawad Nawasra, Scott T. Smith
  • Patent number: 9475242
    Abstract: An eyeglass lens processing apparatus includes a lens chuck unit that holds an eyeglass lens; a processing unit that has a processing tool to process the eyeglass lens held by the lens chuck unit; and an adjustment unit that adjusts a relative distance between the eyeglass lens and the processing tool. The eyeglass lens processing apparatus operates the processing unit and processes the eyeglass lens by operating the adjustment unit based on processing data. The eyeglass lens processing apparatus includes a check unit that checks whether or not the eyeglass lens is properly processed in a state where the eyeglass lens is held by the lens chuck unit.
    Type: Grant
    Filed: March 28, 2014
    Date of Patent: October 25, 2016
    Assignee: NIDEK CO., LTD.
    Inventors: Tadamasa Yamamoto, Motoshi Tanaka, Hirokatsu Obayashi
  • Patent number: 9468373
    Abstract: Aspects of the present disclosure relate to eye tracking systems and methods which track eyes by illuminating the eyes using a light source and detecting the eye illuminations using a sensor. Implementations of the present disclosure may utilize a light source with a dynamic lighting position to account for changes in lighting conditions during the tracking which interfere with detection of the eye illuminations, such as reflections in glasses which may obscure a user's eyes.
    Type: Grant
    Filed: September 23, 2014
    Date of Patent: October 18, 2016
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Eric J. Larsen
  • Patent number: 9473696
    Abstract: A gaze detection apparatus includes a light source which illuminates a user's eye, an imaging unit which generates an image by capturing the image of a user's face, and a processor adapted to: estimate a distance between the imaging unit and the user's face; calculate the ratio of the distance between the imaging unit and the user's face to a separation distance between the imaging unit and the light source and determine, based on the ratio, whether a bright pupil phenomenon occurs; detect from the captured image a corneal reflection image of the light source and a center of the user's pupil when determining that the bright pupil phenomenon does not occur; and detect the user's gaze direction or gaze position based on a positional relationship between the center of the user's pupil and the corneal reflection image when determining that the bright pupil phenomenon does not occur.
    Type: Grant
    Filed: July 22, 2013
    Date of Patent: October 18, 2016
    Assignee: FUJITSU LIMITED
    Inventors: Takuya Kamimura, Hiroyasu Yoshikawa
  • Patent number: 9471763
    Abstract: A system determines which user of multiple users provided input through a single input device. A mechanism captures images of the one or more users. When input is detected, the images may be processed to determine which user provided an input using the input device. The images may be processed to identify each users head and eyes, and determine the focus point for each user's eyes. The user which has eyes focused at the input location is identified as providing the input. When the input mechanism is a touch screen, the user having eyes focused on the touch screen portion which was touched is identified as the source of the input.
    Type: Grant
    Filed: May 4, 2012
    Date of Patent: October 18, 2016
    Assignee: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
    Inventor: Chris Norden
  • Patent number: 9443144
    Abstract: Methods and systems for measuring group behavior are provided. Group behavior of different groups may be measured objectively and automatically in different environments including a dark environment. A uniform visible signal comprising images of members of a group may be obtained. Facial motion and body motions of each member may be detected and analyzed from the signal. Group behavior may be measured by aggregating facial motions and body motions of all members of the group. A facial motion such as a smile may be detected by using the Fourier Lucas-Kanade (FLK) algorithm to register and track faces of each member of a group. A flow-profile for each member of the group is generated. Group behavior may be further analyzed to determine a correlation of the group behavior and the content of the stimulus. A prediction of the general public's response to the stimulus based on the analysis of the group behavior is also provided.
    Type: Grant
    Filed: November 14, 2013
    Date of Patent: September 13, 2016
    Assignee: Disney Enterprises, Inc.
    Inventors: Patrick Lucey, Rajitha Navarathna, Peter Carr, Daniel Candela, Iain Matthews
  • Patent number: 9411416
    Abstract: The present invention relates to a method for operating a computer device with user's eye movement. The method comprises the steps of detecting the user's eye movement, analyzing the user's eye movement to specify an eye movement pattern in the detected user's eye movement and a time period for completing the eye movement pattern, determining a command associated with a combination of the eye movement pattern and the time period and operating the device according to the command.
    Type: Grant
    Filed: June 24, 2011
    Date of Patent: August 9, 2016
    Inventors: Wenjuan Song, Jianping Song, Lin Du
  • Patent number: 9390326
    Abstract: A system mounted within eyewear or headwear to unobtrusively produce and track reference locations on the surface of one or both eyes of an observer is provided to improve the accuracy of gaze tracking. The system utilizes multiple illumination sources and/or multiple cameras to generate and observe glints from multiple directions. The use of multiple illumination sources and cameras can compensate for the complex, three-dimensional geometry of the head and the significant anatomical variations of the head and eye region that occurs among individuals. The system continuously tracks the initial placement and any slippage of eyewear or headwear. In addition, the use of multiple illumination sources and cameras can maintain high-precision, dynamic eye tracking as an eye moves through its full physiological range.
    Type: Grant
    Filed: December 31, 2014
    Date of Patent: July 12, 2016
    Assignee: EYEFLUENCE, INC.
    Inventors: Nelson G. Publicover, William C. Torch, Christopher N. Spitler
  • Patent number: 9386921
    Abstract: A miniature eye tracking system is disclosed that includes a camera, a microelectromechanical (MEMS) device, and a processor. The camera images an eye. The MEMS device controls the view-direction of the camera. The processor receives an image of the eye from the camera, determines the location of the eye within the camera image, and controls the MEMS to keep the camera pointed at the eye. In another embodiment, the MEMS device controls an adjustable focus of the camera. The processor determines the focus condition of the eye image, and controls the MEMS device to maintain a desired focus condition of the camera on the eye. In another embodiment, the MEMS device controls an adjustable camera zoom. The processor determines the size of the eye image within the overall camera image, and controls the MEMS to maintain a desired size of the eye image within the overall camera image.
    Type: Grant
    Filed: February 28, 2015
    Date of Patent: July 12, 2016
    Assignee: LC Technologies, Inc.
    Inventor: Dixon Cleveland
  • Patent number: 9372605
    Abstract: The method and apparatus object of this invention refer to a system for using generic software applications by means of ocular control characterized by simple interaction techniques which minimize the cognitive effort of the user required to manipulate the software and which permit to overcome the problems resulting from the intrinsic problem of accuracy of eye-tracking systems. Indeed, such technique does not provide using the pointer of the mouse moved by means of the gaze to control the various software applications but to use a separate application which through the use of suitable interaction techniques is comfortable and does not involve an increased effort of concentration by the user. An attempt has indeed been made to simplify the process of interaction between the user and machine also by means of the use of visual feedback which allows the same operations of the mouse to be performed by the user without the typical user frustration due to the problems of accuracy of the eye-tracking device.
    Type: Grant
    Filed: September 13, 2010
    Date of Patent: June 21, 2016
    Assignee: SR LABS S.R.L.
    Inventor: Paolo Invernizzi
  • Patent number: 9367960
    Abstract: Embodiments are disclosed that relate to placing virtual objects in an augmented reality environment. For example, one disclosed embodiment provides a method comprising receiving sensor data comprising one or more of motion data, location data, and orientation data from one or more sensors located on a head-mounted display device, and based upon the motion data, determining a body-locking direction vector that is based upon an estimated direction in which a body of a user is facing. The method further comprises positioning a displayed virtual object based on the body-locking direction vector.
    Type: Grant
    Filed: May 22, 2013
    Date of Patent: June 14, 2016
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Adam G. Poulos, Tony Ambrus, Jeffrey Cole, Ian Douglas McIntyre, Stephen Latta, Peter Tobias Kinnebrew, Nicholas Kamuda, Robert Pengelly, Jeffrey C. Fong, Aaron Woo, Udiyan I. Padmanahan, Andrew Wyman MacDonald, Olivia M. Janik
  • Patent number: 9361705
    Abstract: Methods and systems for measuring group behavior are provided. Group behavior of different groups may be measured objectively and automatically in different environments including a dark environment. A uniform visible signal comprising images of members of a group may be obtained. Facial motion and body motions of each member may be detected and analyzed from the signal. Group behavior may be measured by aggregating facial motions and body motions of all members of the group. A facial motion such as a smile may be detected by using the Fourier Lucas-Kanade (FLK) algorithm to register and track faces of each member of a group. A flow-profile for each member of the group is generated. Group behavior may be further analyzed to determine a correlation of the group behavior and the content of the stimulus. A prediction of the general public's response to the stimulus based on the analysis of the group behavior is also provided.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: June 7, 2016
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Patrick Lucey, Rajitha Navarathna, George Carr, Daniel Candela, Iain Matthews
  • Patent number: 9354445
    Abstract: Example methods and systems determine a position of a portion of a human eye based on electromagnetic radiation reflected from the surface of the human eye. A sensor associated with a computing device can be calibrated in response to an event. The computing device can receive data indicative of electromagnetic radiation reflected from a human eye. The computing device can determine a position of a portion of the human eye based on the received data indicative of electromagnetic radiation. The computing device can generate an indication including the position of the portion of the human eye. The computing device can transmit the indication from the computing device. In some embodiments, the data indicative of electromagnetic information can be provided by electromagnetic emitter/sensors mounted on a wearable computing device directed toward a human eye of a wearer of the wearable computing device.
    Type: Grant
    Filed: August 31, 2012
    Date of Patent: May 31, 2016
    Assignee: Google Inc.
    Inventors: Joshua Weaver, Thad Eugene Starner, Cliff L. Biffle, Edward Allen Keyes
  • Patent number: 9355314
    Abstract: Head-mounted display apparatus and login method thereof are provided. The head-mounted display apparatus includes an image capturing device, a pico-projector, an application specific integrated circuit (ASIC), and an application processor. The image capturing device captures a first eye image and a plurality of second eye images corresponding to a locus image. The ASIC determines whether the first eye image passes an iris recognition test. The application processor controls a pico-projector to project the locus image when the first eye image passes an iris recognition test, and generates a pupil locus based on the plurality of second eye images. The application processor determines whether the pupil locus is compliant with the locus image, and allows a login request if the pupil locus is compliant with the locus image.
    Type: Grant
    Filed: January 27, 2014
    Date of Patent: May 31, 2016
    Assignee: QUANTA COMPUTER INC.
    Inventor: Wen-Chu Yang
  • Patent number: 9348139
    Abstract: The present invention provides an open-type head mount display device and a display method thereof. The open-type head mount display device according to the present invention comprises a display unit for generating display images; a focusing lens unit for adjusting the object distance of a display image from a user's eye; an image acquisition unit for acquiring the image of the two eyes of the user; a focal distance analyzing unit for obtaining the focal distance of the user's eye according to the image of the two eyes of the user; and a lens adjusting unit for adjusting the position of the focusing lens unit in the light ray propagation direction of the display image according to a control command from the analyzing unit, so that the object distance of the display image is matched with the current focal distance of the user's eye.
    Type: Grant
    Filed: November 12, 2013
    Date of Patent: May 24, 2016
    Assignee: BOE Technology Group Co., Ltd.
    Inventors: Heecheol Kim, Youngsuk Song, Seongyeol Yoo, Seungjin Choi
  • Patent number: 9332903
    Abstract: An apparatus for covering a left eye and a right eye of a human, includes: a first eye piece configured for covering a left eye of a human; and a second eye piece configured for covering a right eye of the human; wherein the first eye piece and the second eye piece are configured for preventing transmission of visible light; and wherein at least one of the first eye piece and the second eye piece comprises a region that is transparent for electromagnetic radiation with a wavelength range outside a visible range.
    Type: Grant
    Filed: September 20, 2013
    Date of Patent: May 10, 2016
    Assignee: GN Otometrics A/S
    Inventor: Thomas Geertsen
  • Patent number: 9329682
    Abstract: A head mounted display allows user selection of a virtual object through multi-step focusing by the user. Focus on the selectable object is determined and then a validation object is displayed. When user focus moves to the validation object, a timeout determines that a selection of the validation object, and thus the selectable object has occurred. The technology can be used in see through head mounted displays to allow a user to effectively navigate an environment with a multitude of virtual objects without unintended selections.
    Type: Grant
    Filed: June 18, 2013
    Date of Patent: May 3, 2016
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Brian E. Keane, Ben J. Sugden, Robert L. Crocco, Jr., Daniel Deptford, Tom G. Salter, Laura K. Massey, Alex Aben-Athar Kipman, Peter Tobias Kinnebrew, Nicholas Ferianc Kamuda
  • Patent number: 9298985
    Abstract: A head-mounted video-camera-based eye sensor system and method for measuring palpebral movement is disclosed. The system and method comprise a display that includes at least one display element responsive to palpebral movement information from the eye sensor. The system and method also comprise an electronic interface to a vehicle or powered equipment to transmit the palpebral movement information to the vehicle or powered equipment. The system and method can be used to alert the user, the vehicle, and/or the powered equipment to the fact that a person might be experiencing vertigo, motion sickness, motion intolerance, and/or spatial disorientation.
    Type: Grant
    Filed: February 4, 2014
    Date of Patent: March 29, 2016
    Inventor: Wesley W. O. Krueger
  • Patent number: 9285874
    Abstract: A method, including receiving a three-dimensional (3D) map of at least a part of a body of a user (22) of a computerized system, and receiving a two dimensional (2D) image of the user, the image including an eye (34) of the user. 3D coordinates of a head (32) of the user are extracted from the 3D map and the 2D image, and a direction of a gaze performed by the user is identified based on the 3D coordinates of the head and the image of the eye.
    Type: Grant
    Filed: February 9, 2012
    Date of Patent: March 15, 2016
    Assignee: APPLE INC.
    Inventors: Eyal Bychkov, Oren Brezner, Micha Galor, Ofir Or, Jonathan Pokrass, Amir Hoffnung, Tamir Berliner
  • Patent number: 9282887
    Abstract: Provided is a three-dimensional retina image generator that can detect, in a precise manner, the scanning position displacement during scanning of the retina with a simple configuration and, as a result, and can obtain a high-quality retinal image with a reduced influence of speckle noise therein. In order to detect the movement of retina R, the three-dimensional retina image generator has: second light source unit 210 that outputs a line beam to be imaged on retina R; positional displacement detector 220 that detects the line beam reflected from retina R and that detects the “displacement” of the scanning position during scanning of retina R; and dichroic mirror 230 that causes the line beam to propagate along the same light path as that of the object light scanning beam in inspection unit 140.
    Type: Grant
    Filed: March 19, 2013
    Date of Patent: March 15, 2016
    Assignee: UTSUNOMIYA UNIVERSITY
    Inventors: Abraham J. Cense, Roy de Kinkelder