Eye Tracking Patents (Class 396/51)
  • Patent number: 9832372
    Abstract: Aspects of present disclosure relates to a dynamic videotelephony system. In certain embodiments, dynamic videotelephony system includes a first dynamic videotelephony device for a first user group, and a second dynamic videotelephony device for a second user group, and a network connecting these two dynamic videotelephony devices for a dynamic video conference between the two user groups.
    Type: Grant
    Filed: March 18, 2017
    Date of Patent: November 28, 2017
    Inventors: Jerry L. Conway, Sr., Ming Jiang
  • Patent number: 9813597
    Abstract: The present disclosure provides a gaze tracker and a gaze tracking method. The gaze tracker includes: an image acquirer to acquire eye images of a user using two or more cameras and two or more lightings; and a gaze calculator which detects a lighting reflection point from each eye image to extract a cornea central point, detects a pupil central point from each eye image, and calculates a gaze vector. In particular, when lighting reflection points are detected from each eye image, the gaze calculator calculates vectors for connection between each lighting and a corresponding lighting reflection point and detects an intersection point between the calculated vectors. When only one lighting reflection point is detected, the gaze calculator extracts the cornea central point using distance information between a pre-stored lighting reflection point and the cornea central point and the one lighting reflection point.
    Type: Grant
    Filed: November 18, 2015
    Date of Patent: November 7, 2017
    Assignee: HYUNDAI MOTOR COMPANY
    Inventor: Seon A Kim
  • Patent number: 9635222
    Abstract: A wearable camera system includes an eyewear which includes a temple and a lens and a camera coupled to eyewear, the camera having a field of view. The wearable camera system further includes a marker coupled to the eyewear, the camera, or both, the marker positionable on or in front of the lens of the eyewear at a location such that when a wearer of the eyewear aligns the marker with a target, the field of view of the camera includes the target.
    Type: Grant
    Filed: August 21, 2015
    Date of Patent: April 25, 2017
    Assignee: PogoTec, Inc.
    Inventor: Ronald D. Blum
  • Patent number: 9621812
    Abstract: Methods and apparatus for image capturing are provided. A first camera mounted on a rear side of a mobile terminal, and a second camera mounted on a front side of a mobile terminal, are driven in an image capturing mode. A user's face is detected in a second image generated by the second camera. An alarm is generated that indicates that a first image is out of an intended image capturing area, when the user's face is not detected in the second image and when a difference is detected between the first image and a reference first image.
    Type: Grant
    Filed: November 21, 2013
    Date of Patent: April 11, 2017
    Assignee: Samsung Electronics Co., Ltd
    Inventor: Jiyoung Kang
  • Patent number: 9525817
    Abstract: In a system and a method of controlling an imaging direction and an angle of view of a camera according to an aspect of the present disclosure, infrared light may be irradiated toward pupils of eyes of a user, and a position of infrared light reflected from the pupils of the eyes of the user may be detected by a first camera to track a line of sight of the user and calculate a viewing angle of the user. In addition, an imaging direction of a second camera may coincide with the line of sight of the user and an angle of view of the second camera may coincide with the viewing angle of the user to allow an image actually viewed by the user and an image captured by the camera to coincide with each other.
    Type: Grant
    Filed: November 18, 2014
    Date of Patent: December 20, 2016
    Assignee: Samsung Electro-Mechanics Co., Ltd.
    Inventor: Chul Choi
  • Patent number: 9483480
    Abstract: Methods and systems to identify a portion of content, for each of multiple instances of content presented at a display, based on eye contact of a user, populate records of the portions of content with contextual information, and search a data field(s) of the record to identify content of interest to the user amongst the portions of content. The search may be based on a, without limitation, a user-specified application program, file type, URL, time, display position, content presented at the display prior to, concurrently with, and/or subsequent to presentation of content of interest to the user, and/or an action performed by the user prior to and/or subsequent to a time at which the content of interest to the user had been presented at the display.
    Type: Grant
    Filed: April 23, 2012
    Date of Patent: November 1, 2016
    Assignee: Intel Corporation
    Inventor: Michal Jacob
  • Patent number: 9462226
    Abstract: A management system for managing remote communication between a first communication terminal and a second communication terminal includes a transmitter that transmits first screen data to the first communication terminal to display a first screen image based on the first screen data on a first display, a receiver that receives image data including an eye image of a first user from the first communication terminal, circuitry that specifies a sightline position indicating the first user's sightline of with respect to the first screen image based on the received image data, and generates second screen data that includes sightline information indicating the first user's sightline at the specified sightline position. The transmitter transmits the second screen data to the second communication terminal operated by a second user to display a second screen image having the sightline information on the specified sightline position on a second display.
    Type: Grant
    Filed: January 7, 2016
    Date of Patent: October 4, 2016
    Assignee: Ricoh Company, Ltd.
    Inventor: Takuya Mizuhara
  • Patent number: 9414045
    Abstract: A stereo camera for measuring distance to an object using two images of the object having parallax includes an optical multiplexer to set a length of light path of each of the two images having different spectrum properties and parallax to the same length and to superimpose each of the light paths to one light path; an image capturing element to detect luminance of at least two images having different spectrum properties; an optical device to focus a superimposed image on the image capturing element; and a distance computing unit to compute distance to the object using parallax between the two images.
    Type: Grant
    Filed: February 26, 2014
    Date of Patent: August 9, 2016
    Assignee: Ricoh Company, Ltd.
    Inventor: Ryosuke Kasahara
  • Patent number: 9344673
    Abstract: An orientation of a computing device within three dimensional space can be determined. The position of a camera integrated within the device relative to the device screen. The camera can be a front facing camera or a rear facing camera. The camera can include an image sensor, a lense, and/or a shutter. A live view of a real world environment can be received from the camera and presented within the device screen within real-time. An eye guide can be simultaneously presented on the device screen to assist a user interacting with the device to focus the eyes of the user on the camera. The eye guide can be a graphical symbol and/or a text indicating a direction associated with the camera in relation to the orientation of the screen or the device. An image can be recorded within a computer readable storage medium associated with the device. The image can lack the eye guide.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: May 17, 2016
    Inventors: Brian K. Buchheit, Satesh Ramcharitar
  • Patent number: 9319582
    Abstract: Herein describes, by example, a digital image device comprising a CCD image sensor, a setting dial, a controller, and an image processor. The CCD image sensor captures a subject image and outputs image information. The setting dial accepts an input operation and outputs an operation signal including one that corresponds to the direction of the dial. The controller sets an object region that will be the object of a specific image processing process, so that at least one of a region direction and a region range for setting the object region can be changed according to an operation signal corresponding to the operation direction of the interface component. The image processor performs diorama filtering on the object region on the basis of the region direction and the region range.
    Type: Grant
    Filed: June 27, 2012
    Date of Patent: April 19, 2016
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventor: Naoya Maekawa
  • Patent number: 9313396
    Abstract: An imaging device includes an imaging unit configured to generate a moving-image signal by capturing an image of a subject formed by an imaging optical system, a focus adjustment information acquisition unit configured to acquire focus adjustment information related to human subjective focus adjustment, and a focus adjustment determination unit configured to determine behavior of the focus adjustment of the imaging unit using the focus adjustment information obtained by the focus adjustment information acquisition unit.
    Type: Grant
    Filed: October 8, 2014
    Date of Patent: April 12, 2016
    Assignee: OLYMPUS CORPORATION
    Inventor: Natsumi Koishi
  • Patent number: 9277111
    Abstract: A specific subject region is detected, and if a focus detection area that is encompassed in the specific subject region is present, focus detection is performed on that focus detection area. This makes it possible to reduce the influence of a conflict between far and near subjects and reduce the amount of time required for focus detection in an image capture apparatus and in a control method therefor, the image capture apparatus being for performing automatic focus detection based on contrast evaluation values for a plurality of focus detection areas that are each located at a fixed position and each has a fixed size.
    Type: Grant
    Filed: May 7, 2013
    Date of Patent: March 1, 2016
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masahiro Kawarada
  • Patent number: 9207761
    Abstract: The present invention relates to an eye-gaze based control device. The eye-gaze based control device of the present invention may control a control target device according to an eye-gaze point of a user. Here, the eye-gaze based control device controls the control target device by controlling a size of an image displayed to the user, thereby more precisely controlling the control target device.
    Type: Grant
    Filed: September 4, 2013
    Date of Patent: December 8, 2015
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventor: Chang-Geun Ahn
  • Patent number: 9185352
    Abstract: Systems and methods described relate to a user to providing input to a computing device using eye tracking from a mobile position. A scene camera is mounted to the user so that the system collects image information related to where the user is looking. An indication is provided on a monitor of the computing device, or other field of view, to signify the presence and location of an identifying region of the monitor or field of view. An eye camera mounted to the user collects image information of the user's eye relating to a direction of gaze of the eye. When the direction of gaze of the user's tracked eye intersects the identifying region of the monitor or field of view, suitable eye tracking methods for controlling a computing device may be used to send instructions to the computing device.
    Type: Grant
    Filed: December 21, 2011
    Date of Patent: November 10, 2015
    Inventor: Thomas Jacques
  • Patent number: 9164583
    Abstract: An apparatus for mapping a gaze point of a subject on a scene image to a gaze point in a reference image, wherein said scene image and said reference image have been taken by a camera from a different position, said apparatus comprising: A module for executing a feature detection algorithm on said reference image to identify a plurality of characteristic features and their locations in said reference image; a module for executing said feature detection algorithm on said scene image to re-identify said plurality of characteristic features and their locations in said scene image; a module for determining a point transfer mapping that transforms point positions between said scene image and said reference image based on the locations of said plurality of characteristic features detected in said reference image and said scene image; a module for using said point transfer mapping to map a gaze point which has been determined in said scene image to its corresponding point in said reference image.
    Type: Grant
    Filed: March 16, 2012
    Date of Patent: October 20, 2015
    Assignee: SENSO-MOTORIC INSTRUMENTS GESELLSCHAFT FUR INNOVATIVE SENSORIK MBH
    Inventors: Denis Williams, Jan Hoffman
  • Patent number: 9148537
    Abstract: Information regarding facial cues may be received. Such information may associated each facial cue with a responsive action. Images (e.g., photo, video) of an area in front of a computing device may be captured by a front-facing camera. A user's face may be detected, as well as determined to exhibit a facial cue. The facial cue is identified, along with its associated action. The computing device may then perform the action associated with the facial cue exhibited by the user.
    Type: Grant
    Filed: May 18, 2012
    Date of Patent: September 29, 2015
    Assignee: hopTo Inc.
    Inventor: Robert W. Currey
  • Patent number: 9129872
    Abstract: A photodiodes may be formed on a substrate such as an imager substrate. The photodiode may include first and second layers in the substrate that form a p-n junction. The first layer may have a first doping type such as p-type doping, whereas the second layer may have a second, opposite doping type such as n-type doping. A counter-doping implant region may be provided that only partially overlaps with the second layer of the photodiode. The counter-doping implant region may have an opposite doping type to the second layer and may have a dopant concentration that is less than the dopant concentration of the second layer. The counter-doping implant region may extend into a third layer of the substrate that may have the same doping type of the second layer but at a lower concentration than the counter-doping implant region.
    Type: Grant
    Filed: September 19, 2013
    Date of Patent: September 8, 2015
    Assignee: Semiconductor Components Industries, LLC
    Inventors: Xianmin Yi, Paul Perez
  • Patent number: 9105083
    Abstract: Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography.
    Type: Grant
    Filed: July 18, 2012
    Date of Patent: August 11, 2015
    Assignee: Digimarc Corporation
    Inventors: Geoffrey B. Rhoads, William Y. Conwell
  • Patent number: 9098243
    Abstract: A method for adjusting an observation distances between an user and a display device is provided. When the display device determines that the user is squinting and determines a distance value between the user and the display device is larger than a predetermined value, the display device controls a driving unit to drive a display unit of the display device to move toward to the user. A display device is also provided.
    Type: Grant
    Filed: December 30, 2013
    Date of Patent: August 4, 2015
    Assignees: HONG FU JIN PRECISION INDUSTRY (WuHan) CO., LTD., HON HAI PRECISION INDUSTRY CO., LTD.
    Inventors: Min Yang, Xin-Shu Wang, Jian-Hung Hung
  • Patent number: 9092671
    Abstract: There is provided a visual line detection device including at least one light source configured to radiate light to an eyeball of a user observing a display surface through at least one optical member, and an imaging unit configured to acquire a captured image of the eyeball used to detect a visual line of the user on the display surface by detecting reflected light of the light from the eyeball. The reflected right from the eyeball passes through at least the optical member installed in an optical path along which the light from the display surface travels from the display surface to the eyeball of the user, and is incident on the imaging unit.
    Type: Grant
    Filed: June 27, 2014
    Date of Patent: July 28, 2015
    Assignee: Sony Corporation
    Inventors: Takuro Noda, Sayaka Watanabe, Shinichi Haseno, Kenta Katagata
  • Patent number: 8926454
    Abstract: In one example, a system for fitting golf equipment for an individual can be configured to be used with an electronic device comprising a fitting processor module and a camera. The system can comprise an image analysis module configured to receive image data of at least a portion of the individual and one or more physical indicia proximate to the individual, where the image data can be captured by the camera. The image analysis module can also be configured to recognize one or more reference features of the individual from the image data, and to calculate one or more fitting dimensions between the one or more reference features in the image data. Other examples, devices, and related methods are also disclosed herein.
    Type: Grant
    Filed: May 7, 2012
    Date of Patent: January 6, 2015
    Assignee: Karsten Manufacturing Corporation
    Inventors: John K. Solheim, Roger J. Cottam
  • Publication number: 20150003819
    Abstract: Technology disclosed herein automatically focus a camera based on eye tracking. Techniques include tracking an eye gaze of eyes to determine a location at which the user is focusing. Then, a camera lens may be focused on that location. In one aspect, a first vector that corresponds to a first direction in which a first eye of a user is gazing at a point in time is determined. A second vector that corresponds to a second direction in which a second eye of the user is gazing at the point in time is determined. A location of an intersection of the first vector and the second vector is determined. A distance between the location of intersection and a location of a lens of the camera is determined. The lens is focused based on the distance. The lens could be focused based on a single eye vector and a depth image.
    Type: Application
    Filed: June 28, 2013
    Publication date: January 1, 2015
    Inventors: Nathan Ackerman, Andrew C. Goris, Bruno Silva
  • Patent number: 8886298
    Abstract: A small wearable recall device is provided to capture images triggered by a combination of a detection of a capture condition (e.g., changes in motion, temperature or light level) followed by a relatively stable period, as detected by an accelerometer. By triggering on the combination of a detected capture condition followed by a detected stability condition, a clearer image of the environment of an interesting event is expected to be captured. The small size of the recall device makes it possible to integrate it into common portable consumer products, such as MP3 players, purses, clothing, hats, backpacks, necklaces, collars, and other human-wearable products.
    Type: Grant
    Filed: March 1, 2004
    Date of Patent: November 11, 2014
    Assignee: Microsoft Corporation
    Inventors: Lyndsay Williams, Kenneth Robert Wood, Kevin Michael Schofield
  • Patent number: 8878750
    Abstract: A head mount display (HMD) device according to one embodiment comprises a camera unit configured to capture an image at a front of the HMD device, a distance obtaining unit configured to obtain a distance between the HMD device and an object in the front of the HMD device, a communication unit configured to transmit and receive data, a display unit configured to display visual information, and a processor configured to control the camera unit, the distance obtaining unit, the communication unit and the display unit, wherein the processor is further configured: to recognize a face from the image, to receive personal data corresponding to the recognized face, to obtain, from the received personal data, personal information and period from a latest date when the face was lastly recognized to a current date when the face is currently recognized, to display the personal information when the period is longer than a first threshold period, and control a quantity of the personal information to be displayed based on a
    Type: Grant
    Filed: October 31, 2013
    Date of Patent: November 4, 2014
    Assignee: LG Electronics Inc.
    Inventors: Hyorim Park, Doyoung Lee, Yongsin Kim
  • Patent number: 8811657
    Abstract: An eye tracking method for determining a position of an eye or a part of an eye in an image of an image sequence by performing a comparison between said image and a reference image, said process including: aligning a set of images; computing an enhanced reference image based on a combination of said set of aligned images; and determining said position in said image of said image sequence by comparing said image of said image sequence and said enhanced reference image to yield a motion estimation between said reference image and said image of said sequence.
    Type: Grant
    Filed: June 1, 2005
    Date of Patent: August 19, 2014
    Assignee: OD-OS GmbH
    Inventors: Winfried Teiwes, Horia Grecu
  • Patent number: 8761494
    Abstract: Disclosed are systems and methods to extract information about the size and shape of an object by observing variations of the radiation pattern caused by illuminating the object with coherent radiation sources and changing the wavelengths of the source. Sensing and image-reconstruction systems and methods are described for recovering the image of an object utilizing projected and transparent reference points and radiation sources. Sensing and image-reconstruction systems and methods are also described for rapid sensing of such radiation patterns. A computational system and method is also described for sensing and reconstructing the image from its autocorrelation. This computational approach uses the fact that the autocorrelation is the weighted sum of shifted copies of an image, where the shifts are obtained by sequentially placing each individual scattering cell of the object at the origin of the autocorrelation space.
    Type: Grant
    Filed: August 7, 2012
    Date of Patent: June 24, 2014
    Inventor: Lyle Shirley
  • Patent number: 8699870
    Abstract: A vehicular eye-controlled device having an illumination light source essentially includes a first body and a second body which are independent and separate. The first body has an electronic component disposed therein and required for operation and a photographic unit exposed therefrom for capturing an image of a driver. The second body is disposed in the vicinity of the first body and includes an illumination unit for providing illumination required for eye-controlled operation. The illumination unit and the photographic unit are separated by a distance of at least 5 cm.
    Type: Grant
    Filed: March 29, 2012
    Date of Patent: April 15, 2014
    Assignee: Utechzone Co., Ltd.
    Inventors: Po-Tsung Lin, Ming-Chen Lai, Hung-Ju Tsai, Yu-Ling Tang
  • Patent number: 8632182
    Abstract: Methods of eye gaze tracking are provided using magnetized contact lenses tracked by magnetic sensors and/or reflecting contact lenses tracked by video-based sensors. Tracking information of contact lenses from magnetic sensors and video-based sensors may be used to improve eye tracking and/or combined with other sensor data to improve accuracy. Furthermore, reflective contact lenses improve blink detection while eye gaze tracking is otherwise unimpeded by magnetized contact lenses. Additionally, contact lenses may be adapted for viewing 3D information.
    Type: Grant
    Filed: May 5, 2011
    Date of Patent: January 21, 2014
    Assignee: Sony Computer Entertainment Inc.
    Inventors: Ruxin Chen, Ozlem Kalinli
  • Patent number: 8573866
    Abstract: The present invention provides head-mounted systems and devices for capturing an image of a user's face. In particular, the present invention provides systems and devices comprising: a) a head-mounted frame component configured to be mounted on the head of a user (e.g., hat, head band, glasses, goggles, etc.) and b) an extending component that is moveable between a first position in or adjacent to the head-mounted frame component and a second position non-adjacent to the head-mounted frame component that allows a camera (or mirror) on the extending component to capture an image (e.g., picture or video) of the user's face.
    Type: Grant
    Filed: February 3, 2012
    Date of Patent: November 5, 2013
    Inventors: Jason R. Bond, David W. Staple, Michelle Bond
  • Patent number: 8523358
    Abstract: A display unit 11 has a display area of a predetermined shape and displays an image on the display area. An image capturing unit 12 generates data of a captured image by capturing an image of an eye 2 of a user in which the display area is reflected. A reference detection unit 21 detects a moving reference point that moves along with the movement of user's eye-gaze and an unmoving reference point that can be assumed as approximately stationary regardless of the user's eye-gaze movement, and generates a vector drawn from the unmoving reference point to the moving reference point as a shift amount V(x,y). An eye-gaze detection unit 22 detects a movement vector ?V(?x,?y) as the user's eye-gaze movement amount based on a reference shift amount Vo(xo,yo) generated in the past and the shift amount V(x,y) currently generated.
    Type: Grant
    Filed: December 23, 2011
    Date of Patent: September 3, 2013
    Assignee: Casio Computer Co., Ltd.
    Inventor: Tatsuya Dejima
  • Patent number: 8521017
    Abstract: A method for aligning an actuator device relative to an adjacent component, such as a rear cover of an actuator module or a stationary lens, includes disposing a plurality of radially extending tabs around an outer periphery of the actuator device, disposing a corresponding plurality of pairs of raised mounting features on a front surface of the adjacent component, each pair defining a slot having sidewalls that are complementary in configuration to respective sidewalls of corresponding ones of the tabs, and inserting respective ones of the tabs into corresponding ones of the slots.
    Type: Grant
    Filed: April 4, 2011
    Date of Patent: August 27, 2013
    Assignee: DigitalOptics Corporation MEMS
    Inventors: Robert J. Calvet, Roman C. Gutierrez, Guiqin Wang
  • Patent number: 8379073
    Abstract: A system for storing data during a video telephony call includes a portable terminal which requests data storing; a base station connected to the portable terminal and requests storing of the data to a recording server; a recording server which requests a user registration and data storing to a data management server, and transmits a message indicative of the start of the data storing to the base station; and a data management server which provides the storage of the recorded data.
    Type: Grant
    Filed: December 21, 2009
    Date of Patent: February 19, 2013
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Yun Joo Moon
  • Patent number: 8295556
    Abstract: An information processing apparatus includes a face detecting unit that detects a face area included in image data, a face-component detecting unit that detects a face component from the face area detected by the face detecting unit, and a line-of-sight discriminating unit that executes line-of-sight discrimination processing for a face image from which the face component is detected by the face-component detecting unit. The line-of-sight discriminating unit executes processing for discriminating whether a line of sight of the face image data from which the face component is detected is in a positive state in which a line of sight is directed in a camera direction or a negative state in which a line of sight is not directed in a camera direction according to collation processing for a line-of-sight discrimination dictionary in which learning data including classification data corresponding to the respective states are stored and input face image data.
    Type: Grant
    Filed: August 25, 2008
    Date of Patent: October 23, 2012
    Assignee: Sony Corporation
    Inventors: Shinya Ohtani, Atsushi Okubo
  • Patent number: 8265375
    Abstract: Disclosed are systems and methods to extract information about the size and shape of an object by observing variations of the radiation pattern caused by illuminating the object with coherent radiation sources and changing the wavelengths of the source. Sensing and image-reconstruction systems and methods are described for recovering the image of an object utilizing projected and transparent reference points and radiation sources such as tunable lasers. Sensing and image-reconstruction systems and methods are also described for rapid sensing of such radiation patterns. A computational system and method is also described for sensing and reconstructing the image from its autocorrelation. This computational approach uses the fact that the autocorrelation is the weighted sum of shifted copies of an image, where the shifts are obtained by sequentially placing each individual scattering cell of the object at the origin of the autocorrelation space.
    Type: Grant
    Filed: June 16, 2007
    Date of Patent: September 11, 2012
    Inventor: Lyle G. Shirley
  • Patent number: 8174567
    Abstract: A digital photographing apparatus is provided that reduces the number of instances in which an image including a subject having closed eyes is obtained. A method of controlling the apparatus and a computer readable medium having recorded thereon a program for executing the method are also provided. The apparatus includes an image capture device that generates data from light incident thereon, and a blink determination unit that determines whether eyes are closed in an image from the generated data. The blink determination unit performs the determination as to whether eyes are closed only on an image from first still image data obtained in response to a signal received from a user. If the blink determination unit determines that eyes are closed in an image from still image data generated by the image capture device, still image data is obtained again from light incident on the image capture device.
    Type: Grant
    Filed: December 22, 2008
    Date of Patent: May 8, 2012
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seung-yun Lee, Tae-won Moon
  • Patent number: 8123418
    Abstract: An imaging device includes an imaging unit; a display unit; an electronic finder unit that performs preview display before actual shooting based on image signals successively generated by the imaging unit; an optical finder unit having a finder window; an optical-path switching unit that performs switching between a first optical path through which light from a subject is guided to the finder window and a second optical path through which the light is guided to the imaging unit; an eye detecting unit that detects presence of an eye in a proximity of the finder window; a first control unit that performs a first control operation so that the optical-path switching unit selects the first optical path upon detection of an eye; and a second control unit that performs a second control operation so that the optical-path switching unit selects the second optical path upon non-detection of an eye.
    Type: Grant
    Filed: September 29, 2008
    Date of Patent: February 28, 2012
    Assignee: Sony Corporation
    Inventor: Shinichi Fujii
  • Patent number: 8070292
    Abstract: A viewfinder system for a camera, in particular a movie camera, in which there runs a viewfinder beam path that is diverted from a recording beam path for film exposure is provided. The viewfinder system comprising an eyepiece, an eye closure, a shutter for masking out stray light penetrating into the camera via the viewfinder system, and a control device that triggers the shutter and is connected to a sensor. The viewfinder system further comprising a sensor device for contactless detection of an eye or head, located at the eye closure of the viewfinder system, of a person viewing the picture to be recorded through the eyepiece.
    Type: Grant
    Filed: April 11, 2007
    Date of Patent: December 6, 2011
    Assignee: Arnold & Richter Cine Technik GmbH & Co. Betriebs KG
    Inventor: Klaus Jacumet
  • Patent number: 7933508
    Abstract: A camera system, including voice recognition, one or multiple microphones, gaze tracking, touch sensitive inputs and others. The voice recognition unit is operable for, among other things, receiving multiple different voice commands, recognizing the vocal commands, associating the different voice commands to one camera command and controlling some aspect of the digital camera operation in response to these voice commands. The gaze tracking unit is operable for, among other things, determining the location on the viewfinder image that the user is gazing upon and manipulating settings based on that location, possibly in conjunction with other features. One aspect of the touch sensitive inputs provides that the touch sensitive pad is mouse-like and is operable for, among other things, receiving user touch inputs to control some aspect of the camera operation. Another aspect of the system provides for gesture recognition to be used to interface with and control the camera system.
    Type: Grant
    Filed: February 22, 2010
    Date of Patent: April 26, 2011
    Inventor: Jeffrey Konicek
  • Patent number: 7912251
    Abstract: An eyelid detection apparatus includes edge image generating means for generating an edge image representing a magnitude of pixel value change per pixel in a predetermined direction in a region including an eye, based upon an image of the region; local peak value point searching means for searching a local peak value point, where the magnitude of pixel value change reaches a local peak value in the predetermined direction, in the edge image; and boundary point detecting means for detecting at least one of a first boundary point indicating a boundary between an upper eyelid and an eyeball and a second boundary point indicating a boundary between a lower eyelid and the eyeball, based upon a point which is shifted from the local peak value point in a direction towards the eyeball.
    Type: Grant
    Filed: March 12, 2008
    Date of Patent: March 22, 2011
    Assignees: Aisin Seiki Kabushiki Kaisha, Toyota Jidosha Kabushiki Kaisha
    Inventors: Tomoharu Suzuki, Jun Adachi, Shinichi Kojima, Kenichi Ohue, Yuji Ninagawa
  • Patent number: 7860382
    Abstract: A system and method are provided for obtaining a gazing direction of a user of an image-capturing device relative to an image of an object to be captured; identifying an area of the image based on the obtained gazing direction; and performing optical focusing for the identified area using an autofocus arrangement of the image-capturing device.
    Type: Grant
    Filed: October 2, 2006
    Date of Patent: December 28, 2010
    Assignee: Sony Ericsson Mobile Communications AB
    Inventor: Martin Grip
  • Patent number: 7831136
    Abstract: An ocular fundus is photographed as an electronic image via photographic stops, and the image of the photographed ocular fundus is recorded in a recording apparatus. The photographic stops are selected by moving a movable stop unit. Alignment observation or monocular photography is performed when a center photographic stop is selected. Left and right images for stereoscopic viewing are acquired when left and right photographic stops are selected. The acquired ocular fundus images are recorded in association with the position of the photographic stop used when the images were acquired. Therefore, the left image can be displayed on the left side of the monitor and the right image can be displayed on the right side by referring to the information of the photographic stop position when the left and right images for stereoscopic viewing are displayed on the monitor. This makes reliable stereoscopic viewing of the ocular fundus possible.
    Type: Grant
    Filed: July 24, 2006
    Date of Patent: November 9, 2010
    Assignee: Kowa Kabushiki Kaisha
    Inventors: Suzuki Takayoshi, Yoshizawa Itaru
  • Patent number: 7817104
    Abstract: An augmented reality apparatus and method in which the direction of a camera is adjusted to be consistent with a direction toward which a user faces and an augmented reality image is realized for a subject image incident from the adjusted camera direction. The augmented reality apparatus includes a viewing angle determination module which determines a viewing angle of a user, an image input module which receives an image of one or more subjects within the viewing angle of the user, an image synthesization module which generates a synthesized image by synthesizing the subject image with a digital image, and a display module which displays the synthesized image.
    Type: Grant
    Filed: October 13, 2006
    Date of Patent: October 19, 2010
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hee-seob Ryu, Dong-kyung Nam, Jong-ho Lea, Sang-goog Lee, Young-jin Hong
  • Patent number: 7773145
    Abstract: An auto focus unit, comprising a pursuit block, a scanning area setting block, a change area setting block, a permission block, and a lens driver, is provided. The pursuit block pursues the movements of a target object. The scanning area setting block designates a part of an object-area as a scanning area at first timing. After first timing, the scanning area setting block is able to reset the scanning area to the now location where the targeted object has moved. The change area setting block defines an area of a predetermined range as a change area at the first timing. The permission block orders the scanning area setting block to reset the scanning area when the location where the targeted object moved is outside of the change area. The lens driver orders a focus lens to move so that an optical image of the scanning area is focused on.
    Type: Grant
    Filed: February 21, 2007
    Date of Patent: August 10, 2010
    Assignee: Hoya Corporation
    Inventor: Satoru Yamaguchi
  • Patent number: 7760995
    Abstract: When a choice is made between several items offered in a first window on a display screen, a second window is displayed in front of the first window. An image of an watcher who is watching the display screen is captured to detect watcher's eye position relative to the display screen. When the watcher's eye position moves, the second window is displaced to uncover the first window in such a way that the second window moves upward in response to a downward movement of the eye position, downward in response to an upward movement of the eye position, rightward in response to a leftward movement of the eye position or leftward in response to a rightward movement of the eye position.
    Type: Grant
    Filed: February 8, 2007
    Date of Patent: July 20, 2010
    Assignee: Fujifilm Corporation
    Inventor: Hideyuki Kokubo
  • Publication number: 20100166399
    Abstract: A camera system, including voice recognition, one or multiple microphones, gaze tracking, touch sensitive inputs and others. The voice recognition unit is operable for, among other things, receiving multiple different voice commands, recognizing the vocal commands, associating the different voice commands to one camera command and controlling at least some aspect of the digital camera operation in response to these voice commands. The gaze tracking unit is operable for, among other things, determining the location on the viewfinder image that the user is gazing upon. One aspect of the touch sensitive inputs provides that the touch sensitive pad is mouse-like and is operable for, among other things, receiving user touch inputs to control at least some aspect of the camera operation. Another aspect of the disclosed invention provides for gesture recognition to be used to interface with and control the camera system.
    Type: Application
    Filed: February 22, 2010
    Publication date: July 1, 2010
    Inventor: Jeffrey C. Konicek
  • Patent number: 7747068
    Abstract: Disclosed are systems and methods for tracking the eye. In one embodiment, a method for tracking the eye includes acquiring stereo images of the eye using multiple sensors, isolating internal features of the eye in the stereo images acquired from the multiple sensors, and determining an eye gaze direction relative to the isolated internal features.
    Type: Grant
    Filed: January 20, 2006
    Date of Patent: June 29, 2010
    Inventors: Andrew Paul Smyth, Christopher Charles Smyth
  • Patent number: 7717561
    Abstract: In a sight line vector detecting system comprising: an infrared light source for illuminating either an eye or a face; a camera for photographing either the eye or the face; and a computer for processing photographed image data of said camera so as to calculate a sight line vector, the computer includes an image processing unit for detecting the true luminance point and the center of the pupil from the photographed image data; and a calculating unit for calculating the sight line vector; and the image processing unit performs such a processing operation that the image processing unit determines a luminance point capable of satisfying a predetermined requirement as the true luminance point among luminance points having the pupils at near places, calculates a center of the pupils, and further, calculates a center of a cornea ball.
    Type: Grant
    Filed: September 29, 2005
    Date of Patent: May 18, 2010
    Assignee: Honda Motor Co., Ltd.
    Inventors: Dotan Knaan, Adi Shavit, Dana Shavit, Kazufumi Suzuki, Norio Ichihashi, Akio Takahashi, Akihito Kimata
  • Patent number: 7659923
    Abstract: A system and method of eliminating closed or partially closed eyes of subject in photography, caused by subjects blinking at the moment of image capture. A digital camera is configured to capture two images in quick succession. The image processing unit of the camera identifies regions of difference between the two images that indicate that eyes are partially or fully closed in one of the two images, and creates a single composite image from the two original images, in which all eyes are open for all subjects in the image.
    Type: Grant
    Filed: June 20, 2006
    Date of Patent: February 9, 2010
    Inventor: David Alan Johnson
  • Patent number: 7643737
    Abstract: A line of sight detection apparatus includes: a line of sight detection device which detects the line of sight of an occupant; an operation detection device which detects the operation of on-board equipment by the occupant; and a calibration device which calibrates a detection value of the line of sight detection device based on the operation of the on-board equipment by the occupant which is detected by the operation detection device and position data of the on-board equipment.
    Type: Grant
    Filed: March 21, 2007
    Date of Patent: January 5, 2010
    Assignee: Honda Motor Co., Ltd.
    Inventors: Akihito Kimata, Akio Takahashi
  • Patent number: 7572008
    Abstract: When detecting the position and gaze direction of eyes, a photo sensor (1) and light sources (2, 3) placed around a display (1) and a calculation and control unit (6) are used. One of the light sources is placed around the sensor and includes inner and outer elements (3?; 3?). When only the inner elements are illuminated, a strong bright eye effect in a captured image is obtained, this resulting in a simple detection of the pupils and thereby a safe determination of gaze direction. When only the outer elements and the outer light sources (2) are illuminated, a determination of the distance of the eye from the photo sensor is made. After it has been possible to determine the pupils in an image, in the following captured images only those areas around the pupils are evaluated where the images of the eyes are located. Which one of the eyes that is the left eye and the right eye can be determined by following the images of the eyes and evaluating the positions thereof in successively captured images.
    Type: Grant
    Filed: November 21, 2003
    Date of Patent: August 11, 2009
    Assignee: Tobii Technology AB
    Inventors: John Elvesjo, Marten Skogo, Gunnar Elvers