Abstract: An electronic device includes a housing including a front cover opposite a back cover; a display viewable through the front cover; a light-bending mirror positioned between the front cover and the back cover and receiving light through one of the front cover or the back cover, the light-bending mirror redirecting received light along a light path parallel to the front cover and the back cover; a dichroic cube prism positioned in the light path, the dichroic cube prism receiving light through a first face of the dichroic cube prism, redirecting a visible light portion of the received light through a second face of the dichroic cube prism, and redirecting an infrared (IR) portion of the received light through a third face of the dichroic cube prism; a visible light image sensor positioned adjacent the second face; and an IR light image sensor positioned adjacent the third face.

Abstract: Aspects of the present disclosure are directed to a method for focusing a camera. In one embodiment, the method includes: dividing the field of view of the camera in to at least two segments: assigning, in each case, at least one operating element or at least one position of an operating element to the at least two segments; recognizing and tracking at least one object in at least two segments; automatically assigning the recognized at least two objects to the respective operating element or position of the operating element depending on which segment the objects are assigned to; and focusing the camera on the object assigned to the operating element or the position of the operating element in response to the operating element being actuated or the operating element being brought into the corresponding position.

Abstract: An electronic apparatus is provided that is capable of continuing to capture an object intended as a subject by a user before a zoom operation is started, even in a case where the subject selection based on line-of-sight detection is terminated after the zoom operation has started. The electronic apparatus comprising a line-of-sight detecting unit configured to detect a line-of-sight of a user, a zoom operating member configured to perform a zoom operation, a selecting unit configured to select a subject from an image based on the line-of-sight's position, and a control unit configured to perform control so that when the zoom operation is started by the zoom operating member, subject selection based on the line-of-sight's position is stopped without stopping line-of-sight detection performed by the line-of-sight detecting unit.

Abstract: An electronic apparatus comprises an eye approach detection unit configured to detect an objective approaching to a finder, a sight line detection unit configured to detect a sight line position to a display unit that is arranged in the finder, and a control unit configured to perform control to drive the sight line detection unit and stop driving the approach detection unit when it is detected by the approach detection unit that an objective has been approached to the finder, wherein the control unit performs control to, based on a detection result of the sight line detection unit, drive the approach detection unit from a state in which a driving of the approach detection unit is stopped, and stop driving the sight line detection unit while driving the approach detection unit.

Abstract: An imaging device includes a composite display device capable of switching between an electronic viewfinder function and a sighting device function. The composite display device includes an eye window and an object window, an organic EL panel that displays a sighting mark that is an indicator, and a photochromic mirror that is a reflective optical element for guiding the indicator to the eye window. A determination unit determines a subject, and a distance-measuring unit measures a distance to the subject. A body control unit controls the organic EL panel, and a photochromic mirror control unit controls a state and a shape of the photochromic mirror. The body control unit performs control for adjusting the projected position of the sighting mark on the basis of distance information of the subject.

Abstract: An imaging apparatus including a first sensor configured to image an optical subject image incident via a first lens unit includes a display panel, an eyepiece portion, a second sensor configured to image an eye of a user viewing the display panel by looking into the eyepiece portion, the second sensor being different from the first sensor, an optical path split unit configured to guide light from the display panel to outside the imaging apparatus and to guide external light to the second sensor, and a second lens unit disposed between the optical path split unit and the eyepiece portion, wherein the second sensor is disposed at a different side from a side where a grip region of the imaging apparatus is disposed with respect to an optical axis of the second lens unit.

Abstract: An adjustable-focus PV (picture/video) camera in a mixed-reality head-mounted display (HMD) device operates with an auto-focus subsystem that is configured to be triggered based on location and motion of a user's hands to reduce the occurrence of auto-focus hunting during camera operations. The HMD device is equipped with a depth sensor that is configured to capture depth data from the surrounding physical environment to detect and track the user's hand location, movements, and gestures in three-dimensions. The hand tracking data from the depth sensor may be assessed to determine hand characteristics—such as which of the user's hands or part of a hand is detected, its size, motion, speed, etc.—within a particular region of interest (ROI) in the field of view of the PV camera. The auto-focus subsystem uses the assessed hand characteristics as an input to control auto-focus of the PV camera to reduce auto-focus hunting occurrences.

Abstract: The present disclosure relates generally to eye-tracking systems and methods that provide a user the ability to efficiently activate the system and select and dismiss virtual objects within an augmented reality (“AR”) and/or virtual reality (“VR”) environment. A user may activate the user interface by glancing beyond an activation threshold positioned close enough to the edge of the field of view to reliably infer an intent to activate the virtual controls. Subsequently, the user interacts with virtual tools, first virtual “peek” windows and secondary virtual windows to obtain content or virtual control across a variety of granular levels. Subsequently, the user may glance away at virtual content or to other predefined areas within their eye's range of motion to dismiss the tool and/or deactivate the system.

Abstract: An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene of real-world environment; determine gaze directions of first eye and second eye; identify line of sight of user and conical region of interest real-world scene; determine optical depths of objects in conical region of interest, wherein at least first object, second object and third object from amongst objects are at different optical depths; adjust optical focus of one of first camera and second camera to focus on first object and second object in alternating manner, whilst adjusting optical focus of another of first camera and second camera to focus on third object; and capture images using adjusted optical focus of cameras.

Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling the exposure settings of an rolling shutter image sensor device with global reset. This is achieved by obtaining a first image captured by the image sensor device at a current exposure setting that comprises a partial readout parameter representing a number image parts for partial readout by the image sensor device; determining an intensity value of the first image, comparing the intensity value of the first image to a desired intensity value. If the intensity values differ more than an allowed deviation, an updated number of image parts for partial readout is determined based on the current number of image parts and the intensity value of the first image. Thereafter, the current exposure setting is updated by setting the value of the partial readout parameter to the updated number of image parts.

Abstract: An imaging apparatus includes a finder, a proximity detection unit configured to detect a proximity of an object to the finder, a receiving unit configured to receive a line-of-sight input, and a control unit configured to perform control to prohibit, after the proximity of the object is detected by the proximity detection unit, a specific function based on a position input by the line-of-sight input of the user from being performed until a first period of time has elapsed even in a case where a predetermined condition is satisfied, and allow, after the proximity of the object is detected by the proximity detection unit and the first period of time has elapsed, the specific function based on the position input by the line-of-sight input of the user to be performed, in response to satisfaction of the predetermined condition.

Abstract: The present invention provides a method and a device for eyeball tracking operation. By providing a sensing unit under the eyeball recognition region of the display unit, compared with the structure in which the camera is disposed at the edge position independently of the display screen, the sensing unit of the present invention can emit infrared light or detect infrared light signals reflected by the human eye, so as to timely capture the user's eyeball activity. The information is compared with the presetting eyeball activity information, and the operation instruction corresponding to the eyeball activity information is executed, so that the user can quickly control the device through the eyeball activity, thereby effectively improving the user experience.

Abstract: An imaging device detects a specific type object in a captured image, detects a position of a line-of-sight of a photographer, and controls so that: in case where the specific type object is not detected in the captured image, a main object to which a specific process should be applied is selected based on a predetermined condition within a first type zone including a detected line-of-sight input position, and in case where the specific type object is detected in the captured image, if the detected line-of-sight input position is included in a second type zone that is larger than the first type zone and includes the specific type object, the specific type object included in the second type zone corresponding to the line-of-sight input position is selected as the main object to which the specific process should be applied, regardless of the predetermined condition.

Abstract: An electronic device comprising: a line-of-sight detection unit configured to receive line-of-sight input from a user and detect a viewed position of the user; an acquisition unit configured to acquire first distance information that corresponds to a distance to an eye of the user; and a control unit configured to 1) set determination time based on the first distance information, and 2) determine that gaze has occurred, in a case where determination is made that the viewed position does not continuously change longer than the determination time.

Abstract: A method, including receiving a three-dimensional (3D) map of at least a part of a body of a user (22) of a computerized system, and receiving a two dimensional (2D) image of the user, the image including an eye (34) of the user. 3D coordinates of a head (32) of the user are extracted from the 3D map and the 2D image, and a direction of a gaze performed by the user is identified based on the 3D coordinates of the head and the image of the eye.

Abstract: An adjustable-focus PV (picture/video) camera in a mixed-reality head-mounted display (HMD) device operates with an auto-focus subsystem that is configured to be triggered based on location and motion of a user's hands to reduce the occurrence of auto-focus hunting during camera operations. The HMD device is equipped with a depth sensor that is configured to capture depth data from the surrounding physical environment to detect and track the user's hand location, movements, and gestures in three-dimensions. The hand tracking data from the depth sensor may be assessed to determine hand characteristics—such as which of the user's hands or part of a hand is detected, its size, motion, speed, etc.—within a particular region of interest (ROI) in the field of view of the PV camera. The auto-focus subsystem uses the assessed hand characteristics as an input to control auto-focus of the PV camera to reduce auto-focus hunting occurrences.

Abstract: A solid state imaging device that includes a substrate having oppositely facing first and second surfaces and a photoelectric conversion unit layer having a light incident side facing away from the substrate. The substrate includes a first photoelectric conversion unit and a second photoelectric conversion and the photoelectric conversion layer includes a third photoelectric conversion unit.

Abstract: An imaging device comprising a first camera with a controllable focus is provided. The imaging device is operative to detect that a user of the imaging device intends to capture an image of an object using the first camera, control the focus of the first camera to assume a target focal length, and capture the image. The target focal length is derived based on a measured accommodation of an eye lens of the user. Further, a contact lens comprising an eye-accommodation detector and a communications module is provided. The contact lens is operative to measure an accommodation of an eye lens to which the contact lens is attached, and transmit, to an imaging device comprising a first camera with a controllable focus, information pertaining to the measured accommodation of the eye lens and/or a focal length of the eye lens corresponding to the measured accommodation.

Abstract: An adjustable-focus PV (picture/video) camera in a mixed-reality head-mounted display (HMD) device operates with an auto-focus subsystem that is configured to be triggered based on location and motion of a user's hands to reduce the occurrence of auto-focus hunting during camera operations. The HMD device is equipped with a depth sensor that is configured to capture depth data from the surrounding physical environment to detect and track the user's hand location, movements, and gestures in three-dimensions. The hand tracking data from the depth sensor may be assessed to determine hand characteristics—such as which of the user's hands or part of a hand is detected, its size, motion, speed, etc.—within a particular region of interest (ROI) in the field of view of the PV camera. The auto-focus subsystem uses the assessed hand characteristics as an input to control auto-focus of the PV camera to reduce auto-focus hunting occurrences.

Abstract: A method and apparatus for detecting a reflection are provided. The method includes acquiring an input image of an object, based on an activation of an infrared light source, acquiring a reference image of the object, based on a deactivation of the infrared light source, and extracting a reflection region from the input image, based on the input image and the reference image.

Abstract: A corneal reflex position detection device includes a pupil detecting unit that detects the center position of the pupil from an image of an eye of a test subject; and a corneal reflex detecting unit that detects the corneal reflex area from the image. The corneal reflex detecting unit enlarges, in a stepwise manner, a detection target area with reference to the center position of the pupil, to detect whether or not a high-luminance area having the luminance to be equal to or greater than a luminance threshold value is present in the image; and, if the high-luminance area is detected, determines that the high-luminance area represents the corneal reflex area.

Abstract: Provided is a control apparatus including a focus detection control unit that sets a density of a focus detection point in a partial region specified, to be higher than a density of a focus detection point in a region excluding the partial region which corresponds to a position of an identified subject or a region specified by a user.

Abstract: An input system and an electronic apparatus with novel structures are provided. An electronic apparatus whose setting can be changed even when both hands are full is provided. An input system and an electronic apparatus including an imaging device having a function of taking an image of eyes and a detection device having a function of detecting a change of the shape of the eyes from data obtained by the imaging device are provided. Settings are changed in accordance with the change of the shape of the eyes. The settings are changed by a different method from a manual method and the change of the settings can be reflected in display.

Abstract: [Object] To perform appropriate transmission band control. [Solving Means] An information processing apparatus includes an acquisition section and a controller. Here, the acquisition section acquires user information generated by a user operation when information based on a stream communicated between another information processing apparatus via wireless communication is output from an output section. The controller performs band control of the stream communicated between another information processing apparatus via wireless communication based on the user information acquired by the acquisition section.

Abstract: An imaging method and device are provided for local scaling. The method can comprise determining a gazed object of an eye, determining the corresponding sub-areas of an imaging lens group according to the gazed object, the imaging lens group being configured to scale and image for the gazed object, comprising a plurality of sub-areas with adjustable scaling property, and determining the scaling parameter of the corresponding sub-areas according to the gazed object. In the method and the device of at least one embodiment of this application, the images of the gazed object in the user's fundus can be scaled in a local scaling mode, so as to avoid changing the overall view of the user and to enable the user to conveniently observe the gazed object and to simultaneously correctly perceive the surrounding environment.

Abstract: An auto focus photographing system applied in an electronic device that is worn before eyes of a user is provided. The auto focus photographing system includes a first camera module, a second camera module, and a processor. The first camera module captures images of the eyes. The second camera module captures images of objects that the eyes focus on. The processor analyzes a distance between centers of eye pupils of the user and calculates a focusing current value corresponding to the distance, and adjusts a focus distance of the second camera module accordingly. The processor detects a capture command and the second camera module captures an image according to the adjusted focus distance. An electronic device employing the auto focus photographing system is also provided.

Abstract: An information processing method, an information processing apparatus and a user equipment are provided. A method comprises: acquiring sight line information of at least one user in a space; and determining, at least according to the sight line information, at least one transparent object existing in the space. Accordingly, a transparent object in a space is determined according to sight line information of at least one user, providing a basis for transparent-object-based applications, for example, modeling the transparent object.

Abstract: A method includes receiving a sequence of three-dimensional (3D) maps of at least a part of a body of a user of a computerized system and extracting, from the 3D map, 3D coordinates of a head of the user. Based on the 3D coordinates of the head, a direction of a gaze performed by the user and an interactive item presented in the direction of the gaze on a display coupled to the computerized system are identified. An indication is extracted from the 3D maps an indication that the user is moving a limb of the body in a specific direction, and the identified interactive item is repositioned on the display responsively to the indication.

Abstract: Systems and methods for locating the center of a lens in the eye are provided. These systems and methods can be used to improve the effectiveness of a wide variety of different ophthalmic procedures. In one embodiment, a system and method is provided for determining the center of eye lens by illuminating the eye with a set of light sources, and measuring the resulting first image of the light sources reflected from an anterior surface of the lens and the resulting second image of the light sources reflected from a posterior surface of the lens. The location of the center of the lens of the eye is then determined using the measurements. In one embodiment, the center of the lens is determined by interpolating between the measures of the images. Such a determination provides an accurate location of the geometric center of the lens.

Abstract: Image classification based on a calculated camera-to-object distance is described. The camera-to-object distance is calculated based in part on a ratio of a measured dimension of an identified feature in the digital image compared to a known physical dimension of the identified feature in real life. A human anatomical constant, such as a dimension of the human eye, may be used as the feature to calculate the camera-to-object distance. The camera-to-object distance can be used to classify the digital image, such as by determining whether the image is a selfie. The camera-to-object distance may also be used for image editing operations to be performed on the digital image.

Abstract: The various embodiments of the present invention disclose an image processing method and system for capturing a refocusable image set. The method comprises of segmenting a field of view into a plurality of grids, determining a sharpness level associated with each of the plurality of grids, identifying one or more regions based on the determined sharpness level of each of the plurality of grids, each region comprising one or more of the plurality of grids and capturing an image associated with each of the identified one or more regions to form the refocusable image set. The method further comprises of detecting a refocusing action on an object, in the field of view, having an associated illumination level and varying the associated illumination level of the object based on the detection.

Abstract: An information processing method, an information processing apparatus and a user equipment are provided. A method comprises: acquiring sight line information of at least one user in a space; and determining, at least according to the sight line information, at least one mirror object existing in the space. Accordingly, a mirror object in a space is determined according to sight line information of at least one user, providing a basis for mirror-object-based applications, for example, modeling the mirror object.

Abstract: A method for avoiding a tunnel vision of a motor vehicle driver includes detecting an instantaneous viewing direction of the driver; comparing the instantaneous viewing direction with at least one previous viewing direction; detecting a tunnel vision if a rate of change between the viewing directions and/or if an angular range of the viewing direction is not reached; and stimulating the motor vehicle driver to avoid the tunnel vision. A device for avoiding a tunnel vision of the driver includes a camera for detecting an instantaneous viewing direction of the motor vehicle driver; a control unit for comparing the instantaneous viewing direction with at least one previous viewing direction and for detecting a tunnel vision if a rate of change between the viewing directions and/or if an angular range of the viewing direction is not reached, and a device for stimulating the motor vehicle driver to avoid the tunnel vision.

Abstract: An imaging apparatus includes a photometric lens for forming a secondary image of object light that has been transmitted through a lens unit and had a primary image formed by the lens unit, a photometric sensor for outputting a signal of the object light that has had the secondary image formed, and a PN liquid crystal panel located in the vicinity of a primary imaging plane. The imaging apparatus generates an image obtained by subjecting an output signal of the photometric sensor to reforming processing on the basis of an output signal of the photometric sensor when the PN liquid crystal panel serves as an object. Thus, the imaging apparatus can suppress a deterioration in the image that could be caused by various factors including a manufacturing error, a change over time, a change in temperature, and a change in humidity.

Abstract: Aspects of present disclosure relates to a dynamic videotelephony system. In certain embodiments, dynamic videotelephony system includes a first dynamic videotelephony device for a first user group, and a second dynamic videotelephony device for a second user group, and a network connecting these two dynamic videotelephony devices for a dynamic video conference between the two user groups.

Abstract: The present disclosure provides a gaze tracker and a gaze tracking method. The gaze tracker includes: an image acquirer to acquire eye images of a user using two or more cameras and two or more lightings; and a gaze calculator which detects a lighting reflection point from each eye image to extract a cornea central point, detects a pupil central point from each eye image, and calculates a gaze vector. In particular, when lighting reflection points are detected from each eye image, the gaze calculator calculates vectors for connection between each lighting and a corresponding lighting reflection point and detects an intersection point between the calculated vectors. When only one lighting reflection point is detected, the gaze calculator extracts the cornea central point using distance information between a pre-stored lighting reflection point and the cornea central point and the one lighting reflection point.

Abstract: A wearable camera system includes an eyewear which includes a temple and a lens and a camera coupled to eyewear, the camera having a field of view. The wearable camera system further includes a marker coupled to the eyewear, the camera, or both, the marker positionable on or in front of the lens of the eyewear at a location such that when a wearer of the eyewear aligns the marker with a target, the field of view of the camera includes the target.

Abstract: Methods and apparatus for image capturing are provided. A first camera mounted on a rear side of a mobile terminal, and a second camera mounted on a front side of a mobile terminal, are driven in an image capturing mode. A user's face is detected in a second image generated by the second camera. An alarm is generated that indicates that a first image is out of an intended image capturing area, when the user's face is not detected in the second image and when a difference is detected between the first image and a reference first image.

Abstract: In a system and a method of controlling an imaging direction and an angle of view of a camera according to an aspect of the present disclosure, infrared light may be irradiated toward pupils of eyes of a user, and a position of infrared light reflected from the pupils of the eyes of the user may be detected by a first camera to track a line of sight of the user and calculate a viewing angle of the user. In addition, an imaging direction of a second camera may coincide with the line of sight of the user and an angle of view of the second camera may coincide with the viewing angle of the user to allow an image actually viewed by the user and an image captured by the camera to coincide with each other.

Abstract: Methods and systems to identify a portion of content, for each of multiple instances of content presented at a display, based on eye contact of a user, populate records of the portions of content with contextual information, and search a data field(s) of the record to identify content of interest to the user amongst the portions of content. The search may be based on a, without limitation, a user-specified application program, file type, URL, time, display position, content presented at the display prior to, concurrently with, and/or subsequent to presentation of content of interest to the user, and/or an action performed by the user prior to and/or subsequent to a time at which the content of interest to the user had been presented at the display.

Abstract: A management system for managing remote communication between a first communication terminal and a second communication terminal includes a transmitter that transmits first screen data to the first communication terminal to display a first screen image based on the first screen data on a first display, a receiver that receives image data including an eye image of a first user from the first communication terminal, circuitry that specifies a sightline position indicating the first user's sightline of with respect to the first screen image based on the received image data, and generates second screen data that includes sightline information indicating the first user's sightline at the specified sightline position. The transmitter transmits the second screen data to the second communication terminal operated by a second user to display a second screen image having the sightline information on the specified sightline position on a second display.

Abstract: A stereo camera for measuring distance to an object using two images of the object having parallax includes an optical multiplexer to set a length of light path of each of the two images having different spectrum properties and parallax to the same length and to superimpose each of the light paths to one light path; an image capturing element to detect luminance of at least two images having different spectrum properties; an optical device to focus a superimposed image on the image capturing element; and a distance computing unit to compute distance to the object using parallax between the two images.

Abstract: An orientation of a computing device within three dimensional space can be determined. The position of a camera integrated within the device relative to the device screen. The camera can be a front facing camera or a rear facing camera. The camera can include an image sensor, a lense, and/or a shutter. A live view of a real world environment can be received from the camera and presented within the device screen within real-time. An eye guide can be simultaneously presented on the device screen to assist a user interacting with the device to focus the eyes of the user on the camera. The eye guide can be a graphical symbol and/or a text indicating a direction associated with the camera in relation to the orientation of the screen or the device. An image can be recorded within a computer readable storage medium associated with the device. The image can lack the eye guide.

Abstract: Herein describes, by example, a digital image device comprising a CCD image sensor, a setting dial, a controller, and an image processor. The CCD image sensor captures a subject image and outputs image information. The setting dial accepts an input operation and outputs an operation signal including one that corresponds to the direction of the dial. The controller sets an object region that will be the object of a specific image processing process, so that at least one of a region direction and a region range for setting the object region can be changed according to an operation signal corresponding to the operation direction of the interface component. The image processor performs diorama filtering on the object region on the basis of the region direction and the region range.

Abstract: An imaging device includes an imaging unit configured to generate a moving-image signal by capturing an image of a subject formed by an imaging optical system, a focus adjustment information acquisition unit configured to acquire focus adjustment information related to human subjective focus adjustment, and a focus adjustment determination unit configured to determine behavior of the focus adjustment of the imaging unit using the focus adjustment information obtained by the focus adjustment information acquisition unit.

Abstract: A specific subject region is detected, and if a focus detection area that is encompassed in the specific subject region is present, focus detection is performed on that focus detection area. This makes it possible to reduce the influence of a conflict between far and near subjects and reduce the amount of time required for focus detection in an image capture apparatus and in a control method therefor, the image capture apparatus being for performing automatic focus detection based on contrast evaluation values for a plurality of focus detection areas that are each located at a fixed position and each has a fixed size.

Abstract: The present invention relates to an eye-gaze based control device. The eye-gaze based control device of the present invention may control a control target device according to an eye-gaze point of a user. Here, the eye-gaze based control device controls the control target device by controlling a size of an image displayed to the user, thereby more precisely controlling the control target device.

Abstract: Systems and methods described relate to a user to providing input to a computing device using eye tracking from a mobile position. A scene camera is mounted to the user so that the system collects image information related to where the user is looking. An indication is provided on a monitor of the computing device, or other field of view, to signify the presence and location of an identifying region of the monitor or field of view. An eye camera mounted to the user collects image information of the user's eye relating to a direction of gaze of the eye. When the direction of gaze of the user's tracked eye intersects the identifying region of the monitor or field of view, suitable eye tracking methods for controlling a computing device may be used to send instructions to the computing device.

Abstract: An apparatus for mapping a gaze point of a subject on a scene image to a gaze point in a reference image, wherein said scene image and said reference image have been taken by a camera from a different position, said apparatus comprising: A module for executing a feature detection algorithm on said reference image to identify a plurality of characteristic features and their locations in said reference image; a module for executing said feature detection algorithm on said scene image to re-identify said plurality of characteristic features and their locations in said scene image; a module for determining a point transfer mapping that transforms point positions between said scene image and said reference image based on the locations of said plurality of characteristic features detected in said reference image and said scene image; a module for using said point transfer mapping to map a gaze point which has been determined in said scene image to its corresponding point in said reference image.

Abstract: Information regarding facial cues may be received. Such information may associated each facial cue with a responsive action. Images (e.g., photo, video) of an area in front of a computing device may be captured by a front-facing camera. A user's face may be detected, as well as determined to exhibit a facial cue. The facial cue is identified, along with its associated action. The computing device may then perform the action associated with the facial cue exhibited by the user.