Abstract: A portable electronic equipment comprises a gaze tracking device configured to track an eye gaze direction of a user in a time interval. The portable electronic equipment comprises a processing device coupled to the gaze tracking device and configured to generate heat map data for the eye gaze direction, generate saliency map data for a field of view of the user, and identify at least one point of interest in the field of view based on both the heat map data and the saliency map data.

Abstract: The invention is directed to systems, methods and computer program products for gaze tracking. An exemplary method includes directing light into an eye using a projector; detecting, using an image-capturing module, a reflection from a surface associated with the eye; and determining a line of sight associated with the eye based on the detected reflection. In some embodiments, the light comprises infra-red light. In some embodiments, the projector comprises a laser. In some embodiments, the projector comprises a liquid crystal on silicon (LCoS) chip. In some embodiments, the surface associated with the reflection is at least one of the cornea, the iris, or the retina.

Abstract: The present invention relates to a method and system for providing access to a device for a user. The method comprises the steps of receiving an access attempt from the user to the device, identifying the user attempting to access the device, retrieving personal information from a database related to the user, the personal information comprising personal traits of the user, selecting a visual challenge configured based on the personal information, issuing the visual challenge to the user, receiving visual input corresponding to an eye-movement of the user relating to the visual challenge, determining whether the user passed the visual challenge based on the received visual input corresponding to an eye movement of the user, and allowing access to the device for the user if the user passes the visual challenge, or denying access to the device for the user if the user fails the visual challenge.

Abstract: An apparatus and method generate a three-dimensional image by presenting, using a stereoscopic display, a representation of a scene comprising one or more objects, tracking a gaze of the user to determine a direction of gaze within the scene, determining depths associated with one or more objects in the scene, and determining which of the objects in the scene are inside and which are outside a comfort zone based at least in part on the direction of gaze of the user and the depths associated with the one or more objects in the scene. In some embodiments, the method includes identifying one or more objects proximate the direction of gaze of the user, determining depths associated with the one or more identified objects, determining a range of depths based at least in part on the depths associated with the one or more identified objects, and establishing the comfort zone based at least in part on the range of depths.

Abstract: An electronic device comprises a display to output a video, a user interface for controlling a navigation in the video along a time axis, and a processing device. The processing device is configured, when operating in an operating mode in which an object shown in a plurality of frames of the video is selected by a user input, to determine a magnitude of a speed vector of the object, and to apply a time scaling factor which depends on the determined magnitude of the speed vector of the object to the navigation along the time axis.

Abstract: The present invention relates to a method for generating trajectory data for video data. According to the method, an eye movement of an eye (11) of a viewer (10) viewing moving visual images is captured with a capturing device (14). The trajectory data (32) is automatically determined based on the eye movement with a processing device (15) and the trajectory data (32) is automatically assigned to the video data comprising the moving visual images.

Abstract: Operating a display of a user equipment. The present invention relates to a method for operating a display (2) of a user equipment (1). The display (2) is configured to display an object (50). A permission is assigned to the object (50), which defines an allowance for a person (11-13) to view the object (50). According to the method, a gaze position (63) of a person (12) looking at the display (2) is determined, which defines a position on the display (2) at which the person (12) is looking. A distance between the gaze position (63) and a position of the object (50) is determined and furthermore, it is determined, if the person (12) is allowed to view the object based on the permission assigned to the object (50). If the person (12) is not allowed to view the object (50), the object (50) is concealed depending on the determined distance between the gaze position (63) and the position of the object (50).

Abstract: A digital photograph is processed by receiving a communication related to the digital photograph from an application external to an image storage device that stores the digital photograph. Parameters related to the application are processed. The digital photograph is changed based on the parameters related to the application. Related methods, devices, and/or computer program products are described.

Abstract: The present invention relates to a method for generating trajectory data for video data. According to the method, an eye movement of an eye (11) of a viewer (10) viewing moving visual images is captured with a capturing device (14). The trajectory data (32) is automatically determined based on the eye movement with a processing device (15) and the trajectory data (32) is automatically assigned to the video data comprising the moving visual images.

Abstract: The present invention relates to a method and system for providing access to a device for a user. The method comprises the steps of receiving an access attempt from the user to the device, identifying the user attempting to access the device, retrieving personal information from a database related to the user, the personal information comprising personal traits of the user, selecting a visual challenge configured based on the personal information, issuing the visual challenge to the user, receiving visual input corresponding to an eye-movement of the user relating to the visual challenge, determining whether the user passed the visual challenge based on the received visual input corresponding to an eye movement of the user, and allowing access to the device for the user if the user passes the visual challenge, or denying access to the device for the user if the user fails the visual challenge.

Abstract: One or more devices may receive, from a media presentation device worn by a user, sensory data comprising at least information describing orientation of the media presentation device. The one or more devices may also determine an approximate direction of a gaze of the user in a three dimensional audio space based on the information describing the orientation of the media presentation device, identify a sound source at which the user gazes based on the approximate direction of the gaze of the user in the three dimensional audio space, obtain audio data associated with the sound source based on an identity of the identified sound source, determine an action to perform on the audio data associated with the sound source, and perform the determined action.

Abstract: A portable electronic equipment comprises a gaze tracking device configured to track an eye gaze direction of a user in a time interval. The portable electronic equipment comprises a processing device coupled to the gaze tracking device and configured to generate heat map data for the eye gaze direction, generate saliency map data for a field of view of the user, and identify at least one point of interest in the field of view based on both the heat map data and the saliency map data.

Abstract: Operating a display of a user equipment. The present invention relates to a method for operating a display (2) of a user equipment (1). The display (2) is configured to display an object (50). A permission is assigned to the object (50), which defines an allowance for a person (11-13) to view the object (50). According to the method, a gaze position (63) of a person (12) looking at the display (2) is determined, which defines a position on the display (2) at which the person (12) is looking. A distance between the gaze position (63) and a position of the object (50) is determined and furthermore, it is determined, if the person (12) is allowed to view the object based on the permission assigned to the object (50). If the person (12) is not allowed to view the object (50), the object (50) is concealed depending on the determined distance between the gaze position (63) and the position of the object (50).

Abstract: An electronic device comprises a display to output a video, a user interface for controlling a navigation in the video along a time axis, and a processing device. The processing device is configured, when operating in an operating mode in which an object shown in a plurality of frames of the video is selected by a user input, to determine a magnitude of a speed vector of the object, and to apply a time scaling factor which depends on the determined magnitude of the speed vector of the object to the navigation along the time axis.

Abstract: A portable electronic equipment comprises a first sensor to record media and at least one second sensor to capture data representing a physical condition of a user of the portable electronic equipment, the at least one second sensor being configured to capture the data in response to the first sensor recording the media. A processing device is interfaced with the at least one second sensor. The processing device is configured to retrieve the data captured by the at least one second sensor, to generate metadata for the recorded media based on the data, the metadata being indicative of the physical condition, and to cause the metadata to be stored in association with the recorded media.

Abstract: A system includes a processing logic and output logic. The processing logic is configured to receive information identifying points of interest, identify at least one of location or distance information from each of the points of interest to the system, and sort the points of interest based on the location or distance information. The output logic is configured to project information identifying the points of interest onto a surface, wherein the projected information is displayed in accordance with the sorting.

Abstract: A digital photograph is processed by receiving a communication related to the digital photograph from an application external to an image storage device that stores the digital photograph. Parameters related to the application are processed. The digital photograph is changed based on the parameters related to the application. Related methods, devices, and/or computer program products are described.

Abstract: According to one aspect of the present disclosure, a method implemented by a computing device is disclosed. Images from a sequence of images that depicts a scene are displayed on an electronic display. User input is received that selects an image from the sequence to be used as a base image. User input is also received that selects an object from the sequence of images. A movement trajectory of the selected object is determined from the sequence of images. The selected object is repositioned based on user input that drags the selected object along the determined movement trajectory from an initial position to a new position. A new image is created by combining the base image and the repositioned object.

Abstract: An apparatus and method generate a three-dimensional image by determining, using a light-field camera, a depth map corresponding to an environment. The depth map represents how light falls in the environment. The method also includes determining a parallax occlusion map of the environment and creating, using the depth map and the parallax occlusion map, a three-dimensional image representing the environment. In some embodiments, the method includes taking a first picture of the environment with a first flash intensity and a second picture of the environment with a greater second flash, determining differences between the first picture of the environment and the second picture of the environment, determining one or more properties of the environment based at least in part on the determined differences and dynamically re-lighting the three-dimensional image using the depth map, the parallax occlusion map, and one or more of the determined properties of the environment.

Abstract: This disclosure is directed to a sound recording arrangement comprising a sound recording arrangement and a method in the sound recording arrangement for amplifying sounds in a primary gaze direction of the user of the sound recording arrangement. The method comprises the actions of recording sounds arriving at a sound recording unit from objects in the field of view of the user, and recording a first set of images of the head and/or the eyes of the user, and determining a primary gaze direction of the user based on the first set of images, and amplifying sounds arriving in the primary gaze direction compared to sounds arriving from other directions.