Abstract: An apparatus for or processing video frames is presented. The apparatus comprises at least one processing unit and at least one memory. The at least one memory stores program instructions that, when executed by the at least one processing unit, cause the apparatus to segment objects appearing in video frames, model movement of a camera recording the video frames, and individually compensate motion artefacts in the video frames for at least one segmented object based on relative movement of the camera and at least one segmented object.

Abstract: Disclosed is gaze-tracking system for head-mounted display apparatus, the gaze-tracking system including a plurality of non-circular light sources that emit light for illuminating a user's eye when the display apparatus is worn by user, at least one camera, and a processor. The processor is configured to control the at least one camera to capture an image of user's eye and reflections of the plurality of non-circular light sources from user's eye; identify at least one of the plurality of non-circular light sources from where at least one of the reflections originated, based upon shapes, rotational orientations and relative positions of the reflections of the plurality of non-circular light sources, to differentiate said reflections from visual artifacts; and detect a gaze direction of user based upon a relative position of a pupil of user's eye with respect to the reflections of the plurality of non-circular light sources.

Abstract: A display for use in a display apparatus. The display includes a first display part having a first display resolution, and a second display part having a second display resolution, the second display resolution being higher than the first display resolution, the first display part and the second display part being arranged in a manner that a display area of the second display part is substantially surrounded by a display area of the first display part.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator for emitting light pulses; at least one first optical element comprising a plurality of micro-to-nano-sized components, shaped and arranged relative to each other in a manner that, when incident thereupon, a structure of the light pulses is modified to produce structured light, wherein the produced structured light is used to illuminate a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form and a position of the reflections on an image plane of the at least one camera; and a processor configured to control the at least one illuminator and the at least one camera, and to process the captured image to detect a gaze direction of the user.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes a plurality of illuminators for emitting light pulses to illuminate a user's eye when the head-mounted display apparatus is worn by the user, the illuminators including at least a first illuminator and a second illuminator; at least one lens positioned on an optical path of reflections of the light pulses from the user's eye, the at least one lens having no chromatic-aberration correction; at least one camera for capturing an image of the reflections of the light pulses; and a processor coupled with illuminators and the at least one camera, the processor being configured to control operations of the illuminators and the at least one camera, and to process the captured image to detect a gaze direction of the user.

Abstract: Disclosed is a display apparatus including first display having first display resolution, that is to be employed for displaying first image; second display having second display resolution, that is to be employed for displaying second image; exit optical element; and optical combiner to optically combine projections of the first and second images. The optical combiner includes first optical element having a reflective surface obliquely facing the exit optical element having an outwardly-curved shape.

Abstract: A device is presented. The device comprises: at least one processor and at least one memory including computer program code, a display element coupled to the processor, and a user input element coupled to the processor.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator to emit light pulses for illuminating a user's eye; at least one camera to capture image of reflections of the light pulses; at least one reflective element arranged on an optical path of the reflections of the light pulses, such that when incident upon the at least one reflective element, the reflections of the light pulses are reflected towards the at least one camera; at least one actuator associated with the at least one reflective element, wherein the at least one actuator moves the at least one reflective element; and a processor configured to: process the at least one image to detect a gaze direction of user; and control the at least one actuator to adjust, based upon the detected gaze direction, position of the at least one reflective element.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes illuminators for emitting light pulses to illuminate a user's eye; a camera for capturing an image of reflections of the light pulses from the user's eye, the camera including photo-sensitive elements arranged into a chip, wherein a first surface of the chip bulges inwards in a substantially-curved shape, such that a focal plane of photo-sensitive elements positioned proximally to edges of the chip is farther away than a focal plane of photo-sensitive elements positioned substantially at a center portion of the chip, the first surface facing the user's eye; and a processor being configured to control operations of the illuminators and the camera, and to process the captured image to detect a gaze direction of the user.

Abstract: A gaze-tracking system for a head-mounted display apparatus includes a first set of illuminators for emitting light to illuminate a user's eye; at least one photo sensor for sensing reflections of the light from the user's eye; at least one actuator for moving at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor; and a processor coupled with the first set of illuminators, the at least one photo sensor and the at least one actuator. The processor is configured to collect and process sensor data from the at least one photo sensor to detect a gaze direction of the user, and to control the at least one actuator to adjust, based upon the detected gaze direction, a position of the at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator to emit light pulses for illuminating a user's eye; at least one camera to capture image of reflections of the light pulses; at least one reflective element arranged on an optical path of the reflections of the light pulses, such that when incident upon the at least one reflective element, the reflections of the light pulses are reflected towards the at least one camera; at least one actuator associated with the at least one reflective element, wherein the at least one actuator moves the at least one reflective element; and a processor configured to: process the at least one image to detect a gaze direction of user; and control the at least one actuator to adjust, based upon the detected gaze direction, position of the at least one reflective element.

Abstract: An imaging system and a method of producing images for a display apparatus, via the imaging system includes at least one focusable camera for capturing at least one image of a given real-world scene; means for generating a depth map or a voxel map of the given real-world scene; and a processor coupled to the focusable camera and the aforesaid means. The processor is communicably coupled with the display apparatus. The processor is configured to receive information of the gaze direction of the user; map the gaze direction to the depth map or the voxel map to determine an optical depth of a region of interest in the given real-world scene; and control the focusable camera to employ a focus length that is substantially similar to the determined optical depth of the region of interest when capturing the at least one image.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes illuminators for emitting light pulses to illuminate a user's eye; a camera for capturing an image of reflections of the light pulses from the user's eye, the camera including photo-sensitive elements arranged into a chip, wherein a first surface of the chip bulges inwards in a substantially-curved shape, such that a focal plane of photo-sensitive elements positioned proximally to edges of the chip is farther away than a focal plane of photo-sensitive elements positioned substantially at a center portion of the chip, the first surface facing the user's eye; and a processor being configured to control operations of the illuminators and the camera, and to process the captured image to detect a gaze direction of the user.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes a plurality of illuminators for emitting light pulses to illuminate a user's eye when the head-mounted display apparatus is worn by the user, the illuminators including at least a first illuminator and a second illuminator; at least one lens positioned on an optical path of reflections of the light pulses from the user's eye, the at least one lens having no chromatic-aberration correction; at least one camera for capturing an image of the reflections of the light pulses; and a processor coupled with illuminators and the at least one camera, the processor being configured to control operations of the illuminators and the at least one camera, and to process the captured image to detect a gaze direction of the user.

Abstract: A device is presented. The device comprises: at least one processor and at least one memory including computer program code, a display element coupled to the processor, and a user input element coupled to the processor.

Abstract: Disclosed is gaze-tracking system for head-mounted display apparatus, the gaze-tracking system including a plurality of non-circular light sources that emit light for illuminating a user's eye when the display apparatus is worn by user, at least one camera, and a processor. The processor is configured to control the at least one camera to capture an image of user's eye and reflections of the plurality of non-circular light sources from user's eye; identify at least one of the plurality of non-circular light sources from where at least one of the reflections originated, based upon shapes, rotational orientations and relative positions of the reflections of the plurality of non-circular light sources, to differentiate said reflections from visual artifacts; and detect a gaze direction of user based upon a relative position of a pupil of user's eye with respect to the reflections of the plurality of non-circular light sources.

Abstract: A device is presented. The device comprises: at least one processor and at least one memory including computer program code, a display element coupled to the processor, and a user input element coupled to the processor.

Abstract: An apparatus comprises a processing unit configured to obtain preliminary image data of a preliminary digital image frame captured by a digital image sensor having comprising a sensor layer comprising a pixel array; a mask layer comprising an array of micro apertures positioned within aperture sites corresponding the positioning and size of the light sensitive pixels, and a lens layer comprising an array of micro lenses positioned within lens sites. The micro apertures are positioned in the aperture sites at aperture positions defined by an aperture density function. The processing unit is further configured to obtain the aperture density function; and a position difference between prevailing positioning of the mask layer in relation to the lens layer from a reference relative positioning thereof; and to reconstruct, on the basis of the preliminary image data, the position difference, and the aperture density function, an output digital image frame.

Abstract: A display surface structure comprises a deformable transparent surface layer, a visual display layer visible through the deformable transparent surface layer, a piezo-electric layer in mechanical communication with the deformable transparent surface layer, and a drive circuit in electrical communication with the piezo-electric layer. The drive circuit sends a drive signal to the piezo-electric layer to cause the piezo-electric layer to deform the deformable transparent surface layer and generate an audio output.

Abstract: A gaze-tracking system for a head-mounted display apparatus includes a first set of illuminators for emitting light to illuminate a user's eye; at least one photo sensor for sensing reflections of the light from the user's eye; at least one actuator for moving at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor; and a processor coupled with the first set of illuminators, the at least one photo sensor and the at least one actuator. The processor is configured to collect and process sensor data from the at least one photo sensor to detect a gaze direction of the user, and to control the at least one actuator to adjust, based upon the detected gaze direction, a position of the at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor.