Abstract: Disclosed is a method including determining a gaze point and a gaze depth; controlling camera(s) for capturing a real-world image, by adjusting camera settings according to the gaze point and the gaze depth; determining a pose of the camera(s) at a time of capturing the real-world image; identifying region(s) of the real-world environment represented in the real-world image; determining whether a representation of region(s) satisfies quality criteria; when the representation fails to satisfy the quality criteria, capturing a reference real-world image such that the representation fulfills the quality criteria; generating training data comprising reference data and input data wherein reference data comprises reference real-world image, and input data with real-world image and/or previously-captured real-world image; sending training data to a processor to train a first neural network.

Abstract: Disclosed is a depth imaging system with a light source; a depth sensor comprising direct Time-of-Flight (dToF) pixels and indirect Time-of-Flight (iToF) pixels; and processor(s) configured to: employ the light source to emit an intensity-modulated light pulse towards objects in a real-world environment; obtain dToF data indicative of time taken by the intensity-modulated light pulse to reach the dToF pixels after being reflected by the objects; obtain iToF data indicative of phase shifts undergone by the intensity-modulated light pulse upon reaching the iToF pixels after being reflected by the objects; determine optical depths for the dToF pixels; determine optical depths for the iToF pixels; and generate a depth image from the optical depths of the dToF pixels and the optical depths of the iToF pixels.

Abstract: Disclosed is an imaging system with image sensor and processor(s). The image sensor has a plurality of photo-sensitive cells and a colour filter array. The processor(s) is configured to read out unprocessed colour data from those photo-sensitive cells that correspond to the colour filters of the at least three different colours; generate coarse depth data by processing data read out from at least one of: those photo-sensitive cells that correspond to the colour filters that allow the at least one infrared wavelength to pass through the PDAF photo-sensitive cells; perform interpolation and demosaicking on the unprocessed colour data and the coarse depth data, using at least one neural network, to generate a full-resolution colour data and a full-resolution depth data; and reproject the full-resolution colour data from a given camera pose to a given eye pose of a user, by utilising the full-resolution depth data.

Abstract: A system includes a tracking device and a light source. The tracking device has a camera and a first controller. The camera captures a first image and a second image. The first image is captured during a first period of time (t0-t1) and the second image is captured during a second period of time (t2-t3). The first controller is coupled to the camera and configured to obtain first timing information and second timing information; form timing instructions; and communicate timing instructions to light source over a communication interface. The light source is configured to use timing instructions to illuminate first amount of light and a second amount of light. The first controller is further configured to calculate image intensity difference between the first and second image to identify from first image pixel(s) illuminated by the light source.

Abstract: For a given region of a light-emitting surface of a display unit, an iterative search is performed to find a corresponding reflection portion of a semi-reflective surface of an optical combiner where light rays emanating from the given region are incident and from which the light rays reflect towards a given eye, based on a curvature of the semi-reflective surface, a relative location of the semi-reflective surface with respect to the light-emitting surface, and the relative location of the given eye with respect to the semi-reflective surface. A viewing direction from the given eye towards the corresponding reflection portion is determined. A corresponding pixel location in the input image is determined based on the viewing direction. For the corresponding pixel location in the input image, colour values of a corresponding pixel in the input image are fetched and utilised to display colour at the given region of the light-emitting surface.

Abstract: Disclosed is a method including detecting a movement of a user's gaze by processing gaze-tracking data, collected by a gaze-tracking means of a display apparatus; when the movement of the user's gaze is detected, determining a compensatory movement which when implemented by an image stabilization means of the display apparatus, shifts visual content displayed on at least one display of the display apparatus, according to the movement of the user's gaze; and generating a first drive signal for controlling the image stabilization means to implement the compensatory movement, during a frame display time.

Abstract: Disclosed is an apparatus and a method for depth sensing that includes a scanning light source configured to sequentially illuminate an environment utilizing a scan pattern. The apparatus also includes a birefringent layer adapted to receive and split reflected scan pattern from the environment into an ordinary ray (O-ray) image and an extraordinary ray (E-ray) image. The apparatus further includes an imaging sensor positioned along an optical path of the birefringent layer to capture the O-ray image and the E-ray image as transmitted therefrom. The apparatus further includes a processor configured to compute differences between positions of the O-ray image and the E-ray image and derive a depth map of the environment based on the computed differences.

Abstract: Disclosed is data processing system having at least one server communicably couplable to at least one display apparatus, wherein at least one server has at least one processor configured to obtain quality of service information from network traffic regulator of communication network, wherein communication network is between at least one server and at least one display apparatus, obtain media processing latency information from at least one rendering application executing at the at least one server, and obtain client device operational information from at least one display apparatus; process quality of service information, media processing latency information, and client device operational information together to generate streaming configuration parameters; and control at least one rendering application to generate images for displaying at the at least one display apparatus and send images via communication network to at least one display apparatus, according to generated streaming configuration parameters.

Abstract: Tracking means is utilised to estimate potential positions of a head of a user sitting on a seat of a vehicle. A three-dimensional (3D) volume where the user's head is likely to be present is determined, based on a current setting of adjustable seat parameter(s), the adjustable seat parameter(s) being detected by sensor(s). It is detected whether at least one of the plurality of potential positions of the head lies outside the 3D volume. When it is detected that at least one of the plurality of potential positions of the head lies outside the 3D volume, the at least one of the plurality of potential positions is considered as an outlier, and a correct position of the user's head is determined as one of the plurality of potential positions of the head that lies within the 3D volume.

Abstract: Tracking means is utilised to track a position and an orientation of a head of user(s) sitting inside a vehicle. A vehicular acceleration signal is determined for a first time period, based on at least one of: an acceleration, an orientation of the vehicle sensed by sensor(s) during the first time period. Transformation(s) is/are applied to the vehicular acceleration signal to generate a head acceleration signal for a second time period, wherein the head acceleration signal is indicative of a change in at least one of: an acceleration, the orientation of the head. An expected head movement of the user(s) is determined, based on the head acceleration signal. The position and the orientation of the head being tracked by utilising the tracking means are refined, based on the expected head movement.

Abstract: For a region of an image, a portion of a semi-reflective surface of an optical combiner from which light rays of the given region are reflected towards eyes of a user during display via a display unit is determined. For this portion of the semi-reflective surface, a secondary reflection intensity of light rays of another region of the image that undergo secondary reflection from a portion of another surface of the optical combiner is determined. A minimum intensity level of pixels in the image is increased. Intensity values of pixels in said region of the image are adjusted based on the secondary reflection intensity. The image is displayed via the display unit, thereby producing a synthetic light field. The optical combiner reflects the synthetic light field towards the eyes, whilst optically combining the synthetic light field with a real-world light field.

Abstract: Disclosed is a backlight unit of a liquid crystal display device, the backlight unit having an array of light-emitting diodes (LEDs) of at least three different colours, wherein the LEDs are arranged as groups of LEDs within the array, each group including at least one LED of each of the at least three different colours; a control circuit that is to be employed to control individual LEDs in the array; and a controller configured to drive the control circuit to selectively decrease a brightness of LEDs of at least one of the at least three different colours in at least a part of the array.

Abstract: Disclosed is a method for depth image enhancement implemented in at least one apparatus, the method including: reading and processing Phase Detection Autofocus (PDAF) pixels of a region-of-interest (ROI) area of a gaze region in an image obtained from a color camera sensor; utilizing one or more depth camera sensors to provide one or more depth maps of the ROI area of the gaze region; and combining the processed PDAF pixels of the ROI area of the gaze region and the one or more depth maps of the ROI area of the gaze region to obtain an updated ROI area with complementary depth information of the ROI area of the gaze region.

Abstract: Disclosed is imaging system with image sensor; pose-tracking means; and processor(s) configured to capture a sequence of images to determine corresponding poses of the image sensor with respect to which images are captured, wherein when capturing image, the processor(s) is configured to perform demosaicing on image data; identify static region(s) in the image(s); obtain new image data to determine a new pose of image sensor; reproject image(s) from a corresponding pose of image sensor with respect to which image(s) is captured to new pose of image sensor, wherein static region(s) in the image(s) is reprojected to generate reprojected static region(s); and generate a new image corresponding to the new image data, by performing temporal reconstruction of static region(s) in the new image that corresponds to the static region(s) of the image(s), based on the reprojected static region(s) of the reprojected image(s).

Abstract: A system includes a server and a data repository storing a three-dimensional environment model, where the server is configured to: receive, from a client device a first image of a real-world environment captured by camera along with information indicative of a first measured pose of the client device; utilise the 3D environment model to generate a first reconstructed image from a perspective of a first measured pose; determine a transformation indicative of a difference in the first measured pose and a first actual pose of the client device; use the transformation to calculate the first actual pose; and send information indicative of at least one of: the first actual pose, or the first spatial transformation, to the client device for calculating subsequent actual poses.

Abstract: A display device includes a first liquid crystal (LC) layer and a second LC layer arranged between a backlight unit and a linear polarizer, and a multiscopic optical element arranged between the first LC layer and the second LC layer. Drive signals for LC cells of the first LC layer and the second LC layer are generated, based on corresponding images to be presented to each eye of each individual user, a relative location of each eye with respect to an image plane of the display device, and relative positions of the LC cells of the first LC layer and the second LC layer with respect to multiscopic cells of the multiscopic optical element. The LC cells are controlled using the drive signals, to adjust a polarization of light passing therethrough, for producing a synthetic light field presenting the corresponding images to each eye of each individual user.

Abstract: Disclosed is a system with server(s) that is communicably coupled to display apparatus(es). The server(s) is/are configured to: receive, from display apparatus(es), information indicative of gaze directions of a user's eye; process the information to detect a beginning of a saccade; predict a target gaze location of the saccade, based on the information; and foveate a video stream according to the target gaze location after the beginning of the saccade and before an end of the saccade.

Abstract: Disclosed is an apparatus including an image sensor to capture an input image with one or more textual features. The one or more textual features are present in an unreadable or distorted form. Further, the apparatus includes a processor configured to detect the one or more textual features of the input image and execute a neural network to concurrently deduce a plurality of glyphs that form one or more relevant words or abbreviations based on the detected one or more textual features of the input image. Further, the processor is configured to generate an output image with enhanced one or more textual features in a legible form based on the deduced plurality of glyphs.

Abstract: A system includes at least one server configured to receive, from a client device, information indicative of gaze directions of a user's eyes; determine a gaze point and a gaze depth of the user's eyes, using said information; identify, in an image, a gaze-contingent region that includes and surrounds the gaze point; identify a region of interest in the gaze-contingent region, wherein the region of interest comprises pixels whose optical depth lies within a first predefined distance (?d1) from the gaze depth; encode the image by applying a first encoding setting to the pixels belonging to the region of interest; and send the image that is encoded, to the client device.

Abstract: Disclosed is a system with server(s) configured to: receive, from a display apparatus, hardware parameters of a display of the display apparatus and optical path information pertaining to an optical path between the display and a user's eye; determine an effective resolution for each point on the display, based at least on the hardware parameters of the display and the optical path information; determine a foveation setting to be employed for image processing; determine image processing setting(s) to be employed for image processing, based on the effective resolution for each point on the display and the foveation setting; process an image according to the image processing setting(s); and send the image to the display apparatus.