Abstract: A system for producing images for a display apparatus. The system includes image source(s) and processor. The processor is configured to obtain information indicative of angular size of field of view providable by image renderer of display apparatus; obtain information indicative of gaze direction of user; receive sequence of images from image source(s); and process sequence of images to generate sequence of processed images. When processing sequence of images, processor is configured to crop a given image, based on gaze direction of user and angular size of field of view, to generate processed image. Angular size of field of view represented by processed image is larger than angular size of field of view providable by the image renderer.

Abstract: An imaging system for producing images for a display apparatus. Imaging system includes at least one imaging unit including camera, optical element including first optical portion and second optical portion having different focal lengths, and means for adjusting optical focus; means for generating depth or voxel map; and processor. Processor is configured to obtain gaze direction of user; determine optical depth of object present in region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on optical depth of object and focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.

Abstract: A display apparatus including display or projector, means for tracking position and orientation of user's head, and processor coupled to display or projector and said means. The processor or external processor communicably coupled to processor is configured to obtain head-tracking data indicative of position and orientation; process head-tracking data to determine current position and orientation of user's head and velocity and/or acceleration with which position and orientation is changing; predict first and second position and orientation of user's head at time t1 and t2, respectively; determine first and second projection matrices to be applied to three-dimensional image data of given frame, respectively; and apply first and second projection matrices to said image data to generate first image frame and second image frame, respectively. Processor is configured to render first and second image frame at time t1 and t2, respectively.

Abstract: A display apparatus includes at least one light source per eye, the at least one light source being operable to emit a light beam; at least one beam scanning arrangement per eye, the at least one beam scanning arrangement being configured to direct the light beam towards a projection surface, and to sweep the light beam according to a scanning pattern, the scanning pattern being substantially in a form of a spiral; and a processor configured to control the at least one light source and the at least one beam scanning arrangement to draw at least a first region of an input image over the projection surface, wherein a resolution of the first region of the input image is to vary as a function of an angular distance from a centre of the spiral.

Abstract: An imaging system for producing images for a display apparatus. The imaging system includes at least one camera, and processor communicably coupled to the at least one camera. The processor is configured to: obtain, from display apparatus, information indicative of current gaze direction of a user; determine, based on current gaze direction of the user, an object of interest within at least one display image, wherein the at least one display image is representative of a current view presented to user via display apparatus; adjust, based on a plurality of object attributes of the object of interest, a plurality of camera attributes of the at least one camera for capturing a given image of a given real-world scene; and generate from the given image a view to be presented to user via display apparatus.

Abstract: A display apparatus including means for detecting user's gaze direction; first light source; second light source; configuration (108, 208, 306) of reflective elements to split light to create copies of second image; optical waveguides whose outlets are arranged in tiled layout; opacity masks arranged at inlets of waveguides; and processor. Input image is processed to generate first and second images. Processor is configured to: display first and second images; and for optical waveguides, control respective opacity masks to block respective copies of second image or selectively allow portions of respective copies of second image to pass through towards inlets of waveguides. Light from first light source is optically combined with light exiting outlets of waveguides, to produce output image.

Abstract: A system for producing images for display apparatus includes an image source to obtain an input image and a processor configured to obtain information of a gaze direction of a user, determine a region of interest of the input image based on the gaze direction, and process the input image to generate a first with a first region that is blurred with respect to region of interest, and a second image corresponding to the region of interest. The processor adjusts an intensity of pixels within the first region and an intensity of pixels within the second image. When an intensity of a given pixel within the region of interest is lower than or equal to a predefined intensity threshold, an intensity of a corresponding pixel within the first region is lower than an intensity of a corresponding pixel within the second image.

Abstract: An input device including first sensor that measures first sensor data indicative of at least one of: pressure applied to input device, presence or absence of given object in proximity of input device, distance of given object from input device, position and orientation of input device; and processor coupled to first sensor. Processor processes first sensor data to determine state of input device, said state indicating whether or not input device is lying on given object; obtains, from user device, context information pertaining to visual scene being presented to user; and controls input device to operate in first mode of operation or second mode of operation based on said state and context information. Input device acts as computer mouse during first mode of operation and as six-degrees-of-freedom controller during second mode of operation.

Abstract: A display apparatus communicably coupled with server arrangement. Display apparatus includes means for tracking user's gaze; means for tracking pose of display apparatus; light source; optical element; and processor. Processor is configured to: process gaze-tracking data; process pose-tracking data; send, to server arrangement, gaze information and apparatus information, server arrangement predicts gaze information and apparatus information, and processes input image to generate image based on predictions; receive, image, predicted gaze information, and predicted apparatus information; determine adjustment required in configuration of light source and optical element prior to displaying image; determine if portion of previous image is to be displayed during adjustment; if yes, display said portion during adjustment; if no, switch off or dim light source during adjustment; display image via light source after adjustment.

Abstract: An imaging system including infrared light source, imaging unit and processor. Imaging unit includes first and second image-sensor chips, semi-transparent reflective element, infrared filter arranged to block transmission of infrared light towards first image-sensor chip, and means for transmitting infrared light received from overlapping field of view towards second image-sensor chip, whilst blocking transmission of infrared light received from non-overlapping field of view towards second image-sensor chip. First and second image-sensor chips are controlled to capture first and second images of real-world environment, wherein portion of second image-sensor chip that receives infrared light from overlapping field of view captures depth information pertaining to overlapping field of view. Extended-reality image is generated from first and second images, based on depth information.

Abstract: A system for processing images for display apparatus, system is communicably coupled to display apparatus, display apparatus including first and second image renderers, system includes image source and processor, wherein image source produces input image, processor of system being configured to: process input image to generate first image such that first region of first image is blurred and its intensity is reduced with respect to intensity of corresponding region of input image; and process input image to generate second image, second image corresponding to cropped region of input image, intensity of second image being adjusted according to intensity of aforesaid first region; wherein processor of system or processor of display apparatus renders first and second images at first and second image renderers, respectively, projections of rendered first and second images being optically combined such that projection of rendered second image overlaps with projection of first region of first image.

Abstract: A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.

Abstract: A display apparatus includes an image renderer per eye, at least one optical element arranged on an optical path between the image renderer and an image plane and a processor coupled to the image renderer. The processor or an image source communicably coupled to the processor is configured to generate a warped image based upon the optical properties of the first optical portion and the second optical portion. The processor is configured to render the warped image via the image renderer, wherein projections of a first portion and a second portion of the warped image are to be differently magnified by the first optical portion and the second optical portion of the at least one optical element, respectively, to produce the image on the image plane in a manner that the produced image appears de-warped to a user. The image has a spatially-variable angular resolution on an image plane.

Abstract: A display apparatus includes means for detecting gaze direction of user; processor configured to process input image based upon gaze direction to generate first and second images; first and second image renderers to render first and second images; optical combiner; first array of micro-prisms to split light emanating from second image renderer into multiple directions to produce multiple projections of second image; optical element to direct said multiple projections towards optical combiner; and optical shutter arranged between optical element and optical combiner, wherein optical shutter allows given portion of said multiple projections to pass, whilst blocking remaining portion of said multiple projections. The optical combiner optically combines projection of first image with given portion of said multiple projections, to produce on image plane output image having spatially-variable angular resolution.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes: at least one first optical element comprising particles of a phosphorescent or fluorescent material dispersed therein, the particles of the phosphorescent or fluorescent material being dispersed in a manner that when excited by electromagnetic radiation incident thereupon, the particles produce structured light of a given wavelength, wherein the produced structured light illuminates a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form of the reflections and a position of the reflections on an image plane of the at least one camera; and a processor coupled in communication with the at least one camera, wherein the processor is configured to process the captured image to detect a gaze direction of the user.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus and an aperture device. The gaze-tracking system includes a first light source and a second light source operable to emit light of first and second type respectively; an image sensor operable to capture an image of the user's eye and reflections of the light of first type from the user's eye; a primary lens; an aperture device positioned between the image sensor and the primary lens, and a processor configured to control the first and second light sources and image sensor, and to process the captured image to detect a gaze direction of the user. The aperture device provides a first aperture to the light of first type and a second aperture to the light of second type, the first aperture and the second aperture being substantially concentric, the first aperture being smaller than the second aperture.

Abstract: An imaging system for producing images to be displayed to user via a head-mounted display apparatus that includes means for detecting gaze direction of user. The imaging system includes a first outer camera and a second outer camera, at least one inner camera, and processor coupled to aforesaid cameras and means for detecting gaze direction. The processor is configured to (i) obtain inter-pupillary distance of user with respect to user's gaze at infinity; (ii) receive detected gaze direction; (iii) control first outer camera, second outer camera and at least one inner camera to capture first outer image, second outer image and at least one inner image of a scene; and (iv) process first outer image and inner image to generate first view of the scene, and process second outer image and inner image to generate second view of the scene, based upon inter-pupillary distance and detected gaze direction.

Abstract: Disclosed is gaze-tracking system for head-mounted display apparatus, the gaze-tracking system including a plurality of non-circular light sources that emit light for illuminating a user's eye when the display apparatus is worn by user, at least one camera, and a processor. The processor is configured to control the at least one camera to capture an image of user's eye and reflections of the plurality of non-circular light sources from user's eye; identify at least one of the plurality of non-circular light sources from where at least one of the reflections originated, based upon shapes, rotational orientations and relative positions of the reflections of the plurality of non-circular light sources, to differentiate said reflections from visual artifacts; and detect a gaze direction of user based upon a relative position of a pupil of user's eye with respect to the reflections of the plurality of non-circular light sources.

Abstract: An imaging system for producing mixed-reality images for display apparatus. The imaging system includes a camera and a processor communicably coupled to the camera. The processor is configured to control the camera to capture image of real-world environment; analyze the image to identify surface that displays visual content; compare the visual content displayed in the image with reference image of the visual content to determine size, position and orientation of the surface with respect to the camera; process the reference image of the visual content to generate processed image of the visual content; and replace the visual content displayed in the image with the processed image to generate mixed-reality image, wherein resolution of the processed image is higher than resolution of the visual content displayed in the image.

Abstract: A display apparatus including at least one image renderer; light sources; controllable scanning mirrors; at least two actuators associated with the controllable scanning mirrors; means for detecting gaze direction of user; and a processor communicably coupled to the aforementioned components. The processor is configured to: (a) obtain an input image and determine region of visual accuracy thereof; (b) process the input image to generate a context image and a focus image; (c) determine a focus area within a projection surface over which the focus image is to be drawn; (d) render the context image; (e) draw the focus image; and (f) control the actuators to align the controllable scanning mirrors. The processor is configured to perform (d), (e) and (f) substantially simultaneously, and optically combine a projection of the drawn focus image with a projection of the rendered context image to create a visual scene.