Abstract: A display system including eye-tracking means, first image renderer, second image renderer, optical combiner and processor is described. Eye-tracking data is processed to determine gaze directions of user's eyes. Gaze location and gaze velocity and/or acceleration of user is determined based on gaze directions of user's eyes. It is detected whether or not gaze has been fixated for predefined time period based on gaze location and gaze velocity and/or acceleration of user. If gaze has been fixated, input image is processed to generate and render first image and second image substantially simultaneously. Projection of rendered first image and projection of rendered second image are combined optically by optical combiner to create extended-reality scene. If gaze has not been fixated, input image is processed to generate and render first image via first image renderer, whilst switching off or dimming second image renderer.

Abstract: A display apparatus including: image renderer including light-emitting diodes that are to be employed as sub-pixels of image renderer; liquid-crystal device including liquid-crystal structure and control circuit, wherein liquid-crystal structure is arranged in front of light-emitting diodes of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from light-emitting diode to target positions on image plane according to shifting sequence in repeated manner; and processor(s) configured to render output sequence of output image frames via image renderer, wherein shift in light emanating from light-emitting o diode to target positions causes resolution of output image frames to appear higher than display resolution of image renderer.

Abstract: In a display apparatus, a liquid-crystal structure, arranged in front of an image renderer, is controlled to shift light of a given sub-pixel to target positions according to a shifting sequence in a repeated manner, while output image frames are displayed. To generate a given output image frame, a given target position to which the light is to be shifted is determined based on the shifting sequence. An input colour value of the given sub-pixel provided in a given input image frame is then adjusted to generate an output colour value of the given sub-pixel for the given output image frame, based on an output colour value of at least one other sub-pixel whose light overlaps with the given target position during display of a previous output image frame, and a retention coefficient between a colour of the at least one other sub-pixel and a colour of the given sub-pixel.

Abstract: A display apparatus including pose-tracking means; image renderer per eye; liquid-crystal device including liquid-crystal structure and control circuit; and processor. Processor is configured to: process pose-tracking data to determine user's head pose; detect if rate at which head pose is changing is below predefined threshold rate; if yes, switch on lock mode, select head pose for session of lock mode, and generate output image frames according to head pose during session; if no, generate output image frames according to corresponding head poses of user using pose-tracking data; and display output image frames, whilst shifting light emanating to from pixels of image renderer to multiple positions (P1-P9) in sequential and repeated manner, said shifting causes resolution of output image frames to appear higher than display resolution of image renderer.

Abstract: A display apparatus including an image renderer per eye; a liquid-crystal device including a liquid-crystal structure and a control circuit, the liquid-crystal structure being arranged in front of image-rendering surface of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from a given pixel of the image renderer to a plurality of positions in a sequential and repeated manner; and at least one processor configured to render a sequence of output image frames via the image renderer, wherein a shift in the light emanating from the given pixel of the image renderer to the plurality of positions causes a resolution of the output image frames to appear higher than a display resolution of the image renderer.

Abstract: A projection apparatus including an array of infrared emitters, the infrared emitters of said array being arranged in a first pattern; a plurality of liquid-crystal cells and corresponding control circuits, a given liquid-crystal cell being arranged in front of a corresponding infrared emitter of said array; and a processor configured to generate drive signals for driving the control circuits in a random or pseudorandom manner; and control the plurality of liquid-crystal cells individually, via the corresponding control circuits, to project a second pattern of light spots onto objects present in a real-world environment, wherein, when driven by a given drive signal, a given control circuit electrically controls a corresponding liquid-crystal cell to any of: block light emanating from a corresponding infrared emitter, transmit the light in an unbended manner, bend the light.

Abstract: A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.

Abstract: A tracking system for use in head-mounted display apparatus includes at least one emitter that emits signals; a first receiver and a second receiver that sense the emitted signals and generate sensor data, the first receiver and the second receiver being arranged on a first portion and a second portion, respectively, wherein the first portion faces a user when the head-mounted display apparatus is worn by the user, and the second portion is a part of a user-interaction controller of a head-mounted display; and a processor configured to process the generated sensor data to determine relative positions and orientations of first receiver and second receiver with respect to the emitter, and to determine a relative position and orientation of the second receiver with respect to the first receiver.

Abstract: A system for producing images for a display apparatus. The system includes image source(s) and processor. The processor is configured to obtain information indicative of angular size of field of view providable by image renderer of display apparatus; obtain information indicative of gaze direction of user; receive sequence of images from image source(s); and process sequence of images to generate sequence of processed images. When processing sequence of images, processor is configured to crop a given image, based on gaze direction of user and angular size of field of view, to generate processed image. Angular size of field of view represented by processed image is larger than angular size of field of view providable by the image renderer.

Abstract: A system for producing images for a display apparatus. The system includes image source(s) and processor. The processor is configured to obtain information indicative of angular size of field of view providable by image renderer of display apparatus; obtain information indicative of gaze direction of user; receive sequence of images from image source(s); and process sequence of images to generate sequence of processed images. When processing sequence of images, processor is configured to crop a given image, based on gaze direction of user and angular size of field of view, to generate processed image. Angular size of field of view represented by processed image is larger than angular size of field of view providable by the image renderer.

Abstract: A tracking system for use in head-mounted display apparatus includes at least one emitter that emits signals; a first receiver and a second receiver that sense the emitted signals and generate sensor data, the first receiver and the second receiver being arranged on a first portion and a second portion, respectively, wherein the first portion faces a user when the head-mounted display apparatus is worn by the user, and the second portion is a part of a user-interaction controller of a head-mounted display; and a processor configured to process the generated sensor data to determine relative positions and orientations of first receiver and second receiver with respect to the emitter, and to determine a relative position and orientation of the second receiver with respect to the first receiver.

Abstract: A display apparatus includes an image renderer per eye, at least one optical element arranged on an optical path between the image renderer and an image plane and a processor coupled to the image renderer. The processor or an image source communicably coupled to the processor is configured to generate a warped image based upon the optical properties of the first optical portion and the second optical portion. The processor is configured to render the warped image via the image renderer, wherein projections of a first portion and a second portion of the warped image are to be differently magnified by the first optical portion and the second optical portion of the at least one optical element, respectively, to produce the image on the image plane in a manner that the produced image appears de-warped to a user. The image has a spatially-variable angular resolution on an image plane.

Abstract: A display apparatus includes an image renderer per eye, at least one optical element arranged on an optical path between the image renderer and an image plane and a processor coupled to the image renderer. The processor or an image source communicably coupled to the processor is configured to generate a warped image based upon the optical properties of the first optical portion and the second optical portion. The processor is configured to render the warped image via the image renderer, wherein projections of a first portion and a second portion of the warped image are to be differently magnified by the first optical portion and the second optical portion of the at least one optical element, respectively, to produce the image on the image plane in a manner that the produced image appears de-warped to a user. The image has a spatially-variable angular resolution on an image plane.

Abstract: A display apparatus includes means for detecting gaze direction of user; processor configured to process input image based upon gaze direction to generate first and second images; first and second image renderers to render first and second images; optical combiner; first array of micro-prisms to split light emanating from second image renderer into multiple directions to produce multiple projections of second image; optical element to direct said multiple projections towards optical combiner; and optical shutter arranged between optical element and optical combiner, wherein optical shutter allows given portion of said multiple projections to pass, whilst blocking remaining portion of said multiple projections. The optical combiner optically combines projection of first image with given portion of said multiple projections, to produce on image plane output image having spatially-variable angular resolution.

Abstract: A display apparatus includes a plurality of housings connected by adjustable device for setting spacing between centers of the plurality of housings, each housing including: first image source mounted to side of housing; second image source mounted to housing angularly offset from first image source, wherein second image source includes higher resolution and narrower image field of view than first image source; optical combiner positioned in housing between first and second image sources, on which first image from first image source and second image from second image source are superimposed and made visible to user's eye; magnification lens for magnifying second image to increase image field of view; eyepiece lens for reducing focal distance between the optical combiner and the user's eye; and controller configured to control output of second image source to render colors to compensate for distortion and chromatic aberrations introduced by magnification lens.

Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes: at least one first optical element comprising particles of a phosphorescent or fluorescent material dispersed therein, the particles of the phosphorescent or fluorescent material being dispersed in a manner that when excited by electromagnetic radiation incident thereupon, the particles produce structured light of a given wavelength, wherein the produced structured light illuminates a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form of the reflections and a position of the reflections on an image plane of the at least one camera; and a processor coupled in communication with the at least one camera, wherein the processor is configured to process the captured image to detect a gaze direction of the user.

Abstract: A display apparatus includes means for detecting gaze direction of user; processor configured to process input image based upon gaze direction to generate first and second images; first and second image renderers to render first and second images; optical combiner; first array of micro-prisms to split light emanating from second image renderer into multiple directions to produce multiple projections of second image; optical element to direct said multiple projections towards optical combiner; and optical shutter arranged between optical element and optical combiner, wherein optical shutter allows given portion of said multiple projections to pass, whilst blocking remaining portion of said multiple projections. The optical combiner optically combines projection of first image with given portion of said multiple projections, to produce on image plane output image having spatially-variable angular resolution.

Abstract: A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.

Abstract: A display apparatus includes image renderer per eye, optical element arranged on optical path between image renderer and image plane, means for detecting gaze direction of user with respect to image plane, and processor coupled to image renderer and said means. The processor or an image source is configured to generate warped image based upon detected gaze direction and different optical properties of first and second optical portions of optical element. The processor is configured to control image renderer to render warped image, whilst controlling rotational orientation of optical element such that first and second optical portions are oriented according to detected gaze direction of user. Projections of first portion and second portion of the warped image are differently magnified by first optical portion and second optical portion, respectively, to produce on image plane an image having spatially-variable angular resolution such that produced image appears de-warped to user.

Abstract: A display apparatus includes a plurality of housings connected by adjustable device for setting spacing between centers of the plurality of housings, each housing including: first image source mounted to side of housing; second image source mounted to housing angularly offset from first image source, wherein second image source includes higher resolution and narrower image field of view than first image source; optical combiner positioned in housing between first and second image sources, on which first image from first image source and second image from second image source are superimposed and made visible to user's eye; magnification lens for magnifying second image to increase image field of view; eyepiece lens for reducing focal distance between the optical combiner and the user's eye; and controller configured to control output of second image source to render colors to compensate for distortion and chromatic aberrations introduced by magnification lens.