Abstract: An imaging system for correcting visual artifacts during production of extended-reality images for display apparatus. The imaging system includes at least first camera and second camera for capturing first image and second image of real-world environment, respectively; and processor(s) configured to: analyse first and second images to identify visual artifact(s) and determine image segment of one of first image and second image that corresponds to visual artifact(s); generate image data for image segment, based on at least one of: information pertaining to virtual object, other image segment(s) neighbouring image segment, corresponding image segment in other of first image and second image, previous extended-reality image(s), photogrammetric model of real-world environment; and process one of first image and second image, based on image data, to produce extended-reality image for display apparatus.

Abstract: A system including image sensor(s) including a plurality of pixels arranged on a photo-sensitive surface thereof; and image signal processor(s) configured to: receive, from image sensor(s), a plurality of image signals captured by corresponding pixels of image sensor(s); and process the plurality of image signals to generate at least one image, wherein, when processing, image signal processor(s) is configured to: determine, for a given image signal to be processed, a position of a given pixel on the photo-sensitive surface that is employed to capture the given image signal; and selectively perform a sequence of image signal processes on the given image signal and control a plurality of parameters employed for performing the sequence of image signal processes, based on the position of the given pixel.

Abstract: An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene of real-world environment; determine gaze directions of first eye and second eye; identify line of sight of user and conical region of interest real-world scene; determine optical depths of objects in conical region of interest, wherein at least first object, second object and third object from amongst objects are at different optical depths; adjust optical focus of one of first camera and second camera to focus on first object and second object in alternating manner, whilst adjusting optical focus of another of first camera and second camera to focus on third object; and capture images using adjusted optical focus of cameras.

Abstract: An imaging system including: image sensor including pixels arranged on photo-sensitive surface; and processor configured to: obtain information indicative of gaze direction of user's eye; identify gaze position on photo-sensitive surface; determine first region and second region on photo-sensitive surface, wherein first region includes and surrounds gaze position, while second region surrounds first region; read out first pixel data from each pixel of first region; select set of pixels to be read out from second region based on predetermined sub-sampling pattern; read out second pixel data from pixels of selected set; generate, from second pixel data, pixel data of remaining pixels of second region; and process first pixel data, second pixel data, and generated pixel data to generate image frame(s).

Abstract: An encoder for encoding images. The encoder includes processor. The processor is configured to: receive, from display apparatus, information indicative of at least one of: head pose of user, gaze direction of user; identify gaze location in input image, based on the at least one of: head pose, gaze direction; divide input image into first input portion and second input portion, wherein first input portion includes and surrounds gaze location; and encode first input portion and second input portion at first compression ratio and at least one second compression ratio to generate first encoded portion and second encoded portion, respectively, wherein at least one second compression ratio is larger than first compression ratio.

Abstract: An imaging apparatus including: an image sensor having a photo-sensitive surface; an optical device arranged on an optical path of light incidenting on the photo-sensitive surface, the optical device being electrically controllable to have a spatially variable focal length; and a processor configured to: generate and send a drive signal to the optical device to compensate for field curvature of optical device by adjusting focal lengths of different portions of the optical device to different extents, wherein a focal length of a first portion of the optical device is higher than a focal length of a second portion of the optical device surrounding the first portion; and control the image sensor to capture a distorted image of a real-world environment.

Abstract: An imaging apparatus including: an image sensor having a photo-sensitive surface; an optical device arranged on an optical path of light incidenting on the photo-sensitive surface, the optical device being electrically controllable to have a spatially variable focal length; and a processor configured to: generate and send a drive signal to the optical device to compensate for field curvature of optical device by adjusting focal lengths of different portions of the optical device to different extents, wherein a focal length of a first portion of the optical device is higher than a focal length of a second portion of the optical device surrounding the first portion; and control the image sensor to capture a distorted image of a real-world environment.

Abstract: The transmitted information from a gaze tracker camera to a control unit of a VR/AR system can be controlled by an image signal processor (ISP) for use with a camera arranged to provide a stream of images of a moving part of an object in a VR or AR system to a gaze tracking function of the VR or AR system, the image signal processor being arranged to receive a signal from the gaze tracking function indicating at least one desired property of the images and to provide the stream of images to the gaze tracking function according to the signal. The ISP may be arranged to provide the image as either a full view of the image with reduced resolution or a limited part of the image with a second resolution which is high enough to enable detailed tracking of the object.

Abstract: An imaging system for producing images for display apparatus. Imaging system includes at least one imaging unit arranged to face real-world scene including camera, optical element including first optical portion and second optical portion having different focal lengths, first focal length of first optical portion is smaller than second focal length of second optical portion, and means for adjusting optical focus; and processor. Processor is configured to obtain gaze direction of user; determine region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.

Abstract: An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene; determine gaze directions of first eye and second eye; identify line of sight and conical region of interest; determine optical depths of first object and second object present in conical region; when first and second objects are placed horizontally opposite, adjust optical focuses of first and second cameras to focus on respective objects on same side as them; when first and second objects are placed vertically opposite, adjust optical focus of one camera corresponding to dominant eye to focus on object having greater optical depth, and adjust optical focus of another camera to focus on another object; and capture first image(s) and second image(s) using adjusted optical focuses of cameras.

Abstract: A system including image sensor(s) including a plurality of pixels arranged on a photo-sensitive surface thereof; and image signal processor(s) configured to: receive, from image sensor(s), a plurality of image signals captured by corresponding pixels of image sensor(s); and process the plurality of image signals to generate at least one image, wherein, when processing, image signal processor(s) is configured to: determine, for a given image signal to be processed, a position of a given pixel on the photo-sensitive surface that is employed to capture the given image signal; and selectively perform a sequence of image signal processes on the given image signal and control a plurality of parameters employed for performing the sequence of image signal processes, based on the position of the given pixel.

Abstract: A system including: image sensor including pixels arranged on photo-sensitive surface thereof; and image signal processor configured to: receive, from image sensor, image signals captured by corresponding pixels; and process image signals to generate at least one image. When processing, image signal processor is configured to: determine at least one region within photo-sensitive surface that corresponds to image segment of at least one image over which blend object is to be superimposed; and selectively perform sequence of image signal processes on given image signal and control plurality of parameters employed therefor, based on whether a given pixel that is employed to capture given image signal lies in at least one region or remaining region within photo-sensitive surface.

Abstract: An imaging system for correcting visual artifacts during production of extended-reality images for display apparatus. The imaging system includes at least first camera and second camera for capturing first image and second image of real-world environment, respectively; and processor(s) configured to: analyse first and second images to identify visual artifact(s) and determine image segment of one of first image and second image that corresponds to visual artifact(s); generate image data for image segment, based on at least one of: information pertaining to virtual object, other image segment(s) neighbouring image segment, corresponding image segment in other of first image and second image, previous extended-reality image(s), photogrammetric model of real-world environment; and process one of first image and second image, based on image data, to produce extended-reality image for display apparatus.

Abstract: An imaging system including: first camera; N second cameras, optical axes of first and second cameras being arranged at an angle; and processor(s) configured to: control first camera and N second cameras to capture first image and N second images, second field of view (FOV) is narrower than first FOV and overlaps with portion of first FOV; determine first overlapping portions (P, P?, A, A?, A?), second overlapping portion(s) (Q, B, B?, B?), and third overlapping portion (C) of first image; for given overlapping portion of first image, determine corresponding overlapping portion of at least one of N second images; and process corresponding overlapping portions of first and second images to generate corresponding portion of output image.

Abstract: An electronic device is disclosed herein that includes an infrared light source to emit infrared light, a rolling shutter sensor, and at least one processor. The at least one processor is to: cause the rolling shutter sensor to output a first signal corresponding to a first frame of image data during exposure to the infrared light, reset the rows of the rolling shutter sensor at a same time, cause the rolling shutter sensor to output a second signal corresponding to a second frame of image data without exposure to the infrared light from the infrared light source, determine a difference between the first signal and the second signal to generate an ambient infrared free frame, and recognize a face based on the ambient infrared free frame.

Abstract: An electronic device is disclosed herein that includes an infrared light source to emit infrared light, a rolling shutter sensor, and at least one processor. The at least one processor is to: cause the rolling shutter sensor to output a first signal corresponding to a first frame of image data during exposure to the infrared light, reset the rows of the rolling shutter sensor at a same time, cause the rolling shutter sensor to output a second signal corresponding to a second frame of image data without exposure to the infrared light from the infrared light source, determine a difference between the first signal and the second signal to generate an ambient infrared free frame, and recognize a face based on the ambient infrared free frame.

Abstract: An encoder for encoding images. The encoder includes processor. The processor is configured to: receive, from display apparatus, information indicative of at least one of: head pose of user, gaze direction of user; identify gaze location in input image, based on the at least one of: head pose, gaze direction; divide input image into first input portion and second input portion, wherein first input portion includes and surrounds gaze location; and encode first input portion and second input portion at first compression ratio and at least one second compression ratio to generate first encoded portion and second encoded portion, respectively, wherein at least one second compression ratio is larger than first compression ratio.

Abstract: An imaging system for producing extended-reality images for a display apparatus. The imaging system includes a first camera, a second camera and at least one processor. The processor is configured to: control the first camera and the second camera to capture pairs of first images and second images of a real-world environment, respectively, wherein a given pair comprises a first image and a second image captured for a first eye and a second eye of a user, respectively; denoise the first image and the second image at a first denoise level and a second denoise level, respectively; and process the first image and the second image, upon denoising, to generate a first extended-reality image and a second extended-reality image to be rendered via the display apparatus, respectively.

Abstract: A system for producing extended-reality images for a display apparatus. The system includes camera(s) and processor communicably coupled to camera(s), wherein processor is configured to: control camera(s) to capture image(s) representing test object present in real-world environment, wherein test object is physically covered three-dimensionally with coded pattern; obtain information pertaining to three-dimensional geometry of coded pattern; analyze image(s) to identify first image segment representing part of coded pattern visible in image(s); determine virtual content to be presented for test object, based on said part of coded pattern; process image(s) to generate extended-reality image(s) in which virtual content is virtually superimposed over said part of the coded pattern, based on information pertaining to three-dimensional geometry of coded pattern.

Abstract: An imaging system for producing extended-reality images for a display apparatus. The imaging system including camera that is employed to capture input image representing captured region of real-world environment; and processor configured to: generate intermediate image by correcting spatial distortion of input image; determine capturing region of intermediate image representing captured region of real-world environment and non-capturing regions of intermediate image corresponding to non-captured regions of real-world environment; generate image data for non-capturing region of intermediate image, based on at least one of: information pertaining to virtual object that is to be virtually superimposed, capturing region neighbouring non-capturing region, previous extended-reality image, photogrammetric model of real-world environment; and process intermediate image, based on generated image data, to produce extended-reality image to be presented at display apparatus.