Patents Assigned to Varjo Technologies Oy
  • Patent number: 12327528
    Abstract: Disclosed is a backlight unit of a liquid crystal display device, the backlight unit having an array of light-emitting diodes (LEDs) of at least three different colours, wherein the LEDs are arranged as groups of LEDs within the array, each group including at least one LED of each of the at least three different colours; a control circuit that is to be employed to control individual LEDs in the array; and a controller configured to drive the control circuit to selectively decrease a brightness of LEDs of at least one of the at least three different colours in at least a part of the array.
    Type: Grant
    Filed: July 31, 2023
    Date of Patent: June 10, 2025
    Assignee: Varjo Technologies Oy
    Inventors: Oiva Arvo Oskari Sahlsten, Mikko Strandborg
  • Publication number: 20250173118
    Abstract: Disclosed is a display apparatus including at least one speaker per ear; at least one sensor; and at least one processor coupled to the at least one speaker and the at least one sensor. The at least one processor is configured to receive, from the at least one sensor, sensor data indicative of a usage context of the display apparatus; process at least the received sensor data to determine the usage context; and adjust a value of at least one audio parameter for the at least one speaker, based on the determined usage context.
    Type: Application
    Filed: November 23, 2023
    Publication date: May 29, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Anna Nilsson, Oliver Merilaid
  • Publication number: 20250173884
    Abstract: Disclosed is a method for depth image enhancement implemented in at least one apparatus, the method including: reading and processing Phase Detection Autofocus (PDAF) pixels of a region-of-interest (ROI) area of a gaze region in an image obtained from a color camera sensor; utilizing one or more depth camera sensors to provide one or more depth maps of the ROI area of the gaze region; and combining the processed PDAF pixels of the ROI area of the gaze region and the one or more depth maps of the ROI area of the gaze region to obtain an updated ROI area with complementary depth information of the ROI area of the gaze region.
    Type: Application
    Filed: November 23, 2023
    Publication date: May 29, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Mikko Ollila
  • Publication number: 20250175711
    Abstract: Disclosed is imaging system with image sensor; pose-tracking means; and processor(s) configured to capture a sequence of images to determine corresponding poses of the image sensor with respect to which images are captured, wherein when capturing image, the processor(s) is configured to perform demosaicing on image data; identify static region(s) in the image(s); obtain new image data to determine a new pose of image sensor; reproject image(s) from a corresponding pose of image sensor with respect to which image(s) is captured to new pose of image sensor, wherein static region(s) in the image(s) is reprojected to generate reprojected static region(s); and generate a new image corresponding to the new image data, by performing temporal reconstruction of static region(s) in the new image that corresponds to the static region(s) of the image(s), based on the reprojected static region(s) of the reprojected image(s).
    Type: Application
    Filed: November 23, 2023
    Publication date: May 29, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Mikko Ollila
  • Publication number: 20250165064
    Abstract: Disclosed is a system with server(s) that is communicably coupled to display apparatus(es). The server(s) is/are configured to: receive, from display apparatus(es), information indicative of gaze directions of a user's eye; process the information to detect a beginning of a saccade; predict a target gaze location of the saccade, based on the information; and foveate a video stream according to the target gaze location after the beginning of the saccade and before an end of the saccade.
    Type: Application
    Filed: November 19, 2023
    Publication date: May 22, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Tarmo Räntilä
  • Publication number: 20250166258
    Abstract: Disclosed is an apparatus including an image sensor to capture an input image with one or more textual features. The one or more textual features are present in an unreadable or distorted form. Further, the apparatus includes a processor configured to detect the one or more textual features of the input image and execute a neural network to concurrently deduce a plurality of glyphs that form one or more relevant words or abbreviations based on the detected one or more textual features of the input image. Further, the processor is configured to generate an output image with enhanced one or more textual features in a legible form based on the deduced plurality of glyphs.
    Type: Application
    Filed: November 21, 2023
    Publication date: May 22, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Kai Inha, Mikko Ollila, Mikko Strandborg
  • Publication number: 20250155970
    Abstract: A system includes at least one server configured to receive, from a client device, information indicative of gaze directions of a user's eyes; determine a gaze point and a gaze depth of the user's eyes, using said information; identify, in an image, a gaze-contingent region that includes and surrounds the gaze point; identify a region of interest in the gaze-contingent region, wherein the region of interest comprises pixels whose optical depth lies within a first predefined distance (?d1) from the gaze depth; encode the image by applying a first encoding setting to the pixels belonging to the region of interest; and send the image that is encoded, to the client device.
    Type: Application
    Filed: November 9, 2023
    Publication date: May 15, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Timo Toivanen, Mikko Ollila
  • Publication number: 20250157437
    Abstract: Disclosed is a system with server(s) configured to: receive, from a display apparatus, hardware parameters of a display of the display apparatus and optical path information pertaining to an optical path between the display and a user's eye; determine an effective resolution for each point on the display, based at least on the hardware parameters of the display and the optical path information; determine a foveation setting to be employed for image processing; determine image processing setting(s) to be employed for image processing, based on the effective resolution for each point on the display and the foveation setting; process an image according to the image processing setting(s); and send the image to the display apparatus.
    Type: Application
    Filed: November 14, 2023
    Publication date: May 15, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Antti Hirvonen, Mikko Strandborg
  • Patent number: 12294789
    Abstract: An imaging system is disclosed. In a cycle, two or three consecutive pairs of first sub-images and second sub-images are captured using a first image sensor and a second image sensor respectively, while wobulators are controlled to perform, during the cycle, one or two first sub-pixel shifts and one or two second sub-pixel shifts, respectively. A given first sub-pixel shift is performed in first direction, while a given second sub-pixel shift is performed in a second direction different from the first direction The first sub-images and the second sub-images of the cycle are processed, to generate a first image and a second image, respectively.
    Type: Grant
    Filed: July 24, 2023
    Date of Patent: May 6, 2025
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 12293454
    Abstract: A system and method for receiving colour images, depth images and viewpoint information; dividing 3D space occupied by real-world environment into 3D grid(s) of voxels; create 3D data structure(s) comprising nodes, each node representing corresponding voxel; dividing colour image and depth image into colour tiles and depth tiles, respectively; mapping colour tile to voxel(s) whose colour information is captured in colour tile; storing, in node representing voxel(s), viewpoint information indicative of viewpoint from which colour and depth images are captured, along with any of: colour tile that captures colour information of voxel(s) and corresponding depth tile that captured depth information, or reference information indicative of unique identification of colour tile and corresponding depth tile; and utilising 3D data structure(s) for training neural network(s), wherein input of neural network(s) comprises 3D position of point and output of neural network(s) comprises colour and opacity of point.
    Type: Grant
    Filed: February 17, 2023
    Date of Patent: May 6, 2025
    Assignee: Varjo Technologies Oy
    Inventors: Kimmo Roimela, Mikko Strandborg
  • Publication number: 20250142037
    Abstract: Disclosed is computer-implemented method including marching first ray and second ray, along first gaze direction and second gaze direction that are estimated using gaze-tracking means, from given viewpoint into depth map, to determine first optical depth and second optical depth corresponding to first eye and second eye, respectively; calculating gaze convergence distance, based on first gaze direction and second gaze direction; detecting whether first optical depth lies within predefined threshold percent from second optical depth; and when it is detected that first optical depth lies within predefined threshold percent from second optical depth, selecting given focus distance as an average of at least two of: first optical depth, second optical depth, gaze convergence distance; and employing given focus distance for capturing given image using at least one variable-focus camera.
    Type: Application
    Filed: October 31, 2023
    Publication date: May 1, 2025
    Applicant: Varjo Technologies Oy
    Inventor: Ville Timonen
  • Patent number: 12289538
    Abstract: Disclosed is imaging system (200) including controllable light source; image sensor; metalens to focus light onto IS; and processor(s). The processor(s) is configured to control CLS to illuminate given part of field of view of IS at a first instant, while controlling IS to capture first image (FImg). The image segment(s) represent a given part as illuminated and remaining image segment(s) represent a remaining part of the FOV as non-illuminated. The processor controls the CLS to illuminate the remaining part at second instant, while controlling IS to capture a second image whose image segment(s) represents a given part as non-illuminated and a remaining image segment(s) represents a remaining part as illuminated. Output image is generated based on: (i) image segment(s) of FImg and remaining image segment(s) of SImg, and/or (ii) remaining image segment(s) of FImg and image segment(s) of SImg.
    Type: Grant
    Filed: April 25, 2023
    Date of Patent: April 29, 2025
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20250124667
    Abstract: Disclosed is a system comprising data repository(ies) and server(s) configured to: access, from data repository(ies), a first three-dimensional (3D) model of a virtual environment and a second 3D model of a real-world environment; combine the first 3D model and the second 3D model to generate a combined 3D model of an extended-reality (XR) environment; perform occlusion culling using the combined 3D model, to identify a set of virtual objects that occlude real object(s) in the XR environment from a perspective of a viewpoint; and send, to display apparatus(es), a virtual-reality (VR) image representing the set of virtual objects and information indicative of portion(s) of a field of view that corresponds to the real object(s) that is being occluded by the set of virtual objects from the perspective of the viewpoint.
    Type: Application
    Filed: October 17, 2023
    Publication date: April 17, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Antti Hirvonen, Mikko Strandborg
  • Publication number: 20250119524
    Abstract: Image data is read out from a left part (LL) of a left field of view (FOV) of a left image sensor (L) and a right part (RR) of a right FOV of a right image sensor (R). The left part of the left FOV extends horizontally towards a right side of a gaze point (X) till only a first predefined angle (N1) from the gaze point. The right part of the right FOV extends horizontally towards a left side of a gaze point (X) till only a second predefined angle (N2) from the gaze point. The image data is processed to construct a left part of a left image and a right part of a right image. A right part of the left image and a left part of the right image are reconstructed using image reprojection. The left image and the right image are generated by combining respective parts.
    Type: Application
    Filed: October 5, 2023
    Publication date: April 10, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Mikko Ollila
  • Publication number: 20250117076
    Abstract: Disclosed is a system with an image sensor comprising a plurality of photo-sensitive cells; and processor(s) configured to: receive, from the image sensor, a plurality of image signals captured by corresponding photo-sensitive cells of the image sensor; obtain information indicative of a current pupil size of a user of a display apparatus; determine a given luminosity range corresponding to the current pupil size; and selectively perform a sequence of image signal processes on the plurality of image signals and control a plurality of parameters employed for performing the sequence of image signal processes, based on the given luminosity range, to generate an image.
    Type: Application
    Filed: October 6, 2023
    Publication date: April 10, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Mikko Ollila
  • Publication number: 20250119523
    Abstract: A left part (LL) of a left image and a right part (RR) of a right image are rendered, wherein a horizontal FOV of the left part of the left image extends towards a right side of a gaze point (X) of the left image till only a first predefined angle (N1) from the gaze point of the left image, while a horizontal FOV of the right part of the right image extends towards a left side of a gaze point (X) of the right image till only a second predefined angle (N2) from the gaze point of the right image. A right part (RL) of the left image is reconstructed by reprojecting a corresponding part of the right image, while a left part (LR) of the right image is reconstructed by reprojecting a corresponding part of the left image. The left image and the right image are generated by combining respective rendered parts and respective reconstructed parts.
    Type: Application
    Filed: October 5, 2023
    Publication date: April 10, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Patent number: 12273504
    Abstract: A left part (LL) of a left image and a right part (RR) of a right image are rendered, wherein a horizontal FOV of the left part of the left image extends towards a right side of a gaze point (X) of the left image till only a first predefined angle (N1) from the gaze point of the left image, while a horizontal FOV of the right part of the right image extends towards a left side of a gaze point (X) of the right image till only a second predefined angle (N2) from the gaze point of the right image. A right part (RL) of the left image is reconstructed by reprojecting a corresponding part of the right image, while a left part (LR) of the right image is reconstructed by reprojecting a corresponding part of the left image. The left image and the right image are generated by combining respective rendered parts and respective reconstructed parts.
    Type: Grant
    Filed: October 5, 2023
    Date of Patent: April 8, 2025
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Publication number: 20250104619
    Abstract: Disclosed is a display apparatus comprising eye-tracking means, display(s) per eye, and processor(s). The processor(s) is/are configured to: process eye-tracking data, collected by the eye-tracking means, to detect a current pupil size; determine a given luminosity range corresponding to the current pupil size; employ at least one of: a tone-mapping technique, an exposure-adjustment technique, to map luminosity values of pixels in a high dynamic range (HDR) image to luminosity values of corresponding pixels in an output image, wherein the luminosity values of the pixels in the output image lie in the given luminosity range; and display the output image via the display(s).
    Type: Application
    Filed: September 21, 2023
    Publication date: March 27, 2025
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Strandborg
  • Patent number: 12260062
    Abstract: Disclosed is a display apparatus and a method for digital manipulation of a virtual user interface in virtual environments. The display apparatus includes a light source, tracking means, and a processor configured to control the light source to project the virtual user interface, and process tracking data from the tracking means to detect the proximity of an interaction element, such as a user's hand, to an invisible segment of a virtual widget within the virtual user interface. Upon proximity detection, the light source is activated to display the virtual widget. The processor then determines if the segment has been activated and subsequently processes any positional changes of the interaction element to adjust the virtual user interface accordingly. This adjustment is performed in accordance with predefined visual effects that correspond to the activated segment, enabling intuitive and dynamic user interaction.
    Type: Grant
    Filed: November 22, 2023
    Date of Patent: March 25, 2025
    Assignee: Varjo Technologies Oy
    Inventors: Ábel Csendes, Harri Wikberg
  • Publication number: 20250097395
    Abstract: Disclosed is a system with server(s) configured to: obtain a plurality of input images captured by a plurality of input cameras comprising at least a first input camera per eye and a second input camera per eye, wherein a first field of view of the first input camera is narrower than a second field of view of the second input camera and is overlapping with an overlapping portion of the second field of view, the plurality of input images comprising at least a first input image and a second input image captured by the first input camera and the second input camera, respectively; and process the plurality of input images, by using neural style transfer network(s), to generate a single output image per eye.
    Type: Application
    Filed: September 15, 2023
    Publication date: March 20, 2025
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Ollila, Mikko Strandborg