Patents by Inventor Mikko Strandborg

Mikko Strandborg has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220334636
    Abstract: A display apparatus including: light source(s); camera(s); and processor(s) configured to: display extended-reality image for presentation to user, whilst capturing eye image(s) of user's eyes; analyse eye image(s) to detect eye features; employ existing calibration model to determine gaze directions of user's eyes; determine gaze location of user; identify three-dimensional bounding box at gaze location within extended-reality environment, based on position and optical depth of gaze location; identify inlying pixels of extended-reality image lying within three-dimensional bounding box, based on optical depths of pixels in extended-reality image; compute probability of user focussing on given inlying pixel and generate probability distribution of probabilities computed for inlying pixels; identify at least one inlying pixel calibration target, based on probability distribution; and map position of calibration target to eye features, to update existing calibration model to generate new calibration model.
    Type: Application
    Filed: April 19, 2021
    Publication date: October 20, 2022
    Applicant: Varjo Technologies Oy
    Inventors: Ville Miettinen, Mikko Strandborg
  • Publication number: 20220327784
    Abstract: Disocclusion in a VR/AR system may be handled by obtaining depth and color data for the disoccluded area from a 3D model of the imaged environment. The data may be obtained by raytracing and included in the image stream by the reprojecting subsystem.
    Type: Application
    Filed: April 9, 2021
    Publication date: October 13, 2022
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen, Petteri Timonen
  • Patent number: 11308900
    Abstract: In a display apparatus, a liquid-crystal structure, arranged in front of an image renderer, is controlled to shift light of a given sub-pixel to target positions according to a shifting sequence in a repeated manner, while output image frames are displayed. To generate a given output image frame, a given target position to which the light is to be shifted is determined based on the shifting sequence. An input colour value of the given sub-pixel provided in a given input image frame is then adjusted to generate an output colour value of the given sub-pixel for the given output image frame, based on an output colour value of at least one other sub-pixel whose light overlaps with the given target position during display of a previous output image frame, and a retention coefficient between a colour of the at least one other sub-pixel and a colour of the given sub-pixel.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: April 19, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Klaus Melakari, Ville Miettinen
  • Patent number: 11307410
    Abstract: A display apparatus including pose-tracking means; image renderer per eye; liquid-crystal device including liquid-crystal structure and control circuit; and processor. Processor is configured to: process pose-tracking data to determine user's head pose; detect if rate at which head pose is changing is below predefined threshold rate; if yes, switch on lock mode, select head pose for session of lock mode, and generate output image frames according to head pose during session; if no, generate output image frames according to corresponding head poses of user using pose-tracking data; and display output image frames, whilst shifting light emanating to from pixels of image renderer to multiple positions (P1-P9) in sequential and repeated manner, said shifting causes resolution of output image frames to appear higher than display resolution of image renderer.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: April 19, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen, Klaus Melakari
  • Patent number: 11288990
    Abstract: A display apparatus including: image renderer having array of pixels; liquid-crystal device comprising: liquid-crystal structure, wherein portions of liquid-crystal structure are arranged in front of corresponding pixels of said array; and control circuit including circuit elements employed to electrically control corresponding portions of liquid-crystal structure to shift light emanating from corresponding pixels to corresponding target positions; and processor(s) configured to: generate individual drive signals for circuit elements, based on corresponding target positions to which light emanating from corresponding pixels are to be shifted upon passing through corresponding portions of liquid-crystal structure; and send individual drive signals to control circuit to drive circuit elements to address corresponding portions of liquid-crystal structure separately, whilst displaying output image frame via image renderer.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: March 29, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Klaus Melakari
  • Patent number: 11170678
    Abstract: A display apparatus including gaze-tracking means, image renderers, liquid-crystal devices including liquid-crystal structure and control circuit, to shift light emanating from given pixel of image renderer to multiple positions, given pixel including colour component; and processor configured to: process gaze-tracking data to determine gaze direction of user's eye; determine gaze point; display first output image frame; detect if magnitude of difference between first output value and initial second output value of colour component of given pixel in first and second output image frames exceeds first threshold difference; when detected that magnitude of difference exceeds first threshold difference, update initial second output value to sum of first output value and product of distance factor and difference between initial second output and first output values; and display second output image frame.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: November 9, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Patent number: 11094089
    Abstract: A method of encoding images and a method of decoding images. The method of encoding comprises dividing an input image into a first input portion and a plurality of input rings that are concentric with the first input portion, the first input portion and the plurality of input rings being shaped as a simple closed curve; storing the first input portion into a first image; packing the plurality of input rings into a second image, second image having a plurality of rows, a given input ring of input image being packed into a corresponding row of second image; and communicating, to a display apparatus, the first image, the second image and information indicative of a size of the first input portion and sizes of the plurality of input rings.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: August 17, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Publication number: 20210247607
    Abstract: A display apparatus including pose-tracking means; image renderer per eye; liquid-crystal device including liquid-crystal structure and control circuit; and processor. Processor is configured to: process pose-tracking data to determine user's head pose; detect if rate at which head pose is changing is below predefined threshold rate; if yes, switch on lock mode, select head pose for session of lock mode, and generate output image frames according to head pose during session; if no, generate output image frames according to corresponding head poses of user using pose-tracking data; and display output image frames, whilst shifting light emanating to from pixels of image renderer to multiple positions (P1-P9) in sequential and repeated manner, said shifting causes resolution of output image frames to appear higher than display resolution of image renderer.
    Type: Application
    Filed: January 22, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen, Klaus Melakari
  • Publication number: 20210248969
    Abstract: In a display apparatus, a liquid-crystal structure, arranged in front of an image renderer, is controlled to shift light of a given sub-pixel to target positions according to a shifting sequence in a repeated manner, while output image frames are displayed. To generate a given output image frame, a given target position to which the light is to be shifted is determined based on the shifting sequence. An input colour value of the given sub-pixel provided in a given input image frame is then adjusted to generate an output colour value of the given sub-pixel for the given output image frame, based on an output colour value of at least one other sub-pixel whose light overlaps with the given target position during display of a previous output image frame, and a retention coefficient between a colour of the at least one other sub-pixel and a colour of the given sub-pixel.
    Type: Application
    Filed: February 4, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Klaus Melakari, Ville Miettinen
  • Publication number: 20210248941
    Abstract: A display apparatus including gaze-tracking means, image renderers, liquid-crystal devices including liquid-crystal structure and control circuit, to shift light emanating from given pixel of image renderer to multiple positions, given pixel including colour component; and processor configured to: process gaze-tracking data to determine gaze direction of user's eye; determine gaze point; display first output image frame; detect if magnitude of difference between first output value and initial second output value of colour component of given pixel in first and second output image frames exceeds first threshold difference; when detected that magnitude of difference exceeds first threshold difference, update initial second output value to sum of first output value and product of distance factor and difference between initial second output and first output values; and display second output image frame.
    Type: Application
    Filed: January 29, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Patent number: 11055879
    Abstract: An encoder including data processing arrangement configured to analyze depth information pertaining to input image to identify depth edge(s) and to determine location of depth edge(s); analyze input image to identify edges of objects and to determine locations of said edges; select, amongst edges in input image, matching edge(s) whose location matches with location of depth edge(s); obtain intermediate decoded image by decoding intermediate encoded image obtained from intermediate encoding of input image; analyze intermediate decoded image to identify edges of objects and to determine locations of said edges; determine edge(s) in intermediate decoded image that corresponds to matching edge(s); modify pixel values in input image and/or optical depths in depth information, based on difference in location of determined edge(s) in intermediate decoded image and location of matching edge(s); and encode input image and depth information, upon said modification, to generate encoded data.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen