Patents by Inventor Mikko Ollila

Mikko Ollila has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11966045
    Abstract: An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene; determine gaze directions of first eye and second eye; identify line of sight and conical region of interest; determine optical depths of first object and second object present in conical region; determine one of first camera and second camera having lesser occlusion in real-world scene; adjust optical focus of one of first camera and second camera to focus on one of first object and second object having greater optical depth, and adjust optical focus of another of first camera and second camera to focus on another of first object and second object; and capture first image(s) and second image(s) using adjusted optical focuses of cameras.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: April 23, 2024
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11967117
    Abstract: A method implemented by a server communicably coupled to at least two devices, each device including camera(s), the devices being present within same real-world environment. The method includes: receiving, from the devices(s), images captured by respective cameras of the devices; identifying one of the devices whose camera has camera parameter(s) better than camera parameter(s) of camera of another of the devices; training neural network using images captured by camera of one of the devices as ground truth material and using images captured by camera of another of the devices as training material; generating correction information to correct images captured by camera of another of the devices using trained neural network; and correcting the images captured by the camera of the another of the device(s) by utilising the correction information at the server, or sending correction information to another of the devices for correcting the images.
    Type: Grant
    Filed: March 22, 2022
    Date of Patent: April 23, 2024
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11956555
    Abstract: An imaging system includes first camera having negative distortion; second camera, second field of view of second camera being wider than first field of view of first camera, wherein first field of view fully overlaps with portion of second field of view, second camera having negative distortion at said portion and positive distortion at remaining portion; and processor(s) configured to: capture first image and second image; determine overlapping image segment and non-overlapping image segment of second image; and generate output image from first image and second image, wherein: inner image segment of output image is generated from at least one of: first image, overlapping image segment, and peripheral image segment of output image is generated from non-overlapping image segment.
    Type: Grant
    Filed: May 20, 2022
    Date of Patent: April 9, 2024
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11947736
    Abstract: A controller-tracking system includes: camera(s) arranged on head-mounted display (HMD); one or more light sources arranged on controller(s) to be tracked, and controller(s) being associated with the HMD. The light sources provide light having wavelength(s). The processor(s) are configured to receive image(s) representing controller(s); identify image segment(s) in image(s) that represents light source(s); determine level of focussing of light source(s) in image(s), based on characteristics associated with pixels of image segment(s); determine distance between camera(s) and light source(s), based on level of focussing, intrinsic parameters of camera(s), and reference focussing distance corresponding to wavelength of light provided by light source(s); and determine pose of controller(s) in global coordinate space of real-world environment, using distance between camera(s) and light source(s).
    Type: Grant
    Filed: December 21, 2022
    Date of Patent: April 2, 2024
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Mikko Ollila
  • Publication number: 20240054619
    Abstract: An imaging system including: a first camera and a second camera corresponding to a first eye and a second eye of a user, respectively; and processor(s) configured to: control the first camera and the second camera to capture a sequence of first images and a sequence of second images, respectively; and apply motion blur correction to one of a given first image and a given second image, whilst applying at least one of: defocus blur correction, image sharpening, contrast enhancement, edge enhancement to another of the given first image and the given second image.
    Type: Application
    Filed: August 12, 2022
    Publication date: February 15, 2024
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20240054667
    Abstract: An imaging system including processor(s) and data repository. Processor(s) are configured to: receive images of region of real-world environment that are captured by cameras using at least one of: different exposure times, different sensitivities, different apertures; receive depth maps of region that are generated by depth-mapping means; identify different portions of each image that represent objects located at different optical depths; create set of depth planes corresponding to each image; warp depth planes of each set to match perspective of new viewpoint corresponding to which output image is to be generated; fuse sets of warped depth planes corresponding to two or more images to form output set of warped depth planes; and generate output image from output set of warped depth planes.
    Type: Application
    Filed: August 12, 2022
    Publication date: February 15, 2024
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20240056564
    Abstract: An imaging system including a first camera and a second camera corresponding to a first eye and a second eye of a user, respectively; and at least one processor. The at least one processor is configured to control the first camera and the second camera to capture a sequence of first images and a sequence of second images of a real-world environment, respectively; and apply a first extended depth-of-field correction to one of a given first image and a given second image, whilst applying at least one of: defocus blur correction, image sharpening, contrast enhancement, edge enhancement to another of the given first image and the given second image.
    Type: Application
    Filed: August 12, 2022
    Publication date: February 15, 2024
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11871133
    Abstract: An imaging system including: image sensor including pixels arranged on photo-sensitive surface; and processor configured to: obtain information indicative of gaze direction of user's eye; identify gaze position on photo-sensitive surface; determine first region and second region on photo-sensitive surface, wherein first region includes and surrounds gaze position, while second region surrounds first region; read out first pixel data from each pixel of first region; select set of pixels to be read out from second region based on predetermined sub-sampling pattern; read out second pixel data from pixels of selected set; generate, from second pixel data, pixel data of remaining pixels of second region; and process first pixel data, second pixel data, and generated pixel data to generate image frame(s).
    Type: Grant
    Filed: September 30, 2021
    Date of Patent: January 9, 2024
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20230412932
    Abstract: An imaging system includes first camera having negative distortion; second camera, second field of view of second camera being wider than first field of view of first camera, wherein first field of view fully overlaps with portion of second field of view, second camera having negative distortion at said portion and positive distortion at remaining portion; and processor(s) configured to: capture first image and second image; determine overlapping image segment and non-overlapping image segment of second image; and generate output image from first image and second image, wherein: inner image segment of output image is generated from at least one of: first image, overlapping image segment, and peripheral image segment of output image is generated from non-overlapping image segment.
    Type: Application
    Filed: May 20, 2022
    Publication date: December 21, 2023
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20230379594
    Abstract: An imaging system includes first camera; second camera, second field of view of second camera being wider than first field of view of first camera, wherein first field of view overlaps with portion of second field of view; and processor(s) configured to: capture first images and second images, wherein overlapping image segment and non-overlapping image segment of second image correspond to said portion and remaining portion of second field of view; determine blurred region(s) (B1, B2) of first image; and generate output image in manner that: inner image segment of output image is generated from: region(s) of overlapping image segment that corresponds to blurred region(s) of first image, and remaining region of first image that is not blurred, and peripheral image segment of output image is generated from non-overlapping image segment.
    Type: Application
    Filed: May 20, 2022
    Publication date: November 23, 2023
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Ollila, Petteri Timonen
  • Publication number: 20230316577
    Abstract: A method implemented by a server communicably coupled to at least two devices, each device including camera(s, the devices being present within same real-world environment . The method includes: receiving, from the devices(s), images captured by respective cameras of the devices; identifying one of the devices whose camera has camera parameter(s) better than camera parameter(s) of camera of another of the devices; training neural network using images captured by camera of one of the devices as ground truth material and using images captured by camera of another of the devices as training material; generating correction information to correct images captured by camera of another of the devices using trained neural network; and correcting the images captured by the camera of the another of the device(s) by utilising the correction information at the server, or sending correction information to another of the devices for correcting the images.
    Type: Application
    Filed: March 22, 2022
    Publication date: October 5, 2023
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11758077
    Abstract: Disclosed is a system (100) comprising server(s) (102) communicably coupled to devices (104a, 104b, 202a-202c). Server(s) is/are configured to: receive depth information generated by said device using active illuminator and active sensor; detect when at least two devices are in same surroundings, based on at least partial matching of depth information received from at least two devices; and send instructions to at least two devices to generate new depth information by: controlling active illuminator (106a) of one of at least two devices (104a, 202a) to project sequence of light patterns on same surroundings, whilst switching off active illuminator (106b) of another of at least two devices (104b, 202b), and controlling first active sensor (108a) of one of at least two devices and second active sensor (108b) of another of at least two devices to sense simultaneously reflections of sequence of light patterns.
    Type: Grant
    Filed: April 14, 2022
    Date of Patent: September 12, 2023
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11698523
    Abstract: An electronic device is disclosed herein that includes an infrared light source to emit infrared light, a rolling shutter sensor, and at least one processor. The at least one processor is to: cause the rolling shutter sensor to output a first signal corresponding to a first frame of image data during exposure to the infrared light, reset the rows of the rolling shutter sensor at a same time, cause the rolling shutter sensor to output a second signal corresponding to a second frame of image data without exposure to the infrared light from the infrared light source, determine a difference between the first signal and the second signal to generate an ambient infrared free frame, and recognize a face based on the ambient infrared free frame.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: July 11, 2023
    Assignee: Intel Corporation
    Inventor: Mikko Ollila
  • Publication number: 20230213755
    Abstract: An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene; determine gaze directions of first eye and second eye; identify line of sight and conical region of interest; determine optical depths of first object and second object present in conical region; determine one of first camera and second camera having lesser occlusion in real-world scene; adjust optical focus of one of first camera and second camera to focus on one of first object and second object having greater optical depth, and adjust optical focus of another of first camera and second camera to focus on another of first object and second object; and capture first image(s) and second image(s) using adjusted optical focuses of cameras.
    Type: Application
    Filed: January 3, 2022
    Publication date: July 6, 2023
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11688040
    Abstract: An imaging system for correcting visual artifacts during production of extended-reality images for display apparatus. The imaging system includes at least first camera and second camera for capturing first image and second image of real-world environment, respectively; and processor(s) configured to: analyse first and second images to identify visual artifact(s) and determine image segment of one of first image and second image that corresponds to visual artifact(s); generate image data for image segment, based on at least one of: information pertaining to virtual object, other image segment(s) neighbouring image segment, corresponding image segment in other of first image and second image, previous extended-reality image(s), photogrammetric model of real-world environment; and process one of first image and second image, based on image data, to produce extended-reality image for display apparatus.
    Type: Grant
    Filed: April 9, 2021
    Date of Patent: June 27, 2023
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11688046
    Abstract: A system including image sensor(s) including a plurality of pixels arranged on a photo-sensitive surface thereof; and image signal processor(s) configured to: receive, from image sensor(s), a plurality of image signals captured by corresponding pixels of image sensor(s); and process the plurality of image signals to generate at least one image, wherein, when processing, image signal processor(s) is configured to: determine, for a given image signal to be processed, a position of a given pixel on the photo-sensitive surface that is employed to capture the given image signal; and selectively perform a sequence of image signal processes on the given image signal and control a plurality of parameters employed for performing the sequence of image signal processes, based on the position of the given pixel.
    Type: Grant
    Filed: April 23, 2021
    Date of Patent: June 27, 2023
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Ollila, Kai Inha
  • Patent number: 11652976
    Abstract: An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene of real-world environment; determine gaze directions of first eye and second eye; identify line of sight of user and conical region of interest real-world scene; determine optical depths of objects in conical region of interest, wherein at least first object, second object and third object from amongst objects are at different optical depths; adjust optical focus of one of first camera and second camera to focus on first object and second object in alternating manner, whilst adjusting optical focus of another of first camera and second camera to focus on third object; and capture images using adjusted optical focus of cameras.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: May 16, 2023
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20230095462
    Abstract: An imaging system including: image sensor including pixels arranged on photo-sensitive surface; and processor configured to: obtain information indicative of gaze direction of user's eye; identify gaze position on photo-sensitive surface; determine first region and second region on photo-sensitive surface, wherein first region includes and surrounds gaze position, while second region surrounds first region; read out first pixel data from each pixel of first region; select set of pixels to be read out from second region based on predetermined sub-sampling pattern; read out second pixel data from pixels of selected set; generate, from second pixel data, pixel data of remaining pixels of second region; and process first pixel data, second pixel data, and generated pixel data to generate image frame(s).
    Type: Application
    Filed: September 30, 2021
    Publication date: March 30, 2023
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11567567
    Abstract: An encoder for encoding images. The encoder includes processor. The processor is configured to: receive, from display apparatus, information indicative of at least one of: head pose of user, gaze direction of user; identify gaze location in input image, based on the at least one of: head pose, gaze direction; divide input image into first input portion and second input portion, wherein first input portion includes and surrounds gaze location; and encode first input portion and second input portion at first compression ratio and at least one second compression ratio to generate first encoded portion and second encoded portion, respectively, wherein at least one second compression ratio is larger than first compression ratio.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: January 31, 2023
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11558560
    Abstract: An imaging apparatus including: an image sensor having a photo-sensitive surface; an optical device arranged on an optical path of light incidenting on the photo-sensitive surface, the optical device being electrically controllable to have a spatially variable focal length; and a processor configured to: generate and send a drive signal to the optical device to compensate for field curvature of optical device by adjusting focal lengths of different portions of the optical device to different extents, wherein a focal length of a first portion of the optical device is higher than a focal length of a second portion of the optical device surrounding the first portion; and control the image sensor to capture a distorted image of a real-world environment.
    Type: Grant
    Filed: June 16, 2021
    Date of Patent: January 17, 2023
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila