Patents by Inventor Mikko Ollila

Mikko Ollila has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210243384
    Abstract: An imaging system for producing images for display apparatus. Imaging system includes at least one imaging unit arranged to face real-world scene including camera, optical element including first optical portion and second optical portion having different focal lengths, first focal length of first optical portion is smaller than second focal length of second optical portion, and means for adjusting optical focus; and processor. Processor is configured to obtain gaze direction of user; determine region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.
    Type: Application
    Filed: April 26, 2021
    Publication date: August 5, 2021
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11056030
    Abstract: A display apparatus including an image renderer per eye; a liquid-crystal device including a liquid-crystal structure and a control circuit, the liquid-crystal structure being arranged in front of image-rendering surface of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from a given pixel of the image renderer to a plurality of positions in a sequential and repeated manner; and at least one processor configured to render a sequence of output image frames via the image renderer, wherein a shift in the light emanating from the given pixel of the image renderer to the plurality of positions causes a resolution of the output image frames to appear higher than a display resolution of the image renderer.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Klaus Melakari, Oiva Arvo Oskari Sahlsten, Mikko Ollila
  • Patent number: 11054728
    Abstract: A projection apparatus including an array of infrared emitters, the infrared emitters of said array being arranged in a first pattern; a plurality of liquid-crystal cells and corresponding control circuits, a given liquid-crystal cell being arranged in front of a corresponding infrared emitter of said array; and a processor configured to generate drive signals for driving the control circuits in a random or pseudorandom manner; and control the plurality of liquid-crystal cells individually, via the corresponding control circuits, to project a second pattern of light spots onto objects present in a real-world environment, wherein, when driven by a given drive signal, a given control circuit electrically controls a corresponding liquid-crystal cell to any of: block light emanating from a corresponding infrared emitter, transmit the light in an unbended manner, bend the light.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Ollila, Klaus Melakari
  • Patent number: 11030720
    Abstract: A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Klaus Melakari, Mikko Ollila
  • Patent number: 11030719
    Abstract: A display apparatus includes an imaging unit, an image renderer and a processor. The imaging unit includes a camera for capturing an image of a given real-world scene and an optical element arranged on an optical path of a projection of the given real-world scene. The projection of the given real-world scene is differently magnified by first and second optical-element portions of the optical element in a manner that the captured image has a variable angular resolution across a field of view of the optical element. An angular resolution of a first portion of the captured image is greater than an angular resolution of a second portion of the captured image. The processor is configured to process the captured image to generate an output image and render the output image via the image renderer.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11029408
    Abstract: A distance-imaging system including an illuminating unit that projects a spatially non-uniform pattern of light spots onto objects present in real-world environment, first portion of said pattern having higher density of light spots than second portion of said pattern; at least one camera that captures image of reflections of the light spots from surfaces of the objects; and at least one optical element associated with said camera, wherein first optical portion of said optical element has higher magnification factor than second optical portion of said optical element, reflections of said first and second portions of spatially non-uniform pattern of light spots being differently magnified and/or de-magnified by said first and second optical portions, respectively.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Ollila, Oiva Arvo Oskari Sahlsten
  • Patent number: 11017562
    Abstract: An imaging system for producing images for a display apparatus. Imaging system includes at least one imaging unit including camera, optical element including first optical portion and second optical portion having different focal lengths, and means for adjusting optical focus; means for generating depth or voxel map; and processor. Processor is configured to obtain gaze direction of user; determine optical depth of object present in region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on optical depth of object and focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: May 25, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 10939034
    Abstract: An imaging system for producing images for a display apparatus. The imaging system includes at least one camera, and processor communicably coupled to the at least one camera. The processor is configured to: obtain, from display apparatus, information indicative of current gaze direction of a user; determine, based on current gaze direction of the user, an object of interest within at least one display image, wherein the at least one display image is representative of a current view presented to user via display apparatus; adjust, based on a plurality of object attributes of the object of interest, a plurality of camera attributes of the at least one camera for capturing a given image of a given real-world scene; and generate from the given image a view to be presented to user via display apparatus.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: March 2, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Ville Timonen, Mikko Ollila
  • Publication number: 20210014408
    Abstract: An imaging system for producing images for a display apparatus. The imaging system includes at least one camera, and processor communicably coupled to the at least one camera. The processor is configured to: obtain, from display apparatus, information indicative of current gaze direction of a user; determine, based on current gaze direction of the user, an object of interest within at least one display image, wherein the at least one display image is representative of a current view presented to user via display apparatus; adjust, based on a plurality of object attributes of the object of interest, a plurality of camera attributes of the at least one camera for capturing a given image of a given real-world scene; and generate from the given image a view to be presented to user via display apparatus.
    Type: Application
    Filed: July 8, 2019
    Publication date: January 14, 2021
    Inventors: Ville Timonen, Mikko Ollila
  • Publication number: 20210012531
    Abstract: An imaging system for producing images for a display apparatus. Imaging system includes at least one imaging unit including camera, optical element including first optical portion and second optical portion having different focal lengths, and means for adjusting optical focus; means for generating depth or voxel map; and processor. Processor is configured to obtain gaze direction of user; determine optical depth of object present in region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on optical depth of object and focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.
    Type: Application
    Filed: July 8, 2019
    Publication date: January 14, 2021
    Inventor: Mikko Ollila
  • Publication number: 20200400939
    Abstract: An electronic device is disclosed herein that includes an infrared light source to emit infrared light, a rolling shutter sensor, and at least one processor. The at least one processor is to: cause the rolling shutter sensor to output a first signal corresponding to a first frame of image data during exposure to the infrared light, reset the rows of the rolling shutter sensor at a same time, cause the rolling shutter sensor to output a second signal corresponding to a second frame of image data without exposure to the infrared light from the infrared light source, determine a difference between the first signal and the second signal to generate an ambient infrared free frame, and recognize a face based on the ambient infrared free frame.
    Type: Application
    Filed: September 8, 2020
    Publication date: December 24, 2020
    Inventor: Mikko OLLILA
  • Publication number: 20200319341
    Abstract: A distance-imaging system including an illuminating unit that projects a spatially non-uniform pattern of light spots onto objects present in real-world environment, first portion of said pattern having higher density of light spots than second portion of said pattern; at least one camera that captures image of reflections of the light spots from surfaces of the objects; and at least one optical element associated with said camera, wherein first optical portion of said optical element has higher magnification factor than second optical portion of said optical element, reflections of said first and second portions of spatially non-uniform pattern of light spots being differently magnified and/or de-magnified by said first and second optical portions, respectively.
    Type: Application
    Filed: April 3, 2019
    Publication date: October 8, 2020
    Inventors: Mikko Ollila, Oiva Arvo Oskari Sahlsten
  • Patent number: 10798332
    Abstract: An imaging system including infrared light source, imaging unit and processor. Imaging unit includes first and second image-sensor chips, semi-transparent reflective element, infrared filter arranged to block transmission of infrared light towards first image-sensor chip, and means for transmitting infrared light received from overlapping field of view towards second image-sensor chip, whilst blocking transmission of infrared light received from non-overlapping field of view towards second image-sensor chip. First and second image-sensor chips are controlled to capture first and second images of real-world environment, wherein portion of second image-sensor chip that receives infrared light from overlapping field of view captures depth information pertaining to overlapping field of view. Extended-reality image is generated from first and second images, based on depth information.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: October 6, 2020
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 10777016
    Abstract: A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: September 15, 2020
    Assignee: Varjo Technologies Oy
    Inventors: Joonas Nissinen, Mikko Ollila
  • Patent number: 10775605
    Abstract: An apparatus for a combined camera system is described herein. The apparatus includes an adjustable infrared (IR) pass filter. A passband of the adjustable infrared (IR) pass filter is electrically adjusted. The apparatus also includes a rolling shutter sensor. An adjustable filter is to implement a global shutter and a rolling shutter sensor global reset.
    Type: Grant
    Filed: June 16, 2016
    Date of Patent: September 15, 2020
    Assignee: Intel Corporation
    Inventor: Mikko Ollila
  • Patent number: 10764567
    Abstract: A display apparatus includes means for detecting gaze direction of user; processor configured to process input image based upon gaze direction to generate first and second images; first and second image renderers to render first and second images; optical combiner; first array of micro-prisms to split light emanating from second image renderer into multiple directions to produce multiple projections of second image; optical element to direct said multiple projections towards optical combiner; and optical shutter arranged between optical element and optical combiner, wherein optical shutter allows given portion of said multiple projections to pass, whilst blocking remaining portion of said multiple projections. The optical combiner optically combines projection of first image with given portion of said multiple projections, to produce on image plane output image having spatially-variable angular resolution.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: September 1, 2020
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10726257
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes: at least one first optical element comprising particles of a phosphorescent or fluorescent material dispersed therein, the particles of the phosphorescent or fluorescent material being dispersed in a manner that when excited by electromagnetic radiation incident thereupon, the particles produce structured light of a given wavelength, wherein the produced structured light illuminates a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form of the reflections and a position of the reflections on an image plane of the at least one camera; and a processor coupled in communication with the at least one camera, wherein the processor is configured to process the captured image to detect a gaze direction of the user.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: July 28, 2020
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10725292
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus and an aperture device. The gaze-tracking system includes a first light source and a second light source operable to emit light of first and second type respectively; an image sensor operable to capture an image of the user's eye and reflections of the light of first type from the user's eye; a primary lens; an aperture device positioned between the image sensor and the primary lens, and a processor configured to control the first and second light sources and image sensor, and to process the captured image to detect a gaze direction of the user. The aperture device provides a first aperture to the light of first type and a second aperture to the light of second type, the first aperture and the second aperture being substantially concentric, the first aperture being smaller than the second aperture.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: July 28, 2020
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20200236347
    Abstract: A display apparatus includes means for detecting gaze direction of user; processor configured to process input image based upon gaze direction to generate first and second images; first and second image renderers to render first and second images; optical combiner; first array of micro-prisms to split light emanating from second image renderer into multiple directions to produce multiple projections of second image; optical element to direct said multiple projections towards optical combiner; and optical shutter arranged between optical element and optical combiner, wherein optical shutter allows given portion of said multiple projections to pass, whilst blocking remaining portion of said multiple projections. The optical combiner optically combines projection of first image with given portion of said multiple projections, to produce on image plane output image having spatially-variable angular resolution.
    Type: Application
    Filed: January 22, 2019
    Publication date: July 23, 2020
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Publication number: 20200234408
    Abstract: A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.
    Type: Application
    Filed: June 4, 2019
    Publication date: July 23, 2020
    Inventors: Klaus Melakari, Mikko Ollila