Patents by Inventor Mikko Ollila

Mikko Ollila has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200234401
    Abstract: A display apparatus includes image renderer per eye, optical element arranged on optical path between image renderer and image plane, means for detecting gaze direction of user with respect to image plane, and processor coupled to image renderer and said means. The processor or an image source is configured to generate warped image based upon detected gaze direction and different optical properties of first and second optical portions of optical element. The processor is configured to control image renderer to render warped image, whilst controlling rotational orientation of optical element such that first and second optical portions are oriented according to detected gaze direction of user. Projections of first portion and second portion of the warped image are differently magnified by first optical portion and second optical portion, respectively, to produce on image plane an image having spatially-variable angular resolution such that produced image appears de-warped to user.
    Type: Application
    Filed: January 22, 2019
    Publication date: July 23, 2020
    Inventors: Mikko Ollila, Klaus Melakari
  • Publication number: 20200234407
    Abstract: A display apparatus includes an imaging unit, an image renderer and a processor. The imaging unit includes a camera for capturing an image of a given real-world scene and an optical element arranged on an optical path of a projection of the given real-world scene. The projection of the given real-world scene is differently magnified by first and second optical-element portions of the optical element in a manner that the captured image has a variable angular resolution across a field of view of the optical element. An angular resolution of a first portion of the captured image is greater than an angular resolution of a second portion of the captured image. The processor is configured to process the captured image to generate an output image and render the output image via the image renderer.
    Type: Application
    Filed: January 22, 2019
    Publication date: July 23, 2020
    Inventor: Mikko Ollila
  • Patent number: 10701342
    Abstract: An imaging system for producing images to be displayed to user via a head-mounted display apparatus that includes means for detecting gaze direction of user. The imaging system includes a first outer camera and a second outer camera, at least one inner camera, and processor coupled to aforesaid cameras and means for detecting gaze direction. The processor is configured to (i) obtain inter-pupillary distance of user with respect to user's gaze at infinity; (ii) receive detected gaze direction; (iii) control first outer camera, second outer camera and at least one inner camera to capture first outer image, second outer image and at least one inner image of a scene; and (iv) process first outer image and inner image to generate first view of the scene, and process second outer image and inner image to generate second view of the scene, based upon inter-pupillary distance and detected gaze direction.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: June 30, 2020
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 10656407
    Abstract: An example electronic apparatus for switching microlenses includes a microlens including a plurality of microstructures to bend light. The electronic apparatus also includes a chamber coupled to the microlens to receive a liquid with an optical index that matches an optical index of the microlens. The electronic apparatus further includes an electronic device coupled to the chamber to manipulate the liquid to achieve a target optical state of the microlens.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: May 19, 2020
    Assignee: Intel Corporation
    Inventor: Mikko Ollila
  • Publication number: 20200151959
    Abstract: A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
    Type: Application
    Filed: January 9, 2020
    Publication date: May 14, 2020
    Inventors: Joonas Nissinen, Mikko Ollila
  • Patent number: 10592739
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator for emitting light pulses; at least one first optical element comprising a plurality of micro-to-nano-sized components, shaped and arranged relative to each other in a manner that, when incident thereupon, a structure of the light pulses is modified to produce structured light, wherein the produced structured light is used to illuminate a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form and a position of the reflections on an image plane of the at least one camera; and a processor configured to control the at least one illuminator and the at least one camera, and to process the captured image to detect a gaze direction of the user.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: March 17, 2020
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10565797
    Abstract: A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: February 18, 2020
    Assignee: Varjo Technologies Oy
    Inventors: Joonas Nissinen, Mikko Ollila
  • Patent number: 10564429
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes a plurality of illuminators for emitting light pulses to illuminate a user's eye when the head-mounted display apparatus is worn by the user, the illuminators including at least a first illuminator and a second illuminator; at least one lens positioned on an optical path of reflections of the light pulses from the user's eye, the at least one lens having no chromatic-aberration correction; at least one camera for capturing an image of the reflections of the light pulses; and a processor coupled with illuminators and the at least one camera, the processor being configured to control operations of the illuminators and the at least one camera, and to process the captured image to detect a gaze direction of the user.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: February 18, 2020
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10488917
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator to emit light pulses for illuminating a user's eye; at least one camera to capture image of reflections of the light pulses; at least one reflective element arranged on an optical path of the reflections of the light pulses, such that when incident upon the at least one reflective element, the reflections of the light pulses are reflected towards the at least one camera; at least one actuator associated with the at least one reflective element, wherein the at least one actuator moves the at least one reflective element; and a processor configured to: process the at least one image to detect a gaze direction of user; and control the at least one actuator to adjust, based upon the detected gaze direction, position of the at least one reflective element.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: November 26, 2019
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10452911
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes illuminators for emitting light pulses to illuminate a user's eye; a camera for capturing an image of reflections of the light pulses from the user's eye, the camera including photo-sensitive elements arranged into a chip, wherein a first surface of the chip bulges inwards in a substantially-curved shape, such that a focal plane of photo-sensitive elements positioned proximally to edges of the chip is farther away than a focal plane of photo-sensitive elements positioned substantially at a center portion of the chip, the first surface facing the user's eye; and a processor being configured to control operations of the illuminators and the camera, and to process the captured image to detect a gaze direction of the user.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: October 22, 2019
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Publication number: 20190259205
    Abstract: A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
    Type: Application
    Filed: February 17, 2018
    Publication date: August 22, 2019
    Inventors: Joonas Nissinen, Mikko Ollila
  • Publication number: 20190260981
    Abstract: An imaging system for producing images to be displayed to user via a head-mounted display apparatus that includes means for detecting gaze direction of user. The imaging system includes a first outer camera and a second outer camera, at least one inner camera, and processor coupled to aforesaid cameras and means for detecting gaze direction. The processor is configured to (i) obtain inter-pupillary distance of user with respect to user's gaze at infinity; (ii) receive detected gaze direction; (iii) control first outer camera, second outer camera and at least one inner camera to capture first outer image, second outer image and at least one inner image of a scene; and (iv) process first outer image and inner image to generate first view of the scene, and process second outer image and inner image to generate second view of the scene, based upon inter-pupillary distance and detected gaze direction.
    Type: Application
    Filed: February 17, 2018
    Publication date: August 22, 2019
    Inventor: Mikko Ollila
  • Publication number: 20190258314
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator to emit light pulses for illuminating a user's eye; at least one camera to capture image of reflections of the light pulses; at least one reflective element arranged on an optical path of the reflections of the light pulses, such that when incident upon the at least one reflective element, the reflections of the light pulses are reflected towards the at least one camera; at least one actuator associated with the at least one reflective element, wherein the at least one actuator moves the at least one reflective element; and a processor configured to: process the at least one image to detect a gaze direction of user; and control the at least one actuator to adjust, based upon the detected gaze direction, position of the at least one reflective element.
    Type: Application
    Filed: February 17, 2018
    Publication date: August 22, 2019
    Inventors: Mikko Ollila, Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Publication number: 20190236355
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes illuminators for emitting light pulses to illuminate a user's eye; a camera for capturing an image of reflections of the light pulses from the user's eye, the camera including photo-sensitive elements arranged into a chip, wherein a first surface of the chip bulges inwards in a substantially-curved shape, such that a focal plane of photo-sensitive elements positioned proximally to edges of the chip is farther away than a focal plane of photo-sensitive elements positioned substantially at a center portion of the chip, the first surface facing the user's eye; and a processor being configured to control operations of the illuminators and the camera, and to process the captured image to detect a gaze direction of the user.
    Type: Application
    Filed: February 1, 2018
    Publication date: August 1, 2019
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Publication number: 20190235236
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus and an aperture device. The gaze-tracking system includes a first light source and a second light source operable to emit light of first and second type respectively; an image sensor operable to capture an image of the user's eye and reflections of the light of first type from the user's eye; a primary lens; an aperture device positioned between the image sensor and the primary lens, and a processor configured to control the first and second light sources and image sensor, and to process the captured image to detect a gaze direction of the user. The aperture device provides a first aperture to the light of first type and a second aperture to the light of second type, the first aperture and the second aperture being substantially concentric, the first aperture being smaller than the second aperture.
    Type: Application
    Filed: February 1, 2018
    Publication date: August 1, 2019
    Inventor: Mikko Ollila
  • Publication number: 20190235248
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes a plurality of illuminators for emitting light pulses to illuminate a user's eye when the head-mounted display apparatus is worn by the user, the illuminators including at least a first illuminator and a second illuminator; at least one lens positioned on an optical path of reflections of the light pulses from the user's eye, the at least one lens having no chromatic-aberration correction; at least one camera for capturing an image of the reflections of the light pulses; and a processor coupled with illuminators and the at least one camera, the processor being configured to control operations of the illuminators and the at least one camera, and to process the captured image to detect a gaze direction of the user.
    Type: Application
    Filed: February 1, 2018
    Publication date: August 1, 2019
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10362231
    Abstract: Techniques for implementing a head down warning system in a handheld electronic device are described. An example of a device includes a display and a depth detection unit disposed on a surface of the handheld electronic device opposite the display. The depth detection unit includes a pair of cameras with panoramic lenses. The device also includes one or more processors that receive distance information from the depth detection unit, process the distance information to detect a hazard, and render a warning on the display to alert a user of the handheld electronic device about the hazard.
    Type: Grant
    Filed: July 1, 2016
    Date of Patent: July 23, 2019
    Assignee: Intel Corporation
    Inventors: Mikko Ollila, David Isherwood
  • Patent number: 10274169
    Abstract: The present techniques are related to an apparatus for an MEMS LED zoom. The apparatus for includes an LED light source and a collimation lens. The collimation lens to collimate light from the LED light source. The apparatus is also to include an active lens. The active lens to adjust the collimated light from the collimation lens.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: April 30, 2019
    Assignee: Intel Corporation
    Inventor: Mikko Ollila
  • Patent number: 10122990
    Abstract: Disclosed is an imaging system and a method of producing a context image and a focus image for a display apparatus, via the imaging system. The imaging system includes at least one imaging sensor per eye of a user, and a processor coupled thereto. The processor is configured to control the imaging sensors to capture at least one image of a real world environment, and is arranged to be communicably coupled with the display apparatus. Furthermore, the processor is configured to: receive, from the display apparatus, information indicative of a gaze direction of the user; determine a region of visual accuracy of the at least one image, based upon the gaze direction of the user; process the at least one image to generate the context image and the focus image; and communicate the generated context image and the generated focus image to the display apparatus.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: November 6, 2018
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Mikko Ollila, Ville Miettinen
  • Publication number: 20180196279
    Abstract: Various embodiments are generally directed to techniques for using MSM actuators to minimize the consumption of electric power and/or the quantity of components in implementing OIS in an image capture device. An apparatus may include a camera pivotally mounted within an endpiece of a casing, the camera including an image capture element to capture an image of an object along a line of sight of the image capture element; an actuator of elongate shape coupled to the camera to exert a mechanical force to pivot the camera about an axis, the elongate shape of the actuator extending into a relatively thin and elongate portion of the casing that is coupled to and extends from the endpiece; and a countering movement component to operate the actuator to pivot the camera about the axis in a countering movement to provide OIS to the camera. Other embodiments are described and claimed.
    Type: Application
    Filed: October 2, 2017
    Publication date: July 12, 2018
    Inventor: Mikko Ollila