Patents Assigned to Varjo Technologies Oy
  • Patent number: 10602033
    Abstract: A display apparatus, and a method of displaying via the display apparatus. The display apparatus includes at least one context image renderer for rendering a context image, at least one focus image renderer for rendering a focus image, at least one first optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to form a combined projection, and at least one second optical combiner for combining the combined projection with a projection of a real world image. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees.
    Type: Grant
    Filed: May 2, 2017
    Date of Patent: March 24, 2020
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Urho Konttori, Oiva Arvo Oskari Sahlsten, Kseniia Duginova
  • Patent number: 10602132
    Abstract: A display apparatus including at least one light source per eye; at least one controllable scanning mirror per eye; means for detecting gaze direction of user; and a processor communicably coupled to the aforementioned components. The processor is configured to (a) obtain an input image and determine region of visual accuracy thereof; (b) generate pixel data corresponding to at least a first region and a second region of the input image, wherein the second region substantially corresponds to the region of visual accuracy of the input image, while the first region substantially corresponds to a remaining region of the input image, wherein the first region have a first resolution, while the second region have a second resolution, the second resolution being higher than the first resolution; and (c) control the at least one light source and the at least one controllable scanning mirror to draw the aforementioned regions.
    Type: Grant
    Filed: March 6, 2018
    Date of Patent: March 24, 2020
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Ari Antti Erik Peuhkurinen, Oiva Arvo Oskari Sahlsten, Klaus Mikael Melakari
  • Patent number: 10592739
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator for emitting light pulses; at least one first optical element comprising a plurality of micro-to-nano-sized components, shaped and arranged relative to each other in a manner that, when incident thereupon, a structure of the light pulses is modified to produce structured light, wherein the produced structured light is used to illuminate a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form and a position of the reflections on an image plane of the at least one camera; and a processor configured to control the at least one illuminator and the at least one camera, and to process the captured image to detect a gaze direction of the user.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: March 17, 2020
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10564429
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes a plurality of illuminators for emitting light pulses to illuminate a user's eye when the head-mounted display apparatus is worn by the user, the illuminators including at least a first illuminator and a second illuminator; at least one lens positioned on an optical path of reflections of the light pulses from the user's eye, the at least one lens having no chromatic-aberration correction; at least one camera for capturing an image of the reflections of the light pulses; and a processor coupled with illuminators and the at least one camera, the processor being configured to control operations of the illuminators and the at least one camera, and to process the captured image to detect a gaze direction of the user.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: February 18, 2020
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10565797
    Abstract: A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: February 18, 2020
    Assignee: Varjo Technologies Oy
    Inventors: Joonas Nissinen, Mikko Ollila
  • Patent number: 10495895
    Abstract: A display apparatus and a method of displaying, via the display apparatus. The display apparatus includes an image source for rendering an image, a projection screen facing a direction at a predefined angle to a direction in which the rendered image is projected from the image source, an exit optical element facing the projection screen, a first polarizing element facing the image source and arranged to polarize a projection of the rendered image at a first polarization orientation, a first optical element arranged to reflect the polarized projection towards the projection screen, wherein the projection screen is arranged to unpolarize the polarized projection whilst reflecting the unpolarized projection towards the exit optical element, and a second polarizing element positioned between the projection screen and the exit optical element, arranged to polarize the unpolarized projection at a second polarization orientation.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: December 3, 2019
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Evgeny Shirko, Andrei Razumov, Oiva Arvo Oskari Sahlsten
  • Patent number: 10488917
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator to emit light pulses for illuminating a user's eye; at least one camera to capture image of reflections of the light pulses; at least one reflective element arranged on an optical path of the reflections of the light pulses, such that when incident upon the at least one reflective element, the reflections of the light pulses are reflected towards the at least one camera; at least one actuator associated with the at least one reflective element, wherein the at least one actuator moves the at least one reflective element; and a processor configured to: process the at least one image to detect a gaze direction of user; and control the at least one actuator to adjust, based upon the detected gaze direction, position of the at least one reflective element.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: November 26, 2019
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10452911
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes illuminators for emitting light pulses to illuminate a user's eye; a camera for capturing an image of reflections of the light pulses from the user's eye, the camera including photo-sensitive elements arranged into a chip, wherein a first surface of the chip bulges inwards in a substantially-curved shape, such that a focal plane of photo-sensitive elements positioned proximally to edges of the chip is farther away than a focal plane of photo-sensitive elements positioned substantially at a center portion of the chip, the first surface facing the user's eye; and a processor being configured to control operations of the illuminators and the camera, and to process the captured image to detect a gaze direction of the user.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: October 22, 2019
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 10395111
    Abstract: A gaze-tracking system for a head-mounted display apparatus includes a first set of illuminators for emitting light to illuminate a user's eye; at least one photo sensor for sensing reflections of the light from the user's eye; at least one actuator for moving at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor; and a processor coupled with the first set of illuminators, the at least one photo sensor and the at least one actuator. The processor is configured to collect and process sensor data from the at least one photo sensor to detect a gaze direction of the user, and to control the at least one actuator to adjust, based upon the detected gaze direction, a position of the at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor.
    Type: Grant
    Filed: July 13, 2017
    Date of Patent: August 27, 2019
    Assignee: VARJO TECHNOLOGIES OY
    Inventors: Urho Konttori, Klaus Melakari, Thiyagarajan Manihatty Bojan, Ville Miettinen
  • Patent number: 10382699
    Abstract: An imaging system and a method of producing images for a display apparatus, via the imaging system includes at least one focusable camera for capturing at least one image of a given real-world scene; means for generating a depth map or a voxel map of the given real-world scene; and a processor coupled to the focusable camera and the aforesaid means. The processor is communicably coupled with the display apparatus. The processor is configured to receive information of the gaze direction of the user; map the gaze direction to the depth map or the voxel map to determine an optical depth of a region of interest in the given real-world scene; and control the focusable camera to employ a focus length that is substantially similar to the determined optical depth of the region of interest when capturing the at least one image.
    Type: Grant
    Filed: July 7, 2017
    Date of Patent: August 13, 2019
    Assignee: Varjo Technologies Oy
    Inventors: Roope Rainisto, Klaus Melakari
  • Patent number: 10371998
    Abstract: A display apparatus and a method of displaying, via the display apparatus. The display apparatus includes an image source, a processor configured to render an image at the image source, at least one optical combiner for combining a projection of the rendered image with a projection of a real world image, a first polarizing element for polarizing the projection of the real world image at a first polarization orientation, wherein the first polarizing element is positioned on a first side of the at least one optical combiner upon which the projection of the real world image is incident, and a second polarizing element facing a second side of the at least one optical combiner, polarization properties of the second polarizing element being adjustable, wherein the polarization properties of the second polarizing element are to be adjusted with respect to the first polarization orientation of the first polarizing element.
    Type: Grant
    Filed: June 29, 2017
    Date of Patent: August 6, 2019
    Assignee: Varjo Technologies Oy
    Inventor: Oiva Arvo Oskari Sahlsten
  • Patent number: 10122990
    Abstract: Disclosed is an imaging system and a method of producing a context image and a focus image for a display apparatus, via the imaging system. The imaging system includes at least one imaging sensor per eye of a user, and a processor coupled thereto. The processor is configured to control the imaging sensors to capture at least one image of a real world environment, and is arranged to be communicably coupled with the display apparatus. Furthermore, the processor is configured to: receive, from the display apparatus, information indicative of a gaze direction of the user; determine a region of visual accuracy of the at least one image, based upon the gaze direction of the user; process the at least one image to generate the context image and the focus image; and communicate the generated context image and the generated focus image to the display apparatus.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: November 6, 2018
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Mikko Ollila, Ville Miettinen
  • Patent number: 10082672
    Abstract: A display apparatus including at least one focus display; at least one electromechanical faceplate detachably attached to an outer surface of the display apparatus; and a processor coupled to the aforementioned components, wherein the processor is configured to render focus image at the focus display. The display apparatus is arranged to be detachably attached to portable electronic device, the electromechanical faceplate including a wireless communication interface, wherein the aforementioned interface is employed to communicably couple the portable electronic device and the display apparatus. A processor of the portable electronic device is configured to render context image at a display thereof, an angular width of a projection of the rendered context image being greater than an angular width of a projection of the rendered focus image. Furthermore, projection of the rendered context image is optically combined with projection of the rendered focus image to create a visual scene.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: September 25, 2018
    Assignee: Varjo Technologies Oy
    Inventor: Roope Rainisto
  • Patent number: 9989774
    Abstract: A display apparatus and method of displaying, via the display apparatus. The display apparatus includes context image renderer for rendering context image; focus image renderer for rendering focus image; exit optical element; and optical combiner for optically combining projection of the rendered context image with projection of the rendered focus image to create visual scene. The optical combiner includes first semi-transparent reflective element; and a second semi-transparent reflective element. The context image renderer is arranged in a manner that the projection of rendered context image passes through first semi-transparent reflective element towards exit optical element.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: June 5, 2018
    Assignee: Varjo Technologies Oy
    Inventors: Oiva Arvo Oskari Sahlsten, Mikko Ollila
  • Patent number: 9990037
    Abstract: A display apparatus and a method of displaying, via the display apparatus. The display apparatus includes at least one focus display, and a processor coupled to the at least one focus display. The processor of the display apparatus is configured to render a focus image at the at least one focus display. The display apparatus is arranged to be detachably attached to a portable electronic device and to be communicably coupled with the portable electronic device. A processor of the portable electronic device is configured to render a context image at a display of the portable electronic device. The projection of the rendered context image is combined with the projection of the rendered focus image to create a visual scene.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: June 5, 2018
    Assignee: Varjo Technologies Oy
    Inventor: Roope Rainisto
  • Patent number: 9983413
    Abstract: A display apparatus and method of displaying, via the display apparatus. The display apparatus includes context image renderer for rendering context image; focus image renderer for rendering focus image; exit optical element; and optical combiner for optically combining projection of the rendered context image with projection of the rendered focus image to create visual scene. The optical combiner includes first semi-transparent reflective element; and a second semi-transparent reflective element. The context image renderer is arranged in a manner that projection of rendered context image is incident upon first semi-transparent reflective element and reflected towards exit optical element therefrom.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: May 29, 2018
    Assignee: Varjo Technologies Oy
    Inventors: Oiva Arvo Oskari Sahlsten, Mikko Ollila
  • Patent number: 9905143
    Abstract: Disclosed is a display apparatus. The display apparatus includes at least one context image renderer for rendering a context image, wherein an angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees; at least one focus image renderer for rendering a focus image, wherein an angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees; and at least one optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to create a visual scene, wherein the visual scene is to be created in a manner that at least two different optical distances are provided therein.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: February 27, 2018
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten, Kseniia Duginova
  • Patent number: 9710887
    Abstract: Disclosed is a display apparatus and a method of displaying, via the display apparatus. The display apparatus comprises at least one context display for rendering a context image, the at least one context display comprising at least one projection surface, and at least one focus image projector for rendering a focus image. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees. An arrangement is made to combine the projection of the rendered focus image with the projection of the rendered context image to create a visual scene.
    Type: Grant
    Filed: December 8, 2016
    Date of Patent: July 18, 2017
    Assignee: Varjo Technologies Oy
    Inventors: Oiva Arvo Oskari Sahlsten, Urho Konttori, Klaus Melakari
  • Patent number: 9711114
    Abstract: A display apparatus and a method of displaying via the display apparatus. The display apparatus includes at least one context image projector or at least one context display for rendering a context image, wherein an angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees, and at least one focus image projector for rendering a focus image, wherein an angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees. An arrangement is made to combine the projection of the rendered focus image with the projection of the rendered context image to create a visual scene.
    Type: Grant
    Filed: December 1, 2016
    Date of Patent: July 18, 2017
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 9711072
    Abstract: Disclosed is a display apparatus comprising at least one context display for rendering a context image, at least one focus display for rendering a focus image, and at least one optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to create a visual scene. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees.
    Type: Grant
    Filed: December 1, 2016
    Date of Patent: July 18, 2017
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten