Patents Assigned to Varjo Technologies Oy
-
Patent number: 10602033Abstract: A display apparatus, and a method of displaying via the display apparatus. The display apparatus includes at least one context image renderer for rendering a context image, at least one focus image renderer for rendering a focus image, at least one first optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to form a combined projection, and at least one second optical combiner for combining the combined projection with a projection of a real world image. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees.Type: GrantFiled: May 2, 2017Date of Patent: March 24, 2020Assignee: VARJO TECHNOLOGIES OYInventors: Urho Konttori, Oiva Arvo Oskari Sahlsten, Kseniia Duginova
-
Patent number: 10602132Abstract: A display apparatus including at least one light source per eye; at least one controllable scanning mirror per eye; means for detecting gaze direction of user; and a processor communicably coupled to the aforementioned components. The processor is configured to (a) obtain an input image and determine region of visual accuracy thereof; (b) generate pixel data corresponding to at least a first region and a second region of the input image, wherein the second region substantially corresponds to the region of visual accuracy of the input image, while the first region substantially corresponds to a remaining region of the input image, wherein the first region have a first resolution, while the second region have a second resolution, the second resolution being higher than the first resolution; and (c) control the at least one light source and the at least one controllable scanning mirror to draw the aforementioned regions.Type: GrantFiled: March 6, 2018Date of Patent: March 24, 2020Assignee: VARJO TECHNOLOGIES OYInventors: Ari Antti Erik Peuhkurinen, Oiva Arvo Oskari Sahlsten, Klaus Mikael Melakari
-
Patent number: 10592739Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator for emitting light pulses; at least one first optical element comprising a plurality of micro-to-nano-sized components, shaped and arranged relative to each other in a manner that, when incident thereupon, a structure of the light pulses is modified to produce structured light, wherein the produced structured light is used to illuminate a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form and a position of the reflections on an image plane of the at least one camera; and a processor configured to control the at least one illuminator and the at least one camera, and to process the captured image to detect a gaze direction of the user.Type: GrantFiled: February 1, 2018Date of Patent: March 17, 2020Assignee: VARJO TECHNOLOGIES OYInventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
-
Patent number: 10564429Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes a plurality of illuminators for emitting light pulses to illuminate a user's eye when the head-mounted display apparatus is worn by the user, the illuminators including at least a first illuminator and a second illuminator; at least one lens positioned on an optical path of reflections of the light pulses from the user's eye, the at least one lens having no chromatic-aberration correction; at least one camera for capturing an image of the reflections of the light pulses; and a processor coupled with illuminators and the at least one camera, the processor being configured to control operations of the illuminators and the at least one camera, and to process the captured image to detect a gaze direction of the user.Type: GrantFiled: February 1, 2018Date of Patent: February 18, 2020Assignee: VARJO TECHNOLOGIES OYInventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
-
Patent number: 10565797Abstract: A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.Type: GrantFiled: February 17, 2018Date of Patent: February 18, 2020Assignee: Varjo Technologies OyInventors: Joonas Nissinen, Mikko Ollila
-
Patent number: 10495895Abstract: A display apparatus and a method of displaying, via the display apparatus. The display apparatus includes an image source for rendering an image, a projection screen facing a direction at a predefined angle to a direction in which the rendered image is projected from the image source, an exit optical element facing the projection screen, a first polarizing element facing the image source and arranged to polarize a projection of the rendered image at a first polarization orientation, a first optical element arranged to reflect the polarized projection towards the projection screen, wherein the projection screen is arranged to unpolarize the polarized projection whilst reflecting the unpolarized projection towards the exit optical element, and a second polarizing element positioned between the projection screen and the exit optical element, arranged to polarize the unpolarized projection at a second polarization orientation.Type: GrantFiled: June 14, 2017Date of Patent: December 3, 2019Assignee: VARJO TECHNOLOGIES OYInventors: Evgeny Shirko, Andrei Razumov, Oiva Arvo Oskari Sahlsten
-
Patent number: 10488917Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator to emit light pulses for illuminating a user's eye; at least one camera to capture image of reflections of the light pulses; at least one reflective element arranged on an optical path of the reflections of the light pulses, such that when incident upon the at least one reflective element, the reflections of the light pulses are reflected towards the at least one camera; at least one actuator associated with the at least one reflective element, wherein the at least one actuator moves the at least one reflective element; and a processor configured to: process the at least one image to detect a gaze direction of user; and control the at least one actuator to adjust, based upon the detected gaze direction, position of the at least one reflective element.Type: GrantFiled: February 17, 2018Date of Patent: November 26, 2019Assignee: VARJO TECHNOLOGIES OYInventors: Mikko Ollila, Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
-
Patent number: 10452911Abstract: A gaze-tracking system for use in a head-mounted display apparatus, and a method of tracking a user's gaze, via such a gaze-tracking system. The gaze-tracking system includes illuminators for emitting light pulses to illuminate a user's eye; a camera for capturing an image of reflections of the light pulses from the user's eye, the camera including photo-sensitive elements arranged into a chip, wherein a first surface of the chip bulges inwards in a substantially-curved shape, such that a focal plane of photo-sensitive elements positioned proximally to edges of the chip is farther away than a focal plane of photo-sensitive elements positioned substantially at a center portion of the chip, the first surface facing the user's eye; and a processor being configured to control operations of the illuminators and the camera, and to process the captured image to detect a gaze direction of the user.Type: GrantFiled: February 1, 2018Date of Patent: October 22, 2019Assignee: VARJO TECHNOLOGIES OYInventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
-
Patent number: 10395111Abstract: A gaze-tracking system for a head-mounted display apparatus includes a first set of illuminators for emitting light to illuminate a user's eye; at least one photo sensor for sensing reflections of the light from the user's eye; at least one actuator for moving at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor; and a processor coupled with the first set of illuminators, the at least one photo sensor and the at least one actuator. The processor is configured to collect and process sensor data from the at least one photo sensor to detect a gaze direction of the user, and to control the at least one actuator to adjust, based upon the detected gaze direction, a position of the at least one of: (i) the first set of illuminators, (ii) the at least one photo sensor.Type: GrantFiled: July 13, 2017Date of Patent: August 27, 2019Assignee: VARJO TECHNOLOGIES OYInventors: Urho Konttori, Klaus Melakari, Thiyagarajan Manihatty Bojan, Ville Miettinen
-
Patent number: 10382699Abstract: An imaging system and a method of producing images for a display apparatus, via the imaging system includes at least one focusable camera for capturing at least one image of a given real-world scene; means for generating a depth map or a voxel map of the given real-world scene; and a processor coupled to the focusable camera and the aforesaid means. The processor is communicably coupled with the display apparatus. The processor is configured to receive information of the gaze direction of the user; map the gaze direction to the depth map or the voxel map to determine an optical depth of a region of interest in the given real-world scene; and control the focusable camera to employ a focus length that is substantially similar to the determined optical depth of the region of interest when capturing the at least one image.Type: GrantFiled: July 7, 2017Date of Patent: August 13, 2019Assignee: Varjo Technologies OyInventors: Roope Rainisto, Klaus Melakari
-
Patent number: 10371998Abstract: A display apparatus and a method of displaying, via the display apparatus. The display apparatus includes an image source, a processor configured to render an image at the image source, at least one optical combiner for combining a projection of the rendered image with a projection of a real world image, a first polarizing element for polarizing the projection of the real world image at a first polarization orientation, wherein the first polarizing element is positioned on a first side of the at least one optical combiner upon which the projection of the real world image is incident, and a second polarizing element facing a second side of the at least one optical combiner, polarization properties of the second polarizing element being adjustable, wherein the polarization properties of the second polarizing element are to be adjusted with respect to the first polarization orientation of the first polarizing element.Type: GrantFiled: June 29, 2017Date of Patent: August 6, 2019Assignee: Varjo Technologies OyInventor: Oiva Arvo Oskari Sahlsten
-
Patent number: 10122990Abstract: Disclosed is an imaging system and a method of producing a context image and a focus image for a display apparatus, via the imaging system. The imaging system includes at least one imaging sensor per eye of a user, and a processor coupled thereto. The processor is configured to control the imaging sensors to capture at least one image of a real world environment, and is arranged to be communicably coupled with the display apparatus. Furthermore, the processor is configured to: receive, from the display apparatus, information indicative of a gaze direction of the user; determine a region of visual accuracy of the at least one image, based upon the gaze direction of the user; process the at least one image to generate the context image and the focus image; and communicate the generated context image and the generated focus image to the display apparatus.Type: GrantFiled: June 27, 2017Date of Patent: November 6, 2018Assignee: Varjo Technologies OyInventors: Urho Konttori, Klaus Melakari, Mikko Ollila, Ville Miettinen
-
Patent number: 10082672Abstract: A display apparatus including at least one focus display; at least one electromechanical faceplate detachably attached to an outer surface of the display apparatus; and a processor coupled to the aforementioned components, wherein the processor is configured to render focus image at the focus display. The display apparatus is arranged to be detachably attached to portable electronic device, the electromechanical faceplate including a wireless communication interface, wherein the aforementioned interface is employed to communicably couple the portable electronic device and the display apparatus. A processor of the portable electronic device is configured to render context image at a display thereof, an angular width of a projection of the rendered context image being greater than an angular width of a projection of the rendered focus image. Furthermore, projection of the rendered context image is optically combined with projection of the rendered focus image to create a visual scene.Type: GrantFiled: February 28, 2018Date of Patent: September 25, 2018Assignee: Varjo Technologies OyInventor: Roope Rainisto
-
Patent number: 9989774Abstract: A display apparatus and method of displaying, via the display apparatus. The display apparatus includes context image renderer for rendering context image; focus image renderer for rendering focus image; exit optical element; and optical combiner for optically combining projection of the rendered context image with projection of the rendered focus image to create visual scene. The optical combiner includes first semi-transparent reflective element; and a second semi-transparent reflective element. The context image renderer is arranged in a manner that the projection of rendered context image passes through first semi-transparent reflective element towards exit optical element.Type: GrantFiled: July 14, 2017Date of Patent: June 5, 2018Assignee: Varjo Technologies OyInventors: Oiva Arvo Oskari Sahlsten, Mikko Ollila
-
Patent number: 9990037Abstract: A display apparatus and a method of displaying, via the display apparatus. The display apparatus includes at least one focus display, and a processor coupled to the at least one focus display. The processor of the display apparatus is configured to render a focus image at the at least one focus display. The display apparatus is arranged to be detachably attached to a portable electronic device and to be communicably coupled with the portable electronic device. A processor of the portable electronic device is configured to render a context image at a display of the portable electronic device. The projection of the rendered context image is combined with the projection of the rendered focus image to create a visual scene.Type: GrantFiled: June 14, 2017Date of Patent: June 5, 2018Assignee: Varjo Technologies OyInventor: Roope Rainisto
-
Patent number: 9983413Abstract: A display apparatus and method of displaying, via the display apparatus. The display apparatus includes context image renderer for rendering context image; focus image renderer for rendering focus image; exit optical element; and optical combiner for optically combining projection of the rendered context image with projection of the rendered focus image to create visual scene. The optical combiner includes first semi-transparent reflective element; and a second semi-transparent reflective element. The context image renderer is arranged in a manner that projection of rendered context image is incident upon first semi-transparent reflective element and reflected towards exit optical element therefrom.Type: GrantFiled: July 14, 2017Date of Patent: May 29, 2018Assignee: Varjo Technologies OyInventors: Oiva Arvo Oskari Sahlsten, Mikko Ollila
-
Patent number: 9905143Abstract: Disclosed is a display apparatus. The display apparatus includes at least one context image renderer for rendering a context image, wherein an angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees; at least one focus image renderer for rendering a focus image, wherein an angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees; and at least one optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to create a visual scene, wherein the visual scene is to be created in a manner that at least two different optical distances are provided therein.Type: GrantFiled: June 27, 2017Date of Patent: February 27, 2018Assignee: Varjo Technologies OyInventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten, Kseniia Duginova
-
Patent number: 9710887Abstract: Disclosed is a display apparatus and a method of displaying, via the display apparatus. The display apparatus comprises at least one context display for rendering a context image, the at least one context display comprising at least one projection surface, and at least one focus image projector for rendering a focus image. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees. An arrangement is made to combine the projection of the rendered focus image with the projection of the rendered context image to create a visual scene.Type: GrantFiled: December 8, 2016Date of Patent: July 18, 2017Assignee: Varjo Technologies OyInventors: Oiva Arvo Oskari Sahlsten, Urho Konttori, Klaus Melakari
-
Patent number: 9711114Abstract: A display apparatus and a method of displaying via the display apparatus. The display apparatus includes at least one context image projector or at least one context display for rendering a context image, wherein an angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees, and at least one focus image projector for rendering a focus image, wherein an angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees. An arrangement is made to combine the projection of the rendered focus image with the projection of the rendered context image to create a visual scene.Type: GrantFiled: December 1, 2016Date of Patent: July 18, 2017Assignee: Varjo Technologies OyInventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
-
Patent number: 9711072Abstract: Disclosed is a display apparatus comprising at least one context display for rendering a context image, at least one focus display for rendering a focus image, and at least one optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to create a visual scene. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees.Type: GrantFiled: December 1, 2016Date of Patent: July 18, 2017Assignee: Varjo Technologies OyInventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten