Patents by Inventor Ari Antti Peuhkurinen

Ari Antti Peuhkurinen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11508085
    Abstract: A display system including: display apparatus; display-apparatus-tracking means; input device; processor. The processor is configured to: detect input event and identify actionable area of input device; process display-apparatus-tracking data to determine pose of display apparatus in global coordinate space; process first image to identify input device and determine relative pose thereof with respect to display apparatus; determine pose of input device and actionable area in global coordinate space; process second image to identify user's hand and determine relative pose thereof with respect to display apparatus; determine pose of hand in global coordinate space; adjust poses of input device and actionable area and pose of hand such that adjusted poses align with each other; process first image, to generate extended-reality image in which virtual representation of hand is superimposed over virtual representation of actionable area; and render extended-reality image.
    Type: Grant
    Filed: May 8, 2020
    Date of Patent: November 22, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Aleksei Romanov, Evgeny Zuev, Yuri Popov, Tomi Lehto
  • Patent number: 11488345
    Abstract: A display apparatus including means for tracking pose of user's head, light source(s) and processor configured to: process pose-tracking data to determine position, orientation, velocity and acceleration of head; predict viewpoint and view direction of user in extended-reality environment; determine region of extended-reality environment to be presented, based on viewpoint and view direction; determine sub-region(s) of region whose rendering information is to be derived from previous rendering information of corresponding sub-region(s) of previously-presented region of extended-reality environment; generate rendering information of sub-region(s) based on previous rendering information; send, to rendering server, information indicating remaining sub-regions required to be re-rendered and pose information indicating viewpoint and view direction; receive, from rendering server, rendering information of remaining sub-regions; merge rendering information of sub-region(s) and rendering information of remaining sub-
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: November 1, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Ville Miettinen
  • Publication number: 20220130103
    Abstract: A display apparatus including means for tracking pose of user's head, light source(s) and processor configured to: process pose-tracking data to determine position, orientation, velocity and acceleration of head; predict viewpoint and view direction of user in extended-reality environment; determine region of extended-reality environment to be presented, based on viewpoint and view direction; determine sub-region(s) of region whose rendering information is to be derived from previous rendering information of corresponding sub-region(s) of previously-presented region of extended-reality environment; generate rendering information of sub-region(s) based on previous rendering information; send, to rendering server, information indicating remaining sub-regions required to be re-rendered and pose information indicating viewpoint and view direction; receive, from rendering server, rendering information of remaining sub-regions; merge rendering information of sub-region(s) and rendering information of remaining sub-
    Type: Application
    Filed: October 22, 2020
    Publication date: April 28, 2022
    Applicant: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Ville Miettinen
  • Patent number: 11275945
    Abstract: An imaging system and a method for producing extended-reality images for a display apparatus. The imaging system includes camera and processor. The processor is configured to: control camera to capture image of real-world environment; analyse captured image to identify first image segment representing input device and to determine location of at least one actionable area of input device in first image segment; determine at least one functional element to be presented for the actionable area, the functional element being indicative of at least one of: functionality of the at least one actionable area, status of the at least one actionable area; and process captured image to generate extended-reality image in which the functional element is virtually superimposed over the actionable area of input device or a virtual representation of the actionable area of input device.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: March 15, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Aleksei Romanov, Evgeny Zuev, Yuri Popov, Tomi Lehto, Urho Konttori
  • Patent number: 11228745
    Abstract: A display apparatus including first and second displays or projectors that display first and second images for first and second eyes, respectively; first and second portions facing first and second eyes, respectively, first and second portions having first (F-F?) and second (S-S?) optical axes, respectively; means for tracking positions and orientations of first and second eyes relative to corresponding optical axes, respectively; and processor. The processor or external processor obtains current relative positions and orientations of both eyes; determines first and second transformations for first and second input image frames, respectively, given transformation being applied to correct apparent per-pixel distortions produced when given input image frame is displayed; and applies first and second transformations to generate first and second distortion-corrected image frames, respectively, wherein processor renders first and second distortion-corrected image frames.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: January 18, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Thomas Carlsson
  • Patent number: 11175513
    Abstract: A display apparatus including means for detecting user's gaze direction; first light source; second light source; configuration (108, 208, 306) of reflective elements to split light to create copies of second image; optical waveguides whose outlets are arranged in tiled layout; opacity masks arranged at inlets of waveguides; and processor. Input image is processed to generate first and second images. Processor is configured to: display first and second images; and for optical waveguides, control respective opacity masks to block respective copies of second image or selectively allow portions of respective copies of second image to pass through towards inlets of waveguides. Light from first light source is optically combined with light exiting outlets of waveguides, to produce output image.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: November 16, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Publication number: 20210350564
    Abstract: A display system including: display apparatus; display-apparatus-tracking means; input device; processor. The processor is configured to: detect input event and identify actionable area of input device; process display-apparatus-tracking data to determine pose of display apparatus in global coordinate space; process first image to identify input device and determine relative pose thereof with respect to display apparatus; determine pose of input device and actionable area in global coordinate space; process second image to identify user's hand and determine relative pose thereof with respect to display apparatus; determine pose of hand in global coordinate space; adjust poses of input device and actionable area and pose of hand such that adjusted poses align with each other; process first image, to generate extended-reality image in which virtual representation of hand is superimposed over virtual representation of actionable area; and render extended-reality image.
    Type: Application
    Filed: May 8, 2020
    Publication date: November 11, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Aleksei Romanov, Evgeny Zuev, Yuri Popov, Tomi Lehto
  • Patent number: 11145031
    Abstract: A display apparatus including first display or projector for displaying first images for first eye; second display or projector for displaying second images for second eye; first portion and second portion arranged to face first and second eyes; means for tracking poses of first and second eyes relative to first and second optical axes, respectively; and processor. Processor or external processor is configured to: obtain given pose of given eye relative to given optical axis; generate information pertaining to given visual artifact that is formed over given image at image plane when given image is displayed; determine artifact-superposing portion of given image; and process given image based on generated information and artifact-superposing portion, to generate given artifact-compensated image. Processor displays given artifact-compensated image via given display or projector.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: October 12, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Publication number: 20210303854
    Abstract: An imaging system and a method for producing extended-reality images for a display apparatus. The imaging system includes camera and processor. The processor is configured to: control camera to capture image of real-world environment; analyse captured image to identify first image segment representing input device and to determine location of at least one actionable area of input device in first image segment; determine at least one functional element to be presented for the actionable area, the functional element being indicative of at least one of: functionality of the at least one actionable area, status of the at least one actionable area; and process captured image to generate extended-reality image in which the functional element is virtually superimposed over the actionable area of input device or a virtual representation of the actionable area of input device.
    Type: Application
    Filed: March 26, 2020
    Publication date: September 30, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Aleksei Romanov, Evgeny Zuev, Yuri Popov, Tomi Lehto, Urho Konttori
  • Publication number: 20210241424
    Abstract: A display apparatus including first display or projector for displaying first images for first eye; second display or projector for displaying second images for second eye; first portion and second portion arranged to face first and second eyes; means for tracking poses of first and second eyes relative to first and second optical axes, respectively; and processor. Processor or external processor is configured to: obtain given pose of given eye relative to given optical axis; generate information pertaining to given visual artifact that is formed over given image at image plane when given image is displayed; determine artifact-superposing portion of given image; and process given image based on generated information and artifact-superposing portion, to generate given artifact-compensated image. Processor displays given artifact-compensated image via given display or projector.
    Type: Application
    Filed: January 31, 2020
    Publication date: August 5, 2021
    Inventor: Ari Antti Peuhkurinen
  • Patent number: 11054658
    Abstract: A display apparatus including means for detecting gaze direction of user; first and second image renderers; processor, processor or external processor processes input image to generate first image and second image, processor renders first and second images simultaneously; configuration of reflective elements arranged to split light emanating from second image renderer into plurality of directions to produce plurality of projections of second image in tiled layout; optical combiner; and opacity mask that is controlled based upon gaze direction to selectively allow given portion of the projections to pass through towards optical combiner, whilst blocking remaining portion of projections. Optical combiner is arranged to optically combine projection of first image with given portion of the projections, to produce on image plane an output image.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Patent number: 11055049
    Abstract: A system for facilitating shared rendering between display devices including first display device and second display device that are communicably coupled with first computing device and second computing device, respectively. The system includes means for tracking pose of first display device, means for tracking pose of second display device, image server, first client, second client. First client is configured to: send, to image server, first information indicative of pose of first display device; receive first image frame; render first image frame at first display device; receive second information indicative of pose of second display device; send, to image server, second information; receive second image frame; and send second image frame, wherein second client renders second image frame at second display device.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Patent number: 11049306
    Abstract: A display apparatus including image renderer, camera and processor. The processor or external processor communicably coupled to said processor is configured to: render at least one extended-reality image during first mode of operation of display apparatus; determine second mode of operation to which display apparatus is to be switched; control camera to capture at least one real-world image of real-world environment; generate at least one composite image from at least one next extended-reality image and at least one real-world image, wherein first portion of at least one composite image is derived from at least one next extended-reality image, and second portion of at least one composite image is derived from at least one real-world image; and render at least one composite image during second mode of operation of display apparatus.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: June 29, 2021
    Assignee: Vago Technologies Oy
    Inventors: Akseli Anttila, Kaj Harri Wikberg, Jaakko Viitanen, Ari Antti Peuhkurinen, Aleksei Romanov, Iurii Popov, Tomi Lehto, Evgeny Zuev
  • Publication number: 20210160468
    Abstract: A display apparatus including first and second displays or projectors that display first and second images for first and second eyes, respectively; first and second portions facing first and second eyes, respectively, first and second portions having first (F-F?) and second (S-S?) optical axes, respectively; means for tracking positions and orientations of first and second eyes relative to corresponding optical axes, respectively; and processor. The processor or external processor obtains current relative positions and orientations of both eyes; determines first and second transformations for first and second input image frames, respectively, given transformation being applied to correct apparent per-pixel distortions produced when given input image frame is displayed; and applies first and second transformations to generate first and second distortion-corrected image frames, respectively, wherein processor renders first and second distortion-corrected image frames.
    Type: Application
    Filed: November 26, 2019
    Publication date: May 27, 2021
    Inventors: Ari Antti Peuhkurinen, Thomas Carlsson
  • Publication number: 20210132963
    Abstract: A system for presenting notifications on display device and external computing device. The display device includes image renderer, external visual indicator and first processor, the external computing device comprises display and second processor. The system comprises first and second clients executing on first processor, third client executing on second processor, first, second and third clients are configured to generate and render first, second and third user interfaces on image renderer, external visual indicator and display, respectively; and control server. The control server is configured to obtain information; detect whether or not notification is to be presented; determine notification type and content; and select clients from amongst plurality of clients and send content on selected clients, wherein selected clients are configured to generate and render their respective user interfaces to present notification substantially simultaneously.
    Type: Application
    Filed: November 5, 2019
    Publication date: May 6, 2021
    Inventors: Ari Antti Peuhkurinen, Matias Hyry
  • Publication number: 20210134033
    Abstract: A display apparatus including image renderer, camera and processor. The processor or external processor communicably coupled to said processor is configured to: render at least one extended-reality image during first mode of operation of display apparatus; determine second mode of operation to which display apparatus is to be switched; control camera to capture at least one real-world image of real-world environment; generate at least one composite image from at least one next extended-reality image and at least one real-world image, wherein first portion of at least one composite image is derived from at least one next extended-reality image, and second portion of at least one composite image is derived from at least one real-world image; and render at least one composite image during second mode of operation of display apparatus.
    Type: Application
    Filed: November 6, 2019
    Publication date: May 6, 2021
    Inventors: Akseli Anttila, Kaj Harri Wikberg, Jaakko Viitanen, Ari Antti Peuhkurinen, Aleksei Romanov, Iurii Popov, Tomi Lehto, Evgeny Zuev
  • Patent number: 10990167
    Abstract: A display apparatus including display or projector, means for tracking position and orientation of user's head, and processor coupled to display or projector and said means. The processor or external processor communicably coupled to processor is configured to obtain head-tracking data indicative of position and orientation; process head-tracking data to determine current position and orientation of user's head and velocity and/or acceleration with which position and orientation is changing; predict first and second position and orientation of user's head at time t1 and t2, respectively; determine first and second projection matrices to be applied to three-dimensional image data of given frame, respectively; and apply first and second projection matrices to said image data to generate first image frame and second image frame, respectively. Processor is configured to render first and second image frame at time t1 and t2, respectively.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: April 27, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Publication number: 20210116993
    Abstract: A display apparatus including display or projector, means for tracking position and orientation of user's head, and processor coupled to display or projector and said means. The processor or external processor communicably coupled to processor is configured to obtain head-tracking data indicative of position and orientation; process head-tracking data to determine current position and orientation of user's head and velocity and/or acceleration with which position and orientation is changing; predict first and second position and orientation of user's head at time t1 and t2, respectively; determine first and second projection matrices to be applied to three-dimensional image data of given frame, respectively; and apply first and second projection matrices to said image data to generate first image frame and second image frame, respectively. Processor is configured to render first and second image frame at time t1 and t2, respectively.
    Type: Application
    Filed: October 22, 2019
    Publication date: April 22, 2021
    Inventor: Ari Antti Peuhkurinen
  • Publication number: 20210018754
    Abstract: A display apparatus including means for detecting user's gaze direction; first light source; second light source; configuration (108, 208, 306) of reflective elements to split light to create copies of second image; optical waveguides whose outlets are arranged in tiled layout; opacity masks arranged at inlets of waveguides; and processor. Input image is processed to generate first and second images. Processor is configured to: display first and second images; and for optical waveguides, control respective opacity masks to block respective copies of second image or selectively allow portions of respective copies of second image to pass through towards inlets of waveguides. Light from first light source is optically combined with light exiting outlets of waveguides, to produce output image.
    Type: Application
    Filed: September 28, 2020
    Publication date: January 21, 2021
    Applicant: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Publication number: 20200233222
    Abstract: A display apparatus including means for detecting gaze direction of user; first and second image renderers; processor, processor or external processor processes input image to generate first image and second image, processor renders first and second images simultaneously; configuration of reflective elements arranged to split light emanating from second image renderer into plurality of directions to produce plurality of projections of second image in tiled layout; optical combiner; and opacity mask that is controlled based upon gaze direction to selectively allow given portion of the projections to pass through towards optical combiner, whilst blocking remaining portion of projections. Optical combiner is arranged to optically combine projection of first image with given portion of the projections, to produce on image plane an output image.
    Type: Application
    Filed: January 31, 2020
    Publication date: July 23, 2020
    Inventor: Ari Antti Peuhkurinen