Patents Assigned to Varjo Technologies Oy
  • Publication number: 20210303854
    Abstract: An imaging system and a method for producing extended-reality images for a display apparatus. The imaging system includes camera and processor. The processor is configured to: control camera to capture image of real-world environment; analyse captured image to identify first image segment representing input device and to determine location of at least one actionable area of input device in first image segment; determine at least one functional element to be presented for the actionable area, the functional element being indicative of at least one of: functionality of the at least one actionable area, status of the at least one actionable area; and process captured image to generate extended-reality image in which the functional element is virtually superimposed over the actionable area of input device or a virtual representation of the actionable area of input device.
    Type: Application
    Filed: March 26, 2020
    Publication date: September 30, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Ari Antti Peuhkurinen, Aleksei Romanov, Evgeny Zuev, Yuri Popov, Tomi Lehto, Urho Konttori
  • Patent number: 11119313
    Abstract: An imaging system for producing extended-reality images for a display apparatus. The imaging system including camera that is employed to capture input image representing captured region of real-world environment; and processor configured to: generate intermediate image by correcting spatial distortion of input image; determine capturing region of intermediate image representing captured region of real-world environment and non-capturing regions of intermediate image corresponding to non-captured regions of real-world environment; generate image data for non-capturing region of intermediate image, based on at least one of: information pertaining to virtual object that is to be virtually superimposed, capturing region neighbouring non-capturing region, previous extended-reality image, photogrammetric model of real-world environment; and process intermediate image, based on generated image data, to produce extended-reality image to be presented at display apparatus.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: September 14, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Publication number: 20210259344
    Abstract: An adjustment mechanism for allowing a user to adjust a length of a headband includes a stationary case, a clutch, and a knob. The stationary case defines an opening and a circular recess. The clutch includes a cam arranged within the circular recess and a pinion extending axially from the cam such that the pinion is positioned outside the case via the opening to engage with the headband. The clutch also includes a roller located adjacent to a first cam portion of the cam. The knob has an actuating element arranged between the roller and a tab of the cam. The knob is rotatable in a first direction for allowing the user to shorten the length of the headband. The knob is rotatable in a second direction allowing the user to increase the length of the headband.
    Type: Application
    Filed: February 20, 2020
    Publication date: August 26, 2021
    Applicant: Varjo Technologies Oy
    Inventor: Jukka Manni
  • Patent number: 11099381
    Abstract: A display apparatus communicably coupled with server arrangement. Display apparatus includes means for tracking user's gaze; means for tracking pose of display apparatus; light source; optical element; and processor. Processor is configured to: process gaze-tracking data; process pose-tracking data; send, to server arrangement, gaze information and apparatus information, server arrangement predicts gaze information and apparatus information, and processes input image to generate image based on predictions; receive, image, predicted gaze information, and predicted apparatus information; determine adjustment required in configuration of light source and optical element prior to displaying image; determine if portion of previous image is to be displayed during adjustment; if yes, display said portion during adjustment; if no, switch off or dim light source during adjustment; display image via light source after adjustment.
    Type: Grant
    Filed: July 15, 2020
    Date of Patent: August 24, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Ari Antti Erik Peuhkurinen, Ville Ilmari Miettinen
  • Patent number: 11094089
    Abstract: A method of encoding images and a method of decoding images. The method of encoding comprises dividing an input image into a first input portion and a plurality of input rings that are concentric with the first input portion, the first input portion and the plurality of input rings being shaped as a simple closed curve; storing the first input portion into a first image; packing the plurality of input rings into a second image, second image having a plurality of rows, a given input ring of input image being packed into a corresponding row of second image; and communicating, to a display apparatus, the first image, the second image and information indicative of a size of the first input portion and sizes of the plurality of input rings.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: August 17, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Publication number: 20210248952
    Abstract: A display apparatus including: image renderer including light-emitting diodes that are to be employed as sub-pixels of image renderer; liquid-crystal device including liquid-crystal structure and control circuit, wherein liquid-crystal structure is arranged in front of light-emitting diodes of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from light-emitting diode to target positions on image plane according to shifting sequence in repeated manner; and processor(s) configured to render output sequence of output image frames via image renderer, wherein shift in light emanating from light-emitting o diode to target positions causes resolution of output image frames to appear higher than display resolution of image renderer.
    Type: Application
    Filed: February 4, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Publication number: 20210248969
    Abstract: In a display apparatus, a liquid-crystal structure, arranged in front of an image renderer, is controlled to shift light of a given sub-pixel to target positions according to a shifting sequence in a repeated manner, while output image frames are displayed. To generate a given output image frame, a given target position to which the light is to be shifted is determined based on the shifting sequence. An input colour value of the given sub-pixel provided in a given input image frame is then adjusted to generate an output colour value of the given sub-pixel for the given output image frame, based on an output colour value of at least one other sub-pixel whose light overlaps with the given target position during display of a previous output image frame, and a retention coefficient between a colour of the at least one other sub-pixel and a colour of the given sub-pixel.
    Type: Application
    Filed: February 4, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Klaus Melakari, Ville Miettinen
  • Publication number: 20210247607
    Abstract: A display apparatus including pose-tracking means; image renderer per eye; liquid-crystal device including liquid-crystal structure and control circuit; and processor. Processor is configured to: process pose-tracking data to determine user's head pose; detect if rate at which head pose is changing is below predefined threshold rate; if yes, switch on lock mode, select head pose for session of lock mode, and generate output image frames according to head pose during session; if no, generate output image frames according to corresponding head poses of user using pose-tracking data; and display output image frames, whilst shifting light emanating to from pixels of image renderer to multiple positions (P1-P9) in sequential and repeated manner, said shifting causes resolution of output image frames to appear higher than display resolution of image renderer.
    Type: Application
    Filed: January 22, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen, Klaus Melakari
  • Publication number: 20210248941
    Abstract: A display apparatus including gaze-tracking means, image renderers, liquid-crystal devices including liquid-crystal structure and control circuit, to shift light emanating from given pixel of image renderer to multiple positions, given pixel including colour component; and processor configured to: process gaze-tracking data to determine gaze direction of user's eye; determine gaze point; display first output image frame; detect if magnitude of difference between first output value and initial second output value of colour component of given pixel in first and second output image frames exceeds first threshold difference; when detected that magnitude of difference exceeds first threshold difference, update initial second output value to sum of first output value and product of distance factor and difference between initial second output and first output values; and display second output image frame.
    Type: Application
    Filed: January 29, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Publication number: 20210243384
    Abstract: An imaging system for producing images for display apparatus. Imaging system includes at least one imaging unit arranged to face real-world scene including camera, optical element including first optical portion and second optical portion having different focal lengths, first focal length of first optical portion is smaller than second focal length of second optical portion, and means for adjusting optical focus; and processor. Processor is configured to obtain gaze direction of user; determine region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.
    Type: Application
    Filed: April 26, 2021
    Publication date: August 5, 2021
    Applicant: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11054658
    Abstract: A display apparatus including means for detecting gaze direction of user; first and second image renderers; processor, processor or external processor processes input image to generate first image and second image, processor renders first and second images simultaneously; configuration of reflective elements arranged to split light emanating from second image renderer into plurality of directions to produce plurality of projections of second image in tiled layout; optical combiner; and opacity mask that is controlled based upon gaze direction to selectively allow given portion of the projections to pass through towards optical combiner, whilst blocking remaining portion of projections. Optical combiner is arranged to optically combine projection of first image with given portion of the projections, to produce on image plane an output image.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Patent number: 11056030
    Abstract: A display apparatus including an image renderer per eye; a liquid-crystal device including a liquid-crystal structure and a control circuit, the liquid-crystal structure being arranged in front of image-rendering surface of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from a given pixel of the image renderer to a plurality of positions in a sequential and repeated manner; and at least one processor configured to render a sequence of output image frames via the image renderer, wherein a shift in the light emanating from the given pixel of the image renderer to the plurality of positions causes a resolution of the output image frames to appear higher than a display resolution of the image renderer.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Klaus Melakari, Oiva Arvo Oskari Sahlsten, Mikko Ollila
  • Patent number: 11054728
    Abstract: A projection apparatus including an array of infrared emitters, the infrared emitters of said array being arranged in a first pattern; a plurality of liquid-crystal cells and corresponding control circuits, a given liquid-crystal cell being arranged in front of a corresponding infrared emitter of said array; and a processor configured to generate drive signals for driving the control circuits in a random or pseudorandom manner; and control the plurality of liquid-crystal cells individually, via the corresponding control circuits, to project a second pattern of light spots onto objects present in a real-world environment, wherein, when driven by a given drive signal, a given control circuit electrically controls a corresponding liquid-crystal cell to any of: block light emanating from a corresponding infrared emitter, transmit the light in an unbended manner, bend the light.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Ollila, Klaus Melakari
  • Patent number: 11055049
    Abstract: A system for facilitating shared rendering between display devices including first display device and second display device that are communicably coupled with first computing device and second computing device, respectively. The system includes means for tracking pose of first display device, means for tracking pose of second display device, image server, first client, second client. First client is configured to: send, to image server, first information indicative of pose of first display device; receive first image frame; render first image frame at first display device; receive second information indicative of pose of second display device; send, to image server, second information; receive second image frame; and send second image frame, wherein second client renders second image frame at second display device.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Ari Antti Peuhkurinen
  • Patent number: 11055879
    Abstract: An encoder including data processing arrangement configured to analyze depth information pertaining to input image to identify depth edge(s) and to determine location of depth edge(s); analyze input image to identify edges of objects and to determine locations of said edges; select, amongst edges in input image, matching edge(s) whose location matches with location of depth edge(s); obtain intermediate decoded image by decoding intermediate encoded image obtained from intermediate encoding of input image; analyze intermediate decoded image to identify edges of objects and to determine locations of said edges; determine edge(s) in intermediate decoded image that corresponds to matching edge(s); modify pixel values in input image and/or optical depths in depth information, based on difference in location of determined edge(s) in intermediate decoded image and location of matching edge(s); and encode input image and depth information, upon said modification, to generate encoded data.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: July 6, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen
  • Patent number: 11030720
    Abstract: A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Klaus Melakari, Mikko Ollila
  • Patent number: 11030817
    Abstract: A display system including display or projector , camera, means for tracking position and orientation of user's head, and processor. The processor is configured to control camera to capture images of real-world environment using default exposure setting, whilst processing head-tracking data to determine corresponding positions and orientations of user's head with respect to which images are captured; process images to create environment map of real-world environment; generate extended-reality image from images using environment map; render extended-reality image; adjust exposure of camera to capture underexposed image of real-world environment; process images to generate derived image; generate next extended-reality image from derived image using environment map; render next extended-reality image; and identify and modify intensities of oversaturated pixels in environment map, based on underexposed image and position and orientation with respect to which underexposed image is captured.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Petteri Timonen, Ville Timonen
  • Patent number: 11029408
    Abstract: A distance-imaging system including an illuminating unit that projects a spatially non-uniform pattern of light spots onto objects present in real-world environment, first portion of said pattern having higher density of light spots than second portion of said pattern; at least one camera that captures image of reflections of the light spots from surfaces of the objects; and at least one optical element associated with said camera, wherein first optical portion of said optical element has higher magnification factor than second optical portion of said optical element, reflections of said first and second portions of spatially non-uniform pattern of light spots being differently magnified and/or de-magnified by said first and second optical portions, respectively.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Ollila, Oiva Arvo Oskari Sahlsten
  • Patent number: 11030719
    Abstract: A display apparatus includes an imaging unit, an image renderer and a processor. The imaging unit includes a camera for capturing an image of a given real-world scene and an optical element arranged on an optical path of a projection of the given real-world scene. The projection of the given real-world scene is differently magnified by first and second optical-element portions of the optical element in a manner that the captured image has a variable angular resolution across a field of view of the optical element. An angular resolution of a first portion of the captured image is greater than an angular resolution of a second portion of the captured image. The processor is configured to process the captured image to generate an output image and render the output image via the image renderer.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11029385
    Abstract: A tracking system for use in head-mounted display apparatus includes at least one emitter that emits signals; a first receiver and a second receiver that sense the emitted signals and generate sensor data, the first receiver and the second receiver being arranged on a first portion and a second portion, respectively, wherein the first portion faces a user when the head-mounted display apparatus is worn by the user, and the second portion is a part of a user-interaction controller of a head-mounted display; and a processor configured to process the generated sensor data to determine relative positions and orientations of first receiver and second receiver with respect to the emitter, and to determine a relative position and orientation of the second receiver with respect to the first receiver.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: June 8, 2021
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari