Patents by Inventor Klaus Melakari

Klaus Melakari has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11966509
    Abstract: An eye-tracking system (100, 302) comprises light source(s) (102, 202, 306); means (104, 200, 308) for changing direction of light beam (210) emitted by light source(s), wherein said means is to be employed to steer light beam to scan surface of user's eye (214); and light sensor(s) (106, 310) that is to be employed to sense reflected light signals. Said means is to be employed to detect when light beam is incident upon pupil of user's eye, based on variations in at least one parameter of reflected light signals; and steer light beam to be incident upon centre of pupil, wherein light beam is determined to be incident upon centre of pupil when minimum value from amongst values of at least one parameter of reflected light signals.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: April 23, 2024
    Assignee: Pixieray Oy
    Inventors: Ari Pitkänen, Klaus Melakari
  • Publication number: 20240103335
    Abstract: An active optical element includes an active material encased between a first substrate and a second substrate, first electrode(s), and second electrodes employed as a ground plane. The second electrodes divide the active optical element into segments. The first electrode(s) are driven at given voltage(s). At least one of the second electrodes corresponding to at least one of the segments is selectively connected to an electrical ground, whilst a remainder of the second electrodes are disconnected from the electrical ground. The active material in the at least one of the plurality of segments is controlled by a potential difference generated between the given voltage(s) and the electrical ground to produce a given optical power thereat.
    Type: Application
    Filed: September 27, 2022
    Publication date: March 28, 2024
    Applicant: Pixieray Oy
    Inventors: Klaus Melakari, Ari Pitkänen
  • Patent number: 11927837
    Abstract: An optical apparatus includes eye-tracking means, an active optical element per eye including an active material, and means for controlling the active material to generate optical powers. Gaze directions of a user's eyes are determined. When it is detected, based on the gaze directions, that the user is looking through a predefined portion of the active optical element, a drive signal is generated to drive said means to control the active material to produce a predefined optical power. When it is detected that the user's gaze is moving towards a periphery of the predefined portion, at least one other drive signal is generated to drive said means to control the active material to produce at least one intermediate optical power lying in a range between a zero optical power and the predefined optical power.
    Type: Grant
    Filed: February 11, 2022
    Date of Patent: March 12, 2024
    Assignee: Pixieray Oy
    Inventors: Klaus Melakari, Rebecca Qing Melakari
  • Publication number: 20240036310
    Abstract: Disclosed is eye-tracking system (100, 302) comprising: light-emitting units (102a-b), each light-emitting unit comprising light source(s) (108a-b, 202) and means (110a-b, 200) for changing direction of light beam emitted by light source(s), wherein light-emitting units are controlled to emit respective light beams towards user's eye and to change directions of light beams; light sensors (104a-b) to sense reflections of light beams off surface of user's eye; and processor(s) (106) configured to: detect, based on reflections sensed by light sensors, specific direction of light beam at which it is incident upon pupil of user's eye; determine position of pupil, based on specific directions of light beams emitted by light sources of at least two of light-emitting units at which light beams are incident upon pupil and positions of light sources of at least two of light-emitting units; and determine gaze direction of user's eye, based on position of pupil.
    Type: Application
    Filed: July 29, 2022
    Publication date: February 1, 2024
    Applicant: Pixieray Oy
    Inventor: Klaus Melakari
  • Patent number: 11733547
    Abstract: An active optical element includes an active material encased between a first substrate and a second substrate, first electrode(s), second electrodes employed as a ground plane, and means for applying and modulating additional impedance between an electrical ground and the second electrodes. The second electrodes divide the active optical element into segments. The first electrode(s) are driven at given voltage(s). At least one of the second electrodes corresponding to at least one of the segments is selectively connected to an electrical ground without any additional impedance, while applying and modulating the additional impedance between the electrical ground and a remainder of the plurality of second electrodes. The active material in the at least one of the plurality of segments is controlled by a potential difference generated between the given voltage(s) and the electrical ground to produce a given optical power.
    Type: Grant
    Filed: September 27, 2022
    Date of Patent: August 22, 2023
    Assignee: Pixieray Oy
    Inventors: Klaus Melakari, Ari Pitkänen
  • Publication number: 20230258959
    Abstract: An optical apparatus includes eye-tracking means, an active optical element per eye including an active material, and means for controlling the active material to generate optical powers. Gaze directions of a user’s eyes are determined. When it is detected, based on the gaze directions, that the user is looking through a predefined portion of the active optical element, a drive signal is generated to drive said means to control the active material to produce a predefined optical power. When it is detected that the user’s gaze is moving towards a periphery of the predefined portion, at least one other drive signal is generated to drive said means to control the active material to produce at least one intermediate optical power lying in a range between a zero optical power and the predefined optical power.
    Type: Application
    Filed: February 11, 2022
    Publication date: August 17, 2023
    Applicant: Pixieray Oy
    Inventors: Klaus Melakari, Rebecca Qing Melakari
  • Publication number: 20230258936
    Abstract: An optical apparatus includes an active optical element including an active material encased between a first substrate and a second substrate. Means for selectively controlling the active material in a central portion and a plurality of sectors of the active optical element is employed. The central portion and the plurality of sectors are arranged around an optical axis of the active optical element, wherein the plurality of sectors surround the central portion. A processor of the optical apparatus is configured to generate a drive signal to drive said means to selectively control the active material in at least one of: the central portion, at least one of the plurality of sectors to produce a given optical power thereat.
    Type: Application
    Filed: February 11, 2022
    Publication date: August 17, 2023
    Applicant: Pixieray Oy
    Inventors: Klaus Melakari, Niko Eiden, Rebecca Qing Melakari
  • Publication number: 20230258960
    Abstract: An optical apparatus includes means for determining an optical depth at which a user is looking, an active optical element per eye, controlling means for controlling an active material in the active optical element to generate one or more optical powers, and a processor . The processor is configured to process data, collected by the means for determining, to determine the optical depth at which the user is looking; detect when the optical depth at which the user is looking is greater than a predefined optical depth; and when it is detected that the optical depth is greater than the predefined optical depth, generate a drive signal to drive the controlling means to control the active material in a portion of the active optical element to produce a predefined optical power thereat, wherein the predefined optical power is a negative optical power.
    Type: Application
    Filed: February 11, 2022
    Publication date: August 17, 2023
    Applicant: Pixieray Oy
    Inventors: Klaus Melakari, Rebecca Qing Melakari
  • Publication number: 20230097774
    Abstract: An eye-tracking apparatus. At least one light source and a plurality of sensors are arranged at a periphery of a first surface of at least one lens. A frame is employed to hold the at least one lens. A processor coupled to the at least one light source and the plurality of sensors is configured to control the at least one light source to emit light towards the user's eye, control the plurality of sensors to sense reflections of the light off a surface of the user's eye, and process sensor data pertaining to the sensed reflections to determine a gaze direction of the user's eye.
    Type: Application
    Filed: September 29, 2021
    Publication date: March 30, 2023
    Applicant: Pixieray Oy
    Inventors: Klaus Melakari, Qing Xu, Ville Miettinen, Niko Eiden
  • Patent number: 11495194
    Abstract: A display apparatus comprising: first light source(s) per eye, scanning mirror(s) per eye, pattern converting element per eye, and processor(s) configured to control first light source(s) to emit a light beam, whilst controlling scanning mirror(s) to draw subframe(s) of first image frame over pattern converting element, wherein subframe(s), when drawn, comprises plurality of light spots arranged in first pattern, wherein pattern converting element is employed to direct light beam incident thereon towards target surface, whilst converting first pattern of plurality of light spots into second pattern, thereby producing on target surface output image having spatially-variable resolution.
    Type: Grant
    Filed: August 10, 2021
    Date of Patent: November 8, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Ari Antti Erik Peuhkurinen, Klaus Melakari, Perttu Keinänen, Oiva Arvo Oskari Sahlsten
  • Publication number: 20220351411
    Abstract: An AR system is arranged to display an image stream of an environment with one or more virtual objects, each virtual object being associated with a marker in the image stream. The AR system includes a tracking subsystem arranged to track a first pose of the marker in the image, and inform a frame rendering subsystem, which generates a rendering of the VR object and provides the rendering to the reprojecting subsystem together with information about the first pose of the marker and information identifying a set of pixels included in the VR image. The tracking subsystem further determines a second pose of the marker based on detected movement and informs the reprojecting subsystem about the second pose. The reprojecting subsystem renders an image frame including the image stream of the environment with the rendering of the VR object reprojected in dependence of the second pose.
    Type: Application
    Filed: April 30, 2021
    Publication date: November 3, 2022
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Klaus Melakari, Ville Miettinen
  • Publication number: 20220236499
    Abstract: An optical device. The optical device includes a fibre optic plate having an input surface and an output surface, the fibre optic plate including a plurality of optical fibres; and a colour filter array including a plurality of colour filters formed on at least one of: the input surface, the output surface of the fibre optic plate.
    Type: Application
    Filed: January 22, 2021
    Publication date: July 28, 2022
    Applicant: Varjo Technologies Oy
    Inventors: Oiva Arvo Oskari Sahlsten, Klaus Melakari
  • Patent number: 11348514
    Abstract: A display apparatus including: image renderer including light-emitting diodes that are to be employed as sub-pixels of image renderer; liquid-crystal device including liquid-crystal structure and control circuit, wherein liquid-crystal structure is arranged in front of light-emitting diodes of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from light-emitting diode to target positions on image plane according to shifting sequence in repeated manner; and processor(s) configured to render output sequence of output image frames via image renderer, wherein shift in light emanating from light-emitting diode to target positions causes resolution of output image frames to appear higher than display resolution of image renderer.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: May 31, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 11307410
    Abstract: A display apparatus including pose-tracking means; image renderer per eye; liquid-crystal device including liquid-crystal structure and control circuit; and processor. Processor is configured to: process pose-tracking data to determine user's head pose; detect if rate at which head pose is changing is below predefined threshold rate; if yes, switch on lock mode, select head pose for session of lock mode, and generate output image frames according to head pose during session; if no, generate output image frames according to corresponding head poses of user using pose-tracking data; and display output image frames, whilst shifting light emanating to from pixels of image renderer to multiple positions (P1-P9) in sequential and repeated manner, said shifting causes resolution of output image frames to appear higher than display resolution of image renderer.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: April 19, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Ville Miettinen, Klaus Melakari
  • Patent number: 11308900
    Abstract: In a display apparatus, a liquid-crystal structure, arranged in front of an image renderer, is controlled to shift light of a given sub-pixel to target positions according to a shifting sequence in a repeated manner, while output image frames are displayed. To generate a given output image frame, a given target position to which the light is to be shifted is determined based on the shifting sequence. An input colour value of the given sub-pixel provided in a given input image frame is then adjusted to generate an output colour value of the given sub-pixel for the given output image frame, based on an output colour value of at least one other sub-pixel whose light overlaps with the given target position during display of a previous output image frame, and a retention coefficient between a colour of the at least one other sub-pixel and a colour of the given sub-pixel.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: April 19, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Klaus Melakari, Ville Miettinen
  • Patent number: 11288027
    Abstract: A peripheral display apparatus that is wearable by a user. The peripheral display apparatus includes at least two light sources and at least one processor coupled to at least two light sources. The at least two light sources include a first light source and a second light source arranged at a first peripheral portion and a second peripheral portion of a field of view of user, respectively, first peripheral portion and second peripheral portion being positioned at opposite horizontal ends of field of view. The at least one processor or at least one external processor communicably coupled to at least one processor is configured to generate at least two images including a first image and a second image, wherein at least one processor is configured to display first image and second image simultaneously at first light source and second light source, respectively.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: March 29, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Juha Välimäki, Niko Eiden, Qing Xu, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 11288990
    Abstract: A display apparatus including: image renderer having array of pixels; liquid-crystal device comprising: liquid-crystal structure, wherein portions of liquid-crystal structure are arranged in front of corresponding pixels of said array; and control circuit including circuit elements employed to electrically control corresponding portions of liquid-crystal structure to shift light emanating from corresponding pixels to corresponding target positions; and processor(s) configured to: generate individual drive signals for circuit elements, based on corresponding target positions to which light emanating from corresponding pixels are to be shifted upon passing through corresponding portions of liquid-crystal structure; and send individual drive signals to control circuit to drive circuit elements to address corresponding portions of liquid-crystal structure separately, whilst displaying output image frame via image renderer.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: March 29, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Klaus Melakari
  • Patent number: 11281290
    Abstract: A display system including eye-tracking means, first image renderer, second image renderer, optical combiner and processor is described. Eye-tracking data is processed to determine gaze directions of user's eyes. Gaze location and gaze velocity and/or acceleration of user is determined based on gaze directions of user's eyes. It is detected whether or not gaze has been fixated for predefined time period based on gaze location and gaze velocity and/or acceleration of user. If gaze has been fixated, input image is processed to generate and render first image and second image substantially simultaneously. Projection of rendered first image and projection of rendered second image are combined optically by optical combiner to create extended-reality scene. If gaze has not been fixated, input image is processed to generate and render first image via first image renderer, whilst switching off or dimming second image renderer.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: March 22, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Niko Eiden, Klaus Melakari, Jarno Wuolijoki, Ville Kivistö, Antti Peuhkurinen
  • Publication number: 20210397251
    Abstract: A display system including eye-tracking means, first image renderer, second image renderer, optical combiner and processor is described. Eye-tracking data is processed to determine gaze directions of user's eyes. Gaze location and gaze velocity and/or acceleration of user is determined based on gaze directions of user's eyes. It is detected whether or not gaze has been fixated for predefined time period based on gaze location and gaze velocity and/or acceleration of user. If gaze has been fixated, input image is processed to generate and render first image and second image substantially simultaneously. Projection of rendered first image and projection of rendered second image are combined optically by optical combiner to create extended-reality scene. If gaze has not been fixated, input image is processed to generate and render first image via first image renderer, whilst switching off or dimming second image renderer.
    Type: Application
    Filed: June 17, 2020
    Publication date: December 23, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Niko Eiden, Klaus Melakari, Jarno Wuolijoki, Ville Kivistö, Antti Peuhkurinen
  • Publication number: 20210248952
    Abstract: A display apparatus including: image renderer including light-emitting diodes that are to be employed as sub-pixels of image renderer; liquid-crystal device including liquid-crystal structure and control circuit, wherein liquid-crystal structure is arranged in front of light-emitting diodes of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from light-emitting diode to target positions on image plane according to shifting sequence in repeated manner; and processor(s) configured to render output sequence of output image frames via image renderer, wherein shift in light emanating from light-emitting o diode to target positions causes resolution of output image frames to appear higher than display resolution of image renderer.
    Type: Application
    Filed: February 4, 2021
    Publication date: August 12, 2021
    Applicant: Varjo Technologies Oy
    Inventors: Klaus Melakari, Oiva Arvo Oskari Sahlsten