Patents by Inventor Klaus Melakari

Klaus Melakari has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10003872
    Abstract: According to one aspect, there is provided an apparatus comprising a frame and a speaker rigidly attached to the frame, where the speaker comprises a display module and at least one vibrating deformable plate element attached to a bottom surface of the display module and configured to at least partially bend, when actuated, the display module to generate at least one of sound waves or tactile feedback.
    Type: Grant
    Filed: October 6, 2016
    Date of Patent: June 19, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Matti Pellikka, Pasi Kemppinen, Klaus Melakari
  • Publication number: 20180160100
    Abstract: Disclosed is an imaging system and a method of producing a context image and a focus image for a display apparatus, via the imaging system. The imaging system includes at least one imaging sensor per eye of a user, and a processor coupled thereto. The processor is configured to control the imaging sensors to capture at least one image of a real world environment, and is arranged to be communicably coupled with the display apparatus. Furthermore, the processor is configured to: receive, from the display apparatus, information indicative of a gaze direction of the user; determine a region of visual accuracy of the at least one image, based upon the gaze direction of the user; process the at least one image to generate the context image and the focus image; and communicate the generated context image and the generated focus image to the display apparatus.
    Type: Application
    Filed: June 27, 2017
    Publication date: June 7, 2018
    Inventors: Urho Konttori, Klaus Melakari, Mikko Ollila, Ville Miettinen
  • Publication number: 20180160048
    Abstract: An imaging system and a method of producing images for a display apparatus, via the imaging system includes at least one focusable camera for capturing at least one image of a given real-world scene; means for generating a depth map or a voxel map of the given real-world scene; and a processor coupled to the focusable camera and the aforesaid means. The processor is communicably coupled with the display apparatus. The processor is configured to receive information of the gaze direction of the user; map the gaze direction to the depth map or the voxel map to determine an optical depth of a region of interest in the given real-world scene; and control the focusable camera to employ a focus length that is substantially similar to the determined optical depth of the region of interest when capturing the at least one image.
    Type: Application
    Filed: July 7, 2017
    Publication date: June 7, 2018
    Inventors: Roope Rainisto, Klaus Melakari
  • Publication number: 20180157908
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus includes means for producing structured light including a plurality of illuminators for emitting light pulses. Furthermore, the gaze-tracking system includes at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form of the reflections and a position of the reflections on an image plane of the at least one camera. Moreover, the gaze-tracking system includes a processor configured to control the means for producing the structured light to illuminate the user's eye with the structured light and to control the at least one camera to capture the image of the reflections of the structured light, and to process the captured image to detect a gaze direction of the user.
    Type: Application
    Filed: July 13, 2017
    Publication date: June 7, 2018
    Inventors: Oiva Arvo Oskari Sahlsten, Klaus Melakari, Mikko Ollila, Ville Miettinen
  • Publication number: 20180157909
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator for emitting light pulses; at least one first optical element comprising a plurality of micro-to-nano-sized components, shaped and arranged relative to each other in a manner that, when incident thereupon, a structure of the light pulses is modified to produce structured light, wherein the produced structured light is used to illuminate a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form and a position of the reflections on an image plane of the at least one camera; and a processor configured to control the at least one illuminator and the at least one camera, and to process the captured image to detect a gaze direction of the user.
    Type: Application
    Filed: February 1, 2018
    Publication date: June 7, 2018
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Publication number: 20180157910
    Abstract: A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes: at least one first optical element comprising particles of a phosphorescent or fluorescent material dispersed therein, the particles of the phosphorescent or fluorescent material being dispersed in a manner that when excited by electromagnetic radiation incident thereupon, the particles produce structured light of a given wavelength, wherein the produced structured light illuminates a user's eye; at least one camera for capturing an image of reflections of the structured light from the user's eye, wherein the image is representative of a form of the reflections and a position of the reflections on an image plane of the at least one camera; and a processor coupled in communication with the at least one camera, wherein the processor is configured to process the captured image to detect a gaze direction of the user.
    Type: Application
    Filed: February 1, 2018
    Publication date: June 7, 2018
    Inventors: Mikko Ollila, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Publication number: 20180103306
    Abstract: According to one aspect, there is provided an apparatus comprising a frame and a speaker rigidly attached to the frame, where the speaker comprises a display module and at least one vibrating deformable plate element attached to a bottom surface of the display module and configured to at least partially bend, when actuated, the display module to generate at least one of sound waves or tactile feedback.
    Type: Application
    Filed: October 6, 2016
    Publication date: April 12, 2018
    Inventors: Matti Pellikka, Pasi Kemppinen, Klaus Melakari
  • Publication number: 20180077322
    Abstract: An apparatus comprises a processing unit configured to obtain preliminary image data of a preliminary digital image frame captured by a digital image sensor having comprising a sensor layer comprising a pixel array; a mask layer comprising an array of micro apertures positioned within aperture sites corresponding the positioning and size of the light sensitive pixels, and a lens layer comprising an array of micro lenses positioned within lens sites. The micro apertures are positioned in the aperture sites at aperture positions defined by an aperture density function. The processing unit is further configured to obtain the aperture density function; and a position difference between prevailing positioning of the mask layer in relation to the lens layer from a reference relative positioning thereof; and to reconstruct, on the basis of the preliminary image data, the position difference, and the aperture density function, an output digital image frame.
    Type: Application
    Filed: September 15, 2016
    Publication date: March 15, 2018
    Inventors: Klaus Melakari, Mikko Juhola
  • Publication number: 20180070180
    Abstract: A display surface structure comprises a deformable transparent surface layer, a visual display layer visible through the deformable transparent surface layer, a piezo-electric layer in mechanical communication with the deformable transparent surface layer, and a drive circuit in electrical communication with the piezo-electric layer. The drive circuit sends a drive signal to the piezo-electric layer to cause the piezo-electric layer to deform the deformable transparent surface layer and generate an audio output.
    Type: Application
    Filed: September 8, 2016
    Publication date: March 8, 2018
    Inventors: Klaus Melakari, Pasi Kemppinen
  • Patent number: 9905143
    Abstract: Disclosed is a display apparatus. The display apparatus includes at least one context image renderer for rendering a context image, wherein an angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees; at least one focus image renderer for rendering a focus image, wherein an angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees; and at least one optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to create a visual scene, wherein the visual scene is to be created in a manner that at least two different optical distances are provided therein.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: February 27, 2018
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten, Kseniia Duginova
  • Patent number: 9711072
    Abstract: Disclosed is a display apparatus comprising at least one context display for rendering a context image, at least one focus display for rendering a focus image, and at least one optical combiner for combining the projection of the rendered context image with the projection of the rendered focus image to create a visual scene. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees.
    Type: Grant
    Filed: December 1, 2016
    Date of Patent: July 18, 2017
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 9711114
    Abstract: A display apparatus and a method of displaying via the display apparatus. The display apparatus includes at least one context image projector or at least one context display for rendering a context image, wherein an angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees, and at least one focus image projector for rendering a focus image, wherein an angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees. An arrangement is made to combine the projection of the rendered focus image with the projection of the rendered context image to create a visual scene.
    Type: Grant
    Filed: December 1, 2016
    Date of Patent: July 18, 2017
    Assignee: Varjo Technologies Oy
    Inventors: Urho Konttori, Klaus Melakari, Oiva Arvo Oskari Sahlsten
  • Patent number: 9710887
    Abstract: Disclosed is a display apparatus and a method of displaying, via the display apparatus. The display apparatus comprises at least one context display for rendering a context image, the at least one context display comprising at least one projection surface, and at least one focus image projector for rendering a focus image. An angular width of a projection of the rendered context image ranges from 40 degrees to 220 degrees. An angular width of a projection of the rendered focus image ranges from 5 degrees to 60 degrees. An arrangement is made to combine the projection of the rendered focus image with the projection of the rendered context image to create a visual scene.
    Type: Grant
    Filed: December 8, 2016
    Date of Patent: July 18, 2017
    Assignee: Varjo Technologies Oy
    Inventors: Oiva Arvo Oskari Sahlsten, Urho Konttori, Klaus Melakari
  • Publication number: 20170134714
    Abstract: A device for creating video clips from an omnidirectional video is presented. The device comprises at least one processor and a memory including computer program code. The memory is configured to store an omnidirectional video comprising a series of image frames, and the code is configured to cause the device to: identify two or more regions of interest in a segment comprising a sequence of image frames of the omnidirectional video, the regions identified based at least partly on one or more active objects detected in the segment, define two or more digital viewpoints, wherein each digital viewpoint encloses at least one region of interest throughout the segment, create a set of video clips, wherein each video clip is composed of a sequence of images formed by a single digital viewpoint throughout the segment, and assign a common timeline to each of the video clips.
    Type: Application
    Filed: November 11, 2015
    Publication date: May 11, 2017
    Inventors: Shahil Soni, Esa Kankaanpää, Klaus Melakari
  • Publication number: 20170127008
    Abstract: A device is presented. The device comprises: at least one processor and at least one memory including computer program code, a display element coupled to the processor, and a user input element coupled to the processor.
    Type: Application
    Filed: October 29, 2015
    Publication date: May 4, 2017
    Inventors: Esa Kankaanpää, Shahil Soni, Klaus Melakari, Niko Eiden, Roope Rainisto
  • Publication number: 20170094190
    Abstract: In one example, a device comprises a first interface configured to receive an image frame one fraction at a time, the image frame having been captured with a memoryless digital image capture unit. The device further comprises a processing unit configured to process the received fractions of the image frame. The device further comprises a second interface configured to output the processed fractions of the image frame to a memoryless display one fraction at a time.
    Type: Application
    Filed: September 30, 2015
    Publication date: March 30, 2017
    Inventor: Klaus Melakari
  • Publication number: 20160379374
    Abstract: An apparatus for or processing video frames is presented. The apparatus comprises at least one processing unit and at least one memory. The at least one memory stores program instructions that, when executed by the at least one processing unit, cause the apparatus to segment objects appearing in video frames, model movement of a camera recording the video frames, and individually compensate motion artefacts in the video frames for at least one segmented object based on relative movement of the camera and at least one segmented object.
    Type: Application
    Filed: June 29, 2015
    Publication date: December 29, 2016
    Inventors: Tomi Sokeila, Klaus Melakari, Mikko Muukki
  • Publication number: 20120212445
    Abstract: An apparatus including an electronic display having an electrical display section located behind a front window. A capacitive touch sensor located behind the electrical display section. The electrical display section is configured to display information to a user at the front window. The capacitive touch sensor is configured to sense presence of a finger of the user at the front window.
    Type: Application
    Filed: February 23, 2011
    Publication date: August 23, 2012
    Inventors: Marko K. Heikkinen, Mika Antila, Markku Salmela, Klaus Melakari
  • Patent number: 7843220
    Abstract: An integrated circuit comprises a processor, a controller and plural terminals. Each terminal constitutes a connection between the integrated circuit and a peripheral device. Each terminal is connected to a logic circuit on the integrated circuit by a respective IO cell in series connection with a respective IO isolation circuit and wherein the controller is operable on power up of the integrated circuit to activate a reset state and to release the reset state prior to releasing IO isolation by one or more of the IO isolation circuits. Each IO isolation circuit may be arranged so that a default state of the IO isolation circuit is a state in which the IO cell is isolated from the logic circuit. The IO isolation circuits may be controllable by software, for instance a driver for a peripheral device connected to the terminal associated with the IO isolation circuit. Plural IO isolation circuits may be connected so as to be commonly controllable by a single control signal from the controller.
    Type: Grant
    Filed: December 22, 2006
    Date of Patent: November 30, 2010
    Assignee: Nokia Corporation
    Inventors: Pasi Kolinummi, Klaus Melakari, Marko Winblad
  • Publication number: 20100097100
    Abstract: An integrated circuit comprises a processor, a controller and plural terminals. Each terminal constitutes a connection between the integrated circuit and a peripheral device. Each terminal is connected to a logic circuit on the integrated circuit by a respective IO cell in series connection with a respective IO isolation circuit and wherein the controller is operable on power up of the integrated circuit to activate a reset state and to release the reset state prior to releasing IO isolation by one or more of the IO isolation circuits. Each IO isolation circuit may be arranged so that a default state of the IO isolation circuit is a state in which the IO cell is isolated from the logic circuit. The IO isolation circuits may be controllable by software, for instance a driver for a peripheral device connected to the terminal associated with the IO isolation circuit. Plural IO isolation circuits may be connected so as to be commonly controllable by a single control signal from the controller.
    Type: Application
    Filed: December 22, 2006
    Publication date: April 22, 2010
    Applicant: NOKIA CORPORATION
    Inventors: Pasi Kolinummi, Klaus Melakari, Marko Winblad