Patents by Inventor Arto Lehtiniemi

Arto Lehtiniemi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11010051
    Abstract: According to various, but not necessarily all, embodiments of the invention there is provided a method comprising: enabling display to a user of a virtual visual scene; in dependence upon detection of an occurrence of a predetermined action by a user, starting display to the user of one or more control visual elements in the virtual visual scene while the virtual visual scene is being displayed to the user; and enabling interaction by the user with the one or more control visual elements within the displayed virtual visual scene to enable control while the virtual visual scene is being displayed to the user, wherein the one or more control visual elements displayed in the virtual visual scene represent a controller device physically used by the user, within the virtual visual scene, wherein the predetermined action by the user is in relation to a first portion of the physical controller device physically used by the user, and wherein the one or more control visual elements displayed in the virtual visual scen
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: May 18, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Veli-Matti Kolmonen
  • Patent number: 10999412
    Abstract: A method, apparatus and computer program code are provided. The method comprises: causing display of mediated reality content by one or more displays associated with a device; identifying a further device with which at least a portion of the mediated reality content is to be shared; determining one or more parameters characterizing one or more displays associated with the further device; determining at least a portion of the mediated reality content to be shared with the further device based, at least in part, on the determined one or more parameters; and causing the portion of the mediated reality content to be shared with the further device.
    Type: Grant
    Filed: July 15, 2016
    Date of Patent: May 4, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
  • Patent number: 10993064
    Abstract: An apparatus comprising means configured to: receive first audio content from a remote apparatus, the audio content comprising at least one audio stream associated with respective location information; present the audio stream as spatial audio to be perceived as originating from a respective perceived-direction based on the location information; determine a user input direction to identify one of the audio streams; transmit a message to the remote apparatus identifying the identified audio stream; receive second audio content comprising an enhanced version of the at least one identified audio stream; present the enhanced version of the identified audio stream as spatial audio, wherein the perceived-direction of the identified audio stream is offset from the second perceived-direction of the enhanced version of the identified audio stream.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: April 27, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Sujeet Shyamsundar Mate, Arto Lehtiniemi, Miikka Tapani Vilermo
  • Patent number: 10993067
    Abstract: An apparatus configured to use captured spatial audio content captured by a rotatable spatial audio capture microphone array, the captured spatial audio content defining the three-dimensional arrangement of the audio in the scene, an orientation of the aural scene defined relative to the microphone array at the time of audio capture, and use captured direction data representative of the direction of a reference direction of said microphone array relative to the scene over a time during which said spatial audio content was captured; to generate modified spatial audio content in which the aural scene is decoupled from any rotation of the rotatable spatial audio capture microphone array that occurred during capture of the spatial audio content for presentation to the recipient user relative to a space in which the recipient user is located by virtue of modification of the orientation of the aural scene using the captured direction data.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: April 27, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Lasse Juhani Laaksonen, Anssi Rämö, Arto Lehtiniemi, Jussi Leppänen
  • Patent number: 10993066
    Abstract: An apparatus comprising means configured to: receive first information indicative of a reference location; provide for presentation of audio content as spatial audio to be perceived, from the reference location, as originating from a direction of at least one virtual audio source, the at least one virtual audio source associated with a real-world location; receive second information indicative of at least the presence of a real-world object between the real-world location of the at least one virtual audio source and the reference location; modify, based on the second information, the audio content to indicate aurally the location of the real-world object; and provide for presentation of the modified audio content as spatial audio.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: April 27, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Lasse Laaksonen, Arto Lehtiniemi, Antti Eronen, Jussi Leppänen
  • Patent number: 10979846
    Abstract: An apparatus for audio signal rendering, the apparatus including at least one processor configured to: receive at least one microphone audio signal captured by at least one microphone within a capture environment; receive at least one projection audio signal, wherein the at least one projection audio signal is a room-impulse-response filtered at least one microphone audio signal within the capture environment; receive at least one residual audio signal, wherein the at least one residual audio signal is a result of removing the at least one projection audio signal from at least one audio signal captured by a microphone array within the capture environment; and generate at least two volumetric audio signals based on the at least one microphone audio signal, the at least one projection audio signal and the at least one residual audio signal.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: April 13, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppanen, Tapani Pihlajakuja
  • Patent number: 10970932
    Abstract: A method is disclosed, including providing data indicative of dimensions of a real-world space within which a virtual world is to be consumed. The method may also include identifying one or more objects within said real-world space, and determining one or more available areas within the real-world space for rendering three-dimensional virtual content, based at least partly on the dimensions of the real-world space. The method may also include identifying one or more of the objects as being movable, identifying, from a set of three-dimensional virtual content items, one or more candidate items unable to be rendered within the available area(s) and which can be rendered if one or more of the movable objects is moved and providing an indication to a virtual reality user device of the candidate virtual item(s) and of the movable object(s) required to be moved.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: April 6, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Jussi Leppanen, Arto Lehtiniemi, Antti Eronen, Juha Arrasvuori
  • Patent number: 10972800
    Abstract: An apparatus caused to: in respect of video imagery of an event at which one or more commenting users are present and have submitted comments, a location of the or each of the one or more commenting users visible in the video imagery; based on a current view of the video imagery provided for display to a user and at least one comment having location information associated therewith indicative of one or more of (i) the location, at the time of making the comment, of the commenting user who submitted the comment at the event, (ii) a location, at the event, specified by the commenting user who submitted the comment at the event; provide for display of the comment overlaid over the current view of the video imagery, the comment displayed in the current view of the video imagery at a position that corresponds to the location information.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: April 6, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Arto Lehtiniemi, Antti Eronen, Jussi Leppänen, Juha Arrasvuori
  • Publication number: 20210092545
    Abstract: An apparatus is disclosed, which comprises a means for identifying virtual audio content within a first spatial sector of a virtual space with respect to a reference position. The apparatus also comprises a means for modifying the identified virtual audio content to be rendered in a second, smaller spatial sector.
    Type: Application
    Filed: June 18, 2019
    Publication date: March 25, 2021
    Inventors: Jussi LEPPÄNEN, Arto LEHTINIEMI, Antti ERONEN, Sujeet Shyamsundar MATE
  • Publication number: 20210081051
    Abstract: A method, an apparatus and a computer program are provided.
    Type: Application
    Filed: December 18, 2018
    Publication date: March 18, 2021
    Inventors: Lasse Laaksonen, Arto Lehtiniemi, Sujeet Shyamsundar Mate, Francesco Cricri
  • Publication number: 20210074070
    Abstract: An apparatus and method is described, including: determining a position of a plurality of users within a volumetric space; and determining a rendering of a message within the volumetric space, based, at least in part, on the determined positions of said users, such that the message is one or more of: visible to, audible by and touchable by each of said users.
    Type: Application
    Filed: April 1, 2019
    Publication date: March 11, 2021
    Inventors: Arto LEHTINIEMI, Antti Johannes ERONEN, Jussi LEPPÄNEN, Juha Henrik ARRASVUORI
  • Publication number: 20210076153
    Abstract: An apparatus comprising: means for causing selection of spatial audio content in dependence upon a position of a user in a virtual space; •means for causing rendering, for consumption by the user, of the selected spatial audio content including a first spatial audio content; •means for causing, after user consumption of the first spatial audio content, recording of data relating to the first spatial audio content; •means for using, at a later time, the recorded data to detect a new event relating to the first spatial audio content, the new event comprises that the first spatial audio content has been adapted for which a new spatial content is created, for example in the form of a limited preview; and•means for providing a user-selectable option to enable rendering, for consumption by the user, of the first spatial audio content by rendering a simplified sound object representative, which can be a downmix or clustered audio objects.
    Type: Application
    Filed: December 5, 2018
    Publication date: March 11, 2021
    Inventors: Lasse Laaksonen, Arto Lehtiniemi, Antti Eronen, Jussi Leppänen
  • Publication number: 20210076152
    Abstract: An apparatus comprising means for: obtaining an indication of a position of at least one user in real space; mapping the position of the user in real space to a position of the user in a sound space; and controlling an output audio signal, for rendering a sound scene via multiple audio channels, to provide rendering of a first sub-set of sound sources via at least a first sub-set of the multiple audio output channels and rendering a second sub-set of sound sources via at least a second sub-set of the multiple audio output channels, wherein an allocation of a plurality of sound sources to the first sub-set of sound sources or the second sub-set of sound sources is dependent upon at least a position of the user in the sound space; wherein an allocation of the multiple audio output channels to the first sub-set of the multiple audio output channels or the second sub-set of the multiple audio output channels is dependent upon available audio paths for the multiple audio output channels.
    Type: Application
    Filed: May 29, 2019
    Publication date: March 11, 2021
    Inventors: Jussi LEPPÄNEN, Lasse LAAKSONEN, Arto LEHTINIEMI, Antti ERONEN
  • Publication number: 20210067895
    Abstract: An apparatus, method and computer program, the apparatus including means for determining that perspective mediated content is available within content provided to a rendering device; and means for adding a notification to the content indicative that perspective mediated content is available; wherein the notification includes spatial audio effects added to the content.
    Type: Application
    Filed: December 14, 2018
    Publication date: March 4, 2021
    Inventors: Sujeet Shyamsundar MATE, Arto LEHTINIEMI, Antti ERONEN, Jussi Artturi LEPPANEN
  • Publication number: 20210067894
    Abstract: A method, an apparatus and a computer program are provided. The method includes rendering visual augmented reality content for display on a display of a hand-held electronic device, based on a location of the hand-held electronic device; estimate a location of a user of the hand-held electronic device, different from the location of the hand-held electronic device; and rendering aural augmented reality content for output to the user of the hand-held electronic device, based on the location of the user.
    Type: Application
    Filed: December 20, 2018
    Publication date: March 4, 2021
    Inventors: Jussi LEPPANEN, Arto LEHTINIEMI, Antti ERONEN
  • Patent number: 10928893
    Abstract: A method, apparatus and computer program code are provided. The method comprises: monitoring a viewer's gaze direction towards a first display while the first display is displaying primary visual content and secondary visual content; determining that the viewer's gaze is directed towards the secondary visual content displayed by the first display; and causing the secondary visual content to be expanded by a second display, different from the first display.
    Type: Grant
    Filed: June 21, 2016
    Date of Patent: February 23, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
  • Publication number: 20210042990
    Abstract: An apparatus, method and computer program is disclosed, comprising rendering a virtual scene of a virtual space that corresponds to a virtual position of a user in the virtual space as determined at least in part by the position of the user in a physical space. Embodiments also involve identifying one or more objects in the virtual scene which are in conflict with attributes of the physical space. Embodiments also involve detecting one or more blinking periods of the user when consuming the virtual scene. Embodiments also involve modifying the position of the one or more conflicting objects in the virtual scene based on a detected context. The modifying may be performed within the one or more detected blinking periods.
    Type: Application
    Filed: February 20, 2019
    Publication date: February 11, 2021
    Inventors: Ari-Pekka LILJEROOS, Arto LEHTINIEMI, Jussi LEPPÄNEN
  • Publication number: 20210037336
    Abstract: An apparatus configured to, based at least in part on (i) first audio content from a first communication device of a first user, the first user in telecommunication with a second user via a second communication device; and (ii) first-user orientation information indicative of one or more of the orientation and location of the first user relative to a predetermined reference point; provide for presentation of the first audio content at the second communication device in a first presentation mode when the first-user orientation information is indicative of a first condition and in a second presentation mode, different to the first, when the first-user orientation information is indicative of a second condition different to the first condition, the first and second presentation modes providing for different presentation of the first audio content.
    Type: Application
    Filed: February 19, 2019
    Publication date: February 4, 2021
    Inventors: Antti ERONEN, Miikka VILERMO, Arto LEHTINIEMI, Jussi LEPPÄNEN
  • Publication number: 20210014630
    Abstract: An apparatus comprising means for: obtaining an indication of a variable position of at least one user in real space; mapping the position of the user in real space to a position of the user in a sound space; controlling an output audio signal, for rendering a sound scene by a loudspeaker, the sound scene being defined by the one or more sound sources of the plurality of sound sources that are within a sub-volume of the sound space that excludes the position of the user in the sound space and that is sized in dependence upon the position of the user in the sound space.
    Type: Application
    Filed: March 25, 2019
    Publication date: January 14, 2021
    Inventors: Jussi Leppänen, Miikka Vilermo, Arto Lehtiniemi, Antti Eronen
  • Patent number: 10887719
    Abstract: In respect of spatial audio configured to be associated with a moveable, particular object in a scene, the spatial audio for presentation such as to be perceived as originating from a particular direction, the location of the object determined based on automatic identification in sensor data to enable positioning of the spatial audio to correspond to the location of the object, the sensor data from a sensor having a limited field of view of the real-world scene at any one time; based on a current location of the object being unknown; provide for audible presentation of the spatial audio with a previously-determined-direction and, based on a current field of view of the user moving to the previously-determined-direction, provide for modification of the spatial audio from the previously-determined-direction to a direction outside the current field of view of the user at least until the object is once again identified.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: January 5, 2021
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Arto Lehtiniemi, Sujeet Shyamsundar Mate, Jussi Leppänen