Patents by Inventor Arto Lehtiniemi
Arto Lehtiniemi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230224664Abstract: An apparatus, method and computer program product for: providing spatial audio content for output via at least one loudspeaker, determining a position of at least one audio device operatively connected to the at least one loudspeaker, providing, in response to determining that the position of the at least one audio device corresponds to an audio zone associated with additional spatial audio content, the additional spatial audio content for output via the at least one audio device, receiving an instruction to include the additional spatial audio content in the spatial audio content, and supplementing, in response to receiving the instruction to include the additional spatial content in the spatial audio content, the spatial audio content with the additional spatial audio such that the additional spatial audio content is provided for output independent of the audio zone.Type: ApplicationFiled: May 27, 2021Publication date: July 13, 2023Inventors: Arto Lehtiniemi, Sujeet Shyamsundar MATE, Toni MAKINEN, Miikka VILERMO
-
Patent number: 11696085Abstract: An apparatus, method and computer program, the apparatus including means for determining that perspective mediated content is available within content provided to a rendering device; and means for adding a notification to the content indicative that perspective mediated content is available; wherein the notification includes spatial audio effects added to the content.Type: GrantFiled: December 14, 2018Date of Patent: July 4, 2023Assignee: Nokia Technologies OyInventors: Sujeet Shyamsundar Mate, Arto Lehtiniemi, Antti Eronen, Jussi Artturi Leppanen
-
Publication number: 20230179939Abstract: An apparatus for audio signal processing audio objects within at least one audio scene, the apparatus comprising at least one processor configured to: define for at least one time period at least one contextual grouping comprising at least two of a plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping, the plurality of audio objects within at least one audio scene; and define with respect to the at least one contextual grouping at least one first parameter and/or parameter rule type which is configured to be applied with respect to a common element associated with the at least two of the plurality of audio objects and wherein the at least one first parameter and/or parameter rule type is configured to be applied with respect to individual element associated with the at least one further audio object outside of the at least one contextual grouping, the at least one first parameter and/or parameter rule type being appliType: ApplicationFiled: January 30, 2023Publication date: June 8, 2023Applicant: NOKIA TECHNOLOGIES OYInventors: Lasse LAAKSONEN, Mikko TAMMI, Miikka VILERMO, Arto LEHTINIEMI
-
Patent number: 11644528Abstract: An apparatus for generating at least one distance estimate to at least one sound source within a sound scene comprising the least one sound source, the apparatus configured to: receive at least two audio signals from a microphone array located within the sound scene; receive at least one further audio signal associated with the at least one sound source; determine at least one portion of the at least two audio signals from a microphone array corresponding to the at least one further audio signal associated with the at least one sound source; determine a distance estimate to the at least one sound source based on the at least one portion of the at least two audio signals from a microphone array corresponding to the at least one further audio signal associated with the at least one sound source.Type: GrantFiled: June 13, 2018Date of Patent: May 9, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Antti Eronen, Arto Lehtiniemi, Tapani Pihlajakuja, Jussi Leppänen
-
Patent number: 11647350Abstract: An apparatus, method and computer program is disclosed. The apparatus may comprise means for providing first virtual content for presentation, which first virtual content is associated with a first space and comprises one or more first virtual objects. One of the first virtual objects may comprise one or more virtual objects having respective audio signals and another may represent a miniature representation of a second space into which the user can transition. The miniature representation may have a second scale, smaller or larger than the first scale, and may comprise one or more second virtual objects having respective audio signals audible from outside of the second space. The apparatus may further comprise means for determining whether at least part of the user is within the first space or the second space, and dependent on the determination, modifying the audio signal of one or more of the first or second virtual objects.Type: GrantFiled: August 24, 2021Date of Patent: May 9, 2023Assignee: Nokia Technologies OyInventors: Sujeet Shyamsundar Mate, Arto Lehtiniemi, Jussi Artturi Leppänen, Miikka Tapani Vilermo
-
Patent number: 11636572Abstract: A method, apparatus and computer program product are provided for varying panning speeds of images based on saliency such that 360-degree images, panoramic images, video images and/or other wide view area images may be efficiently displayed by varying the panning speed such that the user focuses on salient portions of the image. A panning speed is determined based on the currently displayed area and its saliency relative to the saliency of non-displayed or peripheral portions. As a user pans from one area to another, while the user pans over a salient portion of the image, the actual reflected panning may occur at a relatively slower speed than when the user pans over an area not including a salient portion, or a less salient portion.Type: GrantFiled: December 29, 2016Date of Patent: April 25, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Daniel Andre Vaquero, Muninder Veldandi, Basavaraja Vandrotti, Arto Lehtiniemi
-
Patent number: 11632538Abstract: An apparatus comprising means for: causing display of at least one world-locked volumetric object having at least one non-viewable region; determining a change in a user's viewing position relative to the at least one world-locked volumetric object; determining if the change in the user's viewing position relative to the at least one world-locked volumetric object will cause display of at least a portion of the at least one non-viewable region of the at least one world-locked volumetric object; and if it is determined that the change in the user's viewing position will cause display of at least a portion of the at least one non-viewable region, cause the at least one world-locked volumetric object to be user-locked.Type: GrantFiled: June 25, 2021Date of Patent: April 18, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Sujeet Shyamsundar Mate, Miikka Vilermo, Arto Lehtiniemi
-
Patent number: 11631422Abstract: An apparatus is disclosed, configured to receive, from first and second spatial audio capture apparatuses, respective first and second composite audio signals comprising components derived from one or more sound sources in a capture space. The apparatus is further configured to identify a position of a user device corresponding to one of first and second areas respectively associated with the positions of the first and second spatial audio capture apparatuses, and to render audio representing the one or more sound sources to the user device, the rendering being performed differently dependent on, for the spatial audio capture apparatus associated with the identified first or second area, whether or not individual audio signals from each of the one or more sound sources can be successfully separated from its composite signal.Type: GrantFiled: December 3, 2018Date of Patent: April 18, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Sujeet Shyamsundar Mate, Arto Lehtiniemi, Antti Eronen, Jussi Leppänen
-
Patent number: 11627427Abstract: An apparatus comprising: means for causing selection of spatial audio content in dependence upon a position of a user in a virtual space; • means for causing rendering, for consumption by the user, of the selected spatial audio content including a first spatial audio content; • means for causing, after user consumption of the first spatial audio content, recording of data relating to the first spatial audio content; • means for using, at a later time, the recorded data to detect a new event relating to the first spatial audio content, the new event comprises that the first spatial audio content has been adapted for which a new spatial content is created, for example in the form of a limited preview; and • means for providing a user-selectable option to enable rendering, for consumption by the user, of the first spatial audio content by rendering a simplified sound object representative, which can be a downmix or clustered audio objects.Type: GrantFiled: December 5, 2018Date of Patent: April 11, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Lasse Laaksonen, Arto Lehtiniemi, Antti Eronen, Jussi Leppänen
-
Publication number: 20230066507Abstract: An apparatus, method and computer program is described comprising: capturing images using one or more imaging devices of a foldable user device, wherein the user device comprises a visual display, wherein, in a first mode of operation, a display output on the visual display is modified depending on a folding angle of the foldable user device; capturing audio using one or more microphones of the foldable user device; providing a wind mode indication in a second mode of operation; and disabling the modification of the visual display depending on the folding angle in the second mode of operation.Type: ApplicationFiled: December 10, 2020Publication date: March 2, 2023Inventors: Jussi LEPPÄNEN, Arto LEHTINIEMI, Antti ERONEN, Mikko HEIKKINEN
-
Patent number: 11587202Abstract: A method comprising: processing a recording of a scene to recognise a predetermined user command event performed within the scene; and automatically controlling image processing of a captured image of the scene to adapt the captured image, in dependence on said recognition of the predetermined user command event performed within the scene.Type: GrantFiled: December 15, 2016Date of Patent: February 21, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Antti Eronen, Jussi Leppänen, Arto Lehtiniemi, Kimmo Roimela
-
Patent number: 11570564Abstract: An apparatus for audio signal processing audio objects within at least one audio scene, the apparatus comprising at least one processor configured to:define for at least one time period at least one contextual grouping comprising at least two of a plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping, the plurality of audio objects within at least one audio scene; anddefine with respect to the at least one contextual grouping at least one first parameter and/or parameter rule type which is configured to be applied with respect to a common element associated with the at least two of the plurality of audio objects and wherein the at least one first parameter and/or parameter rule type is configured to be applied with respect to individual element associatedwith the at least one further audio object outside of the at least one contextual grouping, the at least one first parameter and/or parameter rule type being appliedType: GrantFiled: September 24, 2018Date of Patent: January 31, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Lasse Laaksonen, Mikko Tammi, Miikka Vilermo, Arto Lehtiniemi
-
Apparatus, method, computer program for enabling access to mediated reality content by a remote user
Patent number: 11570565Abstract: An apparatus comprising means for: simultaneously controlling content rendered by a hand portable device and content rendered by a spatial audio device; and providing for rendering to a user, in response to an action by the user, of a first part, not a second part, of a spatial audio content via the hand portable device not the spatial audio device.Type: GrantFiled: September 5, 2019Date of Patent: January 31, 2023Assignee: Nokia Technologies OyInventors: Sujeet Shyamsundar Mate, Arto Lehtiniemi, Antti Eronen, Lasse Laaksonen -
Publication number: 20230028238Abstract: An apparatus, method and computer program is described comprising: providing an incoming audio indication in response to incoming audio (41), the incoming audio indication comprising visual representations of a plurality of audio modes (55-58); receiving at least one input from a user (59) for selecting one of the plurality of audio modes (42); and rendering audio (43) based, at least partially, on the selected audio mode, wherein one or more parameters of the rendered audio are determined based on the selected audio mode.Type: ApplicationFiled: December 7, 2020Publication date: January 26, 2023Inventors: Lasse LAAKSONEN, Arto LEHTINIEMI, Sujeet Shyamsundar MATE, Antti ERONEN
-
Publication number: 20230014810Abstract: An apparatus including circuitry configured for: displaying content within a viewport; displaying a symbol representing a sound source within the viewport; detecting one or more gestures that place the displayed symbol in the displayed content; disambiguating between a first placement method, performed for the symbol, that locks the sound source to a position that moves with displayed content moving within the viewport and a second placement method performed for the symbol that is different to the first placement method and locks the sound source to a position that does not move with displayed content moving within the viewport, wherein the first placement method includes a disambiguating gesture relative to the viewport, for the symbol, indicating movement of the symbol relative to the viewport that disambiguates the first placement method from the second placement method.Type: ApplicationFiled: November 12, 2020Publication date: January 19, 2023Inventors: Jussi LEPPANEN, Miikka VILERMO, Arto LEHTINIEMI
-
Patent number: 11551452Abstract: An apparatus configured to, based on first imagery (301) of at least part of a body of a user (204), and contemporaneously captured second imagery (302) of a scene, the second imagery comprising at least a plurality of images taken over time, and based on expression-time information indicative of when a user expression of the user (204) occurs, provide a time window (303) temporally extending from a first time (t?1) prior to the time (t) of the expression-time information, to a second time (t?5) comprising a time equal to or prior to the first time (t?1), the time window (303) provided to identify at least one expression-causing image (305) from the plurality of images of the second imagery (302) that was captured in said time window, and provide for recordal of the at least one expression-causing image (305) with at least one expression-time image (306) comprising at least one image from the first imagery (301).Type: GrantFiled: March 29, 2019Date of Patent: January 10, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Jussi Leppänen, Arto Lehtiniemi, Antti Eronen, Juha Arrasvuori
-
Patent number: 11546718Abstract: A method including enabling a first user having a first user device to communicate with one or more second users having one or more second user devices via a network, wherein each user has a spatial position within a virtual space, such that, for each user within the virtual space, all other users within the virtual space have a relative spatial position; providing spatial audio data from the first user device to the one or more second user devices and receiving spatial audio data at the first user device from the one or more second user devices, such that each user is provided with audio from the other users in the respective relative spatial positions of the other users; and enabling a third user having a third user device to communicate with the first user and the one or more second users via the first user device.Type: GrantFiled: June 25, 2019Date of Patent: January 3, 2023Assignee: Nokia Technologies OyInventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppanen, Mikko-Ville Laitinen
-
Patent number: 11521591Abstract: A method including receiving an audio scene including at least one source captured using at least one near field microphone and at least one far field microphone. The method includes determining at least one room-impulse-response associated with the audio scene based on the at least one near field microphone and the at least one far field microphone, accessing a predetermined scene geometry corresponding to the audio scene, and identifying best match to the predetermined scene geometry in a scene geometry database. The method also includes performing RIR comparison based on the at least one RIR and at least one geometric RIR associated with the best matching geometry and rendering a volumetric audio scene based on a result of the RIR comparison.Type: GrantFiled: November 29, 2018Date of Patent: December 6, 2022Assignee: Nokia Technologies OyInventors: Jussi Leppanen, Antti Eronen, Arto Lehtiniemi, Tapani Pihlajakuja
-
Patent number: 11514108Abstract: A method comprising: enabling user definition of a search parameter; causing searching of content to find content having the search parameter and to provide the found content having the search parameter as search results; and causing rendering of the search results, using virtual reality, at different positions in a three dimensional space.Type: GrantFiled: April 12, 2017Date of Patent: November 29, 2022Assignee: NOKIA TECHNOLOGIES OYInventors: Arto Lehtiniemi, Antti Eronen, Jussi Leppänen
-
Patent number: 11503226Abstract: This specification describes: using a first camera of a multi-camera device to obtain first video data of a first region; using a second camera of the multi-camera device to obtain second video data of a second region; generating a multi-camera video output from the first and second video data using a first video mapping to map the first video data to a first portion of the multi-camera video output and using a second video mapping to map the second video data to a second portion of the multi-camera video output; and generating an audio output from obtained audio data, the audio output comprising an audio output having a directional component within the first portion of the video output and an audio output having a directional component within the second portion of the video output, wherein generating the audio output comprises using a first audio mapping to map audio data having a directional component within the first region to the audio output having a directional component within the first portion of theType: GrantFiled: December 13, 2018Date of Patent: November 15, 2022Assignee: NOKIA TECHNOLOGIES OYInventors: Jussi Leppänen, Arto Lehtiniemi, Sujeet Shyamsundar Mate, Antti Eronen