Patents by Inventor Jussi Leppanen
Jussi Leppanen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20210263636Abstract: An apparatus comprising a man machine interface configured to provide: a screen that presents information indicative of, at least, a real-time capability of a remote user to access and consume mediated reality content; and a user-selectable option to initiate an action that causes the mediated reality content to become accessible to the remote user.Type: ApplicationFiled: July 12, 2019Publication date: August 26, 2021Inventors: Jussi LEPPÄNEN, Arto LEHTINIEMI, Miikka VILERMO, Sujeet Shyamsundar MATE
-
Publication number: 20210258711Abstract: An apparatus, the apparatus comprising means configured to: receive audio content comprising voice audio and ambient audio and directional information indicative of a direction of the at least one sound source and the direction of the remote user relative to the reference point; receive a reference location; provide for presentation of the ambient audio with a first spatial audio effect, based on the directional information, and presentation of the voice audio with a second spatial audio effect, based on the directional information, receive repositioning signalling from the remote user device; and provide for presentation of the audio content using a modification of the first spatial audio effect to reposition an ambient-perceived direction based on the repositioning signalling and/or a modification of the second spatial audio effect to reposition a voice-perceived direction based on the repositioning signalling to increase the spatial separation between the voice-perceived direction and the ambient-perceivedType: ApplicationFiled: June 17, 2019Publication date: August 19, 2021Inventors: Lasse LAAKSONEN, Arto LEHTINIEMI, Antti ERONEN, Jussi LEPPÄNEN
-
Patent number: 11076121Abstract: An apparatus configured to; based on first video content comprising video imagery being captured by a first camera of a device and second video content comprising video imagery being captured by a second camera of the same device, the first and second video content captured contemporaneously and based on a slow-motion-mode input selecting one of the first and second video content for playback in slow-motion, provide for simultaneous display of: a live, first preview comprising video imagery of a non-selected one of the first and second video content as it is captured and presented at a first play rate substantially equal to a capture rate at which the non-selected video content was captured; and a second preview comprising video imagery of the selected one of the first and second video content presented at a second play rate slower than a capture rate at which the selected video content was captured.Type: GrantFiled: March 19, 2019Date of Patent: July 27, 2021Assignee: NOKIA TECHNOLOGIES OYInventors: Jussi Leppänen, Miikka Vilermo, Arto Lehtiniemi, Antti Eronen
-
Publication number: 20210227150Abstract: This specification describes: using a first camera of a multi-camera device to obtain first video data of a first region; using a second camera of the multi-camera device to obtain second video data of a second region; generating a multi-camera video output from the first and second video data using a first video mapping to map the first video data to a first portion of the multi-camera video output and using a second video mapping to map the second video data to a second portion of the multi-camera video output; and generating an audio output from obtained audio data, the audio output comprising an audio output having a directional component within the first portion of the video output and an audio output having a directional component within the second portion of the video output, wherein generating the audio output comprises using a first audio mapping to map audio data having a directional component within the first region to the audio output having a directional component within the first portion of theType: ApplicationFiled: December 13, 2018Publication date: July 22, 2021Inventors: Jussi LEPPÄNEN, Arto LEHTINIEMI, Sujeet Shyamsundar MATE, Antti ERONEN
-
Publication number: 20210227320Abstract: An apparatus comprising means configured to: receive audio content from a remote user device, the audio content comprising primary audio and secondary audio, the secondary audio being different to the primary audio and comprising ambient audio; receive secondary audio importance information associated with said audio content and indicative of an importance of the secondary audio; receive current audio presentation information indicative of at least whether audio from one or more audio sources is currently being presented as spatial audio such that respective audio of the one or more audio sources is to be perceived as originating from one or more respective directions or ranges of directions around the user; provide for presentation of the primary audio; and provide for presentation of the secondary audio based on the secondary audio importance information and the current audio presentation information.Type: ApplicationFiled: June 17, 2019Publication date: July 22, 2021Inventors: Lasse LAAKSONEN, Arto LEHTINIEMI, Antti ERONEN, Jussi LEPPÄNEN
-
Patent number: 11069137Abstract: An apparatus comprising means for rendering virtual reality content, wherein the virtual reality content comprises a virtual reality object associated with a caption and wherein the caption is rendered within a field of view of a user; determining a level of interest with respect to the virtual reality object; and determining if the caption is to be rendered based at least partly on the determined level of interest associated with the virtual reality object.Type: GrantFiled: March 27, 2020Date of Patent: July 20, 2021Assignee: NOKIA TECHNOLOGIES OYInventors: Jussi Leppänen, Sujeet Mate, Arto Lehtiniemi, Antti Eronen
-
Patent number: 11055057Abstract: In respect of virtual reality content of a scene for presentation to a user in a virtual reality (VR) space, the VR content comprising spatial audio captured by an audio capture device at an audio capture location, and based on a virtual location of a user relative to a virtual audio capture location in the virtual reality space that corresponds to the audio capture location; providing for audible presentation of the spatial audio when the virtual location is within a threshold distance with the spatial audio effect such that the one or more sounds are perceived to originate from one or more directions in the virtual reality space in corresponding to the directional information; and providing for audible presentation of the spatial audio when the virtual location is beyond the threshold distance such the one or more sounds are audibly presented with an ambient audio effect.Type: GrantFiled: December 8, 2017Date of Patent: July 6, 2021Assignee: Nokia Technologies OyInventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Juha Arrasvuori
-
Publication number: 20210160642Abstract: According to an example embodiment, a technique for spatial audio processing on basis of two or more input audio signals that represent an audio scene and at least one further input audio signal that represents at least part of the audio scene is provided, the technique including identifying a portion of interest (POI) in the audio scene; processing the two or more input audio signals into a spatial audio signal where the POI in the audio scene is suppressed; generating, on basis of the at least one further input audio signal, a complementary audio signal that represents the POI in the audio scene; and combining the complementary audio signal with the spatial audio signal to create a reconstructed spatial audio signal.Type: ApplicationFiled: May 8, 2018Publication date: May 27, 2021Inventors: Antti ERONEN, Jussi LEPPANEN, Tapani PIHLAJAKUJA, Arto LEHTINIEMI
-
Publication number: 20210158049Abstract: An apparatus configured to, based on first imagery (301) of at least part of a body of a user (204), and contemporaneously captured second imagery (302) of a scene, the second imagery comprising at least a plurality of images taken over time, and based on expression-time information indicative of when a user expression of the user (204) occurs, provide a time window (303) temporally extending from a first time (t-1) prior to the time (t) of the expression-time information, to a second time (t-5) comprising a time equal to or prior to the first time (t-1), the time window (303) provided to identify at least one expression-causing image (305) from the plurality of images of the second imagery (302) that was captured in said time window, and provide for recordal of the at least one expression-causing image (305) with at least one expression-time image (306) comprising at least one image from the first imagery (301).Type: ApplicationFiled: March 29, 2019Publication date: May 27, 2021Applicant: NOKIA TECHNOLOGIES OYInventors: Jussi LEPPÄNEN, Arto LEHTINIEMI, Antti ERONEN, Juha ARRASVUORI
-
Publication number: 20210160646Abstract: A method, apparatus and computer program is described comprising: generating or obtaining at least one augmented reality image for presentation to a user, the augmented reality images comprising one or more virtual objects, displays or devices of an augmented reality system; attenuating real-world audio of the augmented reality system; and controlling the provision of audio to the user in at least one audio focus or beamform direction relating to at least one selected real-world object of the augmented reality system.Type: ApplicationFiled: November 3, 2020Publication date: May 27, 2021Inventors: Jussi LEPPÄNEN, Miikka VILERMO, Arto LEHTINIEMI, Francesco CRICRÌ
-
Publication number: 20210157406Abstract: An apparatus, method and computer instructions are provided. The apparatus comprises means for: mapping a virtual space to a real space; associating a user's real location in the real space with a virtual location of the user in the virtual space, such that a change in the user's real location causes a corresponding change in the user's virtual location; disassociating the user's real location with the user's virtual location, based at least in part on at least one user input; and changing, following disassociation of the user's real location with the user's virtual location, the user's virtual location without a corresponding change in the user's real location.Type: ApplicationFiled: June 21, 2019Publication date: May 27, 2021Applicant: NOKIA TECHNOLOGIES OYInventors: Jussi LEPPÄNEN, Antti ERONEN, Arto LEHTINIEMI, Mikko-Ville LAITINEN
-
Patent number: 11010051Abstract: According to various, but not necessarily all, embodiments of the invention there is provided a method comprising: enabling display to a user of a virtual visual scene; in dependence upon detection of an occurrence of a predetermined action by a user, starting display to the user of one or more control visual elements in the virtual visual scene while the virtual visual scene is being displayed to the user; and enabling interaction by the user with the one or more control visual elements within the displayed virtual visual scene to enable control while the virtual visual scene is being displayed to the user, wherein the one or more control visual elements displayed in the virtual visual scene represent a controller device physically used by the user, within the virtual visual scene, wherein the predetermined action by the user is in relation to a first portion of the physical controller device physically used by the user, and wherein the one or more control visual elements displayed in the virtual visual scenType: GrantFiled: June 2, 2017Date of Patent: May 18, 2021Assignee: NOKIA TECHNOLOGIES OYInventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Veli-Matti Kolmonen
-
Patent number: 10999412Abstract: A method, apparatus and computer program code are provided. The method comprises: causing display of mediated reality content by one or more displays associated with a device; identifying a further device with which at least a portion of the mediated reality content is to be shared; determining one or more parameters characterizing one or more displays associated with the further device; determining at least a portion of the mediated reality content to be shared with the further device based, at least in part, on the determined one or more parameters; and causing the portion of the mediated reality content to be shared with the further device.Type: GrantFiled: July 15, 2016Date of Patent: May 4, 2021Assignee: NOKIA TECHNOLOGIES OYInventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
-
Patent number: 10993067Abstract: An apparatus configured to use captured spatial audio content captured by a rotatable spatial audio capture microphone array, the captured spatial audio content defining the three-dimensional arrangement of the audio in the scene, an orientation of the aural scene defined relative to the microphone array at the time of audio capture, and use captured direction data representative of the direction of a reference direction of said microphone array relative to the scene over a time during which said spatial audio content was captured; to generate modified spatial audio content in which the aural scene is decoupled from any rotation of the rotatable spatial audio capture microphone array that occurred during capture of the spatial audio content for presentation to the recipient user relative to a space in which the recipient user is located by virtue of modification of the orientation of the aural scene using the captured direction data.Type: GrantFiled: June 13, 2018Date of Patent: April 27, 2021Assignee: Nokia Technologies OyInventors: Lasse Juhani Laaksonen, Anssi Rämö, Arto Lehtiniemi, Jussi Leppänen
-
Patent number: 10993066Abstract: An apparatus comprising means configured to: receive first information indicative of a reference location; provide for presentation of audio content as spatial audio to be perceived, from the reference location, as originating from a direction of at least one virtual audio source, the at least one virtual audio source associated with a real-world location; receive second information indicative of at least the presence of a real-world object between the real-world location of the at least one virtual audio source and the reference location; modify, based on the second information, the audio content to indicate aurally the location of the real-world object; and provide for presentation of the modified audio content as spatial audio.Type: GrantFiled: June 12, 2019Date of Patent: April 27, 2021Assignee: NOKIA TECHNOLOGIES OYInventors: Lasse Laaksonen, Arto Lehtiniemi, Antti Eronen, Jussi Leppänen
-
Patent number: 10979846Abstract: An apparatus for audio signal rendering, the apparatus including at least one processor configured to: receive at least one microphone audio signal captured by at least one microphone within a capture environment; receive at least one projection audio signal, wherein the at least one projection audio signal is a room-impulse-response filtered at least one microphone audio signal within the capture environment; receive at least one residual audio signal, wherein the at least one residual audio signal is a result of removing the at least one projection audio signal from at least one audio signal captured by a microphone array within the capture environment; and generate at least two volumetric audio signals based on the at least one microphone audio signal, the at least one projection audio signal and the at least one residual audio signal.Type: GrantFiled: October 1, 2018Date of Patent: April 13, 2021Assignee: Nokia Technologies OyInventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppanen, Tapani Pihlajakuja
-
Patent number: 10970932Abstract: A method is disclosed, including providing data indicative of dimensions of a real-world space within which a virtual world is to be consumed. The method may also include identifying one or more objects within said real-world space, and determining one or more available areas within the real-world space for rendering three-dimensional virtual content, based at least partly on the dimensions of the real-world space. The method may also include identifying one or more of the objects as being movable, identifying, from a set of three-dimensional virtual content items, one or more candidate items unable to be rendered within the available area(s) and which can be rendered if one or more of the movable objects is moved and providing an indication to a virtual reality user device of the candidate virtual item(s) and of the movable object(s) required to be moved.Type: GrantFiled: June 27, 2018Date of Patent: April 6, 2021Assignee: Nokia Technologies OyInventors: Jussi Leppanen, Arto Lehtiniemi, Antti Eronen, Juha Arrasvuori
-
Patent number: 10972800Abstract: An apparatus caused to: in respect of video imagery of an event at which one or more commenting users are present and have submitted comments, a location of the or each of the one or more commenting users visible in the video imagery; based on a current view of the video imagery provided for display to a user and at least one comment having location information associated therewith indicative of one or more of (i) the location, at the time of making the comment, of the commenting user who submitted the comment at the event, (ii) a location, at the event, specified by the commenting user who submitted the comment at the event; provide for display of the comment overlaid over the current view of the video imagery, the comment displayed in the current view of the video imagery at a position that corresponds to the location information.Type: GrantFiled: May 24, 2017Date of Patent: April 6, 2021Assignee: NOKIA TECHNOLOGIES OYInventors: Arto Lehtiniemi, Antti Eronen, Jussi Leppänen, Juha Arrasvuori
-
Publication number: 20210092545Abstract: An apparatus is disclosed, which comprises a means for identifying virtual audio content within a first spatial sector of a virtual space with respect to a reference position. The apparatus also comprises a means for modifying the identified virtual audio content to be rendered in a second, smaller spatial sector.Type: ApplicationFiled: June 18, 2019Publication date: March 25, 2021Inventors: Jussi LEPPÄNEN, Arto LEHTINIEMI, Antti ERONEN, Sujeet Shyamsundar MATE
-
Publication number: 20210076153Abstract: An apparatus comprising: means for causing selection of spatial audio content in dependence upon a position of a user in a virtual space; •means for causing rendering, for consumption by the user, of the selected spatial audio content including a first spatial audio content; •means for causing, after user consumption of the first spatial audio content, recording of data relating to the first spatial audio content; •means for using, at a later time, the recorded data to detect a new event relating to the first spatial audio content, the new event comprises that the first spatial audio content has been adapted for which a new spatial content is created, for example in the form of a limited preview; and•means for providing a user-selectable option to enable rendering, for consumption by the user, of the first spatial audio content by rendering a simplified sound object representative, which can be a downmix or clustered audio objects.Type: ApplicationFiled: December 5, 2018Publication date: March 11, 2021Inventors: Lasse Laaksonen, Arto Lehtiniemi, Antti Eronen, Jussi Leppänen