Patents by Inventor Jussi Leppänen
Jussi Leppänen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20200217919Abstract: An apparatus for generating at least one distance estimate to at least one sound source within a sound scene comprising the least one sound source, the apparatus configured to: receive at least two audio signals from a microphone array located within the sound scene; receive at least one further audio signal associated with the at least one sound source; determine at least one portion of the at least two audio signals from a microphone array corresponding to the at least one further audio signal associated with the at least one sound source; determine a distance estimate to the at least one sound source based on the at least one portion of the at least two audio signals from a microphone array corresponding to the at least one further audio signal associated with the at least one sound source.Type: ApplicationFiled: June 13, 2018Publication date: July 9, 2020Applicant: NOKIA TECHNOLOGIES OYInventors: Antti ERONEN, Arto LEHTINIEMI, Tapani PIHLAJAKUJA, Jussi LEPPÄNEN
-
Patent number: 10665027Abstract: An apparatus comprising: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: based on a virtual reality space provided for viewing by a first user and a physical location of the first user, provide for display of an augmented reality graphic for viewing by a second, different user, in an augmented reality view, said augmented reality graphic comprising an image of at least part of the virtual reality space provided to the first user which is displayed at a position corresponding to the physical location of the first user to at least partially surround the first user in the augmented reality view, such that the second user can see the at least part of the virtual reality space experienced by the first user.Type: GrantFiled: February 6, 2017Date of Patent: May 26, 2020Assignee: Nokia Technologies Oy.Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
-
Publication number: 20200160600Abstract: A method comprising: switching between a first mode for controlling a relative position of a virtual sound object from a notional listener in a virtual space in dependence upon a point of view of the notional listener and a second mode for controlling the relative position of the virtual sound object from the notional listener in the virtual space in dependence upon the point of view of the notional listener, wherein during the first mode there is a higher dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measured location of a user in a real space and during the second mode there is a lower dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measureType: ApplicationFiled: June 19, 2018Publication date: May 21, 2020Inventors: Jussi Leppänen, Arto Lehtiniemi, Sujeet Shyamsundar Mate, Antti Eronen
-
Patent number: 10650595Abstract: A method comprising: displaying a background of a scene from a first point of view and a foreground of the scene from the first point of view; displaying a background of the scene from the first point of view and a modified foreground of the scene from the first point of view; displaying a background of a scene from a second point of view and a modified foreground; and displaying a background of a scene from the second point of view and a foreground of the scene from the second point of view.Type: GrantFiled: July 4, 2016Date of Patent: May 12, 2020Assignee: Nokia Technologies OyInventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
-
Publication number: 20200145778Abstract: An apparatus configured to use captured spatial audio content captured by a rotatable spatial audio capture microphone array, the captured spatial audio content defining the three-dimensional arrangement of the audio in the scene, an orientation of the aural scene defined relative to the microphone array at the time of audio capture, and use captured direction data representative of the direction of a reference direction of said microphone array relative to the scene over a time during which said spatial audio content was captured; to generate modified spatial audio content in which the aural scene is decoupled from any rotation of the rotatable spatial audio capture microphone array that occurred during capture of the spatial audio content for presentation to the recipient user relative to a space in which the recipient user is located by virtue of modification of the orientation of the aural scene using the captured direction data.Type: ApplicationFiled: June 13, 2018Publication date: May 7, 2020Inventors: Lasse Juhani Laaksonen, Anssi Rämö, Arto Lehtiniemi, Jussi Leppänen
-
Publication number: 20200143775Abstract: A method apparatus, and computer program, the method comprising: storing mediated reality content and associated information relating to a first real space in which the mediated reality content has been displayed; selecting the mediated reality content for display in a second real space; obtaining information relating to the second real space; and using the information relating to the first real space and the information relating to the second real space to adapt the mediated reality content for display in the second real space.Type: ApplicationFiled: May 21, 2018Publication date: May 7, 2020Inventors: Lasse Laaksonen, Anssi Rämö, Arto Lehtiniemi, Jussi Leppänen
-
Patent number: 10638247Abstract: A method comprising: causing rendering of a first sound scene comprising multiple first sound objects; in response to direct or indirect user specification of a change in sound scene from the first sound scene to a mixed sound scene based in part on the first sound scene and in part on a second sound scene, causing selection of one or more second sound objects of the second sound scene comprising multiple second sound objects; causing selection of one or more first sound objects in the first sound scene; and causing rendering of a mixed sound scene by rendering the first sound scene while de-emphasising the selected one or more first sound objects and emphasising the selected one or more second sound objects.Type: GrantFiled: October 31, 2017Date of Patent: April 28, 2020Assignee: Nokia Technologies OyInventors: Jussi Leppänen, Arto Lehtiniemi, Antti Eronen, Juha Arrasvuori
-
Publication number: 20200128348Abstract: In respect of spatial audio configured to be associated with a moveable, particular object in a scene, the spatial audio for presentation such as to be perceived as originating from a particular direction, the location of the object determined based on automatic identification in sensor data to enable positioning of the spatial audio to correspond to the location of the object, the sensor data from a sensor having a limited field of view of the real-world scene at any one time; based on a current location of the object being unknown; provide for audible presentation of the spatial audio with a previously-determined-direction and, based on a current field of view of the user moving to the previously-determined-direction, provide for modification of the spatial audio from the previously-determined-direction to a direction outside the current field of view of the user at least until the object is once again identified.Type: ApplicationFiled: April 27, 2018Publication date: April 23, 2020Inventors: Antti Eronen, Arto Lehtiniemi, Sujeet Shyamsundar Mate, Jussi Leppänen
-
Publication number: 20200089466Abstract: In respect of virtual reality content of a scene for presentation to a user in a virtual reality (VR) space, the VR content comprising spatial audio captured by an audio capture device at an audio capture location, and based on a virtual location of a user relative to a virtual audio capture location in the virtual reality space that corresponds to the audio capture location; providing for audible presentation of the spatial audio when the virtual location is within a threshold distance with the spatial audio effect such that the one or more sounds are perceived to originate from one or more directions in the virtual reality space in corresponding to the directional information; and providing for audible presentation of the spatial audio when the virtual location is beyond the threshold distance such the one or more sounds are audibly presented with an ambient audio effect.Type: ApplicationFiled: December 8, 2017Publication date: March 19, 2020Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Juha Arrasvuori
-
Publication number: 20200057493Abstract: A method comprising: rendering, in a first state, any portion of content for rendering that is not defined as restricted content and rendering, in a second state, different to the first state, any portion of the content for rendering that is defined as restricted content; and using a combination of a user perception direction and an observation field of perception to define restricted content.Type: ApplicationFiled: February 20, 2018Publication date: February 20, 2020Inventors: Niko Saarnisto, Miikka Vilermo, Jussi Leppänen, Jukka Holm
-
Patent number: 10567902Abstract: A method comprising: rendering a user interface for user selection of sound objects for rendering, each sound object being associated with a location in a three-dimensional sound space, wherein the user interface maps sound objects onto at least one shape and identifies sound objects on the shape at a collection of locations on the shape that differs from the associated locations of the identified sound objects; and in response to a user actuation selecting a sound object, rendering at least the selected sound object in the three-dimensional sound space at its associated location.Type: GrantFiled: November 19, 2018Date of Patent: February 18, 2020Assignee: Nokia Technologies OyInventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Juha Arrasvuori
-
Patent number: 10560752Abstract: An apparatus configured to: in respect of virtual reality content comprising video imagery and spatial audio wherein the perceived direction to an audio event related to a visual event in the video imagery corresponds to a visual location of said visual event as presented in the virtual reality space; based on a change in the viewing direction of the virtual reality view by the user from a first viewing direction to a second viewing direction, and wherein said second viewing direction corresponds to, within a direction threshold, a direction of a particular audio event; providing for display of missed event content thereby allowing a user to see a missed visual event for which they heard the associated audio event and reacted thereto by changing the viewing direction.Type: GrantFiled: June 12, 2017Date of Patent: February 11, 2020Assignee: Nokia Technologies OyInventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Veli-Matti Kolmonen
-
Patent number: 10559131Abstract: A method comprising: causing display of a polyhedral virtual object, having a first number (M) of faces, in a virtual visual space, wherein each of at least a second number (N) of the M faces, displays content captured from an associated one of N different camera perspectives; causing rotation of the polyhedral virtual object in the virtual visual space to select a first face of the at least M faces of the polyhedral virtual object by orienting the first face in a predetermined direction within the virtual visual space; and causing display of the content captured from the camera perspective associated with the selected first face of the polyhedral virtual object.Type: GrantFiled: June 20, 2017Date of Patent: February 11, 2020Assignee: Nokia Technologies OyInventors: Antti Eronen, Jussi Leppänen, Juha Arrasvuori, Arto Lehtiniemi
-
Publication number: 20200042792Abstract: A method comprising: dividing a virtual space using virtual partitions that affect perception of the virtual space by a user within the virtual space; in response to a first action in the virtual space relative to a first virtual partition by a user making a first change to how the first virtual partition affects the virtual space perceived by the user.Type: ApplicationFiled: February 26, 2018Publication date: February 6, 2020Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Juha Arrasvuori
-
Patent number: 10540542Abstract: A method comprising: automatically processing recorded first sensor data from a scene to recognise automatically a first user input from user action in the scene; in response to recognition of the first user input, automatically entering a learning state to enable: automatic processing of the first sensor data from the scene to capture an ad-hoc sequence of spatial events in the scene subsequent to the first user input and automatic processing of subsequently recorded second sensor data from the scene different to the first sensor data of the scene, to recognise automatically a sequence of spatial events in the subsequently recorded second video corresponding to the captured sequence of spatial events.Type: GrantFiled: December 18, 2015Date of Patent: January 21, 2020Assignee: NOKIA TECHNOLOGIES OYInventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
-
Patent number: 10536794Abstract: A method comprising: automatically applying a selection criterion or criteria to a sound object; if the sound object satisfies the selection criterion or criteria then performing one of correct or incorrect rendering of the sound object; and if the sound object does not satisfy the selection criterion or criteria then performing the other of correct or incorrect rendering of the sound object, wherein correct rendering of the sound object comprises at least rendering the sound object at a correct position within a rendered sound scene compared to a recorded sound scene and wherein incorrect rendering of the sound object comprises at least rendering of the sound object at an incorrect position in a rendered sound scene compared to a recorded sound scene.Type: GrantFiled: November 23, 2016Date of Patent: January 14, 2020Assignee: Nokia Technologies OyInventors: Antti Eronen, Jussi Leppänen, Arto Lehtiniemi
-
Patent number: 10535179Abstract: A method comprising: causing detection of a modification of a visual appearance of a portion of the visual scene; causing determination that the portion of the visual scene that has been modified is or includes a first portion of the visual scene that has a corresponding first sound object; causing modification of the first sound object to modify a spatial extent of the first sound object; and causing rendering of the visual scene and the corresponding sound scene including rendering of the modified portion of the visual scene in the visual scene and rendering of the modified first sound object with modified spatial extent in the corresponding sound scene.Type: GrantFiled: December 21, 2017Date of Patent: January 14, 2020Assignee: Nokia Technologies OyInventors: Antti Eronen, Miikka Vilermo, Arto Lehtiniemi, Jussi Leppänen
-
Publication number: 20200008004Abstract: A method comprising: causing analysis of a portion of a visual scene; causing modification of a first sound object to modify a spatial extent of the first sound object in dependence upon the analysis of the portion of the visual scene corresponding to the first sound object; and causing rendering of the visual scene and the corresponding sound scene including of the modified first sound object with modified spatial extent.Type: ApplicationFiled: November 29, 2017Publication date: January 2, 2020Applicant: NOKIA TECHNOLOGIES OYInventors: Antti ERONEN, Jussi LEPPÄNEN, Francesco CRICRI, Arto LEHTINIEMI
-
Patent number: 10524076Abstract: A method comprising: processing audio signals to rotate a sound scene so that a user selected sound object is automatically at a first position within the rotated sound scene; enabling user editing of audio properties of the selected sound object to create a modified sound object; and causing rendering of the sound scene using the modified sound object.Type: GrantFiled: April 12, 2017Date of Patent: December 31, 2019Assignee: NOKIA TECHNOLOGIES OYInventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen
-
Patent number: 10524074Abstract: A method comprising: automatically applying a selection criterion or criteria to a sound object; if the sound object satisfies the selection criterion or criteria then performing one of correct or incorrect rendering of the sound object; and if the sound object does not satisfy the selection criterion or criteria then performing the other of correct or incorrect rendering of the sound object, wherein correct rendering of the sound object comprises at least rendering the sound object at a correct position within a rendered sound scene compared to a recorded sound scene and wherein incorrect rendering of the sound object comprises at least rendering of the sound object at an incorrect position in a rendered sound scene compared to a recorded sound scene or not rendering the sound object in the rendered sound scene.Type: GrantFiled: November 22, 2016Date of Patent: December 31, 2019Assignee: Nokia Technologies OyInventors: Antti Eronen, Jussi Leppänen, Arto Lehtiniemi, Francesco Cricri