Patents by Inventor Jussi Leppänen

Jussi Leppänen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200217919
    Abstract: An apparatus for generating at least one distance estimate to at least one sound source within a sound scene comprising the least one sound source, the apparatus configured to: receive at least two audio signals from a microphone array located within the sound scene; receive at least one further audio signal associated with the at least one sound source; determine at least one portion of the at least two audio signals from a microphone array corresponding to the at least one further audio signal associated with the at least one sound source; determine a distance estimate to the at least one sound source based on the at least one portion of the at least two audio signals from a microphone array corresponding to the at least one further audio signal associated with the at least one sound source.
    Type: Application
    Filed: June 13, 2018
    Publication date: July 9, 2020
    Applicant: NOKIA TECHNOLOGIES OY
    Inventors: Antti ERONEN, Arto LEHTINIEMI, Tapani PIHLAJAKUJA, Jussi LEPPÄNEN
  • Patent number: 10665027
    Abstract: An apparatus comprising: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: based on a virtual reality space provided for viewing by a first user and a physical location of the first user, provide for display of an augmented reality graphic for viewing by a second, different user, in an augmented reality view, said augmented reality graphic comprising an image of at least part of the virtual reality space provided to the first user which is displayed at a position corresponding to the physical location of the first user to at least partially surround the first user in the augmented reality view, such that the second user can see the at least part of the virtual reality space experienced by the first user.
    Type: Grant
    Filed: February 6, 2017
    Date of Patent: May 26, 2020
    Assignee: Nokia Technologies Oy.
    Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
  • Publication number: 20200160600
    Abstract: A method comprising: switching between a first mode for controlling a relative position of a virtual sound object from a notional listener in a virtual space in dependence upon a point of view of the notional listener and a second mode for controlling the relative position of the virtual sound object from the notional listener in the virtual space in dependence upon the point of view of the notional listener, wherein during the first mode there is a higher dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measured location of a user in a real space and during the second mode there is a lower dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measure
    Type: Application
    Filed: June 19, 2018
    Publication date: May 21, 2020
    Inventors: Jussi Leppänen, Arto Lehtiniemi, Sujeet Shyamsundar Mate, Antti Eronen
  • Patent number: 10650595
    Abstract: A method comprising: displaying a background of a scene from a first point of view and a foreground of the scene from the first point of view; displaying a background of the scene from the first point of view and a modified foreground of the scene from the first point of view; displaying a background of a scene from a second point of view and a modified foreground; and displaying a background of a scene from the second point of view and a foreground of the scene from the second point of view.
    Type: Grant
    Filed: July 4, 2016
    Date of Patent: May 12, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
  • Publication number: 20200145778
    Abstract: An apparatus configured to use captured spatial audio content captured by a rotatable spatial audio capture microphone array, the captured spatial audio content defining the three-dimensional arrangement of the audio in the scene, an orientation of the aural scene defined relative to the microphone array at the time of audio capture, and use captured direction data representative of the direction of a reference direction of said microphone array relative to the scene over a time during which said spatial audio content was captured; to generate modified spatial audio content in which the aural scene is decoupled from any rotation of the rotatable spatial audio capture microphone array that occurred during capture of the spatial audio content for presentation to the recipient user relative to a space in which the recipient user is located by virtue of modification of the orientation of the aural scene using the captured direction data.
    Type: Application
    Filed: June 13, 2018
    Publication date: May 7, 2020
    Inventors: Lasse Juhani Laaksonen, Anssi Rämö, Arto Lehtiniemi, Jussi Leppänen
  • Publication number: 20200143775
    Abstract: A method apparatus, and computer program, the method comprising: storing mediated reality content and associated information relating to a first real space in which the mediated reality content has been displayed; selecting the mediated reality content for display in a second real space; obtaining information relating to the second real space; and using the information relating to the first real space and the information relating to the second real space to adapt the mediated reality content for display in the second real space.
    Type: Application
    Filed: May 21, 2018
    Publication date: May 7, 2020
    Inventors: Lasse Laaksonen, Anssi Rämö, Arto Lehtiniemi, Jussi Leppänen
  • Patent number: 10638247
    Abstract: A method comprising: causing rendering of a first sound scene comprising multiple first sound objects; in response to direct or indirect user specification of a change in sound scene from the first sound scene to a mixed sound scene based in part on the first sound scene and in part on a second sound scene, causing selection of one or more second sound objects of the second sound scene comprising multiple second sound objects; causing selection of one or more first sound objects in the first sound scene; and causing rendering of a mixed sound scene by rendering the first sound scene while de-emphasising the selected one or more first sound objects and emphasising the selected one or more second sound objects.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: April 28, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Jussi Leppänen, Arto Lehtiniemi, Antti Eronen, Juha Arrasvuori
  • Publication number: 20200128348
    Abstract: In respect of spatial audio configured to be associated with a moveable, particular object in a scene, the spatial audio for presentation such as to be perceived as originating from a particular direction, the location of the object determined based on automatic identification in sensor data to enable positioning of the spatial audio to correspond to the location of the object, the sensor data from a sensor having a limited field of view of the real-world scene at any one time; based on a current location of the object being unknown; provide for audible presentation of the spatial audio with a previously-determined-direction and, based on a current field of view of the user moving to the previously-determined-direction, provide for modification of the spatial audio from the previously-determined-direction to a direction outside the current field of view of the user at least until the object is once again identified.
    Type: Application
    Filed: April 27, 2018
    Publication date: April 23, 2020
    Inventors: Antti Eronen, Arto Lehtiniemi, Sujeet Shyamsundar Mate, Jussi Leppänen
  • Publication number: 20200089466
    Abstract: In respect of virtual reality content of a scene for presentation to a user in a virtual reality (VR) space, the VR content comprising spatial audio captured by an audio capture device at an audio capture location, and based on a virtual location of a user relative to a virtual audio capture location in the virtual reality space that corresponds to the audio capture location; providing for audible presentation of the spatial audio when the virtual location is within a threshold distance with the spatial audio effect such that the one or more sounds are perceived to originate from one or more directions in the virtual reality space in corresponding to the directional information; and providing for audible presentation of the spatial audio when the virtual location is beyond the threshold distance such the one or more sounds are audibly presented with an ambient audio effect.
    Type: Application
    Filed: December 8, 2017
    Publication date: March 19, 2020
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Juha Arrasvuori
  • Publication number: 20200057493
    Abstract: A method comprising: rendering, in a first state, any portion of content for rendering that is not defined as restricted content and rendering, in a second state, different to the first state, any portion of the content for rendering that is defined as restricted content; and using a combination of a user perception direction and an observation field of perception to define restricted content.
    Type: Application
    Filed: February 20, 2018
    Publication date: February 20, 2020
    Inventors: Niko Saarnisto, Miikka Vilermo, Jussi Leppänen, Jukka Holm
  • Patent number: 10567902
    Abstract: A method comprising: rendering a user interface for user selection of sound objects for rendering, each sound object being associated with a location in a three-dimensional sound space, wherein the user interface maps sound objects onto at least one shape and identifies sound objects on the shape at a collection of locations on the shape that differs from the associated locations of the identified sound objects; and in response to a user actuation selecting a sound object, rendering at least the selected sound object in the three-dimensional sound space at its associated location.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: February 18, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Juha Arrasvuori
  • Patent number: 10560752
    Abstract: An apparatus configured to: in respect of virtual reality content comprising video imagery and spatial audio wherein the perceived direction to an audio event related to a visual event in the video imagery corresponds to a visual location of said visual event as presented in the virtual reality space; based on a change in the viewing direction of the virtual reality view by the user from a first viewing direction to a second viewing direction, and wherein said second viewing direction corresponds to, within a direction threshold, a direction of a particular audio event; providing for display of missed event content thereby allowing a user to see a missed visual event for which they heard the associated audio event and reacted thereto by changing the viewing direction.
    Type: Grant
    Filed: June 12, 2017
    Date of Patent: February 11, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Veli-Matti Kolmonen
  • Patent number: 10559131
    Abstract: A method comprising: causing display of a polyhedral virtual object, having a first number (M) of faces, in a virtual visual space, wherein each of at least a second number (N) of the M faces, displays content captured from an associated one of N different camera perspectives; causing rotation of the polyhedral virtual object in the virtual visual space to select a first face of the at least M faces of the polyhedral virtual object by orienting the first face in a predetermined direction within the virtual visual space; and causing display of the content captured from the camera perspective associated with the selected first face of the polyhedral virtual object.
    Type: Grant
    Filed: June 20, 2017
    Date of Patent: February 11, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Jussi Leppänen, Juha Arrasvuori, Arto Lehtiniemi
  • Publication number: 20200042792
    Abstract: A method comprising: dividing a virtual space using virtual partitions that affect perception of the virtual space by a user within the virtual space; in response to a first action in the virtual space relative to a first virtual partition by a user making a first change to how the first virtual partition affects the virtual space perceived by the user.
    Type: Application
    Filed: February 26, 2018
    Publication date: February 6, 2020
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen, Juha Arrasvuori
  • Patent number: 10540542
    Abstract: A method comprising: automatically processing recorded first sensor data from a scene to recognise automatically a first user input from user action in the scene; in response to recognition of the first user input, automatically entering a learning state to enable: automatic processing of the first sensor data from the scene to capture an ad-hoc sequence of spatial events in the scene subsequent to the first user input and automatic processing of subsequently recorded second sensor data from the scene different to the first sensor data of the scene, to recognise automatically a sequence of spatial events in the subsequently recorded second video corresponding to the captured sequence of spatial events.
    Type: Grant
    Filed: December 18, 2015
    Date of Patent: January 21, 2020
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
  • Patent number: 10536794
    Abstract: A method comprising: automatically applying a selection criterion or criteria to a sound object; if the sound object satisfies the selection criterion or criteria then performing one of correct or incorrect rendering of the sound object; and if the sound object does not satisfy the selection criterion or criteria then performing the other of correct or incorrect rendering of the sound object, wherein correct rendering of the sound object comprises at least rendering the sound object at a correct position within a rendered sound scene compared to a recorded sound scene and wherein incorrect rendering of the sound object comprises at least rendering of the sound object at an incorrect position in a rendered sound scene compared to a recorded sound scene.
    Type: Grant
    Filed: November 23, 2016
    Date of Patent: January 14, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Jussi Leppänen, Arto Lehtiniemi
  • Patent number: 10535179
    Abstract: A method comprising: causing detection of a modification of a visual appearance of a portion of the visual scene; causing determination that the portion of the visual scene that has been modified is or includes a first portion of the visual scene that has a corresponding first sound object; causing modification of the first sound object to modify a spatial extent of the first sound object; and causing rendering of the visual scene and the corresponding sound scene including rendering of the modified portion of the visual scene in the visual scene and rendering of the modified first sound object with modified spatial extent in the corresponding sound scene.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: January 14, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Miikka Vilermo, Arto Lehtiniemi, Jussi Leppänen
  • Publication number: 20200008004
    Abstract: A method comprising: causing analysis of a portion of a visual scene; causing modification of a first sound object to modify a spatial extent of the first sound object in dependence upon the analysis of the portion of the visual scene corresponding to the first sound object; and causing rendering of the visual scene and the corresponding sound scene including of the modified first sound object with modified spatial extent.
    Type: Application
    Filed: November 29, 2017
    Publication date: January 2, 2020
    Applicant: NOKIA TECHNOLOGIES OY
    Inventors: Antti ERONEN, Jussi LEPPÄNEN, Francesco CRICRI, Arto LEHTINIEMI
  • Patent number: 10524076
    Abstract: A method comprising: processing audio signals to rotate a sound scene so that a user selected sound object is automatically at a first position within the rotated sound scene; enabling user editing of audio properties of the selected sound object to create a modified sound object; and causing rendering of the sound scene using the modified sound object.
    Type: Grant
    Filed: April 12, 2017
    Date of Patent: December 31, 2019
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Antti Eronen, Arto Lehtiniemi, Jussi Leppänen
  • Patent number: 10524074
    Abstract: A method comprising: automatically applying a selection criterion or criteria to a sound object; if the sound object satisfies the selection criterion or criteria then performing one of correct or incorrect rendering of the sound object; and if the sound object does not satisfy the selection criterion or criteria then performing the other of correct or incorrect rendering of the sound object, wherein correct rendering of the sound object comprises at least rendering the sound object at a correct position within a rendered sound scene compared to a recorded sound scene and wherein incorrect rendering of the sound object comprises at least rendering of the sound object at an incorrect position in a rendered sound scene compared to a recorded sound scene or not rendering the sound object in the rendered sound scene.
    Type: Grant
    Filed: November 22, 2016
    Date of Patent: December 31, 2019
    Assignee: Nokia Technologies Oy
    Inventors: Antti Eronen, Jussi Leppänen, Arto Lehtiniemi, Francesco Cricri