Patents by Inventor Emre Aksu

Emre Aksu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11956519
    Abstract: A method, apparatus and computer program product are provided to signal grouping types in an image container file. Relative to the construction of an image container file, the method, apparatus and computer program product construct an image container file having a group box with a grouping type associated with burst-captured images, time-synchronized images captured by a plurality of image capture devices or an image item associated with an audio track. With respect to the processing of an image container file, the method, apparatus and computer program product permit an image container file having a group box with a grouping type associated with one of burst-captured images, time-synchronized images captured by a plurality of image capture devices or an image item associated with an audio track to be processed to cause one or more image items from the image container file to be rendered in accordance with the grouping type.
    Type: Grant
    Filed: April 8, 2019
    Date of Patent: April 9, 2024
    Assignee: Nokia Technologies Oy
    Inventors: Emre Aksu, Miska Hannuksela, Olli Kilpelainen, Jonne Juhani Mäkinen, Juha-Pekka Hippeläinen, Jani Kattelus
  • Patent number: 11909983
    Abstract: A method comprising: encoding video media content into at least a first representation and a second representation, wherein the first representation comprises a switchable inter-coded picture, wherein the switchable picture has a first characteristic that no pictures preceding the switchable picture in decoding order are used as reference pictures for any non-switchable pictures following the switchable picture in decoding order; and the second representation comprises one or more decoder reset pictures aligned with the switchable pictures of the first representation, wherein the frame rate of the second representation is smaller than or equal to the frame rate of the first representation and the resolutions of the first and the second representation are equal.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: February 20, 2024
    Assignee: Nokia Technologies Oy
    Inventors: Miska Hannuksela, Igor Curcio, Sujeet Shyamsundar Mate, Emre Aksu, Ari Hourunranta
  • Publication number: 20240048737
    Abstract: An apparatus comprising: at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: indicate a mixed network abstraction layer unit type pictures sample group used to merge video base tracks having a subpicture track; indicate a sample group description entry of the mixed network abstraction layer unit type pictures sample group, the sample group description entry indicating a group of pairs of mixed network abstraction layer unit type track reference indices, which reference video subpicture tracks or track groups; and wherein when a video bitstream is resolved from a video base track containing a mixed network abstraction layer unit type sample group with merging pairs of video subpicture tracks signaled in a mixed network abstraction layer unit type pictures sample group entry, then there is mixing of different network abstraction layer unit types.
    Type: Application
    Filed: October 12, 2023
    Publication date: February 8, 2024
    Inventors: Miska Matias Hannuksela, Kashyap Kammachi Sreedhar, Emre Aksu
  • Publication number: 20240022787
    Abstract: A method is provided for defining a metadata box of a neural network representation (NNR) item data, wherein the NNR item data comprises an NNR bitstream; and defining an association between the NNR item data and an NNR configuration by using a configuration item property, wherein the NNR configuration item property comprises information about stored NNR item data. Corresponding apparatuses and computer program products are also provided.
    Type: Application
    Filed: October 5, 2021
    Publication date: January 18, 2024
    Inventors: Emre AKSU, Miska HANNUKSELA, Francesco CRICRÌ, Hamed REZAZADEGAN TAVAKOLI
  • Patent number: 11818371
    Abstract: An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: indicate an extraction reference map entry used to assign a group identifier to at least one extraction reference, the extraction reference map entry indicating a subpicture layout; wherein the at least one extraction reference causes extraction of a network abstraction layer unit data by reference from another track; wherein the at least one extraction reference comprises an index of a track reference having a subpicture type within a subpicture order sample group description entry; and indicate, using the at least one extraction reference, subpictures or slices of a coded picture in decoding order.
    Type: Grant
    Filed: October 7, 2021
    Date of Patent: November 14, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Miska Matias Hannuksela, Kashyap Kammachi Sreedhar, Emre Aksu
  • Patent number: 11805303
    Abstract: A method, apparatus and computer program product to signal and store various segment properties in omnidirectional media, including sizes, priority ranks, and the like. The method, apparatus and computer program product access one or more media segments (30). The one or more media segments includes media data configured for streaming playback. The method, apparatus and computer program product access size information (32) or priority rank information of one or more tiles for each of the one or more media segments. The method, apparatus and computer program product encode the size information (34) or priority rank information for each of the one or more media segments in a media file within one or more metadata tracks associated with the one or more media segments or one or more sub-segments associated with the one or more media segments.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: October 31, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Igor Curcio, Miska Hannuksela, Sujeet Shyamsundar Mate, Emre Aksu, Ari Hourunranta
  • Patent number: 11748955
    Abstract: Feature information is received from a client device and describes extended reality scene(s) in an extended reality (ER) environment at the client device. An ER description is formed in an ER description format corresponding to the feature information and is stored. Some of the stored ER description format is provided in a representational format upon request of the client device or other client devices viewing the one or more ER scenes and assisting the positioning of corresponding client devices in the ER environment. A client device captures environmental visual data and generates feature information, describing ER scene(s) in an extended reality environment at the client device, from the environmental visual data, and sends the generated feature information toward a server. A client device can localize itself in a 3D environment of an ER description, and generate ER anchors and objects, link them, and send them to a server.
    Type: Grant
    Filed: October 6, 2021
    Date of Patent: September 5, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Yu You, Peter Fasogbon, Emre Aksu, Igor Danilo Diego Curcio, Saba Ahsan, Ville-Veikko Mattila
  • Patent number: 11722751
    Abstract: The embodiments relate to a method, including writing a first and a second media entity in a container file; creating a media presentation description (MPD) with a first and a second Representation; the Representations belonging to Adaptation Sets; the Representations being associated with the media entities of the container file; when one of the Representations belongs to a media entity which is a thumbnail to a viewpoint or a thumbnail to an overlay, the method includes writing in the MPD file an association/correspondence/grouping information of the said one Representation with another Representation belonging to a media entity which is a viewpoint or an overlay, correspondingly. The embodiments also relate to a method for parsing, and technical equipment for implementing the methods.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: August 8, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Kashyap Kammachi Sreedhar, Miska Hannuksela, Sujeet Mate, Emre Aksu
  • Patent number: 11711505
    Abstract: A user equipment, media control unit, media resource function, or another device or function capable of receiving, manipulating, and transmitting data may be configured to: receive an omnidirectional video; determine a viewport of a user equipment; determining a delivery mode; determine a region of the omnidirectional video based, at least partially, on the determined viewport and the determined delivery mode; encode the determined region; packetizing the encoded region; and transmit the packetized region to the user equipment based, at least partially, on the determined delivery mode.
    Type: Grant
    Filed: July 15, 2021
    Date of Patent: July 25, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Sujeet Shyamsundar Mate, Igor Danilo Diego Curcio, Saba Ahsan, Emre Aksu, Miska Matias Hannuksela, Yu You
  • Publication number: 20230232082
    Abstract: A method, apparatus and computer program product are provided to signaling multiple media data types in a container file format, for example, ISOBMFF, in an efficient manner. In the context of a signaling method, media type definitions overloaded in an instance a plurality of media type definitions is present in compatible media type list, wherein a media type definition is associated with a media type. The method then indicates, using the compatible media type list, presence of a plurality of media types in a metadata or multimedia box. Corresponding apparatuses and computer program products are also provided.
    Type: Application
    Filed: May 24, 2021
    Publication date: July 20, 2023
    Inventors: Emre AKSU, Miska HANNUKSELA, Kashyap KAMMACHI SREEDHAR
  • Patent number: 11700432
    Abstract: A method, apparatus and computer program product are provided to store and signal pre-derivation properties in an image container file (24, 26). Relative to the construction of image package comprising an image container file, the method, apparatus and computer program product assign a pre-derivation property identifier data structure identifying one or more pre-derivation properties of one or more pre-derived images (22). With respect to the processing of an image container file, the method, apparatus and computer program product permit an image container file and a pre-derivation property identifier data structure identifying one or more pre-derivation properties of one or more pre-derived images in the image be processed to cause one or more pre-derived image items from the image container file to be rendered or edited and regenerated in accordance with the pre-derivation properties.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: July 11, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Emre Aksu, Miska Hannuksela
  • Patent number: 11651752
    Abstract: A method, apparatus and computer program product describing groups of overlays, such as semantically correlated overlays, to background media content. In the context of a method, a group of overlays to background media content is defined by metadata (60). The overlays include semantically correlated overlays having alternative overlays representing content with different levels of detail or overlays providing different choices of content. The method also includes receiving client selection of a respective overlay from a group of overlays (62). In response to the client selection, the method causes the respective overlay to be provided. The respective overlay is received (64) for presentation concurrent with background media content (68).
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: May 16, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Kashyap Kammachi-Sreedhar, Igor Curcio, Miska Hannuksela, Sujeet Shyamsundar Mate, Emre Aksu
  • Patent number: 11622119
    Abstract: A method includes maintaining a set of parameters or weights derived through online learning for a neural net; transmitting an update of the parameters or weights to a decoder; deriving a first prediction block based on an output of the neural net using the parameters or weights; deriving a first encoded prediction error block through encoding a difference of the first prediction block and a first input block; encoding the first encoded prediction error block into a bitstream; deriving a reconstructed prediction error block based on the first encoded prediction error block; deriving a second prediction block based on an output of the neural net using the parameters or weights and the reconstructed prediction error block; deriving a second encoded prediction error block through encoding a difference of the second prediction block and a second input block; and encoding the second encoded prediction error block into a bitstream.
    Type: Grant
    Filed: January 14, 2022
    Date of Patent: April 4, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Miska Hannuksela, Mikko Honkala, Jani Lainema, Francesco Cricri, Emre Aksu
  • Publication number: 20230062691
    Abstract: The embodiments relate to a method, including writing a first and a second media entity in a container file; creating a media presentation description (MPD) with a first and a second Representation; the Representations belonging to Adaptation Sets; the Representations being associated with the media entities of the container file; when one of the Representations belongs to a media entity which is a thumbnail to a viewpoint or a thumbnail to an overlay, the method includes writing in the MPD file an association/correspondence/grouping information of the said one Representation with another Representation belonging to a media entity which is a viewpoint or an overlay, correspondingly. The embodiments also relate to a method for parsing, and technical equipment for implementing the methods.
    Type: Application
    Filed: December 30, 2020
    Publication date: March 2, 2023
    Inventors: Kashyap Kammachi SREEDHAR, Miska HANNUKSELA, Sujeet MATE, Emre AKSU
  • Patent number: 11587200
    Abstract: A method, apparatus and computer program product enable multiple timeline support in playback of omnidirectional media content with overlay. The method, apparatus and computer program product receive a visual overlay configured to be rendered as a multi-layer visual content with an omnidirectional media content file (30). The omnidirectional media content file is associated with a first presentation timeline. The visual overlay is associated with a second presentation timeline. The method, apparatus and computer program product construct an overlay behavior definition file associated with the visual overlay (32). The overlay behavior definition file indicates a behavior of the second presentation timeline with respect to the first presentation in an instance that a pre-defined user interaction switch occurs during a playback of the omnidirectional media content file.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: February 21, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Sujeet Shyamsundar Mate, Igor Curcio, Miska Hannuksela, Emre Aksu, Kashyap Kammachi Sreedhar
  • Publication number: 20230027058
    Abstract: The embodiments relate to a method for writing, in a container file, two or more subpicture tracks; writing, in the container file, a base track, which is intended to be resolved into a video bitstream; indicating, in the base track, a layout of subpictures; writing, in the container file, a sample group description entry indicative of a first subpicture track or a group of subpicture tracks for each subpicture position in the layout of subpictures, wherein the first subpicture track includes the subpicture sequence for the respective subpicture position and wherein any track among the group of subpicture tracks includes a valid subpicture sequence for the respective subpicture position; and indicating in the container file, samples of the base track for which the sample group description entry is intended to be used for reconstructing the video bitstream. The embodiments also relate to a method for parsing, as well as technical equipment for implementing the method for writing and the method for parsing.
    Type: Application
    Filed: December 17, 2020
    Publication date: January 26, 2023
    Inventors: Miska Hannuksela, Emre AKSU, Kashyap KAMMACHISREEDHAR
  • Patent number: 11558628
    Abstract: An apparatus includes circuitry configured to: partition an input tensor into one or more block tensors; partition at least one of the block tensors into one or more continuation bands, the one or more continuation bands being associated with a caching counter having a value; store the one or more continuation bands in a cache managed using a cache manager; retrieve, prior to a convolution or pooling operation on a current block tensor, the one or more continuation bands of a previous block tensor from the cache that are adjacent to a current block tensor; concatenate the retrieved continuation bands with the current block tensor; apply the convolution or pooling operation on the current block tensor after the concatenation; decrease the respective caching counter value of the retrieved continuation bands; and clear the continuation bands from the cache when its respective caching counter reaches a value of zero.
    Type: Grant
    Filed: December 13, 2021
    Date of Patent: January 17, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Honglei Zhang, Francesco Cricri, Hamed Rezazadegan Tavakoli, Jani Lainema, Emre Aksu, Nannan Zou
  • Patent number: 11553258
    Abstract: A method comprising: authoring a first section of a first media format, wherein the first section comprises type and length fields of the first section, wherein the type value of the first section of the first media format is such that allows parsers of the first media format ignore the first section; one or more entire sections complying with a second media format; and a section header of a bridge section complying with the second media format, wherein the section header comprises type and length fields; authoring a second section of the first media format, comprising type and length fields of the second section; and data complying with the second media format; and setting the content of the first section to be such that it allows parsers of the second media format ignore the type and length fields of the second section.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: January 10, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Miska Hannuksela, Emre Aksu
  • Patent number: 11442985
    Abstract: The embodiments relate to a method comprising receiving visual data in a file format compatible with ISO base media file format; processing the visual data to detect one or more content elements; storing the detected one or more content elements and information on the used process as a metadata; and including the metadata to the media file in association with the visual data. The embodiments also relate to a technical equipment for implementing the method.
    Type: Grant
    Filed: September 13, 2019
    Date of Patent: September 13, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Emre Aksu, Miska Hannuksela, Jonne Juhani Mäkinen, Juha-Pekka Hippeläinen
  • Patent number: 11412267
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide signal information to identify an atlas identifier on a sample of a volumetric media track, or on the volumetric media track in a multi-track container; wherein the signal information allows a file parser to link volumetric media tracks with different atlas identifiers that originate from a volumetric media elementary stream; and wherein the file parser is able to reconstruct the volumetric media elementary stream based on the signal information and data encapsulated in the multi-track container.
    Type: Grant
    Filed: January 4, 2021
    Date of Patent: August 9, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Sebastian Schwarz, Lukasz Kondrad, Emre Aksu, Lauri Ilola, Vinod Kumar Malamal Vadakital, Miska Matias Hannuksela