Patents by Inventor Nikolai Konrad Leung

Nikolai Konrad Leung has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12155698
    Abstract: Methods and apparatus are disclosed for session initiation in a conference. In one aspect, a method for communicating between multiple parties is disclosed. The method comprises generating, at a first device, a first message for transmission to a second device. The method further comprises receiving, at the first device, a second message for establishing a conference. The second message includes a list of one or more concurrent codec capabilities supported by the second device. The list of one or more concurrent codec capabilities supported by the second device comprises an indication of whether one or more resources usable for one or more concurrent instances of a first listed codec may instead be used for one or more concurrent instances of a second listed codec.
    Type: Grant
    Filed: August 26, 2021
    Date of Patent: November 26, 2024
    Assignee: QUALCOMM INCORPORATED
    Inventors: Nikolai Konrad Leung, Yekui Wang, Ramachandran Subramanian
  • Publication number: 20240364889
    Abstract: A first device may perform a first part of a computing graph to extract a feature map from media (e.g., video) data. The first device may buffer the media data and compress the feature map. The first device may then send the compressed feature map to a second device, which may perform a second part of the computing graph (e.g., processing tasks), e.g., to perform object detection or other such tasks. The second device may request at least a portion of the buffered media data when needed, e.g., to improve accuracy of the second part of the computing graph/processing tasks. Thus, the second device may send a request to the first device for the at least portion of the buffered media data, then perform the second part of the computing graph using the buffered media data and the received feature map.
    Type: Application
    Filed: April 23, 2024
    Publication date: October 31, 2024
    Inventors: Liangping Ma, Nikolai Konrad Leung, Thomas Stockhammer, Imed Bouazizi, Lindsey Makana Kostas
  • Publication number: 20240357141
    Abstract: An example a first network entity for processing feature set data formed from media data includes a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: determine a first set of processing tasks of a series of processing tasks to be performed on a set of media data, the first set of processing tasks corresponding to tasks to be performed by the first network entity, wherein a second set of processing tasks is to be performed by a second network entity; perform the first set of processing tasks on the set of media data to form a feature map; encode the feature map to form an encoded feature map; and send the encoded feature map to the second network entity to enable the second network entity to perform the second set of processing tasks using the feature map.
    Type: Application
    Filed: April 18, 2024
    Publication date: October 24, 2024
    Inventors: Liangping Ma, Nikolai Konrad Leung, Imed Bouazizi, Alberto Rico Alvarino, Charles Nung Lo, Thomas Stockhammer
  • Publication number: 20240311103
    Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a split-compute compiler and game engine. A processor may obtain an executable for an application including a first set of application functions associated with the UE and a second set of application functions associated with a computing device that is different from the UE. The processor may obtain an estimated quality of a link between the UE and the computing device. The processor may obtain, based on the estimated quality of the link, a split-compute configuration between the first set of application functions and the second set of application functions. The processor may output an indication of the split-compute configuration.
    Type: Application
    Filed: January 31, 2024
    Publication date: September 19, 2024
    Inventors: Nikolai Konrad LEUNG, Bojan VRCELJ, Imed BOUAZIZI
  • Publication number: 20240289970
    Abstract: Techniques and systems are provided for image processing. For instance, a process can include obtaining, from one or more image sensors, a first image of an environment; determining semantic labels for a plurality of pixels of the first image based on whether each pixel of the plurality of pixels is associated with an object in the first image to generate a semantically segmented image; applying a two-dimensional line representation of the first image to the semantically segmented image to generate a labeled 2D line representation; back-projecting the labeled 2D line representation to three dimensions to generate a line representation model; fusing the line representation model and the semantically segmented image to generate a labeled line representation model; and outputting the labeled line representation model.
    Type: Application
    Filed: February 24, 2023
    Publication date: August 29, 2024
    Inventors: Yan DENG, Michel Adib SARKIS, Ning BI, Nikolai Konrad LEUNG
  • Publication number: 20240275826
    Abstract: An example first user equipment (UE) for communicating media data includes: a memory configured to store media data; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: send a request to start an augmented reality (AR) media call with a second UE to a call session control function (CSCF), the request including data indicating a request for transcoding of AR media data to two-dimensional video data; establish a media communication session with a transcoding device executing a media function or a multimedia resource function, the transcoding device being between the first UE and the second UE; receive transcoded media data from the transcoding device that the transcoding device transcoded from AR media data received from the second UE; and present the transcoded media data.
    Type: Application
    Filed: February 12, 2024
    Publication date: August 15, 2024
    Inventors: Imed Bouazizi, Nikolai Konrad Leung, Liangping Ma
  • Patent number: 12047806
    Abstract: Various embodiments may provide methods, systems, and devices for supporting application level discovery of Radio Access Network (RAN) statistics and/or events. Various embodiments may provide methods, systems, and devices for supporting application level signaling of Quality of Service (QoS) requirements.
    Type: Grant
    Filed: March 1, 2022
    Date of Patent: July 23, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Liangping Ma, Nikolai Konrad Leung, Alberto Rico Alvarino, Min Wang, Thomas Stockhammer, Leena Zacharias, Yong He, Imed Bouazizi, Muhammed Zeyd Coban, Umesh Phuyal, Louis Joseph Kerofsky
  • Patent number: 12047266
    Abstract: Methods, systems, and devices for wireless communications are described. A wireless communications entity, such as a user equipment (UE), a base station, a network core, or an application server, may identify a round-trip time (RTT) latency requirement that may pertain to a round-trip latency in wireless communications between the UE and the base station. The wireless communications entity may identify a one one-way directional delay budget that satisfies the RTT latency requirement for an application of an application server. The application server may be in communication with the UE via the base station. The wireless communications entity may modify a value of the one-way directional delay budget and transmit a message that is associated with the modified value of the one one-way directional delay budget.
    Type: Grant
    Filed: January 14, 2022
    Date of Patent: July 23, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Prashanth Haridas Hande, Nikolai Konrad Leung, Peerapol Tinnakornsrisuphap, Dario Serafino Tonesi, Sebastian Speicher, Thomas Stockhammer, Mickael Mondet, Yih-Hao Lin, Ravi Agarwal, Simone Merlin
  • Patent number: 12035020
    Abstract: An example device for processing extended reality (XR) data includes a processors configured to: parse entry point data of an XR scene to extract information about one or more required virtual objects for the XR scene, the required virtual objects including a number of dynamic virtual objects equal to or greater than one, each of the dynamic virtual objects including at least one dynamic media component for which media data is to be retrieved; initialize a number of streaming sessions equal to or greater than the number of dynamic virtual objects using the entry point data; configure quality of service (QoS) and charging information for the streaming sessions; retrieve media data for the dynamic virtual objects via the streaming sessions; and send the retrieved media data to a rendering unit to render the XR scene to include the retrieved media data at corresponding locations within the XR scene.
    Type: Grant
    Filed: May 11, 2022
    Date of Patent: July 9, 2024
    Assignee: QUALCOMM INCORPORATED
    Inventors: Imed Bouazizi, Thomas Stockhammer, Nikolai Konrad Leung
  • Publication number: 20240187347
    Abstract: Embodiments of systems and methods for measuring data packet delays in an end-to-end communication path according to some embodiments may include transmitting from a first computing device to a second computing device first delay measurement information in a first packet with a header portion configured to indicate that the first packet is a data packet, receiving from the second computing device second delay measurement information in a second packet with a header portion configured to indicate that the second packet is a data packet, determining a data packet delay between the first computing device and the second computing device based on transmit timing information of the first packet and receive timing information of the second packet, and using the determined packet delay to set a quality of service for a communication path between the first computing device and the second computing device.
    Type: Application
    Filed: February 14, 2023
    Publication date: June 6, 2024
    Inventors: Liangping MA, Prashanth Haridas HANDE, Martin RENSCHLER, Sebastian SPEICHER, Imed BOUAZIZI, Thomas STOCKHAMMER, Nikolai Konrad LEUNG, Peerapol Tinnakornsrisuphap
  • Publication number: 20240163461
    Abstract: An example device for retrieving media data, the device comprising: a memory configured to store scene data and image data; and one or more processors implemented in circuitry and configured to: receive data for a bitstream indicating that the bitstream includes one or more overlay images, the overlay images comprising either a single static image to be presented with scene data that remains constant while being presented frame-by-frame with frames of the scene data or an image sequence that repeats with a regular periodicity while being presented frame-by-frame with the frames of the scene data; receive the one or more overlay images from the bitstream; receive the scene data including one or more scene images; and present the scene images and the overlay images.
    Type: Application
    Filed: November 17, 2023
    Publication date: May 16, 2024
    Inventors: Imed Bouazizi, Nikolai Konrad Leung
  • Publication number: 20240154908
    Abstract: Embodiments of systems and methods for reporting a delay for network segments in an end-to-end communication path may include determining an end-to-end delay measurement of a communication path spanning a first communication network and a second communication network, and transmitting a message including delay information based on the determined end-to-end delay measurement to a network element of the first communication network, wherein the message is configured to enable the network element of the first communication network to configure the first communication network to provide sufficient Quality of Service (QoS) to support an end-to-end QoS requirement based on the delay information.
    Type: Application
    Filed: April 14, 2023
    Publication date: May 9, 2024
    Inventors: Liangping MA, Nikolai Konrad LEUNG, Prashanth Haridas HANDE, Sebastian SPEICHER, Xiaolong HUANG, Srinivas KATAR, Andrew MacKinnon DAVIDSON
  • Publication number: 20240146994
    Abstract: An example device for retrieving media data includes a memory; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: receive a packet including a packet header and a payload including at least a portion of a frame of video data, the packet header being separate from the payload; extract, from the packet header, a video frame identifier for the frame of video data; and process the payload according to the video frame identifier.
    Type: Application
    Filed: June 6, 2023
    Publication date: May 2, 2024
    Inventors: Yong He, Muhammed Zeyd Coban, Prashanth Haridas Hande, Imed Bouazizi, Nikolai Konrad Leung
  • Publication number: 20240121288
    Abstract: A client device (e.g., user equipment or “UE”) may be configured to engage in a media communication session, such as a WebRTC session, with another client device. The client devices may separate a quality of service (QoS) specification from a QoS flow definition, to allow for separate interactive connectivity establishment (ICE) negotiation. The QoS specification may cover all segments of a connection for the media communication session. For example, QoS may be requested for a case where a server (e.g., a Traversal Using Relay Network Address Translation (TURN) server) is hosted by a mobile network operator (MNO). The QoS specification and the QoS flow description may be linked.
    Type: Application
    Filed: October 4, 2023
    Publication date: April 11, 2024
    Inventors: Imed Bouazizi, Thomas Stockhammer, Nikolai Konrad Leung
  • Publication number: 20240114312
    Abstract: A device configured to process a bitstream may implement the techniques. The device comprises a memory configured to store the bitstream representative of at least one audio element in an extended reality scene, and audio descriptive information associated with the at least one audio element. The device also comprises processing circuitry coupled to the memory and configured to execute a scene manager and an audio unit. The scene manager is configured to construct, based on the at least one audio element, a scene graph that includes at least one node that represents the at least one audio element, and modify, based on the scene graph, the audio descriptive information to obtain modified audio descriptive information. The audio unit is configured to render, based on the modified audio descriptive information, the at least one audio element to one or more speaker feeds, and output the one or more speaker feeds.
    Type: Application
    Filed: September 15, 2023
    Publication date: April 4, 2024
    Inventors: Imed Bouazizi, Thomas Stockhammer, Isaac Garcia Munoz, Nikolai Konrad Leung, Andre Schevciw, Graham Bradley Davis
  • Publication number: 20240113975
    Abstract: Embodiments of systems and methods for managing a delay of network segments in an end-to-end communication path may include determining an end-to-end time delay measurement of a communication path spanning a first communication network and a second communication network, and transmitting a message comprising the determined end-to-end time delay measurement of the communication path spanning the first communication network and the second communication network to a network element of the first communication network, wherein the message is configured to enable the network element of the first communication network to configure the first communication network to provide sufficient Quality of Service (QoS) to support an end-to-end QoS requirement based on the determined end-to-end time delay.
    Type: Application
    Filed: February 10, 2023
    Publication date: April 4, 2024
    Inventors: Liangping MA, Prashanth Haridas HANDE, Nikolai Konrad LEUNG, Thomas STOCKHAMMER, Imed BOUAZIZI, Alberto RICO ALVARINO
  • Publication number: 20240107476
    Abstract: Various embodiments provide systems and methods for supporting synchronized delivery of packets of different type media streams of a service. Various embodiments enable wireless device and/or network assistance of packet synchronization in downlink (DL) and/or uplink (UL) transmissions.
    Type: Application
    Filed: November 30, 2023
    Publication date: March 28, 2024
    Inventors: Nikolai Konrad LEUNG, Olufunmilola Omolade AWONIYI-OTERI, Prashanth Haridas HANDE, Tao LUO, Sebastian SPEICHER
  • Publication number: 20240098307
    Abstract: An example device for presenting media data includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to: receive a first set of media data of a media bitstream; in response to determining that a second set of media data of the media bitstream following the first set of media data will not be received within a period of time, predictively generate replacement media data for the second set of media data using at least a subset of the first set of media data; and present the first set of media data and the replacement media data.
    Type: Application
    Filed: September 20, 2022
    Publication date: March 21, 2024
    Inventors: Liangping Ma, Thomas Stockhammer, Alberto Rico Alvarino, Nikolai Konrad Leung, Imed Bouazizi
  • Publication number: 20240098130
    Abstract: An example device for processing media data includes a memory configured to store media data; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: determine one or more user interactions with a virtual scene, each of the one or more user interactions corresponding to a particular media type of one or more media types; construct a packet including data for a media communication session, the packet including header data indicating the one or more media types for the one or more user interactions and one or more attributes for each of the one or more media types; and send the packet to a device involved in the media communication session.
    Type: Application
    Filed: August 24, 2023
    Publication date: March 21, 2024
    Inventors: Yong He, Imed Bouazizi, Muhammed Zeyd Coban, Nikolai Konrad Leung
  • Patent number: 11916980
    Abstract: Various embodiments include systems and methods for providing an immersive three-dimensional group session. Various embodiments include methods and devices for signaling a description of a scene with media components potentially coming from different parties. In various aspects, a scene graph may be signaled through a session description protocol (SDP) during a session initiation protocol (SIP) session setup. In various embodiments, the scene graph may include respective graphical output nodes assigned to be controlled by each of the plurality of participant computing devices in an immersive three-dimensional group session.
    Type: Grant
    Filed: July 21, 2022
    Date of Patent: February 27, 2024
    Assignee: QUALCOMM INCORPORATED
    Inventors: Imed Bouazizi, Nikolai Konrad Leung, Thomas Stockhammer