Patents by Inventor Khaled Mammou

Khaled Mammou has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11017566
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: May 25, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Khaled Mammou, Yeping Su, Jungsun Kim, Valery G. Valentin, David W. Singer, Fabrice A. Robinet, Hsi-Jung Wu
  • Publication number: 20210150765
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.
    Type: Application
    Filed: January 25, 2021
    Publication date: May 20, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su
  • Publication number: 20210150766
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.
    Type: Application
    Filed: January 29, 2021
    Publication date: May 20, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Valery G. Valentin, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su, Jungsun Kim
  • Patent number: 11012713
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: May 18, 2021
    Assignee: Apple Inc.
    Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Fabrice A. Robinet, Yeping Su, David W. Singer
  • Patent number: 11010928
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: May 18, 2021
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Alexandros Tourapis
  • Publication number: 20210119640
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.
    Type: Application
    Filed: December 23, 2020
    Publication date: April 22, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su
  • Publication number: 20210118190
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.
    Type: Application
    Filed: December 4, 2020
    Publication date: April 22, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet
  • Publication number: 20210112289
    Abstract: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (A/V) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.
    Type: Application
    Filed: December 23, 2020
    Publication date: April 15, 2021
    Applicants: Advanced Micro Devices, Inc., ATI Technologies ULC
    Inventors: Lei Zhang, Gabor Sines, Khaled Mammou, David Glen, Layla A. Mah, Rajabali M. Koduri, Bruce Montag
  • Patent number: 10979704
    Abstract: Methods and apparatus of generating a refined reference frame for inter-frame encoding by applying blur parameters to allow encoding of image frames having blurred regions are presented herein. The methods and apparatus may identify a blurred region of an image frame by comparing the image frame with a reference frame, generate a refined reference frame by applying the blur parameter indicative of the blurred region to the reference frame, determine whether to use one of the reference frame and refined reference frame to encode the image frame, and encode the image frame using the refined reference frame when determined to use the refined reference frame.
    Type: Grant
    Filed: May 4, 2015
    Date of Patent: April 13, 2021
    Assignees: Advanced Micro Devices, Inc., ATI Technologies ULC
    Inventors: Ihab M. A. Amer, Khaled Mammou, Vladyslav S. Zakharchenko, Dmytro U. Elperin
  • Publication number: 20210103780
    Abstract: A search space for performing nearest neighbor searches for encoding point cloud data may be trimmed. Ranges of a space filling curve may be used to identify search space to exclude or reuse, instead of generating nearest neighbor search results for at least some of the points of a point cloud located within some of the ranges of the space filling curve. Additionally, neighboring voxels may be searched to identify any neighboring points missed during the trimmed search based on the ranges of the space filling curve.
    Type: Application
    Filed: October 1, 2020
    Publication date: April 8, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, David Flynn, Zhenzhen Gao
  • Publication number: 20210105493
    Abstract: An encoder is configured to compress point cloud information using a blocks of nodes determined from a prediction tree. A prediction tree is generated for a point cloud. Segments of the prediction tree are identified. The segments are divided into blocks that are predicted by predecessor blocks within the segments. The blocks of the prediction tree may then be encoded and may be provided for transmission to a decoder that can regenerate the point cloud from the blocks of the prediction tree.
    Type: Application
    Filed: October 2, 2020
    Publication date: April 8, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, David Flynn, Alexandros Tourapis, Jungsun Kim
  • Publication number: 20210104075
    Abstract: An encoder is configured to compress point cloud geometry information using a prediction tree. Ancestor nodes of a node added to the prediction tree may be used to determine the predicted value of the node to be added according to a prediction technique. The prediction tree may be encoded and may be provided for transmission to a decoder that can regenerate the point cloud.
    Type: Application
    Filed: October 1, 2020
    Publication date: April 8, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, David Flynn, Alexandros Tourapis
  • Publication number: 20210105022
    Abstract: A system comprises an encoder configured to entropy encode a bitstream comprising both compressible and non-compressible symbols. The encoder parses the bitstream into a compressible symbol sub-stream and a non-compressible sub-stream. The non-compressible symbol sub-stream bypass an entropy encoding component of the encoder while the compressible symbol sub-stream is entropy encoded. When a quantity of bytes of entropy encoded symbols and bypass symbols is accumulated a chunk of fixed or known size is formed using the accumulated entropy encoded symbol bytes and the bypass bytes without waiting on the full bitstream to be processed by the encoder. In a complementary manner, a decoder reconstructs the bitstream from the packets or chunks.
    Type: Application
    Filed: October 1, 2020
    Publication date: April 8, 2021
    Applicant: Apple Inc.
    Inventors: David Flynn, Alexandros Tourapis, Khaled Mammou
  • Publication number: 20210097723
    Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder generates time-consistent patches for multiple version of the point cloud at multiple moments in time and uses the time-consistent patches to generate image based representations of the point cloud at the multiple moments in time.
    Type: Application
    Filed: September 24, 2020
    Publication date: April 1, 2021
    Applicant: Apple Inc.
    Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Chao Cao, Marius Preda
  • Publication number: 20210097725
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.
    Type: Application
    Filed: December 11, 2020
    Publication date: April 1, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, David W. Singer, Alexandros Tourapis, Fabrice A. Robinet, Hsi-Jung Wu
  • Publication number: 20210099711
    Abstract: A system comprises an encoder configured to compress attribute information for a dynamic point cloud and/or a decoder configured to decompress compressed attribute information for a dynamic point cloud. The dynamic point cloud may include multiple versions of the point cloud at multiple moments in time Attribute values for the point cloud may be compressed at a reference frame using an intra-prediction process and may be compressed at one or more reference frames using an inter-prediction process that takes advantage of temporal relationships between different frames (e.g. versions) of the dynamic point cloud at the different moments in time.
    Type: Application
    Filed: September 24, 2020
    Publication date: April 1, 2021
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, Liviu Traian Christian Tulvan, Marius Preda
  • Publication number: 20210099701
    Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder applies an attribute transfer function to attributes of an image based representation with out-of-loop smoothing such that a decoder may apply any smoothing filter supported by the decoder without being restricted to using a similar smoothing filter as the encoder.
    Type: Application
    Filed: September 24, 2020
    Publication date: April 1, 2021
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, Dominik Mehlem
  • Publication number: 20210097722
    Abstract: Attributes for point cloud compression may be predicted according to a space filling curve. An order for selecting points of a point cloud to be compressed in order to predict attributes of the points may be determined according to values of a space filling curve applied to spatial information for the points. A point of the point cloud may be selected according to the determined ordering. A prediction technique may be performed with respect to the selected point based on a set of neighboring points in the point cloud also selected according to the ordering. Predicted attribute values and correction values may be determined for the predicted values. The correction values may be encoded as part of a compressed version of the point cloud.
    Type: Application
    Filed: September 27, 2019
    Publication date: April 1, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su
  • Publication number: 20210097726
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.
    Type: Application
    Filed: December 11, 2020
    Publication date: April 1, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet
  • Publication number: 20210090301
    Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.
    Type: Application
    Filed: September 23, 2020
    Publication date: March 25, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim