Patents by Inventor Khaled Mammou

Khaled Mammou has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11854112
    Abstract: A system compresses and decompresses attribute information for visual volumetric content, such as a mesh representation. Attribute values are included in the visual volumetric representation, wherein at least some of the attribute values include unitary vectors, such as surface normal vectors or surface tangent vectors having a magnitude of one unit. In order to compress the attribute information the three-dimensional unit vectors are mapped into two dimensional parametric coordinates for a planar representation of a unit sphere. To reduce negative effects on compression due to distortion or discontinuities in the planar representation, mappings for compressing respective unit vectors are adaptively selected.
    Type: Grant
    Filed: May 17, 2022
    Date of Patent: December 26, 2023
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Deepak S Tolani, Alexandros Tourapis
  • Publication number: 20230401751
    Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.
    Type: Application
    Filed: August 18, 2023
    Publication date: December 14, 2023
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
  • Publication number: 20230403415
    Abstract: Adaptive decoder-drive encoder reconfiguration techniques are described. In one example, techniques include detecting an operational condition at a consumer using a sensor, the consumer receiving a communication of digital content from an encoder; generating an adaptation instruction by the decoder based on the detecting; transmitting the adaptation instruction by the decoder for receipt by the encoder; and receiving an adapted communication of the digital content generated by the encoder, the adapted communication caused by reconfiguration of the encoder based on the adaptation instruction received from the decoder.
    Type: Application
    Filed: June 13, 2022
    Publication date: December 14, 2023
    Inventors: Ihab Amer, Gabor Sines, Haibo Liu, Khaled Mammou, Arun Sundaresan Iyer
  • Publication number: 20230401755
    Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also, the sub-meshes may be grouped into patches, patch-groups, and/or tiles. Different encoding parameters may be used for such different coding units (e.g., patches, patch-groups and/or tiles). However, the encoding parameters are adjusted for vertices that are shared between coding units to avoid introduction of artefacts. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.
    Type: Application
    Filed: April 19, 2023
    Publication date: December 14, 2023
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim, Dimitri Podborski
  • Patent number: 11818401
    Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.
    Type: Grant
    Filed: April 12, 2022
    Date of Patent: November 14, 2023
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Khaled Mammou
  • Publication number: 20230351697
    Abstract: A method of decomposing a three-dimensional representation of an object into a plurality of convex hulls can include instantiating a cluster priority queue in a computing system memory that initially contains a cluster corresponding to the three-dimensional representation of the object, computing with a processor of the computing system a concavity measure for each cluster in the cluster priority queue, and, for the cluster with the highest concavity measure: (1) computing with the processor a cut plane that divides the cluster corresponding to the three-dimensional representation of the object into two new clusters, each of the two new clusters having a corresponding convex hull, wherein computing a cut plane includes performing a hierarchical search of potential cut planes, (2) removing the cluster corresponding to the three-dimensional representation of the object from the cluster priority queue, and (3) adding the two new clusters to the cluster priority queue.
    Type: Application
    Filed: April 28, 2022
    Publication date: November 2, 2023
    Inventors: Khaled Mammou, Adrian A Biagioli, Deepak S Tolani
  • Patent number: 11798196
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for three-dimensional (3D) visual volumetric content and/or a decoder configured to decompress compressed attribute and/or spatial information for the 3D visual volumetric content. The encoder is configured to convert 3D visual volumetric content, such as a point cloud or mesh, into image based patch representations. The encoder is further configured to select one or more reference patches for copying or prediction, such that metadata for copying or predicting a patch based on the reference patch is signaled without explicitly signaling a full set of information for the copied or predicted patch. Likewise, a decoder is configured to receive such information and reconstruct a 3D version of the 3D visual volumetric content using both signaled and predicted or copied patches.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: October 24, 2023
    Assignee: Apple Inc.
    Inventors: Jungsun Kim, Khaled Mammou, Alexandros Tourapis
  • Patent number: 11783508
    Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.
    Type: Grant
    Filed: September 16, 2022
    Date of Patent: October 10, 2023
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
  • Publication number: 20230319310
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.
    Type: Application
    Filed: June 5, 2023
    Publication date: October 5, 2023
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, David W. Singer, Fabrice A. Robinet
  • Publication number: 20230316655
    Abstract: A three-dimensional (3D) mesh encoder is provided. The 3D mesh encoder can include a preprocessing stage configured to generate the mesh M by re-sampling the mesh M and computing a new atlas of parametrization with a fewer number of patches and relatively lower parameterization distortion. The 3D mesh encoder may include an attribute transfer stage for transferring attributes to the re-sampled mesh M.
    Type: Application
    Filed: February 8, 2023
    Publication date: October 5, 2023
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
  • Publication number: 20230290011
    Abstract: A video dynamic mesh coding (v-DMC) decoding system, includes a de-multiplexer that receives and demultiplexes an encoded v-DMC bitstream into: a parameter set and mesh data, geometry, atlas data, and attribute video substreams. The decoding system also includes: a mesh data substream decoder; a video decoder that decodes the geometry data substream; an atlas data substream decoder; a mesh subdivision component that subdivides the one or more base meshes into one or more resampled base meshes based upon the decoded atlas data; a displacement decoder that outputs one or more displacements to verticies of the one or more resampled base meshes; a mesh position refinement component that applies the one or more displacements to the one or more resampled base meshes and outputs one or more resultant meshes; and a video decoder that decodes the attribute video substream into one or more texture images.
    Type: Application
    Filed: February 8, 2023
    Publication date: September 14, 2023
    Inventors: Jungsun Kim, Alexandros Tourapis, Dimitri Podborski, Khaled Mammou, David Flynn
  • Publication number: 20230290010
    Abstract: A method of encoding motion data associated with an input data corresponding to set of 3D meshes M(i), the motion data including at least one of geometry and vertex attribute changes from one frame to another, can include: dividing input mesh M(i) into a set of patches P(i, j), each patch P(i, j) corresponding to a corresponding patch P(k, l) in a previously encoded reference frame; quantizing at least one of vertices and attributes of each patch P(i, j); predicting residuals based on a difference between quantized vertices or attributes of each patch P(i, j) with respect to corresponding patch P(k, l) in the previously encoded reference frame; and entropy encoding the predicted residuals.
    Type: Application
    Filed: February 8, 2023
    Publication date: September 14, 2023
    Inventors: Khaled Mammou, Alexandros Tourapis
  • Publication number: 20230290008
    Abstract: A method of compressing a 3D textured mesh M(i), the 3D textured mesh being defined by connectivity C(i), geometry G(i), texture coordinates T(i), and texture connectivity CT(i), wherein the mesh is associated with one or more 2D image attribute maps A(i) describing attributes associated with the mesh surface, can include pre-processing 3D textured mesh M(i) and attribute maps A(i) to generate a base mesh m(i) and displacement field d(i); and processing 3D textured mesh M(i), attribute maps A(i), base mesh m(i), and the displacement field d(i) to generate a compressed bitstream b(i).
    Type: Application
    Filed: February 8, 2023
    Publication date: September 14, 2023
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
  • Publication number: 20230290009
    Abstract: A re-meshing pre-processor for re-meshing a 3D textured mesh M(i) to generate a base mesh m(i) and displacement field d(i) for input into a mesh encoder, can include a Mesh Decimation module that includes processing hardware that reduces the number of vertices or faces of input mesh M(i), or a mesh derived therefrom, while substantially preserving the shape of the input mesh M(i), thereby producing a decimated mesh dm(i) and a projected mesh P(i); and a Fitting Subdivision Surface module that includes processing hardware that processes the input mesh M(i), the decimated mesh dm(i) or a mesh derived therefrom, and the projected mesh P(i) to produce a base mesh m(i) and the displacement field d(i) for input into a mesh encoder.
    Type: Application
    Filed: February 8, 2023
    Publication date: September 14, 2023
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
  • Publication number: 20230290063
    Abstract: A method of post processing a decoded 3D textured mesh to adaptively tesselate the mesh, can include: receiving from a mesh decoder one or more of metadata(i) describing various information about the mesh structure, a decoded base mesh m?(i), displacements d?(i) associated with the vertices of the decoded base mesh, and optionally one or more attribute maps A?(i) describing information associated with the mesh surface; and receiving control parameters from an application consuming the decoded 3D textured mesh; and performing one or more subdivisions of the decoded base mesh m?(i) based on the received control information.
    Type: Application
    Filed: February 8, 2023
    Publication date: September 14, 2023
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
  • Patent number: 11754685
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.
    Type: Grant
    Filed: September 23, 2022
    Date of Patent: September 12, 2023
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
  • Patent number: 11748916
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.
    Type: Grant
    Filed: May 27, 2022
    Date of Patent: September 5, 2023
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Yeping Su, Jungsun Kim, Fabrice A. Robinet, Valery G. Valentin
  • Patent number: 11727603
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: August 15, 2023
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Alexandros Tourapis
  • Patent number: 11711544
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: July 25, 2023
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, David W. Singer, Fabrice A. Robinet
  • Publication number: 20230232044
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.
    Type: Application
    Filed: March 23, 2023
    Publication date: July 20, 2023
    Applicant: Apple Inc.
    Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Fabrice A. Robinet, Yeping Su, David W. Singer