Patents by Inventor Khaled Mammou
Khaled Mammou has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11854112Abstract: A system compresses and decompresses attribute information for visual volumetric content, such as a mesh representation. Attribute values are included in the visual volumetric representation, wherein at least some of the attribute values include unitary vectors, such as surface normal vectors or surface tangent vectors having a magnitude of one unit. In order to compress the attribute information the three-dimensional unit vectors are mapped into two dimensional parametric coordinates for a planar representation of a unit sphere. To reduce negative effects on compression due to distortion or discontinuities in the planar representation, mappings for compressing respective unit vectors are adaptively selected.Type: GrantFiled: May 17, 2022Date of Patent: December 26, 2023Assignee: Apple Inc.Inventors: Khaled Mammou, Deepak S Tolani, Alexandros Tourapis
-
Publication number: 20230401751Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.Type: ApplicationFiled: August 18, 2023Publication date: December 14, 2023Applicant: Apple Inc.Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
-
Publication number: 20230403415Abstract: Adaptive decoder-drive encoder reconfiguration techniques are described. In one example, techniques include detecting an operational condition at a consumer using a sensor, the consumer receiving a communication of digital content from an encoder; generating an adaptation instruction by the decoder based on the detecting; transmitting the adaptation instruction by the decoder for receipt by the encoder; and receiving an adapted communication of the digital content generated by the encoder, the adapted communication caused by reconfiguration of the encoder based on the adaptation instruction received from the decoder.Type: ApplicationFiled: June 13, 2022Publication date: December 14, 2023Inventors: Ihab Amer, Gabor Sines, Haibo Liu, Khaled Mammou, Arun Sundaresan Iyer
-
Publication number: 20230401755Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also, the sub-meshes may be grouped into patches, patch-groups, and/or tiles. Different encoding parameters may be used for such different coding units (e.g., patches, patch-groups and/or tiles). However, the encoding parameters are adjusted for vertices that are shared between coding units to avoid introduction of artefacts. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.Type: ApplicationFiled: April 19, 2023Publication date: December 14, 2023Applicant: Apple Inc.Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim, Dimitri Podborski
-
Patent number: 11818401Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.Type: GrantFiled: April 12, 2022Date of Patent: November 14, 2023Assignee: Apple Inc.Inventors: Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Khaled Mammou
-
Publication number: 20230351697Abstract: A method of decomposing a three-dimensional representation of an object into a plurality of convex hulls can include instantiating a cluster priority queue in a computing system memory that initially contains a cluster corresponding to the three-dimensional representation of the object, computing with a processor of the computing system a concavity measure for each cluster in the cluster priority queue, and, for the cluster with the highest concavity measure: (1) computing with the processor a cut plane that divides the cluster corresponding to the three-dimensional representation of the object into two new clusters, each of the two new clusters having a corresponding convex hull, wherein computing a cut plane includes performing a hierarchical search of potential cut planes, (2) removing the cluster corresponding to the three-dimensional representation of the object from the cluster priority queue, and (3) adding the two new clusters to the cluster priority queue.Type: ApplicationFiled: April 28, 2022Publication date: November 2, 2023Inventors: Khaled Mammou, Adrian A Biagioli, Deepak S Tolani
-
Patent number: 11798196Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for three-dimensional (3D) visual volumetric content and/or a decoder configured to decompress compressed attribute and/or spatial information for the 3D visual volumetric content. The encoder is configured to convert 3D visual volumetric content, such as a point cloud or mesh, into image based patch representations. The encoder is further configured to select one or more reference patches for copying or prediction, such that metadata for copying or predicting a patch based on the reference patch is signaled without explicitly signaling a full set of information for the copied or predicted patch. Likewise, a decoder is configured to receive such information and reconstruct a 3D version of the 3D visual volumetric content using both signaled and predicted or copied patches.Type: GrantFiled: January 8, 2021Date of Patent: October 24, 2023Assignee: Apple Inc.Inventors: Jungsun Kim, Khaled Mammou, Alexandros Tourapis
-
Patent number: 11783508Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.Type: GrantFiled: September 16, 2022Date of Patent: October 10, 2023Assignee: Apple Inc.Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
-
Publication number: 20230319310Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.Type: ApplicationFiled: June 5, 2023Publication date: October 5, 2023Applicant: Apple Inc.Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, David W. Singer, Fabrice A. Robinet
-
Publication number: 20230316655Abstract: A three-dimensional (3D) mesh encoder is provided. The 3D mesh encoder can include a preprocessing stage configured to generate the mesh M by re-sampling the mesh M and computing a new atlas of parametrization with a fewer number of patches and relatively lower parameterization distortion. The 3D mesh encoder may include an attribute transfer stage for transferring attributes to the re-sampled mesh M.Type: ApplicationFiled: February 8, 2023Publication date: October 5, 2023Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
-
Publication number: 20230290011Abstract: A video dynamic mesh coding (v-DMC) decoding system, includes a de-multiplexer that receives and demultiplexes an encoded v-DMC bitstream into: a parameter set and mesh data, geometry, atlas data, and attribute video substreams. The decoding system also includes: a mesh data substream decoder; a video decoder that decodes the geometry data substream; an atlas data substream decoder; a mesh subdivision component that subdivides the one or more base meshes into one or more resampled base meshes based upon the decoded atlas data; a displacement decoder that outputs one or more displacements to verticies of the one or more resampled base meshes; a mesh position refinement component that applies the one or more displacements to the one or more resampled base meshes and outputs one or more resultant meshes; and a video decoder that decodes the attribute video substream into one or more texture images.Type: ApplicationFiled: February 8, 2023Publication date: September 14, 2023Inventors: Jungsun Kim, Alexandros Tourapis, Dimitri Podborski, Khaled Mammou, David Flynn
-
Publication number: 20230290010Abstract: A method of encoding motion data associated with an input data corresponding to set of 3D meshes M(i), the motion data including at least one of geometry and vertex attribute changes from one frame to another, can include: dividing input mesh M(i) into a set of patches P(i, j), each patch P(i, j) corresponding to a corresponding patch P(k, l) in a previously encoded reference frame; quantizing at least one of vertices and attributes of each patch P(i, j); predicting residuals based on a difference between quantized vertices or attributes of each patch P(i, j) with respect to corresponding patch P(k, l) in the previously encoded reference frame; and entropy encoding the predicted residuals.Type: ApplicationFiled: February 8, 2023Publication date: September 14, 2023Inventors: Khaled Mammou, Alexandros Tourapis
-
Publication number: 20230290008Abstract: A method of compressing a 3D textured mesh M(i), the 3D textured mesh being defined by connectivity C(i), geometry G(i), texture coordinates T(i), and texture connectivity CT(i), wherein the mesh is associated with one or more 2D image attribute maps A(i) describing attributes associated with the mesh surface, can include pre-processing 3D textured mesh M(i) and attribute maps A(i) to generate a base mesh m(i) and displacement field d(i); and processing 3D textured mesh M(i), attribute maps A(i), base mesh m(i), and the displacement field d(i) to generate a compressed bitstream b(i).Type: ApplicationFiled: February 8, 2023Publication date: September 14, 2023Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
-
Publication number: 20230290009Abstract: A re-meshing pre-processor for re-meshing a 3D textured mesh M(i) to generate a base mesh m(i) and displacement field d(i) for input into a mesh encoder, can include a Mesh Decimation module that includes processing hardware that reduces the number of vertices or faces of input mesh M(i), or a mesh derived therefrom, while substantially preserving the shape of the input mesh M(i), thereby producing a decimated mesh dm(i) and a projected mesh P(i); and a Fitting Subdivision Surface module that includes processing hardware that processes the input mesh M(i), the decimated mesh dm(i) or a mesh derived therefrom, and the projected mesh P(i) to produce a base mesh m(i) and the displacement field d(i) for input into a mesh encoder.Type: ApplicationFiled: February 8, 2023Publication date: September 14, 2023Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
-
Publication number: 20230290063Abstract: A method of post processing a decoded 3D textured mesh to adaptively tesselate the mesh, can include: receiving from a mesh decoder one or more of metadata(i) describing various information about the mesh structure, a decoded base mesh m?(i), displacements d?(i) associated with the vertices of the decoded base mesh, and optionally one or more attribute maps A?(i) describing information associated with the mesh surface; and receiving control parameters from an application consuming the decoded 3D textured mesh; and performing one or more subdivisions of the decoded base mesh m?(i) based on the received control information.Type: ApplicationFiled: February 8, 2023Publication date: September 14, 2023Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
-
Patent number: 11754685Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.Type: GrantFiled: September 23, 2022Date of Patent: September 12, 2023Assignee: Apple Inc.Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim
-
Patent number: 11748916Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.Type: GrantFiled: May 27, 2022Date of Patent: September 5, 2023Assignee: Apple Inc.Inventors: Khaled Mammou, Alexandros Tourapis, Yeping Su, Jungsun Kim, Fabrice A. Robinet, Valery G. Valentin
-
Patent number: 11727603Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.Type: GrantFiled: May 12, 2021Date of Patent: August 15, 2023Assignee: Apple Inc.Inventors: Khaled Mammou, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Alexandros Tourapis
-
Patent number: 11711544Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.Type: GrantFiled: June 25, 2020Date of Patent: July 25, 2023Assignee: Apple Inc.Inventors: Alexandros Tourapis, Jungsun Kim, Khaled Mammou, David W. Singer, Fabrice A. Robinet
-
Publication number: 20230232044Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.Type: ApplicationFiled: March 23, 2023Publication date: July 20, 2023Applicant: Apple Inc.Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Fabrice A. Robinet, Yeping Su, David W. Singer