Patents by Inventor Fabrice A. Robinet

Fabrice A. Robinet has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200275125
    Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.
    Type: Application
    Filed: May 11, 2020
    Publication date: August 27, 2020
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Andrea Cremaschi, Alexandros Tourapis
  • Publication number: 20200273208
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.
    Type: Application
    Filed: May 13, 2020
    Publication date: August 27, 2020
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, David W. Singer, Alexandros Tourapis, Fabrice A. Robinet, Hsi-Jung Wu
  • Patent number: 10699444
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: June 30, 2020
    Assignee: Apple Inc
    Inventors: Khaled Mammou, Yeping Su, David W. Singer, Alexandros Tourapis, Fabrice A. Robinet, Hsi-Jung Wu
  • Publication number: 20200193645
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.
    Type: Application
    Filed: February 20, 2020
    Publication date: June 18, 2020
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, David W. Singer, Alexandros Tourapis, Fabrice A. Robinet, Hsi-Jung Wu
  • Patent number: 10659816
    Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: May 19, 2020
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Andrea Cremaschi, Alexandros Tourapis
  • Publication number: 20200111236
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. In order to improve computing efficiency and/or repeatability, fixed-point number representations are used when determining predicted attribute values and attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file using fixed-point number representations.
    Type: Application
    Filed: October 3, 2019
    Publication date: April 9, 2020
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Valery G. Valentin, Fabrice A. Robinet, Khaled Mammou, Jungsun Kim, Yeping Su
  • Publication number: 20200111237
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. The encoder is also configured to determine quantized minimum depths and/or maximum depths patch images in the image frames, wherein depth information is signaled relative to the quantized minimum depth.
    Type: Application
    Filed: October 5, 2019
    Publication date: April 9, 2020
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Fabrice A. Robinet, Jungsun Kim, Khaled Mammou, Valery G. Valentin, Yeping Su
  • Publication number: 20200105024
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.
    Type: Application
    Filed: October 2, 2019
    Publication date: April 2, 2020
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Yeping Su, Jungsun Kim, Fabrice A Robinet, Valery G. Valentin
  • Publication number: 20200104976
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding, wherein pixel values for the padding are determined based on neighboring pixels values such that the padding is smoothed in the image frame. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.
    Type: Application
    Filed: September 27, 2019
    Publication date: April 2, 2020
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim, Yeping Su, David W. Singer, Valery G. Valentin, Fabrice A. Robinet
  • Patent number: 10607373
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: March 31, 2020
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, David W. Singer, Alexandros Tourapis, Fabrice A. Robinet, Hsi-Jung Wu
  • Publication number: 20200099942
    Abstract: Support for additional components may be specified in a coding scheme for image data. A layer of a coding scheme that specifies color components may also specify additional components. Characteristics of the components may be specified in the same layer or a different layer of the coding scheme. An encoder or decoder may identify the specified components and determine the respective characteristics to perform encoding and decoding of image data.
    Type: Application
    Filed: September 25, 2019
    Publication date: March 26, 2020
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Yeping Su, Khaled Mammou, Jungsun Kim, David W. Singer, Fabrice A. Robinet, Guy Cote, Jim C. Chou, Hsi-Jung Wu
  • Publication number: 20200053391
    Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.
    Type: Application
    Filed: September 12, 2019
    Publication date: February 13, 2020
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Andrea Cremaschi, Alexandros Tourapis
  • Publication number: 20200021847
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.
    Type: Application
    Filed: July 12, 2019
    Publication date: January 16, 2020
    Applicant: Apple Inc.
    Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Fabrice A. Robinet, Yeping Su, David W. Singer
  • Publication number: 20200021856
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. To compress the attribute information, multiple levels of detail are generated based on an ordering of the points according to a space filling curve and attribute values are predicted. The attribute values may be predicted simultaneously while points are being assigned to different levels of detail. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, attribute correction values may take into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
    Type: Application
    Filed: July 10, 2019
    Publication date: January 16, 2020
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Khaled Mammou
  • Publication number: 20200014953
    Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.
    Type: Application
    Filed: July 5, 2019
    Publication date: January 9, 2020
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, Jungsun Kim, Valery G. Valentin, David W. Singer, Fabrice A. Robinet, Hsi-Jung Wu, Alexandros Tourapis
  • Publication number: 20200007867
    Abstract: A system comprises an encoder configured to compress images, such as image frames comprising attribute information and/or spatial for a point cloud and/or an occupancy map for the point cloud. Also, a system includes a decoder configured to decompress compressed image frames, such as image frames comprising compressed attribute and/or spatial information for the point cloud or an occupancy map for the point cloud. Additionally, the encoder may map N-bit data to M-bit code words, where M is less than N. Alternatively the encoder may map N-bit data to M-bit code words, where M is greater than N. In a similar manner, a decoder may map the M-bit code words back to the N-bit data.
    Type: Application
    Filed: July 1, 2019
    Publication date: January 2, 2020
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Fabrice A. Robinet, Khaled Mammou, Valery G. Valentin, Yeping Su
  • Publication number: 20190394496
    Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.
    Type: Application
    Filed: June 21, 2019
    Publication date: December 26, 2019
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Khaled Mammou
  • Patent number: 10462485
    Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: October 29, 2019
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Andrea Cremaschi, Alexandros Tourapis
  • Publication number: 20190311501
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, multiple levels of detail are generated based on spatial information. Also, attribute values are predicted based on the level of details. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, an update operation is performed to smooth attribute correction values taking into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
    Type: Application
    Filed: April 10, 2019
    Publication date: October 10, 2019
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim, Fabrice A. Robinet, Valery G. Valentin, Yeping Su
  • Publication number: 20190311500
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.
    Type: Application
    Filed: April 10, 2019
    Publication date: October 10, 2019
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Valery G. Valentin, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su, Jungsun Kim