Patents by Inventor Fabrice Robinet

Fabrice Robinet has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220070493
    Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.
    Type: Application
    Filed: November 10, 2021
    Publication date: March 3, 2022
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, Jungsun Kim, Valery G. Valentin, David W. Singer, Fabrice A. Robinet, Hsi-Jung Wu, Alexandros Tourapis
  • Patent number: 11252441
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. To compress the attribute information, multiple levels of detail are generated based on an ordering of the points according to a space filling curve and attribute values are predicted. The attribute values may be predicted simultaneously while points are being assigned to different levels of detail. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, attribute correction values may take into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: February 15, 2022
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Khaled Mammou
  • Publication number: 20220005228
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.
    Type: Application
    Filed: September 3, 2021
    Publication date: January 6, 2022
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Khaled Mammou, Yeping Su, Fabrice A. Robinet, David W. Singer
  • Patent number: 11202098
    Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: December 14, 2021
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, Jungsun Kim, Valery G. Valentin, David W. Singer, Fabrice A. Robinet, Hsi-Jung Wu, Alexandros Tourapis
  • Patent number: 11132818
    Abstract: Attributes for point cloud compression may be predicted according to a space filling curve. An order for selecting points of a point cloud to be compressed in order to predict attributes of the points may be determined according to values of a space filling curve applied to spatial information for the points. A point of the point cloud may be selected according to the determined ordering. A prediction technique may be performed with respect to the selected point based on a set of neighboring points in the point cloud also selected according to the ordering. Predicted attribute values and correction values may be determined for the predicted values. The correction values may be encoded as part of a compressed version of the point cloud.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: September 28, 2021
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su
  • Patent number: 11113845
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.
    Type: Grant
    Filed: September 17, 2018
    Date of Patent: September 7, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Khaled Mammou, Yeping Su, Fabrice A. Robinet, David W. Singer
  • Publication number: 20210266597
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.
    Type: Application
    Filed: May 12, 2021
    Publication date: August 26, 2021
    Applicant: Apple Inc.
    Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Fabrice A. Robinet, Yeping Su, David W. Singer
  • Publication number: 20210264640
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.
    Type: Application
    Filed: May 12, 2021
    Publication date: August 26, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Alexandros Tourapis
  • Publication number: 20210258617
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. To compress the attribute information, multiple levels of detail are generated based on an ordering of the points according to a space filling curve and attribute values are predicted. The attribute values may be predicted simultaneously while points are being assigned to different levels of detail. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, attribute correction values may take into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
    Type: Application
    Filed: January 29, 2021
    Publication date: August 19, 2021
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Khaled Mammou
  • Publication number: 20210256735
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.
    Type: Application
    Filed: May 3, 2021
    Publication date: August 19, 2021
    Applicant: Apple Inc.
    Inventors: Alexandros Tourapis, Khaled Mammou, Yeping Su, Jungsun Kim, Valery G. Valentin, David W. Singer, Fabrice A. Robinet, Hsi-Jung Wu
  • Patent number: 11044478
    Abstract: A system comprises an encoder configured to compress images, such as image frames comprising attribute information and/or spatial for a point cloud and/or an occupancy map for the point cloud. Also, a system includes a decoder configured to decompress compressed image frames, such as image frames comprising compressed attribute and/or spatial information for the point cloud or an occupancy map for the point cloud. Additionally, the encoder may map N-bit data to M-bit code words, where M is less than N. Alternatively the encoder may map N-bit data to M-bit code words, where M is greater than N. In a similar manner, a decoder may map the M-bit code words back to the N-bit data.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: June 22, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Jungsun Kim, Fabrice A. Robinet, Khaled Mammou, Valery G. Valentin, Yeping Su
  • Publication number: 20210185331
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may also encode the occupancy map as an image based representation. In some embodiments, a video encoder encodes image based representations of spatial information for the points of the point cloud, image based representations of attribute values for points of the point cloud, and an image based representation of an occupancy map for the spatial and attribute images.
    Type: Application
    Filed: February 26, 2021
    Publication date: June 17, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Valery G. Valentin, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su, Jungsun Kim
  • Publication number: 20210183112
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, multiple levels of detail are generated based on spatial information. Also, attribute values are predicted based on the level of details. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, an update operation is performed to smooth attribute correction values taking into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
    Type: Application
    Filed: January 29, 2021
    Publication date: June 17, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Alexandros Tourapis, Jungsun Kim, Fabrice A. Robinet, Valery G. Valentin, Yeping Su
  • Patent number: 11017566
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: May 25, 2021
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Khaled Mammou, Yeping Su, Jungsun Kim, Valery G. Valentin, David W. Singer, Fabrice A. Robinet, Hsi-Jung Wu
  • Publication number: 20210150766
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.
    Type: Application
    Filed: January 29, 2021
    Publication date: May 20, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Valery G. Valentin, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su, Jungsun Kim
  • Publication number: 20210150765
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.
    Type: Application
    Filed: January 25, 2021
    Publication date: May 20, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su
  • Patent number: 11010928
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: May 18, 2021
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Jungsun Kim, Valery G. Valentin, Fabrice A. Robinet, Yeping Su, Alexandros Tourapis
  • Patent number: 11012713
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: May 18, 2021
    Assignee: Apple Inc.
    Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Fabrice A. Robinet, Yeping Su, David W. Singer
  • Publication number: 20210119640
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.
    Type: Application
    Filed: December 23, 2020
    Publication date: April 22, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet, Alexandros Tourapis, Yeping Su
  • Publication number: 20210118190
    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.
    Type: Application
    Filed: December 4, 2020
    Publication date: April 22, 2021
    Applicant: Apple Inc.
    Inventors: Khaled Mammou, Fabrice A. Robinet