Patents by Inventor Esmaeil Faramarzi

Esmaeil Faramarzi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11924397
    Abstract: A method for generating content includes receiving information regarding electronic devices respectively capturing content associated with an event. The method also includes identifying, based on the received information, one or more parameters for the electronic devices to use in capturing the content, the one or more parameters identified to assist in generating multi-view content for the event from the captured content. The method further includes identifying, based on the received information, a common resolution for the electronic devices to use in capturing the content. Additionally, the method includes identifying, based on the received information, a common frame rate for the electronic devices to use in capturing the content. The method also includes sending information indicating the one or more parameters, the common resolution, and the common frame rate to the electronic devices.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: March 5, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Indranil Sinharoy, Abhishek Sehgal, Nishith Tripathi, Madhukar Budagavi, Esmaeil Faramarzi
  • Patent number: 11665372
    Abstract: An encoding device and a method for point cloud encoding are disclosed. The method for encoding includes segmenting an area including points representing a three-dimensional (3D) point cloud into multiple voxels. The method also includes identifying a normal score for each of the points of the 3D point cloud and a smoothing score for each of the multiple voxels that include at least one of the points of the 3D point cloud. The method further includes grouping each point of the 3D point cloud to one of multiple projection planes based on the normal score and the smoothing score to generate refined patches that represent the 3D point cloud. Additionally, the method includes generating frames that include pixels that represent the refined patches. The method also includes encoding the frames to generate a bitstream and transmitting the bitstream.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: May 30, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Esmaeil Faramarzi, Madhukar Budagavi
  • Patent number: 11514613
    Abstract: An decoding device, an encoding device and a method for point cloud encoding is disclosed. The method includes generating, from a three-dimensional point cloud, multiple two-dimensional frames, the two-dimensional frames including at least a first frame representing a geometry of points in the three-dimensional point cloud and a second frame representing texture of points in the three-dimensional point cloud. The method also includes generating an occupancy map indicating locations of pixels in the two-dimensional frames that represent points in the three-dimensional point cloud. The method further includes encoding the two-dimensional frames and the occupancy map to generate a compressed bitstream. The method also includes transmitting the compressed bitstream.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: November 29, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Esmaeil Faramarzi, Tuan Ho
  • Patent number: 11393132
    Abstract: An encoding device, a decoding device, and a method for mesh decoding are disclosed. The method for mesh decoding includes receiving a compressed bitstream. The method also includes separating, from the compressed bitstream, a first bitstream and a second bitstream. The method further includes decoding, from the second bitstream, connectivity information of a three dimensional (3D) mesh. The method additionally includes decoding, from the first bitstream, a first frame and a second frame that include patches. The patches included in the first frame represent vertex coordinates of the 3D mesh and the patches included in the second frame represent a vertex attribute of the 3D mesh. The method also includes reconstructing a point cloud based on the first and second frames. Additionally, the method also includes applying the connectivity information to the point cloud to reconstruct the 3D mesh.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: July 19, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Esmaeil Faramarzi, Madhukar Budagavi, Rajan Laxman Joshi, Hossein Najaf-Zadeh, Indranil Sinharoy
  • Patent number: 11373338
    Abstract: An encoding device and a method for point cloud encoding are disclosed. The method includes generating, for a 3D point cloud, an attribute frame and an occupancy map. The method also includes reducing a resolution of the frames over a number of sequential steps, until the frames are a predetermined size. After the frames are reduced to the predetermined size, the method includes increasing the resolution of the frames over the number of sequential steps while adding padding to modify at least some of the pixels in the attribute frame that do not represent points of the 3D point cloud. While the resolution of the attribute frame is incrementally increased, the method includes performing smoothing on the pixels in the attribute frame that do not represent the points of the 3D point cloud. The method additionally includes encoding the frames to generate a bitstream and then transmitting the bitstream.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: June 28, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Esmaeil Faramarzi, Madhukar Budagavi
  • Publication number: 20220164994
    Abstract: An encoding device, a decoding device, and a method for mesh decoding are disclosed. The method for mesh decoding includes receiving a bitstream. The method also includes decoding a frame that includes pixels from the bitstream. A portion of the pixels of the frame represent geometric locations of vertices of a 3D mesh that are organized into overlapped patches The method further includes decoding connectivity information from the bitstream. Additionally, the method includes identifying triangles associated with the overlapped patches The triangles represented in an overlapped patch of the overlapped patches are allocated to a projection direction based on a normal vector associated with each of the triangles of the overlapped patch. The method also includes reconstructing the 3D mesh based on the connectivity information and the overlapped patches.
    Type: Application
    Filed: November 22, 2021
    Publication date: May 26, 2022
    Inventors: Rajan Laxman Joshi, Esmaeil Faramarzi, Madhukar Budagavi
  • Publication number: 20220058833
    Abstract: An encoding device and a method for point cloud encoding are disclosed. The method includes segmenting an area including points representing a three-dimensional (3D) point cloud into multiple voxels. The method also includes generating a patch information for each of the multiple voxels that include at least one of the points of the 3D point cloud. The method further includes assigning the patch information of the multiple voxels to the points included in each respective voxel, to generate patches that represent the 3D point cloud. Additionally, the method includes generating frames that include pixels that represent the patches. The method also includes encoding the frames to generate a bitstream and transmitting the bitstream.
    Type: Application
    Filed: August 18, 2021
    Publication date: February 24, 2022
    Inventors: Esmaeil Faramarzi, Madhukar Budagavi, Rajan Laxman Joshi
  • Publication number: 20220030214
    Abstract: A method for generating content includes receiving information regarding electronic devices respectively capturing content associated with an event. The method also includes identifying, based on the received information, one or more parameters for the electronic devices to use in capturing the content, the one or more parameters identified to assist in generating multi-view content for the event from the captured content. The method further includes identifying, based on the received information, a common resolution for the electronic devices to use in capturing the content. Additionally, the method includes identifying, based on the received information, a common frame rate for the electronic devices to use in capturing the content. The method also includes sending information indicating the one or more parameters, the common resolution, and the common frame rate to the electronic devices.
    Type: Application
    Filed: July 20, 2021
    Publication date: January 27, 2022
    Inventors: Indranil Sinharoy, Abhishek Sehgal, Nishith Tripathi, Madhukar Budagavi, Esmaeil Faramarzi
  • Patent number: 11216984
    Abstract: An encoding device and methods for point cloud encoding are disclosed. The method for encoding includes generating, using a processor of an encoder, a first frame and a second frame that include patches representing a cluster of points of three-dimensional (3D) point cloud; identifying a patch to segment in the patches of the first frame and the second frame; determining, in response to identifying the patch, a path representing a boundary between segmented regions within the patch; segmenting the patch along the path into two patches for the first frame and the second frame; encoding the first frame and the second frame to generate a compressed bitstream; and transmitting, using a communication interface operably coupled to the processor, the compressed bitstream.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: January 4, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Indranil Sinharoy, Esmaeil Faramarzi, Madhukar Budagavi
  • Patent number: 10853974
    Abstract: A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes receiving a compressed bitstream. The method also includes decoding the compressed bitstream into 2-D frames that represent a 3-D point cloud. Each of the 2-D frames including a set of patches, and each patch includes a cluster of points of the 3-D point cloud. The cluster of points corresponds to an attribute associated with the 3-D point cloud. One patch of the set of patches, the set of patches, and the 2-D frames correspond to respective access levels representing the 3-D point cloud. The method also includes identifying a first and a second flag. In response to identifying the first and the second flag, the method includes reading the metadata from the bitstream. The method further includes generating, based on metadata and using the sets of 2-D frames, the 3-D point cloud.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: December 1, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Esmaeil Faramarzi, Rajan Joshi, Hossein Najaf-Zadeh
  • Publication number: 20200286261
    Abstract: An encoding device, a decoding device, and a method for mesh decoding are disclosed. The method for mesh decoding includes receiving a compressed bitstream. The method also includes separating, from the compressed bitstream, a first bitstream and a second bitstream. The method further includes decoding, from the second bitstream, connectivity information of a three dimensional (3D) mesh. The method additionally includes decoding, from the first bitstream, a first frame and a second frame that include patches. The patches included in the first frame represent vertex coordinates of the 3D mesh and the patches included in the second frame represent a vertex attribute of the 3D mesh. The method also includes reconstructing a point cloud based on the first and second frames. Additionally, the method also includes applying the connectivity information to the point cloud to reconstruct the 3D mesh.
    Type: Application
    Filed: March 5, 2020
    Publication date: September 10, 2020
    Inventors: Esmaeil Faramarzi, Madhukar Budagavi, Rajan Laxman Joshi, Hossein Najaf-Zadeh, Indranil Sinharoy
  • Publication number: 20200221134
    Abstract: An encoding device and a method for point cloud encoding are disclosed. The method for encoding includes segmenting an area including points representing a three-dimensional (3D) point cloud into multiple voxels. The method also includes identifying a normal score for each of the points of the 3D point cloud and a smoothing score for each of the multiple voxels that include at least one of the points of the 3D point cloud. The method further includes grouping each point of the 3D point cloud to one of multiple projection planes based on the normal score and the smoothing score to generate refined patches that represent the 3D point cloud. Additionally, the method includes generating frames that include pixels that represent the refined patches. The method also includes encoding the frames to generate a bitstream and transmitting the bitstream.
    Type: Application
    Filed: January 3, 2020
    Publication date: July 9, 2020
    Inventors: Esmaeil Faramarzi, Madhukar Budagavi
  • Publication number: 20200219286
    Abstract: An encoding device and methods for point cloud encoding are disclosed. The method for encoding includes generating, using a processor of an encoder, a first frame and a second frame that include patches representing a cluster of points of three-dimensional (3D) point cloud; identifying a patch to segment in the patches of the first frame and the second frame; determining, in response to identifying the patch, a path representing a boundary between segmented regions within the patch; segmenting the patch along the path into two patches for the first frame and the second frame; encoding the first frame and the second frame to generate a compressed bitstream; and transmitting, using a communication interface operably coupled to the processor, the compressed bitstream.
    Type: Application
    Filed: January 3, 2020
    Publication date: July 9, 2020
    Inventors: Indranil Sinharoy, Esmaeil Faramarzi, Madhukar Budagavi
  • Publication number: 20200219285
    Abstract: An encoding device and a method for point cloud encoding are disclosed. The method includes generating, for a 3D point cloud, an attribute frame and an occupancy map. The method also includes reducing a resolution of the frames over a number of sequential steps, until the frames are a predetermined size. After the frames are reduced to the predetermined size, the method includes increasing the resolution of the frames over the number of sequential steps while adding padding to modify at least some of the pixels in the attribute frame that do not represent points of the 3D point cloud. While the resolution of the attribute frame is incrementally increased, the method includes performing smoothing on the pixels in the attribute frame that do not represent the points of the 3D point cloud. The method additionally includes encoding the frames to generate a bitstream and then transmitting the bitstream.
    Type: Application
    Filed: December 31, 2019
    Publication date: July 9, 2020
    Inventors: Esmaeil Faramarzi, Madhukar Budagavi
  • Publication number: 20200151913
    Abstract: A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes receiving a compressed bitstream. The method also includes decoding the compressed bitstream into 2-D frames that represent a 3-D point cloud. Each of the 2-D frames including a set of patches, and each patch includes a cluster of points of the 3-D point cloud. The cluster of points corresponds to an attribute associated with the 3-D point cloud. One patch of the set of patches, the set of patches, and the 2-D frames correspond to respective access levels representing the 3-D point cloud. The method also includes identifying a first and a second flag. In response to identifying the first and the second flag, the method includes reading the metadata from the bitstream. The method further includes generating, based on metadata and using the sets of 2-D frames, the 3-D point cloud.
    Type: Application
    Filed: January 13, 2020
    Publication date: May 14, 2020
    Inventors: Madhukar Budagavi, Esmaeil Faramarzi, Rajan Joshi, Hossein Najaf-Zadeh
  • Patent number: 10535161
    Abstract: A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes receiving a compressed bitstream. The method also includes decoding the compressed bitstream into 2-D frames that represent a 3-D point cloud. Each of the 2-D frames including a set of patches, and each patch includes a cluster of points of the 3-D point cloud. The cluster of points corresponds to an attribute associated with the 3-D point cloud. One patch of the set of patches, the set of patches, and the 2-D frames correspond to respective access levels representing the 3-D point cloud. The method also includes identifying a first and a second flag. In response to identifying the first and the second flag, the method includes reading the metadata from the bitstream. The method further includes generating, based on metadata and using the sets of 2-D frames, the 3-D point cloud.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: January 14, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Esmaeil Faramarzi, Rajan Joshi, Hossein Najaf-Zadeh
  • Patent number: 10424083
    Abstract: A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes decoding the compressed bitstream into a first set and second set of 2-D frames. The first set of 2-D frames include first set of regular patches representing geometry of a 3-D point cloud and the second set of 2-D frames include first set of regular patches representing texture of the 3-D point cloud. The method includes identifying in the first set of 2-D frames, a missed points patch representing geometry of points of the 3-D point cloud not included in the regular patches, and in the second set of 2-D frames a missed points patch that represents texture of the points of the 3-D point cloud not included in the regular patches. The method also includes generating, using the set of 2-D frames, the 3-D point cloud using the missed points patches.
    Type: Grant
    Filed: October 19, 2018
    Date of Patent: September 24, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Indranil Sinharoy, Madhukar Budagavi, Youngkwon Lim, Hossein Najaf-Zadeh, Sungryeul Rhyu, Esmaeil Faramarzi
  • Publication number: 20190139266
    Abstract: A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes receiving a compressed bitstream. The method also includes decoding the compressed bitstream into 2-D frames that represent a 3-D point cloud. Each of the 2-D frames including a set of patches, and each patch includes a cluster of points of the 3-D point cloud. The cluster of points corresponds to an attribute associated with the 3-D point cloud. One patch of the set of patches, the set of patches, and the 2-D frames correspond to respective access levels representing the 3-D point cloud. The method also includes identifying a first and a second flag. In response to identifying the first and the second flag, the method includes reading the metadata from the bitstream. The method further includes generating, based on metadata and using the sets of 2-D frames, the 3-D point cloud.
    Type: Application
    Filed: November 6, 2018
    Publication date: May 9, 2019
    Inventors: Madhukar Budagavi, Esmaeil Faramarzi, Rajan Joshi, Hossein Najaf-Zadeh
  • Publication number: 20190122393
    Abstract: A decoding device, an encoding device and a method for point cloud decoding is disclosed. The method includes decoding the compressed bitstream into a first set and second set of 2-D frames. The first set of 2-D frames include first set of regular patches representing geometry of a 3-D point cloud and the second set of 2-D frames include first set of regular patches representing texture of the 3-D point cloud. The method includes identifying in the first set of 2-D frames, a missed points patch representing geometry of points of the 3-D point cloud not included in the regular patches, and in the second set of 2-D frames a missed points patch that represents texture of the points of the 3-D point cloud not included in the regular patches. The method also includes generating, using the set of 2-D frames, the 3-D point cloud using the missed points patches.
    Type: Application
    Filed: October 19, 2018
    Publication date: April 25, 2019
    Inventors: Indranil Sinharoy, Madhukar Budagavi, Youngkwon Lim, Hossein Najaf-Zadeh, Sungryeul Rhyu, Esmaeil Faramarzi
  • Patent number: 10192297
    Abstract: A user equipment includes a modem receives a compressed bitstream and metadata. The UE also includes a decoder that decodes the compressed bitstream to generate an HDR image, an inertial measurement unit that determines viewpoint information based on an orientation of the UE, and a graphics processing unit (GPU). The GPU maps the HDR image onto a surface and renders a portion of the HDR image based on the metadata and the viewpoint information. A display displays the portion of the HDR image.
    Type: Grant
    Filed: September 1, 2016
    Date of Patent: January 29, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Hossein Najaf-Zadeh, Esmaeil Faramarzi, Ankur Saxena