Patents by Inventor Priyam Chatterjee
Priyam Chatterjee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11983893Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: GrantFiled: January 12, 2023Date of Patent: May 14, 2024Assignee: Adeia Imaging LLCInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
Publication number: 20230336707Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: ApplicationFiled: December 28, 2022Publication date: October 19, 2023Applicant: Adeia Imaging LLCInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Publication number: 20230334687Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: ApplicationFiled: January 12, 2023Publication date: October 19, 2023Applicant: Adeia Imaging LLCInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
Publication number: 20230098356Abstract: A computer-implemented method for identifying candidate videos for audio experiences may include (i) identifying a video with audio content that is a candidate for an audio-primary user experience that enables users to consume the video by listening to the audio content without watching visual content of the video, (ii) determining, at least in part by analyzing the video via a machine learning algorithm, that the audio content of the video is suitable for the audio-primary user experience, and (iii) presenting the audio content of the video to at least one user via an interface designed for the audio-primary user experience in response to determining that the audio content of the video is suitable for the audio-primary user experience. Various other methods, systems, and computer-readable media are also disclosed.Type: ApplicationFiled: September 30, 2021Publication date: March 30, 2023Inventors: Sonal Gandhi, Priyam Chatterjee, Nader Hamekasi
-
Patent number: 11562498Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: GrantFiled: October 23, 2020Date of Patent: January 24, 2023Assignee: Adela Imaging LLCInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
Patent number: 11546576Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: GrantFiled: March 8, 2021Date of Patent: January 3, 2023Assignee: Adeia Imaging LLCInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Patent number: 11170470Abstract: Techniques are described for content-adaptive downsampling of digital images and videos for computer vision operations, such as semantic segmentation. A computer vision system comprises a memory, one or more processors operably coupled to the memory and a downsampling module configured for execution by the one or more processors to perform, based on a non-uniform sampling model trained to predict content-aware sampling parameters, downsampling input image data to generate downsampled image data. A segmentation module is configured for execution by the one or more processors to perform segmentation on the downsampled image to produce a segmentation result, such as a feature map that assigns pixels of the downsampled image data to object classes. An upsampling module is configured for execution by the one or more processors to perform upsampling according to the segmentation result to produce upsampled image data.Type: GrantFiled: December 6, 2019Date of Patent: November 9, 2021Assignee: Facebook, Inc.Inventors: Zijian He, Peter Vajda, Priyam Chatterjee, Shanghsuan Tsai, Dmitrii Marin
-
Publication number: 20210281828Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: ApplicationFiled: March 8, 2021Publication date: September 9, 2021Applicant: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Patent number: 10944961Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: GrantFiled: April 1, 2019Date of Patent: March 9, 2021Assignee: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Publication number: 20210042952Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: ApplicationFiled: October 23, 2020Publication date: February 11, 2021Applicant: FotoNation LimitedInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
Patent number: 10818026Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: GrantFiled: November 15, 2019Date of Patent: October 27, 2020Assignee: FotoNation LimitedInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
Publication number: 20200151894Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: ApplicationFiled: November 15, 2019Publication date: May 14, 2020Applicant: FotoNation LimitedInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
Patent number: 10574905Abstract: Systems and methods in accordance with embodiments of this invention perform depth regularization and semiautomatic interactive matting using images. In an embodiment of the invention, the image processing pipeline application directs a processor to receive (i) an image (ii) an initial depth map corresponding to the depths of pixels within the image, regularize the initial depth map into a dense depth map using depth values of known pixels to compute depth values of unknown pixels, determine an object of interest to be extracted from the image, generate an initial trimap using the dense depth map and the object of interest to be extracted from the image, and apply color image matting to unknown regions of the initial trimap to generate a matte for image matting.Type: GrantFiled: October 1, 2018Date of Patent: February 25, 2020Assignee: FotoNation LimitedInventors: Manohar Srikanth, Ravi Ramamoorthi, Kartik Venkataraman, Priyam Chatterjee -
Patent number: 10482618Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: GrantFiled: August 21, 2017Date of Patent: November 19, 2019Assignee: FotoNation LimitedInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
Publication number: 20190230348Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: ApplicationFiled: April 1, 2019Publication date: July 25, 2019Applicant: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Patent number: 10250871Abstract: Systems and methods for dynamically calibrating an array camera to accommodate variations in geometry that can occur throughout its operational life are disclosed. The dynamic calibration processes can include acquiring a set of images of a scene and identifying corresponding features within the images. Geometric calibration data can be used to rectify the images and determine residual vectors for the geometric calibration data at locations where corresponding features are observed. The residual vectors can then be used to determine updated geometric calibration data for the camera array. In several embodiments, the residual vectors are used to generate a residual vector calibration data field that updates the geometric calibration data. In many embodiments, the residual vectors are used to select a set of geometric calibration from amongst a number of different sets of geometric calibration data that is the best fit for the current geometry of the camera array.Type: GrantFiled: September 29, 2015Date of Patent: April 2, 2019Assignee: FotoNation LimitedInventors: Florian Ciurea, Dan Lelescu, Priyam Chatterjee
-
Publication number: 20190057513Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.Type: ApplicationFiled: August 21, 2017Publication date: February 21, 2019Applicant: FotoNation Cayman LimitedInventors: Ankit Jain, Priyam Chatterjee, Kartik Venkataraman
-
SYSTEM AND METHODS FOR DEPTH REGULARIZATION AND SEMIAUTOMATIC INTERACTIVE MATTING USING RGB-D IMAGES
Publication number: 20190037150Abstract: Systems and methods in accordance with embodiments of this invention perform depth regularization and semiautomatic interactive matting using images. In an embodiment of the invention, the image processing pipeline application directs a processor to receive (i) an image (ii) an initial depth map corresponding to the depths of pixels within the image, regularize the initial depth map into a dense depth map using depth values of known pixels to compute depth values of unknown pixels, determine an object of interest to be extracted from the image, generate an initial trimap using the dense depth map and the object of interest to be extracted from the image, and apply color image matting to unknown regions of the initial trimap to generate a matte for image matting.Type: ApplicationFiled: October 1, 2018Publication date: January 31, 2019Inventors: Manohar SRIKANTH, Ravi RAMAMOORTHI, Kartik VENKATARAMAN, Priyam CHATTERJEE -
System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
Patent number: 10089740Abstract: Systems and methods in accordance with embodiments of this invention perform depth regularization and semiautomatic interactive matting using images. In an embodiment of the invention, the image processing pipeline application directs a processor to receive (i) an image (ii) an initial depth map corresponding to the depths of pixels within the image, regularize the initial depth map into a dense depth map using depth values of known pixels to compute depth values of unknown pixels, determine an object of interest to be extracted from the image, generate an initial trimap using the dense depth map and the object of interest to be extracted from the image, and apply color image matting to unknown regions of the initial trimap to generate a matte for image matting.Type: GrantFiled: March 9, 2015Date of Patent: October 2, 2018Assignee: FotoNation LimitedInventors: Manohar Srikanth, Ravi Ramamoorthi, Kartik Venkataraman, Priyam Chatterjee -
Systems and methods for performing high speed video capture and depth estimation using array cameras
Patent number: 9942474Abstract: High speed video capture and depth estimation using array cameras is disclosed. Real world scenes typically include objects located at different distances from a camera. Therefore, estimating depth during video capture by an array camera can result in smoother rendering of video from image data captured of real world scenes. One embodiment of the invention includes cameras that capture images from different viewpoints, and an image processing pipeline application that obtains images from groups of cameras, where each group of cameras starts capturing image data at a staggered start time relative to the other groups of cameras. The application then selects a reference viewpoint and determines scene-dependent geometric corrections that shift pixels captured from an alternate viewpoint to the reference viewpoint by performing disparity searches to identify the disparity at which pixels from the different viewpoints are most similar. The corrections can then be used to render frames of video.Type: GrantFiled: April 17, 2015Date of Patent: April 10, 2018Assignee: FotoNation Cayman LimitedInventors: Kartik Venkataraman, Yusong Huang, Ankit K. Jain, Priyam Chatterjee