Patents by Inventor Dibyendu Mukherjee

Dibyendu Mukherjee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230267646
    Abstract: A method of the present disclosure includes (a) extracting distinctive features used for respectively distinguishing a plurality of similar attitudes from which images similar to one another are obtained using a simulation model of an object, (b) capturing an object image of the object using a camera, (c) estimating a position and an attitude of the object using the object image, and (d) when the estimated attitude corresponds to one of the plurality of similar attitudes, determining the one of the plurality of similar attitudes as the attitude of the object using the distinctive features.
    Type: Application
    Filed: February 21, 2023
    Publication date: August 24, 2023
    Inventors: Masaki HAYASHI, Jian YAO, Dibyendu MUKHERJEE, Andrei Mark ROTENSTEIN
  • Patent number: 11475242
    Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method. The method includes selecting a 3D model corresponding to an object, and generating a first 2D image of the 3D model in a first pose. The method further includes generating a second 2D image of the 3D model in the first pose, the second 2D image having a different texture on the 3D model than the first 2D image. The method further includes, using an algorithm, determining a first location of a first feature on the 3D model in the first 2D image and a second location of a second feature on the 3D model in the second 2D image. The method further includes calculating a difference based on the first location and the second location. The method further includes adjusting parameters representing the algorithm based on the calculated difference.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: October 18, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Dibyendu Mukherjee, Chen Xuan Cui
  • Patent number: 11430151
    Abstract: A non-transitory computer readable medium storing instructions to cause one or more processors to acquire an image data sequence containing images of an object in a scene along time and track a pose of the object through an object pose tracking algorithm. The processor may further, acquire a first pose of the object in a first image of the image data sequence, the first pose being a result of tracking a pose of the object through an object pose tracking algorithm, verify the first pose, extract 2D features of the object from the first image when the first pose is verified, and store a training dataset containing the extracted 2D features and the corresponding verified first pose in the one or more memories or other one or more memories.
    Type: Grant
    Filed: July 13, 2020
    Date of Patent: August 30, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Mirza Tahir Ahmed, Yan He, Dibyendu Mukherjee
  • Publication number: 20220115674
    Abstract: Compositions, systems, and methods for producing nanoalloys and/or nanocomposites using tandem laser ablation synthesis in solution-galvanic replacement reaction (LASiS-GRR) are disclosed. The method may include disposing a first metal composition within a reaction cell, adding a quantity of a second metal composition into the reaction cell, ablating, with a laser, the first metal composition disposed in the quantity of the second metal composition within the reaction cell, and tuning one or more reaction parameter and/or one or more functional parameter during the tandem LASiS-GRR in order to tailor at least one characteristic of the metal nanoalloy and/or the metal nanocomposite.
    Type: Application
    Filed: September 20, 2021
    Publication date: April 14, 2022
    Inventors: Dibyendu Mukherjee, Sheng Hu
  • Publication number: 20220027671
    Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method. The method includes selecting a 3D model corresponding to an object, and generating a first 2D image of the 3D model in a first pose. The method further includes generating a second 2D image of the 3D model in the first pose, the second 2D image having a different texture on the 3D model than the first 2D image. The method further includes, using an algorithm, determining a first location of a first feature on the 3D model in the first 2D image and a second location of a second feature on the 3D model in the second 2D image. The method further includes calculating a difference based on the first location and the second location. The method further includes adjusting parameters representing the algorithm based on the calculated difference.
    Type: Application
    Filed: July 27, 2020
    Publication date: January 27, 2022
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Dibyendu MUKHERJEE, Chen Xuan CUI
  • Patent number: 11127956
    Abstract: Compositions, systems, and methods for producing nanoalloys and/or nanocomposites using tandem laser ablation synthesis in solution-galvanic replacement reaction (LASiS-GRR) are disclosed. The method may include disposing a first metal composition within a reaction cell, adding a quantity of a second metal composition into the reaction cell, ablating, with a laser, the first metal composition disposed in the quantity of the second metal composition within the reaction cell, and tuning one or more reaction parameter and/or one or more functional parameter during the tandem LASiS-GRR in order to tailor at least one characteristic of the metal nanoalloy and/or the metal nanocomposite.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: September 21, 2021
    Inventors: Dibyendu Mukherjee, Sheng Hu
  • Patent number: 11107241
    Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method. The method includes selecting a 3D model corresponding to an object. The method further includes generating domain-adapted images of the 3D model, the domain-adapted images representing the 3D model at corresponding poses. The method further includes acquiring 2D projections of 3D points on a 3D bounding box defined around the 3D model at the corresponding poses. The method further includes training an algorithm model to learn correspondences between the generated images and the corresponding 2D projections. The method further includes storing, in a memory, parameters representing the algorithm model.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: August 31, 2021
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Dibyendu Mukherjee, Bowen Chen, Juhan Bae
  • Publication number: 20210232858
    Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method for training an object detection algorithm. The method includes: (a) selecting a 3D model corresponding to an object; (b) acquiring images of the 3D model, the images being obtained by rendering the 3D model at respective poses; (c) acquiring 2D projections of 3D points on the 3D model at the respective poses; and (d) storing, in a memory, an association between the acquired 2D projections and the respective poses.
    Type: Application
    Filed: January 23, 2020
    Publication date: July 29, 2021
    Applicant: SEIKO EPSON CORPORATION
    Inventor: Dibyendu MUKHERJEE
  • Publication number: 20210224591
    Abstract: An exemplary method includes generating a first image containing a model image based on a 3D model at a pose. Second images are acquired containing an image not containing the model image. Training image patches are extracted from the first and second images, each training image patch being associated with a class representing whether the corresponding image patch contains at least a part of the model image. An algorithm model is trained with the training image patches and the respective classes to derive the model image's position relative to the first image. Parameters defining the trained algorithm model are stored. Another exemplary method includes a camera acquiring an image containing an object in a scene. An enhancement filter is applied to the acquired image. Image patches are extracted from the filtered image. The object's position is determined in the image by applying the trained algorithm model to the image patches.
    Type: Application
    Filed: January 17, 2020
    Publication date: July 22, 2021
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Dibyendu MUKHERJEE, Syed Alimul HUDA
  • Publication number: 20210134007
    Abstract: A non-transitory computer readable medium storing instructions to cause one or more processors to acquire an image data sequence containing images of an object in a scene along time and track a pose of the object through an object pose tracking algorithm. The processor may further, acquire a first pose of the object in a first image of the image data sequence, the first pose being a result of tracking a pose of the object through an object pose tracking algorithm, verify the first pose, extract 2D features of the object from the first image when the first pose is verified, and store a training dataset containing the extracted 2D features and the corresponding verified first pose in the one or more memories or other one or more memories.
    Type: Application
    Filed: July 13, 2020
    Publication date: May 6, 2021
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Mirza Tahir AHMED, Yan HE, Dibyendu MUKHERJEE
  • Patent number: 10878285
    Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method. The method includes: (A) receiving, in one or more memories, a 3D model corresponding to an object, and (B) setting a depth sensor characteristic data set for a depth sensor for use in detecting a pose of the object in a real scene. The method also includes (C) generating blurred 2.5D representation data of the 3D model for at least one view around the 3D model based on the 3D model and the depth sensor characteristic data set, to generate, on the basis of the 2.5D representation data, training data for training an object detection algorithm, and (D) storing the training data in one or more memories.
    Type: Grant
    Filed: April 12, 2018
    Date of Patent: December 29, 2020
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Mirza Tahir Ahmed, Dibyendu Mukherjee, Jie Wang
  • Publication number: 20200380723
    Abstract: A non-transitory computer readable medium storing instructions to cause one or more processors to acquire, from a camera or one or more memory storing an image data sequence captured by the camera, the image data sequence containing images of an object in a scene along a time. The instructions further cause the one or more processors to track a pose of the object through an object pose tracking algorithm and during the tracking of the pose, acquire a first pose of the object in a first image of the image data sequence. The instructions further cause the one or more processor to, during the tracking, extract two-dimensional (2D) features of the object from the first image, and store a training dataset containing the extracted 2D features and the corresponding first pose in the one or more memories or other one or more memories.
    Type: Application
    Filed: May 28, 2020
    Publication date: December 3, 2020
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Dibyendu MUKHERJEE, Mirza Tahir AHMED, Ariel Shlomo KELMAN
  • Patent number: 10769437
    Abstract: A head-mounted display, a method, and a non-transitory computer readable medium are provided. An embodiment of a method for obtaining training sample views of an object includes the step of storing, in a memory, multiple views of an object. The method also includes the step of deriving similarity scores between adjacent views and then a sampling density is varied based on the similarity scores.
    Type: Grant
    Filed: April 10, 2018
    Date of Patent: September 8, 2020
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Dibyendu Mukherjee, Jia Li, Mikhail Brusnitsyn, Irina Kezele
  • Patent number: 10755434
    Abstract: A method includes acquiring, from a camera, an image data sequence of a real object in a real scene and performing a first template-matching on an image frame in the image data sequence using intensity-related data sets stored in one or more memories to generate response maps. The intensity-related data sets represent an intensity distribution of a reference object from respective viewpoints. The reference object corresponds to the real object. A candidate region of interest is determined for the real object in the image frame based on the response maps, and second template-matching is performed on the candidate region of interest using shape-related feature data sets stored in one or more memories to derive a pose of the real object. The shape-related feature data sets represent edge information of the reference object from the respective viewpoints.
    Type: Grant
    Filed: March 28, 2018
    Date of Patent: August 25, 2020
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Dibyendu Mukherjee, Irina Kezele, Mikhail Brusnitsyn
  • Publication number: 20200184678
    Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method. The method includes selecting a 3D model corresponding to an object. The method further includes generating domain-adapted images of the 3D model, the domain-adapted images representing the 3D model at corresponding poses. The method further includes acquiring 2D projections of 3D points on a 3D bounding box defined around the 3D model at the corresponding poses. The method further includes training an algorithm model to learn correspondences between the generated images and the corresponding 2D projections. The method further includes storing, in a memory, parameters representing the algorithm model.
    Type: Application
    Filed: December 11, 2019
    Publication date: June 11, 2020
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Dibyendu MUKHERJEE, Bowen CHEN, Juhan BAE
  • Publication number: 20190334180
    Abstract: Compositions, systems, and methods for producing nanoalloys and/or nanocomposites using tandem laser ablation synthesis in solution-galvanic replacement reaction (LASiS-GRR) are disclosed. The method may include disposing a first metal composition within a reaction cell, adding a quantity of a second metal composition into the reaction cell, ablating, with a laser, the first metal composition disposed in the quantity of the second metal composition within the reaction cell, and tuning one or more reaction parameter and/or one or more functional parameter during the tandem LASiS-GRR in order to tailor at least one characteristic of the metal nanoalloy and/or the metal nanocomposite.
    Type: Application
    Filed: June 12, 2019
    Publication date: October 31, 2019
    Inventors: Dibyendu Mukherjee, Sheng Hu
  • Publication number: 20190318201
    Abstract: A non-transitory computer readable medium embodies instructions that cause one or more processors to perform a method. The method includes: (A) receiving, in one or more memories, a 3D model corresponding to an object, and (B) setting a depth sensor characteristic data set for a depth sensor for use in detecting a pose of the object in a real scene. The method also includes (C) generating blurred 2.5D representation data of the 3D model for at least one view around the 3D model based on the 3D model and the depth sensor characteristic data set, to generate, on the basis of the 2.5D representation data, training data for training an object detection algorithm, and (D) storing the training data in one or more memories.
    Type: Application
    Filed: April 12, 2018
    Publication date: October 17, 2019
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Mirza Tahir AHMED, Dibyendu MUKHERJEE, Jie WANG
  • Publication number: 20190311199
    Abstract: A head-mounted display, a method, and a non-transitory computer readable medium are provided. An embodiment of a method for obtaining training sample views of an object includes the step of storing, in a memory, multiple views of an object. The method also includes the step of deriving similarity scores between adjacent views and then a sampling density is varied based on the similarity scores.
    Type: Application
    Filed: April 10, 2018
    Publication date: October 10, 2019
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Dibyendu MUKHERJEE, Jia LI, Mikhail BRUSNITSYN, Irina KEZELE
  • Publication number: 20190304124
    Abstract: A method includes acquiring, from a camera, an image data sequence of a real object in a real scene and performing a first template-matching on an image frame in the image data sequence using intensity-related data sets stored in one or more memories to generate response maps. The intensity-related data sets represent an intensity distribution of a reference object from respective viewpoints. The reference object corresponds to the real object. A candidate region of interest is determined for the real object in the image frame based on the response maps, and second template-matching is performed on the candidate region of interest using shape-related feature data sets stored in one or more memories to derive a pose of the real object. The shape-related feature data sets represent edge information of the reference object from the respective viewpoints.
    Type: Application
    Filed: March 28, 2018
    Publication date: October 3, 2019
    Applicant: SEIKO EPSON CORPORATION
    Inventors: Dibyendu MUKHERJEE, Irina KEZELE, Mikhail BRUSNITSYN
  • Patent number: 10326146
    Abstract: Compositions, systems, and methods for producing nanoalloys and/or nanocomposites using tandem laser ablation synthesis in solution-galvanic replacement reaction (LASiS-GRR) are disclosed. The method may include disposing a first metal composition within a reaction cell, adding a quantity of a second metal composition into the reaction cell, ablating, with a laser, the first metal composition disposed in the quantity of the second metal composition within the reaction cell, and tuning one or more reaction parameter and/or one or more functional parameter during the tandem LASiS-GRR in order to tailor at least one characteristic of the metal nanoalloy and/or the metal nanocomposite.
    Type: Grant
    Filed: April 19, 2016
    Date of Patent: June 18, 2019
    Inventors: Dibyendu Mukherjee, Sheng Hu