Patents by Inventor Silvio Savarese

Silvio Savarese has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240118937
    Abstract: Embodiments herein relate to prediction, based on previous usage of a cloud-based computing resource by a user of one or more users of the cloud-based computing resource, future usage of the cloud-based computing resource. Based on the predicted future usage, embodiments relate to identifying that throttling of access to the cloud-based computing resource is to occur, and notifying the user of the throttling. Other embodiments may be described and/or claimed.
    Type: Application
    Filed: October 7, 2022
    Publication date: April 11, 2024
    Applicant: Salesforce, Inc.
    Inventors: Bo Zong, Huan Wang, Tian Lan, Ran Yao, Tony Wong, Daeki Cho, Caiming Xiong, Silvio Savarese, Yingbo Zhou
  • Publication number: 20230226696
    Abstract: Methods and systems to remotely operate robotic devices are provided. A number of embodiments allow users to remotely operate robotic devices using generalized consumer devices (e.g., cell phones). Additional embodiments provide for a platform to allow communication between consumer devices and the robotic devices. Further embodiments allow for training robotic devices to operate autonomously by training the robotic device with machine learning algorithms using data collected from scalable methods of controlling robotic devices.
    Type: Application
    Filed: November 2, 2020
    Publication date: July 20, 2023
    Applicant: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Ajay U. Mandlekar, Yuke Zhu, Animesh Garg, Silvio Savarese, Fei-Fei Li
  • Patent number: 11301775
    Abstract: A data annotation apparatus for machine learning is provided, which includes a stimulus generation portion, a biometrics reading portion, and a data integration portion. The stimulus generation portion is configured to generate, and present to an agent, at least one stimulus based on a first data from a first machine learning dataset. The biometrics reading portion is configured to measure at least one response of the agent to the at least one stimulus, and to generate biometrics data based on the at least one response. The data integration portion is configured to integrate the biometrics data, data of the at least one stimulus, and data of the first machine learning dataset to thereby obtain a second machine learning dataset. The data annotation apparatus can result in an improved data labeling and an enhanced machine learning.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: April 12, 2022
    Assignee: CloudMinds Robotics Co., Ltd.
    Inventors: Qiang Li, Silvio Savarese, Charles Robert Jankowski, Jr., William Xiao-Qing Huang, Zhe Zhang, Xiaoli Fern
  • Patent number: 11004202
    Abstract: Systems and methods for obtaining 3D point-level segmentation of 3D point clouds in accordance with various embodiments of the invention are disclosed. One embodiment includes: at least one processor, and a memory containing a segmentation pipeline application. In addition, the segmentation pipeline application configures the at least one processor to: pre-process a 3D point cloud to group 3D points; provide the groups of 3D points to a 3D neural network to generate initial label predictions for the groups of 3D points; interpolate label predictions for individual 3D points based upon initial label predictions for at least two neighboring groups of 3D points including the group of 3D points to which a given individual 3D point belongs; refine the label predictions using a graph neural network; and output a segmented 3D point cloud.
    Type: Grant
    Filed: October 9, 2018
    Date of Patent: May 11, 2021
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Lyne P. Tchapmi, Christopher B. Choy, Iro Armeni, JunYoung Gwak, Silvio Savarese
  • Patent number: 10922353
    Abstract: A system and method for determining an object or product represented in an image is disclosed. The system receives a first image, determines a region of interest in the first image, determines a classification score for the region of interest using a convolutional neural network that assigns the region of interest the classification score corresponding to a class, and identifies a first product in the first image based on the classification score.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: February 16, 2021
    Assignee: Ricoh Company, Ltd.
    Inventors: Junghyun Kwon, Ramya Narasimha, Edward L. Schwartz, Max McFarland, Silvio Savarese, Kathrin Berkner
  • Patent number: 10846836
    Abstract: Disclosed is a system and method for generating intermediate views between two received images. To generate the intermediate views, a rectification network rectifies the two images and an encoder network encodes the two rectified images to generate convolutional neural network features. The convolutional neural network features are fed to a decoder network that decodes the features to generate a correspondence between the two rectified images and blending masks to predict the visibility of pixels of the rectified images in the intermediate view images. Using the correspondence between the two rectified images and blending masks, a view morphing network synthesizes intermediate view images depicting an object in the two images in a view between the two images.
    Type: Grant
    Filed: November 14, 2016
    Date of Patent: November 24, 2020
    Assignee: RICOH COMPANY, LTD.
    Inventors: Junghyun Kwon, Dinghuang Ji, Max McFarland, Silvio Savarese
  • Patent number: 10489893
    Abstract: The disclosure includes a system and method for performing image rectification using a single image and information identified from the single image. An image recognition application receives an input image, identifies a plurality of objects in the input image, estimates rectification parameters for the plurality of objects, identifies a plurality of candidate rectification parameters using a voting procedure on the rectification parameters for the plurality of objects, estimates final rectification parameters based on the plurality of candidate rectification parameters, computes a global transformation matrix using the final rectification parameters, and performs image rectification on the input image using the global transformation matrix.
    Type: Grant
    Filed: January 29, 2018
    Date of Patent: November 26, 2019
    Assignee: Ricoh Company, Ltd.
    Inventors: Jorge Moraleda, Ekta Prashnani, Michael J. Gormish, Kathrin Berkner, Silvio Savarese
  • Patent number: 10424065
    Abstract: Systems and methods for performing three-dimensional semantic parsing of indoor spaces in accordance with embodiments of the invention are disclosed. In one embodiment, a method includes receiving input data representing a three-dimensional space, determining disjointed spaces within the received data by generating a density histogram on each of a plurality of axes, determining space dividers based on the generated density histogram, and dividing the point cloud data into segments based on the determined space dividers, and determining elements in the disjointed spaces by aligning the disjointed spaces within the point cloud data along similar axes to create aligned versions of the disjointed spaces normalizing the aligned version of the disjointed spaces into the aligned version of the disjointed spaces, determining features in the disjointed spaces, generating at least one detection score, and filtering the at least one detection score to determine a final set of determined elements.
    Type: Grant
    Filed: June 9, 2017
    Date of Patent: September 24, 2019
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Iro Armeni, Ozan Sener, Amir R. Zamir, Martin Fischer, Silvio Savarese
  • Publication number: 20190163698
    Abstract: A system and method for determining an object or product represented in an image is disclosed. The system receives a first image, determines a region of interest in the first image, determines a classification score for the region of interest using a convolutional neural network that assigns the region of interest the classification score corresponding to a class, and identifies a first product in the first image based on the classification score.
    Type: Application
    Filed: February 1, 2019
    Publication date: May 30, 2019
    Applicant: Ricoh Company, Ltd.
    Inventors: Junghyun Kwon, Ramya Narasimha, Edward L. Schwartz, Max McFarland, Silvio Savarese, Kathrin Berkner
  • Publication number: 20190108639
    Abstract: Systems and methods for obtaining 3D point-level segmentation of 3D point clouds in accordance with various embodiments of the invention are disclosed. One embodiment includes: at least one processor, and a memory containing a segmentation pipeline application. In addition, the segmentation pipeline application configures the at least one processor to: pre-process a 3D point cloud to group 3D points; provide the groups of 3D points to a 3D neural network to generate initial label predictions for the groups of 3D points; interpolate label predictions for individual 3D points based upon initial label predictions for at least two neighboring groups of 3D points including the group of 3D points to which a given individual 3D point belongs; refine the label predictions using a graph neural network; and output a segmented 3D point cloud.
    Type: Application
    Filed: October 9, 2018
    Publication date: April 11, 2019
    Applicant: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Lyne P. Tchapmi, Christopher B. Choy, Iro Armeni, JunYoung Gwak, Silvio Savarese
  • Patent number: 10242036
    Abstract: A system and method for determining an object or product represented in an image is disclosed. The system receives a first image, determines a region of interest in the first image, determines a classification score for the region of interest using a convolutional neural network that assigns the region of interest the classification score corresponding to a class, and identifies a first product in the first image based on the classification score.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: March 26, 2019
    Assignee: Ricoh Co., Ltd.
    Inventors: Junghyun Kwon, Ramya Narasimha, Edward L. Schwartz, Max McFarland, Silvio Savarese, Kathrin Berkner
  • Patent number: 10115032
    Abstract: A computer-implemented method for training a convolutional neural network (CNN) is presented. The method includes extracting coordinates of corresponding points in the first and second locations, identifying positive points in the first and second locations, identifying negative points in the first and second locations, training features that correspond to positive points of the first and second locations to move closer to each other, and training features that correspond to negative points in the first and second locations to move away from each other.
    Type: Grant
    Filed: November 3, 2016
    Date of Patent: October 30, 2018
    Assignee: NEC Corporation
    Inventors: Manmohan Chandraker, Christopher Bongsoo Choy, Silvio Savarese
  • Patent number: 9990736
    Abstract: Velocity controllers in accordance with embodiments of the invention enable velocity estimation for tracked objects. One embodiment includes a tracker controller, including: a processor; and a memory containing: a velocity tracker application; a state space describing relationships between measured locations, calculated locations, and changes in locations, where the calculated locations in the state space correspond to unoccluded points on the surface of the tracked object; wherein the processor is configured by the velocity tracker application to: pre-process the state space to identify a tracked object; estimate a velocity of the tracked object using a location history calculated from the measured locations of the tracked object within the state space and a motion model calculated from the state space; and return the velocity of the tracked object.
    Type: Grant
    Filed: July 17, 2017
    Date of Patent: June 5, 2018
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: David Held, Jesse Levinson, Sebastian Thrun, Silvio Savarese
  • Publication number: 20180150945
    Abstract: The disclosure includes a system and method for performing image rectification using a single image and information identified from the single image. An image recognition application receives an input image, identifies a plurality of objects in the input image, estimates rectification parameters for the plurality of objects, identifies a plurality of candidate rectification parameters using a voting procedure on the rectification parameters for the plurality of objects, estimates final rectification parameters based on the plurality of candidate rectification parameters, computes a global transformation matrix using the final rectification parameters, and performs image rectification on the input image using the global transformation matrix.
    Type: Application
    Filed: January 29, 2018
    Publication date: May 31, 2018
    Applicant: Ricoh Co., Ltd.
    Inventors: Jorge Moraleda, Ekta Prashnani, Michael J. Gormish, Kathrin Berkner, Silvio Savarese
  • Publication number: 20180137611
    Abstract: Disclosed is a system and method for generating intermediate views between two received images. To generate the intermediate views, a rectification network rectifies the two images and an encoder network encodes the two rectified images to generate convolutional neural network features. The convolutional neural network features are fed to a decoder network that decodes the features to generate a correspondence between the two rectified images and blending masks to predict the visibility of pixels of the rectified images in the intermediate view images. Using the correspondence between the two rectified images and blending masks, a view morphing network synthesizes intermediate view images depicting an object in the two images in a view between the two images.
    Type: Application
    Filed: November 14, 2016
    Publication date: May 17, 2018
    Applicant: Ricoh Co., Ltd.
    Inventors: Junghyun Kwon, Dinghuang Ji, Max McFarland, Silvio Savarese
  • Patent number: 9965719
    Abstract: A computer-implemented method for detecting objects by using subcategory-aware convolutional neural networks (CNNs) is presented. The method includes generating object region proposals from an image by a region proposal network (RPN) which utilizes subcategory information, and classifying and refining the object region proposals by an object detection network (ODN) that simultaneously performs object category classification, subcategory classification, and bounding box regression. The image is an image pyramid used as input to the RPN and the ODN. The RPN and the ODN each include a feature extrapolating layer to detect object categories with scale variations among the objects.
    Type: Grant
    Filed: November 3, 2016
    Date of Patent: May 8, 2018
    Assignee: NEC Corporation
    Inventors: Wongun Choi, Yuanqing Lin, Yu Xiang, Silvio Savarese
  • Publication number: 20180060757
    Abstract: A data annotation apparatus for machine learning is provided, which includes a stimulus generation portion, a biometrics reading portion, and a data integration portion. The stimulus generation portion is configured to generate, and present to an agent, at least one stimulus based on a first data from a first machine learning dataset. The biometrics reading portion is configured to measure at least one response of the agent to the at least one stimulus, and to generate biometrics data based on the at least one response. The data integration portion is configured to integrate the biometrics data, data of the at least one stimulus, and data of the first machine learning dataset to thereby obtain a second machine learning dataset. The data annotation apparatus can result in an improved data labeling and an enhanced machine learning.
    Type: Application
    Filed: August 24, 2017
    Publication date: March 1, 2018
    Applicant: CloudMinds Technology, Inc.
    Inventors: Qiang LI, Silvio SAVARESE, Charles Robert JANKOWSKI, JR., William Xiao-Qing HUANG, Zhe ZHANG, Xiaoli FERN
  • Patent number: 9904990
    Abstract: The disclosure includes a system and method for performing image rectification using a single image and information identified from the single image. An image recognition application receives an input image, identifies a plurality of objects in the input image, estimates rectification parameters for the plurality of objects, identifies a plurality of candidate rectification parameters using a voting procedure on the rectification parameters for the plurality of objects, estimates final rectification parameters based on the plurality of candidate rectification parameters, computes a global transformation matrix using the final rectification parameters, and performs image rectification on the input image using the global transformation matrix.
    Type: Grant
    Filed: December 18, 2015
    Date of Patent: February 27, 2018
    Assignee: Ricoh Co., Ltd.
    Inventors: Jorge Moraleda, Ekta Prashnani, Michael J. Gormish, Kathrin Berkner, Silvio Savarese
  • Publication number: 20170358087
    Abstract: Systems and methods for performing three-dimensional semantic parsing of indoor spaces in accordance with embodiments of the invention are disclosed. In one embodiment, a method includes receiving input data representing a three-dimensional space, determining disjointed spaces within the received data by generating a density histogram on each of a plurality of axes, determining space dividers based on the generated density histogram, and dividing the point cloud data into segments based on the determined space dividers, and determining elements in the disjointed spaces by aligning the disjointed spaces within the point cloud data along similar axes to create aligned versions of the disjointed spaces normalizing the aligned version of the disjointed spaces into the aligned version of the disjointed spaces, determining features in the disjointed spaces, generating at least one detection score, and filtering the at least one detection score to determine a final set of determined elements.
    Type: Application
    Filed: June 9, 2017
    Publication date: December 14, 2017
    Inventors: Iro Armeni, Ozan Sener, Amir R. Zamir, Martin Fischer, Silvio Savarese
  • Publication number: 20170316569
    Abstract: Velocity controllers in accordance with embodiments of the invention enable velocity estimation for tracked objects. One embodiment includes a tracker controller, including: a processor; and a memory containing: a velocity tracker application; a state space describing relationships between measured locations, calculated locations, and changes in locations, where the calculated locations in the state space correspond to unoccluded points on the surface of the tracked object; wherein the processor is configured by the velocity tracker application to: pre-process the state space to identify a tracked object; estimate a velocity of the tracked object using a location history calculated from the measured locations of the tracked object within the state space and a motion model calculated from the state space; and return the velocity of the tracked object.
    Type: Application
    Filed: July 17, 2017
    Publication date: November 2, 2017
    Applicant: The Board of Trustees of the Leland Stanford Junior University
    Inventors: David Held, Jesse Levinson, Sebastian Thrun, Silvio Savarese