Patents by Inventor Frank Florian Liberato

Frank Florian Liberato has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11829943
    Abstract: Described is a multiple-camera system and process for re-identifying a user located in a materials handling facility based on user patterns and/or descriptors representative of the user. In one implementation, a user pattern and/or a plurality of descriptors representative of a user are maintained as a position of a user is tracked through a materials handling facility. If the tracking of the user is lost, the last known position is stored with the user pattern and/or descriptors. If a new object is detected and confirmed to be a user, a user pattern and/or descriptors of the new object are compared with the stored user pattern and/or descriptors to determine if the new object is the user.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: November 28, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Pranab Mohanty, Shrivatsan Vasudhevan, Frank Florian Liberato, Jiajun Zhao, Maxwell Aaron Corman, Ammar Chinoy, Joachim Sebastian Stahl
  • Patent number: 11263795
    Abstract: Described are systems and techniques to generate data for display to present visualizations of data acquired from sensors in a facility. The data visualizations may be used to develop, configure, administer, or otherwise support operation of the facility. In one implementation, the visualization may include a view incorporating aggregated images acquired from multiple cameras, depth data, tracking information about objects in the facility, and so forth. An analyst may use the data visualization to determine occurrence of an action in the facility such as a pick of an item, place of an item, what item was involved with an action, what user was involved with the action, and so forth. Based on the information presented by the data visualization, changes may be made to data processing parameters.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: March 1, 2022
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Nishitkumar Ashokkumar Desai, Frank Florian Liberato, Jr., I-Hung Wang, Daniel Bibireata, Muralidhar Koka
  • Patent number: 11205270
    Abstract: Described is a multiple-camera system and process for detecting a user within a materials handling facility and tracking a position of the user as the user moves through the materials handling facility. In one implementation, a plurality of depth sensing cameras are positioned above a surface of the materials handling facility and oriented to obtain a top-down view of the surface of the materials handling facility, along with any objects (e.g., users) on the surface of the materials handling facility. The depth information from the cameras may be utilized to detect objects on the surface of the materials handling facility, track a movement of those objects and determine if those objects are users.
    Type: Grant
    Filed: March 25, 2015
    Date of Patent: December 21, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Yasser Baseer Asmi, Sudarshan Narasimha Raghavan, Emilio Ian Maldonado, Shrivatsan Vasudhevan, Ammar Chinoy, David Allen Smith, Pranab Mohanty, Frank Florian Liberato
  • Patent number: 10963835
    Abstract: Described is a multiple-camera system for use in capturing images of users within a materials handling facility and processing those images to monitor the movement of users. For large materials handling facilities, a large number of cameras may be required to monitor the facility. Processing of the data generated from a large number of cameras becomes difficult. The implementations described herein include a hierarchy that allows image data from any number of cameras within a materials handling facility to be processed without substantially increasing the processing time needed or sacrificing processing capabilities.
    Type: Grant
    Filed: October 26, 2018
    Date of Patent: March 30, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Frank Florian Liberato, Daniel Bibireata, Muralidhar Koka, Yasser Baseer Asmi, Nishitkumar Ashokkumar Desai
  • Patent number: 10810539
    Abstract: Described is a multiple-camera system and process for re-identifying a user located in a materials handling facility based on user patterns and/or descriptors representative of the user. In one implementation, a user pattern and/or a plurality of descriptors representative of a user are maintained as a position of a user is tracked through a materials handling facility. If the tracking of the user is lost, the last known position is stored with the user pattern and/or descriptors. If a new object is detected and confirmed to be a user, a user pattern and/or descriptors of the new object are compared with the stored user pattern and/or descriptors to determine if the new object is the user.
    Type: Grant
    Filed: March 25, 2015
    Date of Patent: October 20, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Pranab Mohanty, Shrivatsan Vasudhevan, Frank Florian Liberato, Jr., Jiajun Zhao, Maxwell Aaron Corman, Ammar Chinoy, Joachim Sebastian Stahl
  • Patent number: 10679177
    Abstract: Described is a multiple-camera system and process for detecting a user within a materials handling facility and tracking a position of the user as the user moves through the materials handling facility. In one implementation, a plurality of depth sensing cameras are positioned above a surface of the materials handling facility and oriented to obtain an overhead view of the surface of the materials handling facility, along with any objects (e.g., users) on the surface of the materials handling facility. The depth information from the cameras may be utilized to detect objects on the surface of the materials handling facility, track a movement of those objects and determine if those objects are users.
    Type: Grant
    Filed: March 25, 2015
    Date of Patent: June 9, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Frank Florian Liberato, Jr., Jaechul Kim, Daniel Bibireata, Chen Xu, Xiaofeng Ren
  • Patent number: 10332089
    Abstract: Frames of sensor data may be obtained from many sensors arranged throughout a facility. These frames may be time synchronized to support further processing. For example, frames containing image data obtained at about the same time from many cameras within the facility may be used to create an aggregate or “stitched” view of the facility at that time. The synchronization may involve storing the frames from several sensors in buffers. A time window may be specified and used in conjunction with timestamps of the frames to select a set of sensor data from the buffers that are deemed to be synchronized data. The synchronized data may then be used for further processing.
    Type: Grant
    Filed: March 31, 2015
    Date of Patent: June 25, 2019
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Yasser Baseer Asmi, Frank Florian Liberato, Jr., Daniel Bibireata, Bradley David Volen, Prafulla Jinendra Masalkar, Todd Nelson Schoepflin
  • Patent number: 10291862
    Abstract: Described is a multiple-camera system for use in capturing images of users within a materials handling facility and processing those images to monitor the movement of users. For large materials handling facilities, a large number of cameras may be required to monitor the facility. Processing of the data generated from a large number of cameras becomes difficult. The implementations described herein include a hierarchy that allows image data from any number of cameras within a materials handling facility to be processed without substantially increasing the processing time needed or sacrificing processing capabilities.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: May 14, 2019
    Assignee: Amazon Technologies, Inc.
    Inventors: Frank Florian Liberato, Sudarshan Narasimha Raghavan, Emilio Ian Maldonado, Muralidhar Koka, Ammar Chinoy, Daniel Bibireata, Yasser Baseer Asmi, Hao Jiang, Jaechul Kim, Nishitkumar Ashokkumar Desai
  • Patent number: 10147210
    Abstract: Described are systems and techniques to generate data for display to present visualizations of data acquired from sensors in a facility. The data visualizations may be used to develop, configure, administer, or otherwise support operation of the facility. In one implementation, the visualization may include a view incorporating aggregated images acquired from multiple cameras, depth data, tracking information about objects in the facility, and so forth. An analyst may use the data visualization to determine occurrence of an action in the facility such as a pick of an item, place of an item, what item was involved with an action, what user was involved with the action, and so forth. Based on the information presented by the data visualization, changes may be made to data processing parameters.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: December 4, 2018
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Nishitkumar Ashokkumar Desai, Frank Florian Liberato, Jr., I-Hung Wang, Daniel Bibireata, Muralidhar Koka
  • Patent number: 10134004
    Abstract: Described is a multiple-camera system for use in capturing images of users within a materials handling facility and processing those images to monitor the movement of users. For large materials handling facilities, a large number of cameras may be required to monitor the facility. Processing of the data generated from a large number of cameras becomes difficult. The implementations described herein include a hierarchy that allows image data from any number of cameras within a materials handling facility to be processed without substantially increasing the processing time needed or sacrificing processing capabilities.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: November 20, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Frank Florian Liberato, Jr., Daniel Bibireata, Muralidhar Koka, Yasser Baseer Asmi, Nishitkumar Ashokkumar Desai
  • Patent number: 9984354
    Abstract: Systems involving a plurality of cameras with clocks may not remain time synchronized during operation. Described in this disclosure are techniques for synchronizing one or more of the clocks of a plurality of cameras or the images produced by the plurality of cameras. In one implementation, a timestamp projector produces an optical timestamp encoding data indicative of timing. One or more cameras may acquire images of a scene that include the optical timestamp. The images may be processed to recover the data indicative of timing. This data may be used to set the clock of the camera, set timestamps associated with the images for subsequent use, and so forth.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: May 29, 2018
    Assignee: Amazon Technologies, Inc.
    Inventors: Ammar Chinoy, Joachim Sebastian Stahl, Frank Florian Liberato, Jr., Yasser Baseer Asmi, Daniel Bibireata