Patents by Inventor Ryan B. Reagan

Ryan B. Reagan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12094130
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting and tracking humans. In some embodiments, there is provided a system for detecting and tracking humans from one image to another image including: a camera; a control circuit configure to: receive a first image; detect a plurality of key body joints of a first human captured on the first image; determine segmentations of the plurality of key body joints to determine one or more body parts of the first human; determine a color distribution map of aggregate pixels associated with each body part of the first human on the first image; and cause a database to store the color distribution map; and a database comprising one or more color distribution map sets each associated with a detected human in a captured image of the camera.
    Type: Grant
    Filed: July 29, 2021
    Date of Patent: September 17, 2024
    Assignee: Walmart Apollo, LLC
    Inventors: Haining Liu, Ryan B. Reagan, Zhichun Xiao
  • Publication number: 20240273598
    Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.
    Type: Application
    Filed: April 22, 2024
    Publication date: August 15, 2024
    Inventors: Zhichun XIAO, Lingfeng ZHANG, Yao LIU, Jon HAMMER, Yutao TANG, Sicong FANG, Haining LIU, Yijing SUN, Mingquan YUAN, Shouyi ZHANG, Pingjian YU, Ryan B. REAGAN, Tianyi MAO, Shangeetha Ravichandran SUSSEELAA, Zhenyu WANG, Feiyun ZHU
  • Patent number: 12002080
    Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: June 4, 2024
    Assignee: Walmart Apollo, LLC
    Inventors: Zhichun Xiao, Lingfeng Zhang, Yao Liu, Jon Hammer, Yutao Tang, Sicong Fang, Haining Liu, Yijing Sun, Mingquan Yuan, Shouyi Zhang, Pingjian Yu, Ryan B. Reagan, Tianyi Mao, Shangeetha Ravichandran Susseelaa, Zhenyu Wang, Feiyun Zhu
  • Patent number: 11983216
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.
    Type: Grant
    Filed: June 20, 2023
    Date of Patent: May 14, 2024
    Assignee: Walmart Apollo, LLC
    Inventors: Haining Liu, Feiyun Zhu, Ryan B. Reagan, Zhichun Xiao
  • Patent number: 11983751
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting inbound and outbound traffic. In some embodiments, there is provided a system for detecting inbound and outbound traffic at a facility including a video camera and a control circuit configured to detect a human and estimate a location of the human; determine whether the detected human is inbound or outbound the facility based on a relative movement of the detected human within a first region, a second region, and a third region; and transmit data based on the determination.
    Type: Grant
    Filed: July 11, 2022
    Date of Patent: May 14, 2024
    Assignee: Walmart Apollo, LLC
    Inventors: Yi Ding, Joseph Duffy, Jiankun Liu, Tianyi Mao, Ryan B. Reagan, Zhichun Xiao, Jinhan Zhang, Shouyi Zhang
  • Patent number: 11954928
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.
    Type: Grant
    Filed: March 7, 2023
    Date of Patent: April 9, 2024
    Assignee: Walmart Apollo, LLC
    Inventors: Haining Liu, Feiyun Zhu, Jon Hammer, Ryan B. Reagan, Pingjian Yu, Zhichun Xiao, Yuqi Zhang, Yao Liu
  • Publication number: 20230334088
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.
    Type: Application
    Filed: June 20, 2023
    Publication date: October 19, 2023
    Inventors: Haining Liu, Feiyun Zhu, Ryan B. Reagan, Zhichun Xiao
  • Patent number: 11720623
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: August 8, 2023
    Assignee: Walmart Apollo, LLC
    Inventors: Haining Liu, Feiyun Zhu, Ryan B. Reagan, Zhichun Xiao
  • Publication number: 20230222825
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.
    Type: Application
    Filed: March 7, 2023
    Publication date: July 13, 2023
    Inventors: Haining Liu, Feiyun Zhu, Jon Hammer, Ryan B. Reagan, Pingjian Yu, Zhichun Xiao, Yuqi Zhang, Yao Liu
  • Patent number: 11620839
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: April 4, 2023
    Assignee: Walmart Apollo, LLC
    Inventors: Haining Liu, Feiyun Zhu, Jon Hammer, Ryan B. Reagan, Pingjian Yu, Zhichun Xiao, Yuqi Zhang, Yao Liu
  • Publication number: 20220383383
    Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.
    Type: Application
    Filed: November 12, 2020
    Publication date: December 1, 2022
    Inventors: Zhichun XIAO, Lingfeng ZHANG, Yao LIU, Jon HAMMER, Yutao TANG, Sicong FANG, Haining LIU, Yijing SUN, Mingquan YUAN, Shouyi ZHANG, Pingjian YU, Ryan B. REAGAN, Tianyi MAO, Shangeetha RAVICHANDRAN SUSSEELAA, Zhenyu WANG, Feiyun ZHU
  • Publication number: 20220343668
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting inbound and outbound traffic. In some embodiments, there is provided a system for detecting inbound and outbound traffic at a facility including a video camera and a control circuit configured to detect a human and estimate a location of the human; determine whether the detected human is inbound or outbound the facility based on a relative movement of the detected human within a first region, a second region, and a third region; and transmit data based on the determination.
    Type: Application
    Filed: July 11, 2022
    Publication date: October 27, 2022
    Inventors: Yi Ding, Joseph Duffy, Jiankun Liu, Tianyi Mao, Ryan B. Reagan, Zhichun Xiao, Jinhan Zhang, Shouyi Zhang
  • Publication number: 20220036568
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting and tracking humans. In some embodiments, there is provided a system for detecting and tracking humans from one image to another image including: a camera; a control circuit configure to: receive a first image; detect a plurality of key body joints of a first human captured on the first image; determine segmentations of the plurality of key body joints to determine one or more body parts of the first human; determine a color distribution map of aggregate pixels associated with each body part of the first human on the first image; and cause a database to store the color distribution map; and a database comprising one or more color distribution map sets each associated with a detected human in a captured image of the camera.
    Type: Application
    Filed: July 29, 2021
    Publication date: February 3, 2022
    Inventors: Haining Liu, Ryan B. Reagan, Zhichun Xiao
  • Publication number: 20210150276
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.
    Type: Application
    Filed: November 13, 2020
    Publication date: May 20, 2021
    Inventors: Haining Liu, Feiyun Zhu, Ryan B. Reagan, Zhichun Xiao
  • Publication number: 20210150245
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.
    Type: Application
    Filed: November 13, 2020
    Publication date: May 20, 2021
    Inventors: Haining Liu, Feiyun Zhu, Jon Hammer, Ryan B. Reagan, Pingjian Yu, Zhichun Xiao, Yuqi Zhang, Yao Liu
  • Publication number: 20200380252
    Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting egress. In some embodiments, there is provided a system for detecting egress at an entrance including a video camera; a computer; a network; and a control circuit configured to receive live video footage; detect a human and estimate a location of the human; track a location and movement of a detected human; determine that the detected human has moved from a first region to a second region and to a third region; and transmit an alert message that indicates that the human has exited the retail facility through the entrance area. In some embodiments, the systems and methods may be configured to comply with privacy requirements which may vary between jurisdictions. For example, before any recording, collection, capturing or processing of user images (e.g., video image, video footage, etc.), a “consent to capture” process may be implemented.
    Type: Application
    Filed: May 29, 2020
    Publication date: December 3, 2020
    Inventors: Yi Ding, Joseph Duffy, Jiankun Liu, Tianyi Mao, Ryan B. Reagan, Zhichun Xiao, Jinhan Zhang, Shouyi Zhang