Patents by Inventor Tianyi Mao
Tianyi Mao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12373873Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.Type: GrantFiled: April 22, 2024Date of Patent: July 29, 2025Assignee: Walmart Apollo, LLCInventors: Zhichun Xiao, Lingfeng Zhang, Yao Liu, Jon Hammer, Yutao Tang, Sicong Fang, Haining Liu, Yijing Sun, Mingquan Yuan, Shouyi Zhang, Pingjian Yu, Ryan B. Reagan, Tianyi Mao, Shangeetha Ravichandran Susseelaa, Zhenyu Wang, Feiyun Zhu
-
Publication number: 20250232603Abstract: Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to extract meta data from the packaging the individual products to detect one more keywords and determine the locations of the detected keywords on the packaging, and then utilize this information to predict an identity of the products associated with the packaging.Type: ApplicationFiled: April 2, 2025Publication date: July 17, 2025Inventors: Lingfeng Zhang, Han Zhang, Abhinav Pachauri, Amit Jhunjhunwala, Ashlin Ghosh, Avinash M. Jade, Raghava Balusu, Srinivas Muktevi, Mingquan Yuan, Zhaoliang Duan, Zhiwei Huang, Tianyi Mao
-
Patent number: 12288408Abstract: Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to extract meta data from the packaging the individual products to detect one more keywords and determine the locations of the detected keywords on the packaging, and then utilize this information to predict an identity of the products associated with the packaging.Type: GrantFiled: October 11, 2022Date of Patent: April 29, 2025Assignee: Walmart Apollo, LLCInventors: Lingfeng Zhang, Han Zhang, Abhinav Pachauri, Amit Jhunjhunwala, Ashlin Ghosh, Avinash Madhusudanrao Jade, Raghava Balusu, Srinivas Muktevi, Mingquan Yuan, Zhaoliang Duan, Zhiwei Huang, Tianyi Mao
-
Publication number: 20240273598Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.Type: ApplicationFiled: April 22, 2024Publication date: August 15, 2024Inventors: Zhichun XIAO, Lingfeng ZHANG, Yao LIU, Jon HAMMER, Yutao TANG, Sicong FANG, Haining LIU, Yijing SUN, Mingquan YUAN, Shouyi ZHANG, Pingjian YU, Ryan B. REAGAN, Tianyi MAO, Shangeetha Ravichandran SUSSEELAA, Zhenyu WANG, Feiyun ZHU
-
Publication number: 20240220958Abstract: A transaction record is created showing a purchase transaction of a customer. A CV profile showing a list of items in the transaction obtained from images is also obtained. The items in the transaction record are compared to items on the list. When there is a discrepancy, an action to take is determined.Type: ApplicationFiled: March 19, 2024Publication date: July 4, 2024Inventors: Zhichun Xiao, Lingfeng Zhang, Jon Hammer, Joseph Duffy, Yao Liu, Sicong Fang, Xiang Yao, Pingyuan Wang, Yu Tao, Tianyi Mao, Yutao Tang, Feiyun Zhu, Han Zhang, Chunmei Wang, Pingjian Yu, Muzzammil Afroz, Haining Liu
-
Patent number: 12002080Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.Type: GrantFiled: November 12, 2020Date of Patent: June 4, 2024Assignee: Walmart Apollo, LLCInventors: Zhichun Xiao, Lingfeng Zhang, Yao Liu, Jon Hammer, Yutao Tang, Sicong Fang, Haining Liu, Yijing Sun, Mingquan Yuan, Shouyi Zhang, Pingjian Yu, Ryan B. Reagan, Tianyi Mao, Shangeetha Ravichandran Susseelaa, Zhenyu Wang, Feiyun Zhu
-
Patent number: 11983751Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting inbound and outbound traffic. In some embodiments, there is provided a system for detecting inbound and outbound traffic at a facility including a video camera and a control circuit configured to detect a human and estimate a location of the human; determine whether the detected human is inbound or outbound the facility based on a relative movement of the detected human within a first region, a second region, and a third region; and transmit data based on the determination.Type: GrantFiled: July 11, 2022Date of Patent: May 14, 2024Assignee: Walmart Apollo, LLCInventors: Yi Ding, Joseph Duffy, Jiankun Liu, Tianyi Mao, Ryan B. Reagan, Zhichun Xiao, Jinhan Zhang, Shouyi Zhang
-
Patent number: 11966900Abstract: A transaction record is created showing a purchase transaction of a customer. A CV profile showing a list of items in the transaction obtained from images is also obtained. The items in the transaction record are compared to items on the list. When there is a discrepancy, an action to take is determined.Type: GrantFiled: July 16, 2020Date of Patent: April 23, 2024Assignee: Walmart Apollo, LLCInventors: Zhichun Xiao, Lingfeng Zhang, Jon Hammer, Joseph Duffy, Yao Liu, Sicong Fang, Xiang Yao, Pingyuan Wang, Yu Tao, Tianyi Mao, Yutao Tang, Feiyun Zhu, Han Zhang, Chunmei Wang, Pingjian Yu, Muzzammil Afroz, Haining Liu
-
Publication number: 20240119749Abstract: Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to extract meta data from the packaging the individual products to detect one more keywords and determine the locations of the detected keywords on the packaging, and then utilize this information to predict an identity of the products associated with the packaging.Type: ApplicationFiled: October 11, 2022Publication date: April 11, 2024Inventors: Lingfeng Zhang, Han Zhang, Abhinav Pachauri, Amit Jhunjhunwala, Ashlin Ghosh, Avinash Madhusudanrao Jade, Raghava Balusu, Srinivas Muktevi, Mingquan Yuan, Zhaoliang Duan, Zhiwei Huang, Tianyi Mao
-
Publication number: 20240119735Abstract: Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to detect one or more adjacent product storage structures (shelves, pallets, etc.) and identifies and selects a single image that fully shows a product storage structure of interest and fully shows each of the products stored on the product storage structure of interest.Type: ApplicationFiled: October 11, 2022Publication date: April 11, 2024Inventors: Lingfeng Zhang, Mingquan Yuan, Paul Lewis Lobo, Avinash M. Jade, Zhichun Xiao, William Craig Robinson, JR., Zhaoliang Duan, Wei Wang, Han Zhang, Raghava Balusu, Tianyi Mao
-
Publication number: 20230245535Abstract: In some embodiments, apparatuses and methods are provided herein useful to self-checkout verification at a retail facility. In some embodiments, there is provided a system for self-checkout verification at a retail facility including a first optical imaging unit; and a control circuit. The control circuit configured to: receive purchase receipt data; receive one or more images of the items in the container; and execute a machine learning model trained to: perform item detection, item classification, and item verification of each item shown in the one or more images; and output electronic data corresponding to an electronic receipt of the items in the container. The control circuit may automatically detect each unpaid item in the container based on a comparison of the purchase receipt data with the electronic data; and provide an alert signal in response to automatically detecting an unpaid item.Type: ApplicationFiled: January 27, 2023Publication date: August 3, 2023Inventors: Zhichun Xiao, Lingfeng Zhang, Yutao Tang, Mingquan Yuan, Tianyi Mao, Han Zhang, Chunmei Wang, Feiyun Zhu, Zhaoliang Duan, Yanmei Jin, Jing Wang, Wei Wang, Ranran Cao, Zhiwei Huang
-
Publication number: 20220383383Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.Type: ApplicationFiled: November 12, 2020Publication date: December 1, 2022Inventors: Zhichun XIAO, Lingfeng ZHANG, Yao LIU, Jon HAMMER, Yutao TANG, Sicong FANG, Haining LIU, Yijing SUN, Mingquan YUAN, Shouyi ZHANG, Pingjian YU, Ryan B. REAGAN, Tianyi MAO, Shangeetha RAVICHANDRAN SUSSEELAA, Zhenyu WANG, Feiyun ZHU
-
Publication number: 20220343668Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting inbound and outbound traffic. In some embodiments, there is provided a system for detecting inbound and outbound traffic at a facility including a video camera and a control circuit configured to detect a human and estimate a location of the human; determine whether the detected human is inbound or outbound the facility based on a relative movement of the detected human within a first region, a second region, and a third region; and transmit data based on the determination.Type: ApplicationFiled: July 11, 2022Publication date: October 27, 2022Inventors: Yi Ding, Joseph Duffy, Jiankun Liu, Tianyi Mao, Ryan B. Reagan, Zhichun Xiao, Jinhan Zhang, Shouyi Zhang
-
Publication number: 20210019725Abstract: A transaction record is created showing a purchase transaction of a customer. A CV profile showing a list of items in the transaction obtained from images is also obtained. The items in the transaction record are compared to items on the list. When there is a discrepancy, an action to take is determined.Type: ApplicationFiled: July 16, 2020Publication date: January 21, 2021Inventors: Zhichun Xiao, Lingfeng Zhang, Jon Hammer, Joseph Duffy, Yao Liu, Sicong Fang, Xiang Yao, Pingyuan Wang, Yu Tao, Tianyi Mao, Yutao Tang, Feiyun Zhu, Han Zhang, Chunmei Wang, Pingjian Yu, Muzzammil Afroz, Haining Liu
-
Publication number: 20200380252Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting egress. In some embodiments, there is provided a system for detecting egress at an entrance including a video camera; a computer; a network; and a control circuit configured to receive live video footage; detect a human and estimate a location of the human; track a location and movement of a detected human; determine that the detected human has moved from a first region to a second region and to a third region; and transmit an alert message that indicates that the human has exited the retail facility through the entrance area. In some embodiments, the systems and methods may be configured to comply with privacy requirements which may vary between jurisdictions. For example, before any recording, collection, capturing or processing of user images (e.g., video image, video footage, etc.), a “consent to capture” process may be implemented.Type: ApplicationFiled: May 29, 2020Publication date: December 3, 2020Inventors: Yi Ding, Joseph Duffy, Jiankun Liu, Tianyi Mao, Ryan B. Reagan, Zhichun Xiao, Jinhan Zhang, Shouyi Zhang