Patents by Inventor Haining Liu
Haining Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12094130Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting and tracking humans. In some embodiments, there is provided a system for detecting and tracking humans from one image to another image including: a camera; a control circuit configure to: receive a first image; detect a plurality of key body joints of a first human captured on the first image; determine segmentations of the plurality of key body joints to determine one or more body parts of the first human; determine a color distribution map of aggregate pixels associated with each body part of the first human on the first image; and cause a database to store the color distribution map; and a database comprising one or more color distribution map sets each associated with a detected human in a captured image of the camera.Type: GrantFiled: July 29, 2021Date of Patent: September 17, 2024Assignee: Walmart Apollo, LLCInventors: Haining Liu, Ryan B. Reagan, Zhichun Xiao
-
Publication number: 20240273598Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.Type: ApplicationFiled: April 22, 2024Publication date: August 15, 2024Inventors: Zhichun XIAO, Lingfeng ZHANG, Yao LIU, Jon HAMMER, Yutao TANG, Sicong FANG, Haining LIU, Yijing SUN, Mingquan YUAN, Shouyi ZHANG, Pingjian YU, Ryan B. REAGAN, Tianyi MAO, Shangeetha Ravichandran SUSSEELAA, Zhenyu WANG, Feiyun ZHU
-
Publication number: 20240220958Abstract: A transaction record is created showing a purchase transaction of a customer. A CV profile showing a list of items in the transaction obtained from images is also obtained. The items in the transaction record are compared to items on the list. When there is a discrepancy, an action to take is determined.Type: ApplicationFiled: March 19, 2024Publication date: July 4, 2024Inventors: Zhichun Xiao, Lingfeng Zhang, Jon Hammer, Joseph Duffy, Yao Liu, Sicong Fang, Xiang Yao, Pingyuan Wang, Yu Tao, Tianyi Mao, Yutao Tang, Feiyun Zhu, Han Zhang, Chunmei Wang, Pingjian Yu, Muzzammil Afroz, Haining Liu
-
Patent number: 12002080Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.Type: GrantFiled: November 12, 2020Date of Patent: June 4, 2024Assignee: Walmart Apollo, LLCInventors: Zhichun Xiao, Lingfeng Zhang, Yao Liu, Jon Hammer, Yutao Tang, Sicong Fang, Haining Liu, Yijing Sun, Mingquan Yuan, Shouyi Zhang, Pingjian Yu, Ryan B. Reagan, Tianyi Mao, Shangeetha Ravichandran Susseelaa, Zhenyu Wang, Feiyun Zhu
-
Patent number: 11983216Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.Type: GrantFiled: June 20, 2023Date of Patent: May 14, 2024Assignee: Walmart Apollo, LLCInventors: Haining Liu, Feiyun Zhu, Ryan B. Reagan, Zhichun Xiao
-
Patent number: 11966900Abstract: A transaction record is created showing a purchase transaction of a customer. A CV profile showing a list of items in the transaction obtained from images is also obtained. The items in the transaction record are compared to items on the list. When there is a discrepancy, an action to take is determined.Type: GrantFiled: July 16, 2020Date of Patent: April 23, 2024Assignee: Walmart Apollo, LLCInventors: Zhichun Xiao, Lingfeng Zhang, Jon Hammer, Joseph Duffy, Yao Liu, Sicong Fang, Xiang Yao, Pingyuan Wang, Yu Tao, Tianyi Mao, Yutao Tang, Feiyun Zhu, Han Zhang, Chunmei Wang, Pingjian Yu, Muzzammil Afroz, Haining Liu
-
Publication number: 20240118821Abstract: A data storage device processes a mixed workload including a plurality of superblocks to be written to and read from a plurality of memory dies, where each of the plurality of superblocks to be apportioned among the plurality of memory dies. The data storage device writes a first data stripe associated with a first superblock to the plurality of memory dies according to a sequential write pattern, and reads the first data stripe associated with the first superblock from the plurality of memory dies according to a sequential read pattern. The sequential write pattern causes the controller to write to the plurality of memory dies in a first order of memory dies. The sequential read pattern causes the controller to read from the plurality of memory dies in a second order of memory dies different from the first order of memory dies, thereby reducing read collisions.Type: ApplicationFiled: July 6, 2023Publication date: April 11, 2024Applicant: Western Digital Technologies, Inc.Inventors: Neil HUTCHISON, Haining LIU, Jerry LO, Sergey Anatolievich GOROBETS
-
Patent number: 11954928Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.Type: GrantFiled: March 7, 2023Date of Patent: April 9, 2024Assignee: Walmart Apollo, LLCInventors: Haining Liu, Feiyun Zhu, Jon Hammer, Ryan B. Reagan, Pingjian Yu, Zhichun Xiao, Yuqi Zhang, Yao Liu
-
Patent number: 11816338Abstract: A data storage device that provides priority-based internal data movement includes a controller communicatively coupled to volatile memory and to non-volatile memory circuits, where the controller is configured to queue requests in a plurality of queues in the volatile memory, where each of the requests is associated with one of a plurality of internal data movement command types. The controller is also configured to select one of the plurality of queues based on a prioritization of the plurality of internal data movement command types. The controller is also configured to determine that the selected queue includes at least one request of the associated internal data movement command type. The controller is also configured to issue the at least one request from the selected queue to at least one of the non-volatile memory circuits.Type: GrantFiled: September 28, 2022Date of Patent: November 14, 2023Assignee: Western Digital Technologies, Inc.Inventors: Yun-Tzuo Lai, Haining Liu, Subhash Balakrishna Pillai
-
Publication number: 20230334088Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.Type: ApplicationFiled: June 20, 2023Publication date: October 19, 2023Inventors: Haining Liu, Feiyun Zhu, Ryan B. Reagan, Zhichun Xiao
-
Patent number: 11720623Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.Type: GrantFiled: November 13, 2020Date of Patent: August 8, 2023Assignee: Walmart Apollo, LLCInventors: Haining Liu, Feiyun Zhu, Ryan B. Reagan, Zhichun Xiao
-
Publication number: 20230222825Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.Type: ApplicationFiled: March 7, 2023Publication date: July 13, 2023Inventors: Haining Liu, Feiyun Zhu, Jon Hammer, Ryan B. Reagan, Pingjian Yu, Zhichun Xiao, Yuqi Zhang, Yao Liu
-
Patent number: 11645217Abstract: The subject technology provides for managing a data storage system. Commands are identified into as a first command type or a second command type. The commands identified as the first command type are assigned to a first queue, and the commands identified as the second command type are assigned to a second queue. After the commands from the first queue and the commands from the second queue are processed based on a scheduling ratio over a predetermined period of time, a write amplification factor, number of host read commands, and number of host write commands during the predetermined period of time are determined. The scheduling ratio is updated based on the write amplification, the number of host read commands, the number of host write commands, and a predetermined scheduling ratio factor. Subsequent commands are processed from the first queue and the second queue based on the updated scheduling ratio.Type: GrantFiled: May 25, 2021Date of Patent: May 9, 2023Assignee: Western Digital Technologies, Inc.Inventors: Scott Jinn, Yun-Tzuo Lai, Haining Liu, Yuriy Pavlenko
-
Patent number: 11630720Abstract: A device that provides error recovery handling includes a processor that is configured to receive an error recovery request including error type information and a page address, where the error type information is mapped to a first error recovery technique. The processor may be configured to determine whether an error count associated with the flash memory circuit satisfies a first criterion and an error map associated with the flash memory circuit satisfies a second criterion, where the error count indicates a number of read errors that have occurred and the error map indicates blocks in which the read errors have occurred. The processor may be configured to utilize a second technique to attempt to recover data when the first and second criterions are satisfied, otherwise utilize the first technique to attempt to recover data, where the second technique is associated with recovering data stored in an offline flash memory circuit.Type: GrantFiled: June 24, 2021Date of Patent: April 18, 2023Assignee: Western Digital Technologies, Inc.Inventors: Parvaneh Alavi, Kai-Lung Cheng, Yun-Tzuo Lai, Haining Liu
-
Patent number: 11630609Abstract: Systems and methods are disclosed for scheduling access commands for a data storage device. A data storage device determines a layout of a plurality of non-volatile memory arrays. The data storage device also determine completed access statistics and pending access statistics for a first set of the plurality of non-volatile memory arrays during a monitoring period. The data storage device further generates a schedule based on the layout of the plurality of non-volatile memory arrays, the completed access statistics, and the pending access statistics and executes access commands based on schedule.Type: GrantFiled: July 23, 2020Date of Patent: April 18, 2023Assignee: Western Digital Technologies, Inc.Inventors: Haining Liu, YungLi Ji, Yun-Tzuo Lai, Ming-Yu Tai
-
Patent number: 11620839Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.Type: GrantFiled: November 13, 2020Date of Patent: April 4, 2023Assignee: Walmart Apollo, LLCInventors: Haining Liu, Feiyun Zhu, Jon Hammer, Ryan B. Reagan, Pingjian Yu, Zhichun Xiao, Yuqi Zhang, Yao Liu
-
Publication number: 20230058632Abstract: Particular data is selected from a members-based dataset to provide a resultant training corpus. A first neural network receives that training corpus and generates a first trained machine learning model. That first trained machine learning model can predict member engagement score values for each of a plurality of candidate variable values. The aforementioned training corpus can also be provided to a second neural network to generate a second trained machine learning model. That second trained machine learning model can then be used to predict member engagement score values for each of a plurality of initial-state variable values. The aforementioned member engagement score values for each of the plurality of candidate variable values can then be consolidated with the member engagement score values for each of a plurality of initial-state variable values to thereby provide resultant consolidated member engagement score values.Type: ApplicationFiled: August 17, 2021Publication date: February 23, 2023Inventors: Anbu Aaron Ajay Ullas, Ehsan Nazarian, Haining Liu, Pingjian Yu, Ketan Mudda, Sara Amin, Zekun Li
-
Publication number: 20230017605Abstract: A data storage device that provides priority-based internal data movement includes a controller communicatively coupled to volatile memory and to non-volatile memory circuits, where the controller is configured to queue requests in a plurality of queues in the volatile memory, where each of the requests is associated with one of a plurality of internal data movement command types. The controller is also configured to select one of the plurality of queues based on a prioritization of the plurality of internal data movement command types. The controller is also configured to determine that the selected queue includes at least one request of the associated internal data movement command type. The controller is also configured to issue the at least one request from the selected queue to at least one of the non-volatile memory circuits.Type: ApplicationFiled: September 28, 2022Publication date: January 19, 2023Applicant: Western Digital Technologies, Inc.Inventors: Yun-Tzuo LAI, Haining LIU, Subhash Balakrishna PILLAI
-
Publication number: 20220383383Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.Type: ApplicationFiled: November 12, 2020Publication date: December 1, 2022Inventors: Zhichun XIAO, Lingfeng ZHANG, Yao LIU, Jon HAMMER, Yutao TANG, Sicong FANG, Haining LIU, Yijing SUN, Mingquan YUAN, Shouyi ZHANG, Pingjian YU, Ryan B. REAGAN, Tianyi MAO, Shangeetha RAVICHANDRAN SUSSEELAA, Zhenyu WANG, Feiyun ZHU
-
Patent number: 11500780Abstract: The subject technology provides for recovering a validity table for a data storage system. A set of logical addresses in a mapping table is partitioned into subsets of logical addresses. Each of the subsets of logical addresses is assigned to respective processor cores in the data storage system. Each of the processor cores is configured to check each logical address of the assigned subset of logical addresses in the mapping table for a valid physical address mapped to the logical address, for each valid physical address mapped to a logical address of the assigned subset of logical addresses, increment a validity count in a local validity table associated with a blockset of the non-volatile memory corresponding to the valid physical address, and update validity counts in a global validity table associated with respective blocksets of the non-volatile memory with the validity counts in the local validity table.Type: GrantFiled: October 30, 2020Date of Patent: November 15, 2022Assignee: WESTERN DIGITAL TECHNOLOGIES, INC.Inventors: Caesar Cheuk-Chow Cheung, Haining Liu, Subhash Balakrishna Pillai