Patents by Inventor Crystal Maung
Crystal Maung has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20220414924Abstract: A device configured to detect a triggering event at a platform and to capture a depth image of items on the platform using a three-dimensional (3D) sensor. The device is further configured to determine an object pose for each item on the platform and to identify one or more cameras from among a plurality of cameras based on the object pose for each item on the platform. The device is further configured to capture one or more images of the items on the platform using the identified cameras and to identify items within the one or more images based on features of the items. The device is further configured to identify a user associated with the identified items on the platform, to identify an account that is associated with the user, and to associate the identified items with the account of the user.Type: ApplicationFiled: June 29, 2021Publication date: December 29, 2022Inventors: Sailesh Bharathwaaj Krishnamurthy, Sumedh Vilas Datar, Shantanu Yadunath Thakurdesai, Crystal Maung
-
Publication number: 20220414373Abstract: A system for identifying items based on aggregated metadata obtains images of an item. The system extracts a set of features from images of the item. The system identifies a first value of a first feature associated with a first image of the item. The system identifies a second value of the first feature associated with a second image of the item. The system aggregates the first value and the second value. The system associates the item to the aggregated first value and the second value, where the aggregated first value and the second value represent the first feature of the item. The system adds a new entry for each image of the item to a training dataset associated with an item identification model.Type: ApplicationFiled: November 19, 2021Publication date: December 29, 2022Inventors: Sailesh Bharathwaaj Krishnamurthy, Tejas Pradip Rode, Crystal Maung, Shahmeer Ali Mirza
-
Publication number: 20220414375Abstract: A device configured to capture a first image of an item on a platform using a camera and to determine a first number of pixels in the first image that corresponds with the item. The device is further configured to capture a first depth image of an item on the platform using a three-dimensional (3D) sensor and to determine a second number of pixels within the first depth image that corresponds with the item. The device is further configured to determine that the difference between the first number of pixels in the first image and the second number of pixels in the first depth image is less than the difference threshold value, to extract the plurality of pixels corresponding with the item in the first image from the first image to generate a second image, and to output the second image.Type: ApplicationFiled: November 19, 2021Publication date: December 29, 2022Inventors: Sailesh Bharathwaaj Krishnamurthy, Sumedh Vilas Datar, Crystal Maung, Shantanu Yadunath Thakurdesai
-
Publication number: 20220414899Abstract: A device configured to identify a first pixel location within a first plurality of pixels corresponding with an item in a first image and to apply a first homography to the first pixel location to determine a first (x,y) coordinate. The device is further configured to identify a second pixel location within a second plurality of pixels corresponding with the item in a second image and to apply a second homography to the second pixel location to determine a second (x,y) coordinate. The device is further configured to determine that the distance between the first (x,y) coordinate and the second (x,y) coordinate is less than or equal to the distance threshold value, to associate the first plurality of pixels and the second plurality of pixels with a cluster for the item, and to output the first plurality of pixels and the second plurality of pixels.Type: ApplicationFiled: November 19, 2021Publication date: December 29, 2022Inventors: Sumedh Vilas Datar, Sailesh Bharathwaaj Krishnamurthy, Crystal Maung, Shahmeer Ali Mirza
-
Publication number: 20220414374Abstract: A device configured to receive a first encoded vector and receive one or more feature descriptors for a first object. The device is further configured to remove one or more encoded vectors from an encoded vector library that are not associated with the one or more feature descriptors and to identify a second encoded vector in the encoded vector library that most closely matches the first encoded vector based on the numerical values within the first encoded vector. The device is further configured to identify a first item identifier in the encoded vector library that is associated with the second encoded vector and to output the first item identifier.Type: ApplicationFiled: November 19, 2021Publication date: December 29, 2022Inventors: Sailesh Bharathwaaj Krishnamurthy, Sumedh Vilas Datar, Crystal Maung, Tejas Pradip Rode, Shantanu Yadunath Thakurdesai, Shahmeer Ali Mirza
-
Publication number: 20220414587Abstract: A device configured to receive a first point cloud data for a first item, to identify a first plurality of data points for the first object within the first point cloud data, and to extract the first plurality of data points from the first point cloud data. The device is further configured to receive a second point cloud data for the first item, to identify a second plurality of data points for the first object within the second point cloud data, and to extract a second plurality of data points from the second point cloud data. The device is further configured to merge the first plurality of data points and the second plurality of data points to generate combined point cloud data and to determine dimensions for the first object based on the combined point cloud data.Type: ApplicationFiled: November 19, 2021Publication date: December 29, 2022Inventors: Crystal Maung, Sailesh Bharathwaaj Krishnamurthy
-
Publication number: 20220414900Abstract: A device configured to detect a triggering event corresponding with a user placing a first item on the platform, to capture a first image of the first item on the platform using a camera, and to input the first image into a machine learning model that is configured to output a first encoded vector based on features of the first item that are present in the first image. The device is further configured to identify a second encoded vector in an encoded vector library that most closely matches the first encoded vector and to identify a first item identifier in the encoded vector library that is associated with the second encoded vector. The device is further configured to identify the user, to identify an account that is associated with the user, and to associate the first item identifier with the account of the user.Type: ApplicationFiled: November 19, 2021Publication date: December 29, 2022Inventors: Sumedh Vilas Datar, Sailesh Bharathwaaj Krishnamurthy, Crystal Maung, Shahmeer Ali Mirza
-
Patent number: 11475657Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide whether to use a virtual shopping cart to verify all or a portion of a transaction performed with an algorithmic shopping cart. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts do not match. A first negative reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts match.Type: GrantFiled: February 12, 2021Date of Patent: October 18, 2022Assignee: 7-ELEVEN, INC.Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
-
Patent number: 11430222Abstract: An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a first frame of a global plane for at least a portion of a marker grid in a space. The tracking system is configured to receive a first coordinate in the global plane for a first corner of a marker grid, to determine a second coordinate in the global plane for the first marker on the marker grid, and to determine a third coordinate in the global plane where the second marker on the marker grid. The tracking system is further configured to determine a first pixel location for the first marker, to determine a second pixel location for the second marker, and to generate a homography based on the second coordinate for the first marker, the third coordinate for the second marker, the first pixel location, and the second pixel location.Type: GrantFiled: July 28, 2020Date of Patent: August 30, 2022Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Crystal Maung
-
Publication number: 20220148195Abstract: An object tracking system that includes a plurality of sensors and a tracking system. A first sensor from the plurality of sensors is configured to capture a first frame of a global plane for at least a portion of the space. The tracking system is configured to determine a pixel location in the first frame for an object located in the space, and to apply a homography to the pixel location to determine a coordinate in the global plane. The homography is configured to translate between pixel locations in the first frame and coordinates in the global plane.Type: ApplicationFiled: November 29, 2021Publication date: May 12, 2022Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Crystal Maung
-
Patent number: 11257225Abstract: An object tracking system that includes a plurality of sensors and a tracking system. A first sensor from the plurality of sensors is configured to capture a first frame of a global plane for at least a portion of the space. The tracking system is configured to determine a pixel location in the first frame for an object located in the space, and to apply a homography to the pixel location to determine a coordinate in the global plane. The homography is configured to translate between pixel locations in the first frame and coordinates in the global plane.Type: GrantFiled: October 25, 2019Date of Patent: February 22, 2022Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Crystal Maung
-
Publication number: 20210334541Abstract: An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a frame of at least a portion of a physical space within a global plane for a space. The tracking system is configured to receive the frame, to detect an object within a zone of the frame, and to determine a pixel location for the object. The tracking system is further configured to identify a zone of the physical structure based on the pixel location, to identify an item based on the identified zone.Type: ApplicationFiled: July 6, 2021Publication date: October 28, 2021Inventors: Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza, Sarath Vakacharla, Trong Nghia Nguyen, Crystal Maung, Deepanjan Paul
-
Patent number: 11132550Abstract: An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a frame of at least a portion of a rack within a global plane for a space. The tracking system is configured to receive the frame, to detect an object within a zone of the frame, and to determine a pixel location for the object. The tracking system is further configured to identify a zone and a shelf of the rack based on the pixel location, to identify an item based on the identified zone and the identified shelf of the rack, and to add the identified item to a digital cart associated with a person.Type: GrantFiled: October 25, 2019Date of Patent: September 28, 2021Assignee: 7-Eleven, Inc.Inventors: Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza, Sarath Vakacharla, Trong Nghia Nguyen, Crystal Maung, Deepanjan Paul
-
Patent number: 11113837Abstract: An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a first frame of a global plane for at least a portion of a space. The tracking system is configured to receive a first coordinate in the global plane where a first marker is located in the space and to receive a second coordinate in the global plane where a second marker is located in the space. The tracking system is further configured to identify the first marker and the second marker within the first frame, to determine a first pixel location in the first frame for the first marker, to determine a second pixel location in the first frame for the second marker, and to generate a homography based on the first coordinate, the second coordinate, the first pixel location, and the second pixel location.Type: GrantFiled: October 25, 2019Date of Patent: September 7, 2021Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Crystal Maung
-
Publication number: 20210272296Abstract: A system includes sensors and a processor that tracks first and second objects in a space. Upon detecting that a tracked position of the first object is within a threshold distance of a tracked position of a second object, a top-view image of the first object is received from a first sensor. Based on this top-view image, a first descriptor is determined for the first object. The first descriptor is associated with an observable characteristic of the first object. The processor identifies the first object based at least in part upon the first descriptor.Type: ApplicationFiled: May 21, 2021Publication date: September 2, 2021Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Madan Mohan Chinnam, Crystal Maung
-
Publication number: 20210272311Abstract: An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a first frame of a global plane for at least a portion of a space. The tracking system is configured to receive a first coordinate in the global plane where a first marker is located in the space and to receive a second coordinate in the global plane where a second marker is located in the space. The tracking system is further configured to identify the first marker and the second marker within the first frame, to determine a first pixel location in the first frame for the first marker, to determine a second pixel location in the first frame for the second marker, and to generate a homography based on the first coordinate, the second coordinate, the first pixel location, and the second pixel location.Type: ApplicationFiled: May 20, 2021Publication date: September 2, 2021Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Crystal Maung
-
Patent number: 11107226Abstract: A system includes sensors and a tracking subsystem. The subsystem tracks first and second objects in a space. Following a collision event between the first and second object, a top-view image of the first object is received from a first sensor. Based on the top-view image, a first descriptor is determined for the first object. The first descriptor is associated with an observable characteristic of the first object. If criteria are not satisfied for distinguishing the first object from the second object based on the first descriptor, a third descriptor is determined for the first object. The third descriptor is generated by an artificial neural network configured to identify objects in top-view images. The tracking subsystem uses the third descriptor to assign an identifier to the first object.Type: GrantFiled: October 25, 2019Date of Patent: August 31, 2021Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Madan Mohan Chinnam, Crystal Maung
-
Publication number: 20210166021Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide between using an algorithmic and a virtual cart to process a transaction. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is selected, and the feedback indicates that the carts do not match. A first negative reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is selected, and the feedback indicates that the carts match. The processor uses the reward to update the algorithm.Type: ApplicationFiled: November 25, 2020Publication date: June 3, 2021Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
-
Publication number: 20210166025Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide whether to use a virtual shopping cart to verify all or a portion of a transaction performed with an algorithmic shopping cart. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts do not match. A first negative reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts match.Type: ApplicationFiled: February 12, 2021Publication date: June 3, 2021Inventors: Xinan Wang, Mathew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
-
Patent number: 11023728Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide between using an algorithmic and a virtual cart to process a transaction. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is selected, and the feedback indicates that the carts do not match. A first negative reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is selected, and the feedback indicates that the carts match. The processor uses the reward to update the algorithm.Type: GrantFiled: November 25, 2020Date of Patent: June 1, 2021Assignee: 7-Eleven, Inc.Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung