Patents by Inventor Kyle Dalal
Kyle Dalal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11893759Abstract: An object tracking system that includes a first sensor and a second sensor that are each configured to capture frames of at least a portion of a global plane for a space. The system is configured to identify a first pixel location for a marker within a first frame and to determine an (x,y) coordinate for the marker using a first homography. The system is further configured to identify a second pixel location for the marker in the second sensor using a second homography, to identify a third pixel location using a disparity mapping, and to determine a distance difference between the second pixel location and the third pixel location. The system is further configured to compare the distance difference to a difference threshold level and to recompute the first homography and/or the second homography in response to determining that the distance difference exceeds the difference threshold level.Type: GrantFiled: November 25, 2020Date of Patent: February 6, 2024Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal
-
Patent number: 11887372Abstract: An image sensor is positioned such that a field-of-view of the sensor encompasses portion of a beverage machine. The field-of-view includes a first zone associated with operating the beverage machine to dispense the beverage and a second zone in which a cup is placed to receive the beverage. A beverage assignment subsystem receives angled-view images from the image sensor. An event associated with an object entering one or both of the first zone and the second zone is detected. In image(s) associated with a start of the event, it is determined that both a hand of a person enters the first zone and the cup is placed in the second zone. If the cup remained in the second zone for at least a threshold time, the beverage is assigned to the person whose hand entered the first zone.Type: GrantFiled: November 25, 2020Date of Patent: January 30, 2024Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Xinan Wang
-
Patent number: 11721029Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.Type: GrantFiled: February 12, 2021Date of Patent: August 8, 2023Assignee: 7-ELEVEN, INC.Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
-
Patent number: 11587243Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.Type: GrantFiled: March 17, 2021Date of Patent: February 21, 2023Assignee: 7-ELEVEN, INC.Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
-
Patent number: 11551454Abstract: An object tracking system that includes a sensor that is configured to capture frames of at least a portion of a global plane for a space. The system is configured to receive a first frame from the sensor and to identify a first pixel location and a second pixel location within the first frame. The system is further configured to determine (x,y) coordinates by applying a homography to the first pixel location and the second pixel location. The system is further configured to determine an estimated distance between the (x,y) coordinates, to determine an actual distance, and to determine a distance difference between the estimated distance and the actual distance. The system is further configured to compare the distance difference to a difference threshold level and to recompute the homography in response to determining that the distance difference exceeds the difference threshold level.Type: GrantFiled: November 25, 2020Date of Patent: January 10, 2023Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal
-
Patent number: 11501454Abstract: An item position tracking system includes weight sensors each associated with a weight board. Each weight sensor transmits sensor data indicative of a weight of an item to its corresponding weight board. Each weight board is configured to assign a particular address number to its corresponding weight sensor. The weight boards transmit the sensor data and the address numbers to a circuit board that transmits the sensor data and the address numbers to a weight server. The weight server determines from which weight sensor data is originated based on the address numbers, and whether items were removed from the weight sensors.Type: GrantFiled: November 25, 2020Date of Patent: November 15, 2022Assignee: 7-ELEVEN, INC.Inventors: Fahad Mirza, Kyle Dalal, Ryan Jerman Jones, Shahmeer Ali Mirza
-
Patent number: 11501455Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.Type: GrantFiled: February 12, 2021Date of Patent: November 15, 2022Assignee: 7-ELEVEN, INC.Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
-
Patent number: 11475657Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide whether to use a virtual shopping cart to verify all or a portion of a transaction performed with an algorithmic shopping cart. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts do not match. A first negative reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts match.Type: GrantFiled: February 12, 2021Date of Patent: October 18, 2022Assignee: 7-ELEVEN, INC.Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
-
Publication number: 20220165063Abstract: An object tracking system that includes a first sensor and a second sensor that are each configured to capture frames of at least a portion of a global plane for a space. The system is configured to identify a pixel location for a marker within a frame from the first sensor and to determine an (x,y) coordinate for the marker using a first homography. The system is further configured to identify a pixel location for a different marker in a frame from the second sensor and to determine an (x,y) coordinate for the marker using a second homography. The system is further configured to determine a distance difference between the computed distance between the (x,y) coordinates and an actual distance. The system is further configured to recompute the first homography and/or the second homography in response to determining that the distance difference exceeds a difference threshold level.Type: ApplicationFiled: February 10, 2022Publication date: May 26, 2022Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj KRISHNAMURTHY, Kyle Dalal
-
Patent number: 11301691Abstract: An object tracking system that includes a first sensor and a second sensor that are each configured to capture frames of at least a portion of a global plane for a space. The system is configured to identify a pixel location for a marker within a frame from the first sensor and to determine an (x,y) coordinate for the marker using a first homography. The system is further configured to identify a pixel location for a different marker in a frame from the second sensor and to determine an (x,y) coordinate for the marker using a second homography. The system is further configured to determine a distance difference between the computed distance between the (x,y) coordinates and an actual distance. The system is further configured to recompute the first homography and/or the second homography in response to determining that the distance difference exceeds a difference threshold level.Type: GrantFiled: November 25, 2020Date of Patent: April 12, 2022Assignee: 7-ELEVEN, INC.Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal
-
Publication number: 20210201510Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.Type: ApplicationFiled: March 17, 2021Publication date: July 1, 2021Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
-
Publication number: 20210183078Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.Type: ApplicationFiled: February 12, 2021Publication date: June 17, 2021Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
-
Patent number: 11030756Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.Type: GrantFiled: November 25, 2020Date of Patent: June 8, 2021Assignee: 7-Eleven, Inc.Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
-
Publication number: 20210166021Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide between using an algorithmic and a virtual cart to process a transaction. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is selected, and the feedback indicates that the carts do not match. A first negative reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is selected, and the feedback indicates that the carts match. The processor uses the reward to update the algorithm.Type: ApplicationFiled: November 25, 2020Publication date: June 3, 2021Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
-
Publication number: 20210166038Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.Type: ApplicationFiled: February 12, 2021Publication date: June 3, 2021Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
-
Publication number: 20210166025Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide whether to use a virtual shopping cart to verify all or a portion of a transaction performed with an algorithmic shopping cart. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts do not match. A first negative reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts match.Type: ApplicationFiled: February 12, 2021Publication date: June 3, 2021Inventors: Xinan Wang, Mathew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
-
Patent number: 11023741Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.Type: GrantFiled: November 25, 2020Date of Patent: June 1, 2021Assignee: 7-Eleven, Inc.Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
-
Patent number: 11023728Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide between using an algorithmic and a virtual cart to process a transaction. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is selected, and the feedback indicates that the carts do not match. A first negative reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is selected, and the feedback indicates that the carts match. The processor uses the reward to update the algorithm.Type: GrantFiled: November 25, 2020Date of Patent: June 1, 2021Assignee: 7-Eleven, Inc.Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
-
Publication number: 20210158051Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.Type: ApplicationFiled: November 25, 2020Publication date: May 27, 2021Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
-
Publication number: 20210124952Abstract: An object tracking system that includes a sensor that is configured to capture frames of at least a portion of a global plane for a space. The system is configured to receive a first frame from the sensor and to identify a first pixel location and a second pixel location within the first frame. The system is further configured to determine (x,y) coordinates by applying a homography to the first pixel location and the second pixel location. The system is further configured to determine an estimated distance between the (x,y) coordinates, to determine an actual distance, and to determine a distance difference between the estimated distance and the actual distance. The system is further configured to compare the distance difference to a difference threshold level and to recompute the homography in response to determining that the distance difference exceeds the difference threshold level.Type: ApplicationFiled: November 25, 2020Publication date: April 29, 2021Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal