Patents by Inventor Kyle Dalal

Kyle Dalal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11893759
    Abstract: An object tracking system that includes a first sensor and a second sensor that are each configured to capture frames of at least a portion of a global plane for a space. The system is configured to identify a first pixel location for a marker within a first frame and to determine an (x,y) coordinate for the marker using a first homography. The system is further configured to identify a second pixel location for the marker in the second sensor using a second homography, to identify a third pixel location using a disparity mapping, and to determine a distance difference between the second pixel location and the third pixel location. The system is further configured to compare the distance difference to a difference threshold level and to recompute the first homography and/or the second homography in response to determining that the distance difference exceeds the difference threshold level.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: February 6, 2024
    Assignee: 7-ELEVEN, INC.
    Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal
  • Patent number: 11887372
    Abstract: An image sensor is positioned such that a field-of-view of the sensor encompasses portion of a beverage machine. The field-of-view includes a first zone associated with operating the beverage machine to dispense the beverage and a second zone in which a cup is placed to receive the beverage. A beverage assignment subsystem receives angled-view images from the image sensor. An event associated with an object entering one or both of the first zone and the second zone is detected. In image(s) associated with a start of the event, it is determined that both a hand of a person enters the first zone and the cup is placed in the second zone. If the cup remained in the second zone for at least a threshold time, the beverage is assigned to the person whose hand entered the first zone.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: January 30, 2024
    Assignee: 7-ELEVEN, INC.
    Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Xinan Wang
  • Patent number: 11721029
    Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: August 8, 2023
    Assignee: 7-ELEVEN, INC.
    Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
  • Patent number: 11587243
    Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: February 21, 2023
    Assignee: 7-ELEVEN, INC.
    Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
  • Patent number: 11551454
    Abstract: An object tracking system that includes a sensor that is configured to capture frames of at least a portion of a global plane for a space. The system is configured to receive a first frame from the sensor and to identify a first pixel location and a second pixel location within the first frame. The system is further configured to determine (x,y) coordinates by applying a homography to the first pixel location and the second pixel location. The system is further configured to determine an estimated distance between the (x,y) coordinates, to determine an actual distance, and to determine a distance difference between the estimated distance and the actual distance. The system is further configured to compare the distance difference to a difference threshold level and to recompute the homography in response to determining that the distance difference exceeds the difference threshold level.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: January 10, 2023
    Assignee: 7-ELEVEN, INC.
    Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal
  • Patent number: 11501454
    Abstract: An item position tracking system includes weight sensors each associated with a weight board. Each weight sensor transmits sensor data indicative of a weight of an item to its corresponding weight board. Each weight board is configured to assign a particular address number to its corresponding weight sensor. The weight boards transmit the sensor data and the address numbers to a circuit board that transmits the sensor data and the address numbers to a weight server. The weight server determines from which weight sensor data is originated based on the address numbers, and whether items were removed from the weight sensors.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: November 15, 2022
    Assignee: 7-ELEVEN, INC.
    Inventors: Fahad Mirza, Kyle Dalal, Ryan Jerman Jones, Shahmeer Ali Mirza
  • Patent number: 11501455
    Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: November 15, 2022
    Assignee: 7-ELEVEN, INC.
    Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
  • Patent number: 11475657
    Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide whether to use a virtual shopping cart to verify all or a portion of a transaction performed with an algorithmic shopping cart. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts do not match. A first negative reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts match.
    Type: Grant
    Filed: February 12, 2021
    Date of Patent: October 18, 2022
    Assignee: 7-ELEVEN, INC.
    Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
  • Publication number: 20220165063
    Abstract: An object tracking system that includes a first sensor and a second sensor that are each configured to capture frames of at least a portion of a global plane for a space. The system is configured to identify a pixel location for a marker within a frame from the first sensor and to determine an (x,y) coordinate for the marker using a first homography. The system is further configured to identify a pixel location for a different marker in a frame from the second sensor and to determine an (x,y) coordinate for the marker using a second homography. The system is further configured to determine a distance difference between the computed distance between the (x,y) coordinates and an actual distance. The system is further configured to recompute the first homography and/or the second homography in response to determining that the distance difference exceeds a difference threshold level.
    Type: Application
    Filed: February 10, 2022
    Publication date: May 26, 2022
    Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj KRISHNAMURTHY, Kyle Dalal
  • Patent number: 11301691
    Abstract: An object tracking system that includes a first sensor and a second sensor that are each configured to capture frames of at least a portion of a global plane for a space. The system is configured to identify a pixel location for a marker within a frame from the first sensor and to determine an (x,y) coordinate for the marker using a first homography. The system is further configured to identify a pixel location for a different marker in a frame from the second sensor and to determine an (x,y) coordinate for the marker using a second homography. The system is further configured to determine a distance difference between the computed distance between the (x,y) coordinates and an actual distance. The system is further configured to recompute the first homography and/or the second homography in response to determining that the distance difference exceeds a difference threshold level.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: April 12, 2022
    Assignee: 7-ELEVEN, INC.
    Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal
  • Publication number: 20210201510
    Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.
    Type: Application
    Filed: March 17, 2021
    Publication date: July 1, 2021
    Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
  • Publication number: 20210183078
    Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.
    Type: Application
    Filed: February 12, 2021
    Publication date: June 17, 2021
    Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
  • Patent number: 11030756
    Abstract: A tracking system includes a camera subsystem that includes cameras that capture vide of a space. Each camera is coupled with a camera client that determines local coordinates of people in the captured video. The camera clients generate frames that include color frames and depth frames labeled with an identifier number of the camera and their corresponding timestamps. The camera clients generate tracks that include metadata describing historical people detections, tracking identifications, timestamps, and the identifier number of the camera. The camera clients send the frames and tracks to cluster servers that maintain the frames and tracks such that they are retrievable using their corresponding labels. A camera server queries the cluster servers to receive the frames and tracks using their corresponding labels. The camera server determines the physical positions of people in the space based on the determined local coordinates.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: June 8, 2021
    Assignee: 7-Eleven, Inc.
    Inventors: Jon Andrew Crain, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal, Shahmeer Ali Mirza
  • Publication number: 20210166021
    Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide between using an algorithmic and a virtual cart to process a transaction. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is selected, and the feedback indicates that the carts do not match. A first negative reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is selected, and the feedback indicates that the carts match. The processor uses the reward to update the algorithm.
    Type: Application
    Filed: November 25, 2020
    Publication date: June 3, 2021
    Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
  • Publication number: 20210166038
    Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.
    Type: Application
    Filed: February 12, 2021
    Publication date: June 3, 2021
    Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
  • Publication number: 20210166025
    Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide whether to use a virtual shopping cart to verify all or a portion of a transaction performed with an algorithmic shopping cart. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts do not match. A first negative reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts match.
    Type: Application
    Filed: February 12, 2021
    Publication date: June 3, 2021
    Inventors: Xinan Wang, Mathew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
  • Patent number: 11023741
    Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: June 1, 2021
    Assignee: 7-Eleven, Inc.
    Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
  • Patent number: 11023728
    Abstract: An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide between using an algorithmic and a virtual cart to process a transaction. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is selected, and the feedback indicates that the carts do not match. A first negative reward is assigned when the algorithmic cart is selected, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is selected, and the feedback indicates that the carts match. The processor uses the reward to update the algorithm.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: June 1, 2021
    Assignee: 7-Eleven, Inc.
    Inventors: Xinan Wang, Matthew Raymond Magee, Kyle Dalal, Shahmeer Ali Mirza, Crystal Maung
  • Publication number: 20210158051
    Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.
    Type: Application
    Filed: November 25, 2020
    Publication date: May 27, 2021
    Inventors: Kyle Dalal, Sailesh Bharathwaaj Krishnamurthy, Shahmeer Ali Mirza
  • Publication number: 20210124952
    Abstract: An object tracking system that includes a sensor that is configured to capture frames of at least a portion of a global plane for a space. The system is configured to receive a first frame from the sensor and to identify a first pixel location and a second pixel location within the first frame. The system is further configured to determine (x,y) coordinates by applying a homography to the first pixel location and the second pixel location. The system is further configured to determine an estimated distance between the (x,y) coordinates, to determine an actual distance, and to determine a distance difference between the estimated distance and the actual distance. The system is further configured to compare the distance difference to a difference threshold level and to recompute the homography in response to determining that the distance difference exceeds the difference threshold level.
    Type: Application
    Filed: November 25, 2020
    Publication date: April 29, 2021
    Inventors: Shahmeer Ali Mirza, Sailesh Bharathwaaj Krishnamurthy, Kyle Dalal