Patents by Inventor Mark Jamtgaard

Mark Jamtgaard has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11087130
    Abstract: Various embodiments are disclosed for simultaneous object localization and attribute classification using multitask deep neural networks. In an embodiment, a method comprises: obtaining, by a processing circuit, an image from an image capture device in an environment, the image including a target object in the environment; generating, by the processing circuit, predictions from the image for the target object using a multitask deep neural network, the multitask deep neural network including a network trunk and side branches, the network trunk configured for multi-scale feature extraction guided by supervision information provided by the side branches during training of the multitask deep neural network, the side branches configured as learning task-specific classifiers; and using, by the processing circuit, the predictions to localize the target object in the environment and to classify the target object and at least one attribute of the target object.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: August 10, 2021
    Assignee: RetailNext, Inc.
    Inventors: Dong Liu, Imran Saleemi, Mark Jamtgaard
  • Patent number: 10891741
    Abstract: Various embodiments are disclosed for detecting, tracking and counting objects of interest in video frames using fusion of image and depth modalities. In an embodiment, a method comprises: obtaining multiple frames of stereo image pairs from an image capturing device; rectifying each frame of the stereo image pairs; computing a stereo disparity for each frame of the stereo image pairs; determining a first set of object detections in each frame using the computed stereo disparity; determining a second set of object detections in each left or right frame of the stereo image pair using one or more machine learning models; fusing the first and second sets of object detections; and creating tracks based on the fused object detections.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: January 12, 2021
    Assignee: RetailNext, Inc.
    Inventors: Imran Saleemi, Mark Jamtgaard, Dong Liu
  • Publication number: 20200242784
    Abstract: Various embodiments are disclosed for detecting, tracking and counting objects of interest in video. In an embodiment, a method of detecting and tracking objects of interest comprises: obtaining, by a computing device, multiple frames of images from an image capturing device; detecting, by the computing device, objects of interest in each frame; accumulating, by the computing device, multiple frames of object detections; creating, by the computing device, object tracks based on a batch of object detections over multiple frames; and associating, by the computing device, the object tracks over consecutive batches.
    Type: Application
    Filed: April 13, 2020
    Publication date: July 30, 2020
    Applicant: RetailNext, Inc.
    Inventors: Imran Saleemi, Mark Jamtgaard, Arun Nair
  • Patent number: 10621735
    Abstract: Various embodiments are disclosed for detecting, tracking and counting objects of interest in video. In an embodiment, a method of detecting and tracking objects of interest comprises: obtaining, by a computing device, multiple frames of images from an image capturing device; detecting, by the computing device, objects of interest in each frame; accumulating, by the computing device, multiple frames of object detections; creating, by the computing device, object tracks based on a batch of object detections over multiple frames; and associating, by the computing device, the object tracks over consecutive batches.
    Type: Grant
    Filed: November 15, 2018
    Date of Patent: April 14, 2020
    Assignee: RetailNext, Inc.
    Inventors: Imran Saleemi, Mark Jamtgaard, Arun Nair
  • Publication number: 20190325588
    Abstract: Various embodiments are disclosed for detecting, tracking and counting objects of interest in video. In an embodiment, a method of detecting and tracking objects of interest comprises: obtaining, by a computing device, multiple frames of images from an image capturing device; detecting, by the computing device, objects of interest in each frame; accumulating, by the computing device, multiple frames of object detections; creating, by the computing device, object tracks based on a batch of object detections over multiple frames; and associating, by the computing device, the object tracks over consecutive batches.
    Type: Application
    Filed: November 15, 2018
    Publication date: October 24, 2019
    Inventors: Imran Saleemi, Mark Jamtgaard, Arun Nair
  • Publication number: 20190205643
    Abstract: Various embodiments are disclosed for simultaneous object localization and attribute classification using multitask deep neural networks. In an embodiment, a method comprises: obtaining, by a processing circuit, an image from an image capture device in an environment, the image including a target object in the environment; generating, by the processing circuit, predictions from the image for the target object using a multitask deep neural network, the multitask deep neural network including a network trunk and side branches, the network trunk configured for multi-scale feature extraction guided by supervision information provided by the side branches during training of the multitask deep neural network, the side branches configured as learning task-specific classifiers; and using, by the processing circuit, the predictions to localize the target object in the environment and to classify the target object and at least one attribute of the target object.
    Type: Application
    Filed: December 26, 2018
    Publication date: July 4, 2019
    Inventors: Dong Liu, Imran Saleemi, Mark Jamtgaard
  • Publication number: 20190206066
    Abstract: Various embodiments are disclosed for detecting, tracking and counting objects of interest in video frames using fusion of image and depth modalities. In an embodiment, a method comprises: obtaining multiple frames of stereo image pairs from an image capturing device; rectifying each frame of the stereo image pairs; computing a stereo disparity for each frame of the stereo image pairs; determining a first set of object detections in each frame using the computed stereo disparity; determining a second set of object detections in each left or right frame of the stereo image pair using one or more machine learning models; fusing the first and second sets of object detections; and creating tracks based on the fused object detections.
    Type: Application
    Filed: December 26, 2018
    Publication date: July 4, 2019
    Inventors: Imran Saleemi, Mark Jamtgaard, Dong Liu
  • Patent number: 10134146
    Abstract: Various embodiments are disclosed for detecting, tracking and counting objects of interest in video. In an embodiment, a method of detecting and tracking objects of interest comprises: obtaining, by a computing device, multiple frames of images from an image capturing device; detecting, by the computing device, objects of interest in each frame; accumulating, by the computing device, multiple frames of object detections; creating, by the computing device, object tracks based on a batch of object detections over multiple frames; and associating, by the computing device, the object tracks over consecutive batches.
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: November 20, 2018
    Assignee: RetailNext, Inc.
    Inventors: Imran Saleemi, Mark Jamtgaard, Arun Nair
  • Publication number: 20180158063
    Abstract: A system, method and non-transitory, computer-readable storage medium are disclosed for point-of-sale (POS) fraud detection using, POS transaction data, video data and statistical evaluations of employee behavior. In an embodiment, the POS transaction data, video data and statistical evaluations are used to examine patterns of individual employees of an organization versus metrics across all employees of the organization to identify employees that are most likely to perform a fraudulent transaction.
    Type: Application
    Filed: December 23, 2016
    Publication date: June 7, 2018
    Inventors: Mark Jamtgaard, Arun Nair
  • Patent number: 9882955
    Abstract: A wireless analytics system and method are disclosed that take shoppers through an initial registration process, after which they can access the Internet quickly and easily every time they visit any of the retailer's stores. During future visits to any of the retailer's store locations the shopper's device is automatically granted network access as soon as it is within wireless range. Once on the network, a shopper can access websites, social networks, and shopping resources from across the mobile web. The system collects information about these access events, including the location and timestamp of each access event. The retailer may be notified when a shopper enters their store. This information may automate the check-in process for processes within the retail store or within a mobile application.
    Type: Grant
    Filed: January 9, 2013
    Date of Patent: January 30, 2018
    Assignee: Retailnext, Inc.
    Inventors: Mark Jamtgaard, Nathan Mueller, Peter Sanford
  • Publication number: 20170206669
    Abstract: Various embodiments are disclosed for detecting, tracking and counting objects of interest in video. In an embodiment, a method of detecting and tracking objects of interest comprises: obtaining, by a computing device, multiple frames of images from an image capturing device; detecting, by the computing device, objects of interest in each frame; accumulating, by the computing device, multiple frames of object detections; creating, by the computing device, object tracks based on a batch of object detections over multiple frames; and associating, by the computing device, the object tracks over consecutive batches.
    Type: Application
    Filed: January 13, 2017
    Publication date: July 20, 2017
    Inventors: Imran Saleemi, Mark Jamtgaard, Arun Nair
  • Patent number: 9411037
    Abstract: In some implementations, video camera networks can be used to track people or objects and determine their locations. In some implementations, location accuracy better than one meter can be achieved using video cameras. According to some implementations, Wi-Fi localization and video localization systems can be fused together to perform calibration. In some implementations, by using the video network to continuously update the Wi-Fi localization calibration database, Wi-Fi location accuracy can be improved.
    Type: Grant
    Filed: August 17, 2011
    Date of Patent: August 9, 2016
    Assignee: RETAILNEXT, INC.
    Inventors: Mark Jamtgaard, Nathan Mueller
  • Patent number: 9270952
    Abstract: According to some implementations, an estimate of a target's location can be calculated by correlating Wi-Fi and video location measurements. This spatio-temporal correlation combines the Wi-Fi and video measurements to determine an identity and location of an object. The accuracy of the video localization and the identity from the Wi-Fi network provide an accurate location of the Wi-Fi identified object.
    Type: Grant
    Filed: October 25, 2013
    Date of Patent: February 23, 2016
    Assignee: RetailNext, Inc.
    Inventors: Mark Jamtgaard, Nathan Mueller
  • Publication number: 20140285660
    Abstract: According to some implementations, an estimate of a target's location can be calculated by correlating Wi-Fi and video location measurements. This spatio-temporal correlation combines the Wi-Fi and video measurements to determine an identity and location of an object. The accuracy of the video localization and the identity from the Wi-Fi network provide an accurate location of the Wi-Fi identified object.
    Type: Application
    Filed: October 25, 2013
    Publication date: September 25, 2014
    Applicant: NEARBUY SYSTEMS, INC.
    Inventors: Mark Jamtgaard, Nathan Mueller
  • Publication number: 20140195380
    Abstract: A wireless analytics system and method are disclosed that take shoppers through an initial registration process, after which they can access the Internet quickly and easily every time they visit any of the retailer's stores. During future visits to any of the retailer's store locations the shopper's device is automatically granted network access as soon as it is within wireless range. Once on the network, a shopper can access websites, social networks, and shopping resources from across the mobile web. The system collects information about these access events, including the location and timestamp of each access event. The retailer may be notified when a shopper enters their store. This information may automate the check-in process for processes within the retail store or within a mobile application.
    Type: Application
    Filed: January 9, 2013
    Publication date: July 10, 2014
    Inventors: Mark Jamtgaard, Nathan Mueller, Peter Sanford
  • Patent number: 8615254
    Abstract: According to some implementations, an estimate of a target's location can be calculated by correlating Wi-Fi and video location measurements. This spatio-temporal correlation combines the Wi-Fi and video measurements to determine an identity and location of an object. The accuracy of the video localization and the identity from the Wi-Fi network provide an accurate location of the Wi-Fi identified object.
    Type: Grant
    Filed: August 17, 2011
    Date of Patent: December 24, 2013
    Assignee: NearBuy Systems, Inc.
    Inventors: Mark Jamtgaard, Nathan Mueller
  • Publication number: 20120046044
    Abstract: According to some implementations, an estimate of a target's location can be calculated by correlating Wi-Fi and video location measurements. This spatio-temporal correlation combines the Wi-Fi and video measurements to determine an identity and location of an object. The accuracy of the video localization and the identity from the Wi-Fi network provide an accurate location of the Wi-Fi identified object.
    Type: Application
    Filed: August 17, 2011
    Publication date: February 23, 2012
    Inventors: Mark Jamtgaard, Nathan Mueller
  • Publication number: 20120044355
    Abstract: In some implementations, video camera networks can be used to track people or objects and determine their locations. In some implementations, location accuracy better than one meter can be achieved using video cameras. According to some implementations, Wi-Fi localization and video localization systems can be fused together to perform calibration. In some implementations, by using the video network to continuously update the Wi-Fi localization calibration database, Wi-Fi location accuracy can be improved.
    Type: Application
    Filed: August 17, 2011
    Publication date: February 23, 2012
    Applicant: NEARBUY SYSTEMS, INC.
    Inventors: Mark Jamtgaard, Nathan Mueller
  • Patent number: 6430624
    Abstract: A content delivery system and method are provided in which different types of content may be delivered to different information appliances having different protocols and different browser specifications. The system permits internet content providers to create a single piece of content that is re-formatted automatically for the different information appliances.
    Type: Grant
    Filed: February 14, 2000
    Date of Patent: August 6, 2002
    Assignee: Air2Web, Inc.
    Inventors: Mark Jamtgaard, Jacob Sullivan, Tyler Kohn