Patents by Inventor Sarjoun Skaff

Sarjoun Skaff has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11774842
    Abstract: An image capture system for tracking target objects includes a movable base that supports one or more image capture modules, each of the image capture modules including a camera module, a first light module and a second light module. The camera module is mounted on a first plane of a mount bracket, the first light module is mounted on a second plane of the mounting bracket, and a second light module is mounted on a third plane of the mounting bracket. The first and second planes define a first angle, the first and third planes define a second angle, and the second angle is larger than the first angle. An output of the first light module and a light output of the second light module is selected based on an operating condition of the camera module.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: October 3, 2023
    Assignee: BOSSA NOVA ROBOTICS IP, INC.
    Inventors: Sarjoun Skaff, Matthew Brekken, Alexander Fink, Garrick Kremesec, Brendan Mcleod, Christian Carlberg
  • Publication number: 20220303445
    Abstract: An image capture system for tracking target objects includes a movable base that supports one or more image capture modules, each of the image capture modules including a camera module, a first light module and a second light module. The camera module is mounted on a first plane of a mount bracket, the first light module is mounted on a second plane of the mounting bracket, and a second light module is mounted on a third plane of the mounting bracket. The first and second planes define a first angle, the first and third planes define a second angle, and the second angle is larger than the first angle. An output of the first light module and a light output of the second light module is selected based on an operating condition of the camera module.
    Type: Application
    Filed: August 14, 2020
    Publication date: September 22, 2022
    Applicant: BOSSA NOVA ROBOTICS IP, INC.
    Inventors: Sarjoun SKAFF, Matthew BREKKEN, Alexander FINK, Garrick KREMESEC, Brendan MCLEOD, Christian CARLBERG
  • Publication number: 20220138674
    Abstract: An automated inventory monitoring system includes an image capture module able to create an image of an aisle of a retail store. Images of products labels are identified in the image and classified as shelf labels or peg labels. For shelf labels, an area of the shelf is defined and associated with the shelf label. Images of products are identified in the image and products on the shelf within an area associated with a shelf label are associated with the shelf label. Products located below a peg label are associated with the peg label. Based on the association between labels and products, out-of-stock products, plugs and spread may be detected and reported to the staff of the retail store.
    Type: Application
    Filed: April 13, 2020
    Publication date: May 5, 2022
    Inventors: Sarjoun SKAFF, Marios SAVVIDES, Uzair AHMED, Sreena NALLAMOTHU, Ran TAO, Nikhil MOHAN
  • Publication number: 20220108264
    Abstract: An automated inventory monitoring system includes an image capture module able to create an image of an aisle of a retail store. Product images and shelf label and peg label images are identified in the image and products are associated with product labels based on the positioning of the products with respect to the labels. Based on the association between labels and products, out-of-stock products are detected and reported to the retail store.
    Type: Application
    Filed: April 13, 2020
    Publication date: April 7, 2022
    Inventors: Sarjoun SKAFF, Marios SAVVIDES, Uzair AHMED, Nikhil MOHAN, Sreena NALLAMOTHU
  • Publication number: 20220083959
    Abstract: An automated inventory monitoring system includes an image capture module able to create a panoramic image of an aisle of a retail store. Images captured from the all of the store are stitched together to create a panoramic image of the aisle. Product images and label images are isolated from the panoramic image and classified, and a list of product images and label images is provided.
    Type: Application
    Filed: April 13, 2020
    Publication date: March 17, 2022
    Inventors: Sarjoun SKAFF, Marios SAVVIDES, Chenchen ZHU, Fangyi CHEN, Han ZHANG, Uzair AHMED, Sreena NALLAMOTHU
  • Patent number: 11153483
    Abstract: A method for monitoring a shelf includes the steps of moving a camera with multiple focus capability alongside a shelf. A series of shelf images are captured by the camera, with images of at least two different focal lengths being captured. Images having the same focal length can be merged to form at least two panoramic images suitable for further evaluation or review.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: October 19, 2021
    Assignee: Bossa Nova Robotics IP, Inc.
    Inventors: Alexander Fink, Garrick Kremesec, Matthew Brekken, Sarjoun Skaff
  • Patent number: 11087272
    Abstract: A system for building a product library without requiring a planogram includes an image capture unit operated to provide images of items. Taking data from a shelf label detector and depth map creation unit, a processing module can be used to compare detected shelf labels to a depth map, define a product bounding box, and associate the bounding box with an image provided by the image capture unit to build image descriptors. The system can include one or more autonomous robots for supporting and moving the image capture unit and other components.
    Type: Grant
    Filed: March 28, 2017
    Date of Patent: August 10, 2021
    Assignee: BOSSA NOVA ROBOTICS IP, INC.
    Inventors: Sarjoun Skaff, Jonathan Davis Taylor, Stephen Vincent Williams, Simant Dube
  • Patent number: 10769582
    Abstract: A camera system for inventory monitoring includes a movable base that supports multiple cameras. The multiple cameras are directed toward inventory to take a series of pictures along aisle of a retail store or warehouse. A processing module connected to the multiple cameras is used to stitch together the pictures, and along with depth information and product identification information, construct a real time or near real time inventory mapping of products positioned on aisle shelves. This information can be transferred to remote locations to simplify and speed product ordering, and assist in maintenance of appropriate product stock levels.
    Type: Grant
    Filed: June 26, 2017
    Date of Patent: September 8, 2020
    Assignee: BOSSA NOVA ROBOTICS IP, INC.
    Inventors: Stephen Williams, Juan Pablo Gonzalez, Sarjoun Skaff
  • Publication number: 20200068126
    Abstract: A method for monitoring a shelf includes the steps of moving a camera with multiple focus capability alongside a shelf. A series of shelf images are captured by the camera, with images of at least two different focal lengths being captured. Images having the same focal length can be merged to form at least two panoramic images suitable for further evaluation or review.
    Type: Application
    Filed: August 23, 2019
    Publication date: February 27, 2020
    Inventors: Alexander Fink, Garrick Kremesec, Matthew Brekken, Sarjoun Skaff
  • Patent number: 10565548
    Abstract: A manually assisted robot inventory monitoring method provides for detecting and reading shelf labels using an autonomous robot. Bounding boxes around possible products in a panoramic image can be taken with at least one camera associated with the autonomous robot. Products in the bounding boxes are automatically identified, with those that are not being later manually identified.
    Type: Grant
    Filed: March 28, 2017
    Date of Patent: February 18, 2020
    Assignee: BOSSA NOVA ROBOTICS IP, INC.
    Inventors: Sarjoun Skaff, Jonathan Davis Taylor, Stephen Vincent Williams, Simant Dube
  • Publication number: 20190034864
    Abstract: A method for greatly reducing data storage requirements of autonomous robots capable of product inventory is described. Instead using high resolution images for label identification and position tracking, a lower resolution map can be searched. Human or machines can identify position of labels, and via a reverse mapping, the corresponding position of a label on the high resolution image can be identified. Except for those portions of the high resolution image showing a label, most of the high resolution image can be discarded. Further processing on the limited image subset can be used to read the labels.
    Type: Application
    Filed: July 24, 2018
    Publication date: January 31, 2019
    Inventors: Sarjoun Skaff, Stephen Vincent Williams
  • Publication number: 20180133904
    Abstract: An articulated device may include a first steerable multi-linked mechanism and a second steerable multi-linked mechanism. The second steerable multi-linked mechanism may include a first link, a plurality of intermediate links and a second link movably coupled to a second one of the intermediate links. A first one of the intermediate links may be movably coupled to the first link. The articulated device may include a camera located within at least a portion of the second link and a protective shield connected to a distal end of the second link. The protective shield may surround at least a portion of the camera.
    Type: Application
    Filed: October 19, 2017
    Publication date: May 17, 2018
    Inventors: Brett Zubiate, Howard Choset, Amir Degani, Sarjoun Skaff
  • Publication number: 20180005176
    Abstract: A camera system for inventory monitoring includes a movable base that supports multiple cameras. The multiple cameras are directed toward inventory to take a series of pictures along aisle of a retail store or warehouse. A processing module connected to the multiple cameras is used to stitch together the pictures, and along with depth information and product identification information, construct a real time or near real time inventory mapping of products positioned on aisle shelves. This information can be transferred to remote locations to simplify and speed product ordering, and assist in maintenance of appropriate product stock levels.
    Type: Application
    Filed: June 26, 2017
    Publication date: January 4, 2018
    Inventors: Stephen Williams, Juan Pablo Gonzalez, Sarjoun Skaff
  • Patent number: 9821476
    Abstract: An articulated device may include a first steerable multi-linked mechanism and a second steerable multi-linked mechanism. The second steerable multi-linked mechanism may include a first link, a plurality of intermediate links and a second link movably coupled to a second one of the intermediate links. A first one of the intermediate links may be movably coupled to the first link. The articulated device may include a camera located within at least a portion of the second link and a protective shield connected to a distal end of the second link. The protective shield may surround at least a portion of the camera.
    Type: Grant
    Filed: March 9, 2015
    Date of Patent: November 21, 2017
    Assignee: Carnegie Mellon University
    Inventors: Brett Zubiate, Howard Choset, Amir Degani, Sarjoun Skaff
  • Publication number: 20170286773
    Abstract: A manually assisted robot inventory monitoring method provides for detecting and reading shelf labels using an autonomous robot. Bounding boxes around possible products in a panoramic image can be taken with at least one camera associated with the autonomous robot. Products in the bounding boxes are automatically identified, with those that are not being later manually identified.
    Type: Application
    Filed: March 28, 2017
    Publication date: October 5, 2017
    Inventors: Sarjoun Skaff, Jonathan Davis Taylor, Stephen Vincent Williams, Simant Dube
  • Publication number: 20170286901
    Abstract: A system for building a product library without requiring a planogram includes an image capture unit operated to provide images of items. Taking data from a shelf label detector and depth map creation unit, a processing module can be used to compare detected shelf labels to a depth map, define a product bounding box, and associate the bounding box with an image provided by the image capture unit to build image descriptors. The system can include one or more autonomous robots for supporting and moving the image capture unit and other components.
    Type: Application
    Filed: March 28, 2017
    Publication date: October 5, 2017
    Inventors: Sarjoun Skaff, Jonathan Davis Taylor, Stephen Vincent Williams, Simant Dube
  • Publication number: 20150239132
    Abstract: An articulated device may include a first steerable multi-linked mechanism and a second steerable multi-linked mechanism. The second steerable multi-linked mechanism may include a first link, a plurality of intermediate links and a second link movably coupled to a second one of the intermediate links. A first one of the intermediate links may be movably coupled to the first link. The articulated device may include a camera located within at least a portion of the second link and a protective shield connected to a distal end of the second link. The protective shield may surround at least a portion of the camera.
    Type: Application
    Filed: March 9, 2015
    Publication date: August 27, 2015
    Inventors: Brett Zubiate, Howard Choset, Amir Degani, Sarjoun Skaff
  • Patent number: 9005114
    Abstract: An articulated device may include a first steerable multi-linked mechanism and a second steerable multi-linked mechanism. The second steerable multi-linked mechanism may include a first link, a plurality of intermediate links and a second link movably coupled to a second one of the intermediate links. A first one of the intermediate links may be movably coupled to the first link. The articulated device may include a camera located within at least a portion of the second link and a protective shield connected to a distal end of the second link. The protective shield may surround at least a portion of the camera.
    Type: Grant
    Filed: April 14, 2009
    Date of Patent: April 14, 2015
    Assignee: Carnegie Mellon University
    Inventors: Brett Zubiate, Howard Choset, Amir Degani, Sarjoun Skaff
  • Patent number: 8919710
    Abstract: An apparatus for positioning a device. The apparatus includes a coupling member, a first arm, a second arm, and a sloped support member. The coupling member defines a first opening and a second opening. The first arm passes through the first opening, and the coupling member is movably connected to the first arm. The second arm passes through the second opening. The sloped support member is releasably connected to the second arm. The apparatus has at least five degrees of freedom.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: December 30, 2014
    Assignee: Carnegie Mellon University
    Inventors: Brett Zubiate, Sarjoun Skaff, Amir Degani, Howie Choset
  • Patent number: D945507
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: March 8, 2022
    Assignee: BOSSA NOVA ROBOTICS IP, INC.
    Inventors: Garrick Kremesec, Matthew Brekken, Carlos Ramos, Jussi Timonen, Christian Carlberg, Daniel Shope, Sarjoun Skaff, Rachael Putnam, Brendan McLeod