Patents by Inventor Michael Kallay

Michael Kallay has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11557058
    Abstract: A machine vision-based method and system to facilitate the unloading of a pile of cartons within a work cell are provided. The method includes the step of providing at least one 3-D or depth sensor having a field of view at the work cell. Each sensor has a set of radiation sensing elements which detect reflected, projected radiation to obtain 3-D sensor data. The 3-D sensor data including a plurality of pixels. For each possible pixel location and each possible carton orientation, the method includes generating a hypothesis that a carton with a known structure appears at that pixel location with that container orientation to obtain a plurality of hypotheses. The method further includes ranking the plurality of hypotheses. The step of ranking includes calculating a surprisal for each of the hypotheses to obtain a plurality of surprisals. The step of ranking is based on the surprisals of the hypotheses.
    Type: Grant
    Filed: June 29, 2022
    Date of Patent: January 17, 2023
    Assignee: Liberty Reach Inc.
    Inventors: G. Neil Haven, Michael Kallay
  • Publication number: 20220327736
    Abstract: A machine vision-based method and system to facilitate the unloading of a pile of cartons within a work cell are provided. The method includes the step of providing at least one 3-D or depth sensor having a field of view at the work cell. Each sensor has a set of radiation sensing elements which detect reflected, projected radiation to obtain 3-D sensor data. The 3-D sensor data including a plurality of pixels. For each possible pixel location and each possible carton orientation, the method includes generating a hypothesis that a carton with a known structure appears at that pixel location with that container orientation to obtain a plurality of hypotheses. The method further includes ranking the plurality of hypotheses. The step of ranking includes calculating a surprisal for each of the hypotheses to obtain a plurality of surprisals. The step of ranking is based on the surprisals of the hypotheses.
    Type: Application
    Filed: June 29, 2022
    Publication date: October 13, 2022
    Applicant: Liberty Reach, Inc.
    Inventors: G. Neil Haven, Michael Kallay
  • Patent number: 11461926
    Abstract: A machine vision-based method and system for measuring 3D pose of a part or subassembly of parts having an unknown pose are disclosed. A number of different applications of the method and system are disclosed including applications which utilize a reprogrammable industrial automation machine such as a robot. The method includes providing a reference cloud of 3D voxels which represent a reference surface of a reference part or subassembly having a known reference pose. Using at least one 2D/3D hybrid sensor, a sample cloud of 3D voxels which represent a corresponding surface of a sample part or subassembly of the same type as the reference part or subassembly is acquired. The sample part or subassembly has an actual pose different from the reference pose. The voxels of the sample and reference clouds are processed utilizing a matching algorithm to determine the pose of the sample part or subassembly.
    Type: Grant
    Filed: September 15, 2020
    Date of Patent: October 4, 2022
    Assignee: Liberty Reach Inc.
    Inventors: G. Neil Haven, Gary William Bartos, Michael Kallay, Fansheng Meng
  • Patent number: 11436753
    Abstract: A machine vision-based method and system to facilitate the unloading of a pile of cartons within a work cell are provided. The method includes the step of providing at least one 3-D or depth sensor having a field of view at the work cell. Each sensor has a set of radiation sensing elements which detect reflected, projected radiation to obtain 3-D sensor data. The 3-D sensor data including a plurality of pixels. For each possible pixel location and each possible carton orientation, the method includes generating a hypothesis that a carton with a known structure appears at that pixel location with that container orientation to obtain a plurality of hypotheses. The method further includes ranking the plurality of hypotheses. The step of ranking includes calculating a surprisal for each of the hypotheses to obtain a plurality of surprisals. The step of ranking is based on the surprisals of the hypotheses.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: September 6, 2022
    Assignee: Liberty Reach, Inc.
    Inventors: G. Neil Haven, Michael Kallay
  • Publication number: 20210150760
    Abstract: A machine vision-based method and system to facilitate the unloading of a pile of cartons within a work cell are provided. The method includes the step of providing at least one 3-D or depth sensor having a field of view at the work cell. Each sensor has a set of radiation sensing elements which detect reflected, projected radiation to obtain 3-D sensor data. The 3-D sensor data including a plurality of pixels. For each possible pixel location and each possible carton orientation, the method includes generating a hypothesis that a carton with a known structure appears at that pixel location with that container orientation to obtain a plurality of hypotheses. The method further includes ranking the plurality of hypotheses. The step of ranking includes calculating a surprisal for each of the hypotheses to obtain a plurality of surprisals. The step of ranking is based on the surprisals of the hypotheses.
    Type: Application
    Filed: January 5, 2021
    Publication date: May 20, 2021
    Applicant: Liberty Reach, Inc.
    Inventors: G. Neil Haven, Michael Kallay
  • Publication number: 20200410712
    Abstract: A machine vision-based method and system for measuring 3D pose of a part or subassembly of parts having an unknown pose are disclosed. A number of different applications of the method and system are disclosed including applications which utilize a reprogrammable industrial automation machine such as a robot. The method includes providing a reference cloud of 3D voxels which represent a reference surface of a reference part or subassembly having a known reference pose. Using at least one 2D/3D hybrid sensor, a sample cloud of 3D voxels which represent a corresponding surface of a sample part or subassembly of the same type as the reference part or subassembly is acquired. The sample part or subassembly has an actual pose different from the reference pose. The voxels of the sample and reference clouds are processed utilizing a matching algorithm to determine the pose of the sample part or subassembly.
    Type: Application
    Filed: September 15, 2020
    Publication date: December 31, 2020
    Applicant: Liberty Reach Inc.
    Inventors: G. Neil Haven, Gary William Bartos, Michael Kallay, Fansheng Meng
  • Patent number: 10776949
    Abstract: A machine vision-based method and system for measuring 3D pose of a part or subassembly of parts having an unknown pose are disclosed. A number of different applications of the method and system are disclosed including applications which utilize a reprogrammable industrial automation machine such as a robot. The method includes providing a reference cloud of 3D voxels which represent a reference surface of a reference part or subassembly having a known reference pose. Using at least one 2D/3D hybrid sensor, a sample cloud of 3D voxels which represent a corresponding surface of a sample part or subassembly of the same type as the reference part or subassembly is acquired. The sample part or subassembly has an actual pose different from the reference pose. The voxels of the sample and reference clouds are processed utilizing a matching algorithm to determine the pose of the sample part or subassembly.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: September 15, 2020
    Assignee: Liberty Reach Inc.
    Inventors: G. Neil Haven, Gary William Bartos, Michael Kallay, Fansheng Meng
  • Publication number: 20200134860
    Abstract: A machine vision-based method and system for measuring 3D pose of a part or subassembly of parts having an unknown pose are disclosed. A number of different applications of the method and system are disclosed including applications which utilize a reprogrammable industrial automation machine such as a robot. The method includes providing a reference cloud of 3D voxels which represent a reference surface of a reference part or subassembly having a known reference pose. Using at least one 2D/3D hybrid sensor, a sample cloud of 3D voxels which represent a corresponding surface of a sample part or subassembly of the same type as the reference part or subassembly is acquired. The sample part or subassembly has an actual pose different from the reference pose. The voxels of the sample and reference clouds are processed utilizing a matching algorithm to determine the pose of the sample part or subassembly.
    Type: Application
    Filed: October 30, 2018
    Publication date: April 30, 2020
    Applicant: Liberty Reach Inc.
    Inventors: G. Neil Haven, Gary William Bartos, Michael Kallay, Fansheng Meng
  • Patent number: 10591277
    Abstract: Method and system for measuring outermost dimensions of a vehicle positioned at an inspection station and having top, front, back and side exterior surfaces are provided. The system includes a plurality of 3-D or depth sensors supported around and above the vehicle at the inspection station. Each of the sensors has a field of view so that one of the exterior surfaces of the vehicle is in one of the fields of view. Each sensor includes a set of radiation sensing elements which detect projected radiation reflected from its exterior surface to obtain sensor data. At least one processor processes the sensor data from each of the sensors to obtain a virtual 3-D model of the vehicle. Control logic is employed to obtain measurements of outermost dimensions of the vehicle based on the 3-D model.
    Type: Grant
    Filed: July 28, 2016
    Date of Patent: March 17, 2020
    Assignee: Liberty Reach Inc.
    Inventors: Michael Kallay, Gary W. Bartos, Grason Brennan, G. Neil Haven
  • Publication number: 20180031364
    Abstract: Method and system for measuring outermost dimensions of a vehicle positioned at an inspection station and having top, front, back and side exterior surfaces are provided. The system includes a plurality of 3-D or depth sensors supported around and above the vehicle at the inspection station. Each of the sensors has a field of view so that one of the exterior surfaces of the vehicle is in one of the fields of view. Each sensor includes a set of radiation sensing elements which detect projected radiation reflected from its exterior surface to obtain sensor data. At least one processor processes the sensor data from each of the sensors to obtain a virtual 3-D model of the vehicle. Control logic is employed to obtain measurements of outermost dimensions of the vehicle based on the 3-D model.
    Type: Application
    Filed: July 28, 2016
    Publication date: February 1, 2018
    Inventors: Michael Kallay, Gary W. Bartos, Grason Brennan, G. Neil Haven
  • Patent number: 9043186
    Abstract: Various technologies described herein pertain to computing surface normals for points in a point cloud. The point cloud is representative of a measured surface of a physical object. A point in the point cloud can be set as a point of origin, and points in the point cloud can be modeled as electrostatic point charges. Moreover, a point of least electrostatic potential on a sphere centered at the point of origin can be computed as a function of the electrostatic point charges. Further, unit vector with a direction from the point of origin to the point of least electrostatic potential on the sphere can be assigned as a normal for the point of origin.
    Type: Grant
    Filed: December 8, 2011
    Date of Patent: May 26, 2015
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Kallay, Simon A. J. Winder
  • Publication number: 20150070356
    Abstract: Techniques to manage map information illustrating a transition between views of a digital map. The transition may refer to a visual transition from a three dimensional map view and a two dimensional map view or vice versa. For each map location, the map information may include a set of spherical coordinates that corresponds to intermediate map views. This set of spherical coordinates enable presentation to a user the visual transition such that user is able to switch between viewing spatially correct surface locations and substantially all surface locations. Other embodiments are described and claimed.
    Type: Application
    Filed: April 14, 2014
    Publication date: March 12, 2015
    Applicant: Microsoft Corporation
    Inventors: Alexandre DA VEIGA, Ehab SOBHY, Michael KALLAY, Ian WOOD
  • Patent number: 8669983
    Abstract: A method with acts for representing a buffer about a feature represented on an ellipsoid or round-object model. The method includes accessing a definition of a buffer stored on one or more computer readable medium in a format readable by a computer application. The definition of the buffer includes a number of arcs around a feature on an ellipsoid or round-object model. Each of the arcs is defined using three points defined using geodetic coordinates. The three points includes two endpoints of a given arc and a point on the arc between the two endpoints. The method further includes rendering the buffer by rendering the plurality of arcs. The method further includes displaying the rendered buffer to a user at a computing system display.
    Type: Grant
    Filed: August 31, 2010
    Date of Patent: March 11, 2014
    Assignee: Microsoft Corporation
    Inventors: Michael Kallay, Danica M. Porobic
  • Publication number: 20140047385
    Abstract: Concepts and technologies are described herein for providing a 3D data environment disambiguation tool. In accordance with some concepts and technologies disclosed herein, a 3D data environment disambiguation tool can be configured to resolve an ambiguity associated with one or more data points to be rendered in a 3D data environment. The 3D data environment disambiguation tool can present various user interfaces to receive inputs to resolve an ambiguity associated with a data point. The ambiguity can be resolved prior to, in conjunction with, or after the selected data is rendered in a 3D data environment, or various combinations thereof.
    Type: Application
    Filed: February 5, 2013
    Publication date: February 13, 2014
    Applicant: MICROSOFT CORPORATION
    Inventors: B. Scott Ruble, Kevin Fan, Jai Srinivasan, Michael Kallay, Alexandre da Veiga, Ehab Sobhy
  • Publication number: 20140043340
    Abstract: Concepts and technologies are described herein for animation transitions and effects in a spreadsheet application. In accordance with the concepts and technologies disclosed herein, a computer system can execute a visualization component. The computer system can detect selection of a scene included in a visualization of spreadsheet data. The computer system also can generate an effect for the scene selected. In some embodiments, the computer system identifies another scene and generates a transition between the scenes. The computer system can output the effect animation and the transition animation.
    Type: Application
    Filed: March 15, 2013
    Publication date: February 13, 2014
    Applicant: MICROSOFT CORPORATION
    Inventors: Ehab Sobhy, Steven Drucker, Michael Kallay, Alexandre da Veiga, John Alfred Payne, Curtis G. Wong, Jonathan Edgar Fay, Igor Borisov Peev
  • Patent number: 8638327
    Abstract: A system and method that facilitates planar processing of round earth data by employing a tiled projection is provided. The tiled projection is a two-step projection from the surface of the earth to a common plane that preserves polygons and polygonal paths. During the first step, the system performs a gnomonic projection to the facets of a circumscribed platonic solid, which maps spherical polygons to spatial polygons on the facets of the solid. During the second step, the system performs a polygon-preserving projection from the facets of the platonic solid to tiles in common plane. Thus, projections from multiple facets of the platonic solid on the common plane are processed by employing a planar algorithm.
    Type: Grant
    Filed: May 8, 2008
    Date of Patent: January 28, 2014
    Assignee: Microsoft Corporation
    Inventors: Michael Kallay, Isaac Kenneth Kunen
  • Publication number: 20130151210
    Abstract: Various technologies described herein pertain to computing surface normals for points in a point cloud. The point cloud is representative of a measured surface of a physical object. A point in the point cloud can be set as a point of origin, and points in the point cloud can be modeled as electrostatic point charges. Moreover, a point of least electrostatic potential on a sphere centered at the point of origin can be computed as a function of the electrostatic point charges. Further, unit vector with a direction from the point of origin to the point of least electrostatic potential on the sphere can be assigned as a normal for the point of origin.
    Type: Application
    Filed: December 8, 2011
    Publication date: June 13, 2013
    Applicant: MICROSOFT CORPORATION
    Inventors: Michael Kallay, Simon A. J. Winder
  • Publication number: 20120050294
    Abstract: A method with acts for representing a buffer about a feature represented on an ellipsoid or round-object model. The method includes accessing a definition of a buffer stored on one or more computer readable medium in a format readable by a computer application. The definition of the buffer includes a number of arcs around a feature on an ellipsoid or round-object model. Each of the arcs is defined using three points defined using geodetic coordinates. The three points includes two endpoints of a given arc and a point on the arc between the two endpoints. The method further includes rendering the buffer by rendering the plurality of arcs. The method further includes displaying the rendered buffer to a user at a computing system display.
    Type: Application
    Filed: August 31, 2010
    Publication date: March 1, 2012
    Applicant: Microsoft Corporation
    Inventors: Michael Kallay, Danica M. Porobic
  • Patent number: 7752543
    Abstract: Effects are applied to a shape that is generated from a merged text path. The merged text path is created from text paths that are associated with a text run. Boolean operations may be used to create the merged text path. The merged text path removes any overlap and redundancy of the characters within the text run. The shape that is generated from the merged text path maintains the text path information that is associated with the text run such that additional effects may be applied to the shape.
    Type: Grant
    Filed: February 17, 2006
    Date of Patent: July 6, 2010
    Assignee: Microsoft Corporation
    Inventors: Lutz Gerhard, Michael J. Arvold, Michael Kallay
  • Patent number: 7542049
    Abstract: Systems and methods are provided for providing anti-aliasing by introducing a falloff area around a graphics object to be rendered. The falloff area is shaded, using Gouraud shading or texture mapping to reduce the aliasing effects of the graphics object. The outside edge of the falloff area is set to be fully transparent, and the inside edge to an opacity matching the outer edge of the graphics object being rendered. To counteract bloating effects, the graphics object is shrunk by half the width of the falloff area. While the width of the falloff area may vary, generally, the width of the falloff area stays constant. In one embodiment, this width corresponds to the edge or diagonal of the square area mapped to each pixel.
    Type: Grant
    Filed: March 16, 2006
    Date of Patent: June 2, 2009
    Assignee: Microsoft Corporation
    Inventors: Christopher Raubacher, Gregory D. Swedberg, Ashraf A. Michail, Michael Kallay