Patents Assigned to Electronic Scripting Products, Inc.
  • Patent number: 10191559
    Abstract: A manipulated object using high optical contrast features and an on-board photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The manipulated object uses one or more controllers to determine its position and/or orientation, including full pose, in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector. The manipulated object can be embodied by any suitable device manipulated by a user, including a tablet computer or a phone.
    Type: Grant
    Filed: March 7, 2018
    Date of Patent: January 29, 2019
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Patent number: 9939911
    Abstract: A remotely controlled object (e.g., an aircraft) or a wearable article (e.g., virtual or augmented reality glasses) using high optical contrast features and a photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The remotely controlled object or wearable article uses one or more controllers to determine its position and/or orientation in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.
    Type: Grant
    Filed: January 11, 2016
    Date of Patent: April 10, 2018
    Assignee: ELECTRONIC SCRIPTING PRODUCTS, INC.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Patent number: 9852512
    Abstract: Efficient techniques of recovering the pose of an optical apparatus exploiting structural redundancies due the conditioned motion of an apparatus are disclosed. The techniques are based on determining a reduced homography consonant to the conditioned motion of the optical apparatus. The optical apparatus comprises an optical sensor on which space points are imaged as measured image points. The reduced homography is based on a reduced representation of the space points, obtained by exploiting the structural redundancy in the measured image points due to the conditioned motion. The reduced representation consonant with the conditioned motion is defined by rays in homogeneous coordinates and contained in a projective plane of the optical sensor.
    Type: Grant
    Filed: October 29, 2015
    Date of Patent: December 26, 2017
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Hector H. Gonzalez-Banos, Marek Alboszta, Michael J. Mandella
  • Patent number: 9235934
    Abstract: A wearable article, such as glasses for a virtual reality program or glasses for an augmented reality application, using light sources and a photodetector that detects their light and outputs data indicative of the detected light. The wearable article uses one or more controllers to determine its position and/or orientation in the environment based on the data output by the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.
    Type: Grant
    Filed: November 24, 2014
    Date of Patent: January 12, 2016
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Patent number: 9229540
    Abstract: The present invention relates to interfaces and methods for producing input for software applications based on the absolute pose of an item manipulated or worn by a user in a three-dimensional environment. Absolute pose in the sense of the present invention means both the position and the orientation of the item as described in a stable frame defined in that three-dimensional environment. The invention describes how to recover the absolute pose with optical hardware and methods, and how to map at least one of the recovered absolute pose parameters to the three translational and three rotational degrees of freedom available to the item to generate useful input. The applications that can most benefit from the interfaces and methods of the invention involve 3D virtual spaces including augmented reality and mixed reality environments.
    Type: Grant
    Filed: August 22, 2011
    Date of Patent: January 5, 2016
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Patent number: 9189856
    Abstract: A reduced homography H for an optical apparatus to recover pose parameters from imaged space points Pi using an optical sensor. The electromagnetic radiation from the space points Pi is recorded on the optical sensor at measured image coordinates. A structural uncertainty introduced in the measured image points is determined and a reduced representation of the measured image points is selected based on the type of structural uncertainty. The reduced representation includes rays {circumflex over (r)}i defined in homogeneous coordinates and contained in a projective plane of the optical apparatus. At least one pose parameter of the optical apparatus is then estimated by applying the reduced homography H and by applying a condition on the motion of the optical apparatus, the condition being consonant with the reduced representation employed in the reduced homography H.
    Type: Grant
    Filed: February 27, 2015
    Date of Patent: November 17, 2015
    Assignee: ELECTRONIC SCRIPTING PRODUCTS, INC.
    Inventors: Hector H. Gonzalez-Banos, Marek Alboszta, Michael J. Mandella
  • Patent number: 8970709
    Abstract: A reduced homography H for an optical apparatus to recover pose parameters from imaged space points Pi using an optical sensor. The electromagnetic radiation from the space points Pi is recorded on the optical sensor at measured image coordinates. A structural uncertainty introduced in the measured image points is determined and a reduced representation of the measured image points is selected based on the type of structural uncertainty. The reduced representation includes rays {circumflex over (r)}i defined in homogeneous coordinates and contained in a projective plane of the optical apparatus. At least one pose parameter of the optical apparatus is then estimated by applying the reduced homography H and by applying a condition on the motion of the optical apparatus, the condition being consonant with the reduced representation employed in the reduced homography H.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: March 3, 2015
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Hector H. Gonzalez-Banos, Marek Alboszta, Michael J. Mandella
  • Patent number: 8897494
    Abstract: A system with a remote control or wand equipped with a relative motion sensor that outputs data indicative of a change in position. The system has one or more light sources and a photodetector that detects their light and outputs data indicative of the detected light. One or more controllers are used to determine the absolute position of the wand based on the data output by the relative motion sensor and by the photodetector. The wand's absolute pose is determined from the data and includes the absolute position of a reference point on the wand and the wand's absolute orientation. A display is used to show an image defined by two orthogonal axes, e.g., those of world coordinates (Xo,Yo,Zo). The display is rendered as a function of absolute position of the wand in or along a third orthogonal axis.
    Type: Grant
    Filed: May 8, 2013
    Date of Patent: November 25, 2014
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Publication number: 20140145930
    Abstract: A system with a remote control or wand equipped with a relative motion sensor that outputs data indicative of a change in position. The system has one or more light sources and a photodetector that detects their light and outputs data indicative of the detected light. One or more controllers are used to determine the absolute position of the wand based on the data output by the relative motion sensor and by the photodetector. The wand's absolute pose is determined from the data and includes the absolute position of a reference point on the wand and the wand's absolute orientation. A display is used to show an image defined by two orthogonal axes, e.g., those of world coordinates (Xo,Yo,Zo). The display is rendered as a function of absolute position of the wand in or along a third orthogonal axis.
    Type: Application
    Filed: May 8, 2013
    Publication date: May 29, 2014
    Applicant: Electronic Scripting Products, Inc.
    Inventor: Electronic Scrpting Pruducts, Inc.
  • Patent number: 8553935
    Abstract: A system that has a remote control, e.g., a wand, equipped with a relative motion sensor that outputs data indicative of a change in position of the wand. The system also has one or more light sources and a photodetector that detects their light and outputs data indicative of the detected light. The system uses one or more controllers to determine the absolute position of the wand based on the data output by the relative motion sensor and by the photodetector. The data enables determination of the absolute pose of the wand, which includes the absolute position of a reference point chosen on the wand and the absolute orientation of the wand. To properly express the absolute parameters of position and/or orientation of the wand a reference location is chosen with respect to which the calculations are performed. The system is coupled to a display that shows an image defined by a first and second orthogonal axes such as two axes belonging to world coordinates (Xo,Yo,Zo).
    Type: Grant
    Filed: May 25, 2011
    Date of Patent: October 8, 2013
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Patent number: 8542219
    Abstract: An apparatus and method for processing pose data derived from a pose of an elongate object such as, for example, a jotting implement, a pointer, a robotic arm or a cane. The elongate object has a tip contacting a plane surface with one or more invariant features. The pose of the elongate object is measured optically from on-board by an optical measuring system with the aid of the invariant feature. The pose is used for preparing a corresponding pose data and a subset of the pose data is identified and transmitted to an application such as a user application, where the subset can serve as command data or input data. Since the elongate object moves while its tip is contacting the surface the pose is measured periodically at sufficiently frequent measurement times ti to describe the motion at a desired temporal resolution. The subset can include all or a portion of the orientation data that describe the orientation of the elongate object in space and/or position data of the tip on the surface.
    Type: Grant
    Filed: January 30, 2004
    Date of Patent: September 24, 2013
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Stewart R. Carl, Michael J. Mandella, Guanghua G. Zhang, Hector H. Gonzalez-Banos
  • Publication number: 20130194418
    Abstract: A reduced homography H for an optical apparatus to recover pose parameters from imaged space points Pi using an optical sensor. The electromagnetic radiation from the space points Pi is recorded on the optical sensor at measured image coordinates. A structural uncertainty introduced in the measured image points is determined and a reduced representation of the measured image points is selected based on the type of structural uncertainty. The reduced representation includes rays {circumflex over (r)}i defined in homogeneous coordinates and contained in a projective plane of the optical apparatus. At least one pose parameter of the optical apparatus is then estimated by applying the reduced homography H and by applying a condition on the motion of the optical apparatus, the condition being consonant with the reduced representation employed in the reduced homography H.
    Type: Application
    Filed: March 13, 2013
    Publication date: August 1, 2013
    Applicant: Electronic Scripting Products, Inc.
    Inventor: Electronic Scripting Products, Inc.
  • Patent number: 7961909
    Abstract: A system that has a remote control, e.g., a wand, equipped with a relative motion sensor that outputs data indicative of a change in position of the wand. The system also has one or more light sources and a photodetector that detects their light and outputs data indicative of the detected light. The system uses one or more controllers to determine the absolute position of the wand based on the data output by the relative motion sensor and by the photodetector. The data enables determination of the absolute pose of the wand, which includes the absolute position of a reference point chosen on the wand and the absolute orientation of the wand. To properly express the absolute parameters of position and/or orientation of the wand a reference location is chosen with respect to which the calculations are performed. The system is coupled to a display that shows an image defined by a first and second orthogonal axes such as two axes belonging to world coordinates (Xo,Yo,Zo).
    Type: Grant
    Filed: September 18, 2009
    Date of Patent: June 14, 2011
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Patent number: 7826641
    Abstract: An apparatus and method for optically inferring an absolute pose of a manipulated object in a real three-dimensional environment from on-board the object with the aid of an on-board optical measuring arrangement. At least one invariant feature located in the environment is used by the arrangement for inferring the absolute pose. The inferred absolute pose is expressed with absolute pose data (?, ?, ?, x, y, z) that represents Euler rotated object coordinates expressed in world coordinates (Xo, Yo, Zo) with respect to a reference location, such as, for example, the world origin. Other conventions for expressing absolute pose data in three-dimensional space and representing all six degrees of freedom (three translational degrees of freedom and three rotational degrees of freedom) are also supported. Irrespective of format, a processor prepares the absolute pose data and identifies a subset that may contain all or fewer than all absolute pose parameters.
    Type: Grant
    Filed: September 3, 2009
    Date of Patent: November 2, 2010
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Marek Alboszta
  • Patent number: 7729515
    Abstract: The present invention relates to an optical navigation system for determining a pose, which includes the position and orientation of an object in an environment. The optical navigation system uses a number of beacons affixed at known locations in the environment to provide electromagnetic radiation in a sequenced pattern. An on-board optic images the radiation from the beacons onto an on-board centroid sensing device to obtain an imaged distribution of the radiation on the on-board centroid sensing device. The centroid sensing device determines the centroid of the imaged distribution and provides centroid information to a navigation unit for determining the pose of the object from the centroid. The navigation system is particularly well-suited for navigating hand-held objects.
    Type: Grant
    Filed: October 31, 2006
    Date of Patent: June 1, 2010
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Michael J. Mandella, Hector H. Gonzalez-Banos, Timothy J. Hawks, Marek Alboszta
  • Patent number: 7474809
    Abstract: The present invention relates to a jotting implement that infers hand-jotted information from viewing a jotting surface and environmental landmarks. The hand-jotted information is any information marked on the jotting surface as a result of writing, jotting, drawing, sketching or otherwise operating on the jotting surface as well as hand-generated information produced by moving the implement in the air with respect to the jotting surface. The jotting implement has a nib for jotting and an arrangement for determining when the nib is jotting on the jotting surface. Further, the implement has an optical unit for viewing an environmental landmark and the jotting surface. The implement has a processing unit for receiving optical data of the environmental landmark and the jotting surface from the optical unit and determining from the optical data the physical coordinates of the nib with respect to the jotting surface.
    Type: Grant
    Filed: March 26, 2007
    Date of Patent: January 6, 2009
    Assignee: Electronic Scripting Products, inc.
    Inventors: Stewart R. Carl, Marek Alboszta, Michael J. Mandella, Hector H Gonzalez, Timothy Hawks
  • Patent number: 7268956
    Abstract: A dual viewpoint solid catadioptric lens has a first spherical refractive surface S1 having a center C1 located on an optical axis of the lens and having a radius r1, and a second spherical refractive surface S2 having a center C2 located on the optical axis of the lens and having a radius r2<r1. The lens also has a first ellipsoidal reflective surface E1 with foci F1 and F1? on the optical axis of the lens, and a second ellipsoidal partially reflective surface E2 having foci F2 and F2? on the optical axis of the lens. Focus F1 coincides with C1, focus F2 conincides with C2, and focus F1? coincides with F2?. The points C1 and C2 provide dual viewpoints for the lens, which may be used in a variety of imaging applications.
    Type: Grant
    Filed: January 19, 2006
    Date of Patent: September 11, 2007
    Assignee: Electronic Scripting Products, Inc.
    Inventor: Michael J. Mandella
  • Patent number: 7203384
    Abstract: The present invention relates to a jotting implement that infers hand-jotted information from a jotting surface. The hand-jotted information is any information marked on the jotting surface as a result of writing, jotting, drawing, sketching or in any other manner of marking or depositing marks on the jotting surface. Hand-jotted information is also information traced on the jotting surface without leaving any markings thereon or otherwise produced by the motions executed by the jotting implement with respect to the jotting surface while in contact with the jotting surface. The jotting implement has a nib for jotting and an arrangement for determining when the nib is jotting on the jotting surface. Further, the implement has an optical unit for viewing the jotting surface.
    Type: Grant
    Filed: August 13, 2003
    Date of Patent: April 10, 2007
    Assignee: Electronic Scripting Products, Inc.
    Inventor: Stewart R. Carl
  • Patent number: 7161664
    Abstract: An apparatus and a method are disclosed for optically determining a distance r to a feature from an origin or a center. The apparatus uses a beam generation unit for launching a reference beam on a reference path and a first beam on a first path. The center from which distance r is determined is selected such that it is along a line of the reference path and not along a line of the first path. Alternatively, the center can be chosen not to lie along a line of the reference path. A rotation mechanism rotates the reference path and the first path about the center such that the reference beam moves over the feature at a reference time tr and the first beam moves over the feature at a first time t1. A determination unit determines distance r between the center and the feature from an angular velocity ? of the reference beam over the feature and from times tr, t1.
    Type: Grant
    Filed: April 13, 2004
    Date of Patent: January 9, 2007
    Assignee: Electronic Scripting Products, Inc.
    Inventors: Dale H. Buermann, Michael J. Mandella
  • Patent number: 7113270
    Abstract: An elongate object optically determines at least one of its orientation parameters relative to a plane surface. A probe radiation beam is directed from the object at various angles ? to various locations on the plane, where the angle ? is a periodic function of time. Two angularly-selective radiation detectors oriented at fixed angles ?1 and ?2 sense scattered portions of the beam from two locations at two corresponding times. The orientation parameter is computed from a time difference ?t=t2?t1 between the two times.
    Type: Grant
    Filed: June 18, 2004
    Date of Patent: September 26, 2006
    Assignee: Electronics Scripting Products, Inc.
    Inventors: Dale H. Buermann, Michael J. Mandella