Abstract: A system and method for generating input data from a pose estimate for a pose (position and orientation) of a manipulated object operated in a three-dimensional environment that offers optical features. The manipulated object has an on-board photodetector for providing light data and an on-board auxiliary motion detection component for providing relative motion data indicative of a change in an orientation, a change in position or both (relative change in pose). A processor in communication with the on-board photodetector and auxiliary motion detection component uses light data to determine an absolute pose estimate at times ti and relative motion data to determine a relative pose change. The processor deploys a technique that combines the absolute pose estimate from the light data and the relative pose change from the relative motion data to provide the pose estimate at an application request time tr.

Abstract: The present invention discloses systems and methods for both viewing and interacting with a virtual reality (VR), an augmented reality (AR) or a mixed reality (MR). More specifically, the systems and methods allow the user to interact with aspects of such realities including virtual items presented in such realities or within such environments by manipulating a control device that has an inside-out camera mounted on-board. The apparatus or system uses two distinct representations including a reduced representation in determining the pose of the control device and uses these representations to compute an interactive pose portion of the control device to be used for interacting with the virtual item. The reduced representation is consonant with a constrained motion of the control device.

Abstract: The present invention discloses systems and methods for both viewing and interacting with a virtual reality (VR), an augmented reality (AR) or a mixed reality (MR). More specifically, the systems and methods allow the user to interact with aspects of such realities including virtual items presented in such realities or within such environments by manipulating a control device that has an inside-out camera mounted on-board. The apparatus or system uses two distinct representations including a reduced representation in determining the pose of the control device and uses these representations to compute an interactive pose portion of the control device to be used for interacting with the virtual item. The reduced representation is consonant with a constrained motion of the control device.

Abstract: A system, including a structured illumination stage to provide a spatially modulated imaging field is provided. The system further includes a spatial frequency modulation stage to adjust the frequency of the spatially modulated imaging field, a sample interface stage to direct the spatially modulated imaging field to a sample, and a sensor configured to receive a plurality of fluorescence emission signals from the sample. The system also includes a processor configured to reduce a sample scattering signal and to provide a fluorescence emission signal from a portion of the sample including the spatially modulated imaging field. A method for using the above system to form an image of the sample is also provided.

Abstract: The present disclosure describes a Raman topography system, which includes a container with at least one Raman probe positioned within. Also described are methods of imaging which include the Raman topography system.

Abstract: A manipulated object using high optical contrast features and an on-board photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The manipulated object uses one or more controllers to determine its position and/or orientation, including full pose, in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector. The manipulated object can be embodied by any suitable device manipulated by a user, including a tablet computer or a phone.

Abstract: A system, including a structured illumination stage to provide a spatially modulated imaging field is provided. The system further includes a spatial frequency modulation stage to adjust the frequency of the spatially modulated imaging field, a sample interface stage to direct the spatially modulated imaging field to a sample, and a sensor configured to receive a plurality of fluorescence emission signals from the sample. The system also includes a processor configured to reduce a sample scattering signal and to provide a fluorescence emission signal from a portion of the sample including the spatially modulated imaging field. A method for using the above system to form an image of the sample is also provided.

Abstract: A manipulated object using high optical contrast features and an on-board photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The manipulated object uses one or more controllers to determine its position and/or orientation, including full pose, in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector. The manipulated object can be embodied by any suitable device manipulated by a user, including a tablet computer or a phone.

Abstract: The present disclosure describes a Raman topography system, which includes a container with at least one Raman probe positioned within. Also described are methods of imaging which include the Raman topography system.

Abstract: A remotely controlled object (e.g., an aircraft) or a wearable article (e.g., virtual or augmented reality glasses) using high optical contrast features and a photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The remotely controlled object or wearable article uses one or more controllers to determine its position and/or orientation in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.

Abstract: Efficient techniques of recovering the pose of an optical apparatus exploiting structural redundancies due the conditioned motion of an apparatus are disclosed. The techniques are based on determining a reduced homography consonant to the conditioned motion of the optical apparatus. The optical apparatus comprises an optical sensor on which space points are imaged as measured image points. The reduced homography is based on a reduced representation of the space points, obtained by exploiting the structural redundancy in the measured image points due to the conditioned motion. The reduced representation consonant with the conditioned motion is defined by rays in homogeneous coordinates and contained in a projective plane of the optical sensor.

Abstract: Various aspects as described herein are directed to apparatuses, methods, and systems including a sandwiched arrangement having a light-access port, a scanning mirror, an optics region, and a spacer. The spacer provides a light-directing optical region that separates the scanning mirror and the optics region, and includes a mirrored surface that reflects light between the light-access port and the optics region. Additionally, the optics region includes a curved-shaped window that provides a field of view by communicating beams of light between a target region. The optics region also includes a curved-shaped mirror having a surface that reflects light between the scanning mirror and the mirrored surface. Light beams, as conveyed between the light-access port and the curved-shaped window, are folded by being reflected off the scanning mirror, the curved-shaped mirror and the mirrored surface.

Abstract: The present invention discloses apparatus and methods for the viewing of a reality, and in particular a comfortable and pleasant viewing of the reality by a user. The reality is viewed by the user with a viewing mechanism that may involve optics. The reality viewed may be a virtual reality, an augmented reality or a mixed reality. A projection mechanism renders the scene for the user and modifies one or more virtual objects present in the scene. The modification performed is based on one or more properties of an inside-out camera. The modification and the associated property/properties of the inside-out camera are suitably chosen to fit an application need such as to provide a pleasant and comfortable viewing experience for the user. The inside-out camera may be attached to the viewing mechanism, which may be worn by the user. The reality viewed may be from the viewpoint of the user, or from the viewpoint of another device detached from the user.

Abstract: A remotely controlled object (e.g., an aircraft) or a wearable article (e.g., virtual or augmented reality glasses) using high optical contrast features and a photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The remotely controlled object or wearable article uses one or more controllers to determine its position and/or orientation in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.

Abstract: The present invention relates to interfaces and methods for producing input for software applications based on the absolute pose of an item manipulated or worn by a user in a three-dimensional environment. Absolute pose in the sense of the present invention means both the position and the orientation of the item as described in a stable frame defined in that three-dimensional environment. The invention describes how to recover the absolute pose with optical hardware and methods, and how to map at least one of the recovered absolute pose parameters to the three translational and three rotational degrees of freedom available to the item to generate useful input. The applications that can most benefit from the interfaces and methods of the invention involve 3D virtual spaces including augmented reality and mixed reality environments.

Abstract: Efficient techniques of recovering the pose of an optical apparatus exploiting structural redundancies due the conditioned motion of an apparatus are disclosed. The techniques are based on determining a reduced homography consonant to the conditioned motion of the optical apparatus. The optical apparatus comprises an optical sensor on which space points are imaged as measured image points. The reduced homography is based on a reduced representation of the space points, obtained by exploiting the structural redundancy in the measured image points due to the conditioned motion. The reduced representation consonant with the conditioned motion is defined by rays in homogeneous coordinates and contained in a projective plane of the optical sensor.

Abstract: A wearable article, such as glasses for a virtual reality program or glasses for an augmented reality application, using light sources and a photodetector that detects their light and outputs data indicative of the detected light. The wearable article uses one or more controllers to determine its position and/or orientation in the environment based on the data output by the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.

Abstract: The present invention relates to interfaces and methods for producing input for software applications based on the absolute pose of an item manipulated or worn by a user in a three-dimensional environment. Absolute pose in the sense of the present invention means both the position and the orientation of the item as described in a stable frame defined in that three-dimensional environment. The invention describes how to recover the absolute pose with optical hardware and methods, and how to map at least one of the recovered absolute pose parameters to the three translational and three rotational degrees of freedom available to the item to generate useful input. The applications that can most benefit from the interfaces and methods of the invention involve 3D virtual spaces including augmented reality and mixed reality environments.

Abstract: A reduced homography H for an optical apparatus to recover pose parameters from imaged space points Pi using an optical sensor. The electromagnetic radiation from the space points Pi is recorded on the optical sensor at measured image coordinates. A structural uncertainty introduced in the measured image points is determined and a reduced representation of the measured image points is selected based on the type of structural uncertainty. The reduced representation includes rays {circumflex over (r)}i defined in homogeneous coordinates and contained in a projective plane of the optical apparatus. At least one pose parameter of the optical apparatus is then estimated by applying the reduced homography H and by applying a condition on the motion of the optical apparatus, the condition being consonant with the reduced representation employed in the reduced homography H.

Abstract: A reduced homography H for an optical apparatus to recover pose parameters from imaged space points Pi using an optical sensor. The electromagnetic radiation from the space points Pi is recorded on the optical sensor at measured image coordinates. A structural uncertainty introduced in the measured image points is determined and a reduced representation of the measured image points is selected based on the type of structural uncertainty. The reduced representation includes rays {circumflex over (r)}i defined in homogeneous coordinates and contained in a projective plane of the optical apparatus. At least one pose parameter of the optical apparatus is then estimated by applying the reduced homography H and by applying a condition on the motion of the optical apparatus, the condition being consonant with the reduced representation employed in the reduced homography H.