Abstract: A system and method for an asynchronous media fabric service. The system includes at least one host configured with the asynchronous media fabric service. The asynchronous media fabric service is configured to: create and delete shared memory pools that are used to allow processes running on a single host direct access to grain data; send and receive grains from other hosts; and serve as an API end-point for asynchronous media fabric function processes to create, delete and obtain references to streams.

Abstract: An electro-optic method and device fabricated with a metastable phase of BTO. The metastable tetragonal crystalline phase of BTO is preserved using direct wafer bonding on a thick SiO2 lower cladding layer for optical confinement in the active BTO.

Abstract: A high-resolution image sensor suitable for use in an augmented reality (AR) system to provide low latency image analysis with low power consumption. The AR system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object, selectively output imaging information for that region, and synchronously output high-resolution image frames. The region may be updated dynamically as the image sensor and/or the object moves. The image sensor may output the high-resolution image frames less frequently than the region being updated when the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an AR scene can be developed.

Abstract: Wearable systems and method for operation thereof incorporating headset and controller inside-out tracking are disclosed. A wearable system may include a headset and a controller. The wearable system may cause fiducials of the controller to flash. The wearable system may track a pose of the controller by capturing headset images using a headset camera, identifying the fiducials in the headset images, and tracking the pose of the controller based on the identified fiducials in the headset images and based on a pose of the headset. While tracking the pose of the controller, the wearable system may capture controller images using a controller camera. The wearable system may identify two-dimensional feature points in each controller image and determine three-dimensional map points based on the two-dimensional feature points and the pose of the controller.

Abstract: Examples of the disclosure describe systems and methods for presenting virtual content on a wearable head device. In some embodiments, a state of a wearable head device is determined by minimizing a total error based on a reduced weight associated with a reprojection error. A view reflecting the determined state of the wearable head device is presented via a display of the wearable head device. In some embodiments, a wearable head device calculates a preintegration term based on the image data received via a sensor of the wearable head device and the inertial data received via a first IMU and a second IMU of the wearable head device. The wearable head device estimates a position of the device based on the preintegration term, and the wearable head device presents the virtual content based on the position of the device.

Abstract: Wearable systems and method for operation thereof incorporating headset and controller localization using headset cameras and controller fiducials are disclosed. A wearable system may include a headset and a controller. The wearable system may alternate between performing headset tracking and performing controller tracking by repeatedly capturing images using a headset camera of the headset during headset tracking frames and controller tracking frames. The wearable system may cause the headset camera to capture a first exposure image an exposure above a threshold and cause the headset camera to capture a second exposure image having an exposure below the threshold. The wearable system may determine a fiducial interval during which fiducials of the controller are to flash at a fiducial frequency and a fiducial period. The wearable system may cause the fiducials to flash during the fiducial interval in accordance with the fiducial frequency and the fiducial period.

Abstract: An apparatus and method for sending test signals to an instrument, and checking the resultant and subsequently arriving echo signals in order to detect specific properties and changes of properties on the line, the instrument, the tissue or also on a fluid body, e.g., plasma body, present on an electrode of the instrument, and to control the operation of the supply arrangement accordingly.

Abstract: To determine the head pose of a user, a head-mounted display system having an imaging device can obtain a current image of a real-world environment, with points corresponding to salient points which will be used to determine the head pose. The salient points are patch-based and include: a first salient point being projected onto the current image from a previous image, and with a second salient point included in the current image being extracted from the current image. Each salient point is subsequently matched with real-world points based on descriptor-based map information indicating locations of salient points in the real-world environment. The orientation of the imaging devices is determined based on the matching and based on the relative positions of the salient points in the view captured in the current image. The orientation may be used to extrapolate the head pose of the wearer of the head-mounted display system.

Abstract: A high-resolution image sensor suitable for use in an augmented reality (AR) system to provide low latency image analysis with low power consumption. The AR system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object, selectively output imaging information for that region, and synchronously output high-resolution image frames. The region may be updated dynamically as the image sensor and/or the object moves. The image sensor may output the high-resolution image frames less frequently than the region being updated when the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an AR scene can be developed.

Abstract: A wearable display system with a limited number of cameras. Two cameras can be arranged to provide an overlapping central view field and a peripheral view field associated with one of the two cameras. A third camera can be arranged to provide a color view field overlapping the central view field. The wearable display system may be coupled to a processor configured to generate a world model and track hand motion in the central view field using the two cameras. The processor may be configured to perform a calibration routine to compensate for distortions during use of the wearable display system. The processor may be configured to identify and address portions of the world model including incomplete depth information by obtaining additional depth information, such as by enabling emitters, detecting planar surfaces in the physical world, or identifying relevant object templates in the world model.

Abstract: An apparatus for supply of coolant, particularly CO2 that is preferably provided in bottles, to cryosurgical instruments. The device may be a mechanical or thermal compression device. A pump may supply the CO2 taken from the bottle in a buffer container with a desired operation pressure. The pressure in the gas bottle can be less than the desired operation pressure. The apparatus includes a tempering device that is configured to bring the coolant to a desired temperature, particularly a temperature that is higher than the temperature in the gas bottle or in another storage container.

Abstract: A venting device includes an anchor structure and a membrane. The membrane is anchored on the anchor structure and configured to form a first vent and a second vent. The membrane includes a first flap, a second flap and a third flap. The membrane partitions a space into a first volume and a second volume, and the first volume and the second volume are connected when the first vent and the second vent are formed. The first flap is actuated to move toward a first direction and the second flap is actuated to move toward a second direction opposite to the first direction, so as to form the first vent. The first flap is actuated to move toward the first direction and the third flap is actuated to move toward the second direction opposite to the first direction, so as to form the second vent.

Abstract: A high-resolution image sensor suitable for use in an augmented reality (AR) system. The AR system may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may have pixels configured to output events indicating changes in sensed IR light. Those pixels may be sensitive to IR light of the same frequency source as an active IR light source, and may be part of an eye tracking camera, oriented toward a user's eye. Changes in IR light may be used to determine the location of the user's pupil, which may be used in rendering virtual objects. The events may be generated and processed at a high rate, enabling the system to render the virtual object based on the user's gaze so that the virtual object will appear more realistic to the user.

Abstract: A wearable display system for a cross reality (XR) system may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR function being performed. For tracking an object, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. The object may be tracked based on asynchronously acquired events indicating changes within the patches. Stereoscopic or other types of image information may be used when event-based object tacking yields an inadequate quality metric. The tracked object may be a user's hand or a stationary object in the physical world, enabling calculation of the pose of the wearable display system and of the wearer's head.

Abstract: An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The image sensor may have multiple pixel cells, each of the pixel cells comprising a photodetector to generate an electric signal based on an intensity of light incident upon the photodetector. The pixel cells may include multiple subsets of pixel cells, each subset of pixel cells including at least one angle-of-arrival to-intensity converter to modulate incident light reaching one or more of the pixel cells in the subset based on an angle of arrival of the incident light. Each pixel cell within the plurality of pixel cells may include differential readout circuitry configured to output a readout signal only when an amplitude of a current electric signal from the photodetector is different from an amplitude of a previous electric signal from the photodetector.

Abstract: A venting device includes an anchor structure and a membrane. The membrane is anchored on the anchor structure and configured to form a first vent and a second vent. The membrane includes a first flap, a second flap and a third flap. The membrane partitions a space into a first volume and a second volume, and the first volume and the second volume are connected when the first vent and the second vent are formed. The first flap is actuated to move toward a first direction and the second flap is actuated to move toward a second direction opposite to the first direction, so as to form the first vent. The first flap is actuated to move toward the first direction and the third flap is actuated to move toward the second direction opposite to the first direction, so as to form the second vent.

Abstract: A high-resolution image sensor suitable for use in an augmented reality (AR) system. The AR system may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may have pixels configured to output events indicating changes in sensed IR light. Those pixels may be sensitive to IR light of the same frequency source as an active IR light source, and may be part of an eye tracking camera, oriented toward a user's eye. Changes in IR light may be used to determine the location of the user's pupil, which may be used in rendering virtual objects. The events may be generated and processed at a high rate, enabling the system to render the virtual object based on the user's gaze so that the virtual object will appear more realistic to the user.

Abstract: To determine the head pose of a user, a head-mounted display system having an imaging device can obtain a current image of a real-world environment, with points corresponding to salient points which will be used to determine the head pose. The salient points are patch-based and include: a first salient point being projected onto the current image from a previous image, and with a second salient point included in the current image being extracted from the current image. Each salient point is subsequently matched with real-world points based on descriptor-based map information indicating locations of salient points in the real-world environment. The orientation of the imaging devices is determined based on the matching and based on the relative positions of the salient points in the view captured in the current image. The orientation may be used to extrapolate the head pose of the wearer of the head-mounted display system.