Abstract: A system for determining and tracking camera pose includes a dynamic vision sensor (DVS) configured to generate a current DVS image, an inertial measurement unit (IMU) configured to generate inertial data, and a memory. The memory is configured to store a 3-dimensional (3D) map of a known 3D environment. The system may also include a processor coupled to the memory. The processor is configured to initiate operations including determining a current camera pose for the DVS based on the current DVS image, the inertial data, the 3D map, and a prior camera pose.

Abstract: In one embodiment, a computing system may access one or more frames of media content with each frame corresponding to at least part of an image. The computing system may automatically detect at least one object in at least one of the one or more frames. The computing system may automatically identify the at least one object. For each of the identified objects, the computing system may automatically determine an annotation corresponding to that object and each annotation may include one or more graphical elements. For each annotation, the computing system may automatically associate that annotation for display with its corresponding object.

Abstract: An apparatus for a robotic limb includes one or more limb segments connected via one or more joints. The robotic limb may feature one or more dual-reduction quasi-quasi-direct-drive joint actuators that permit the robotic limb to move throughout a scene. The robotic limb may further include an end-effector connected to a free end of the robotic limb with one or more opposable fingers comprising a four bar linkage. The end-effector may include a main actuator that actuates the one or more fingers via the four-bar linkages to complete various tasks.

Abstract: In one embodiment, an apparatus includes a processor and multiple pairs of cameras, where each camera of a first pair of cameras is separated from each other by one camera of a second pair of cameras. Each camera of the first pair of cameras has a first orientation, and each camera of the second pair of cameras has a second orientation that is different from the first orientation.

Abstract: In one embodiment, a non-transitory computer-readable storage media contains instructions for displaying on a small display an interactive element that is or includes one or more characters. The instructions can identify, based on an input, one or more of the interactive elements or characters.

Abstract: An apparatus and method for a wall clock AI voice assistant, such as a computing device, is provided herein. The wall-mountable electronic clock includes an optical sensor, a microphone, a digital display and a speaker. The optical sensor captures image data representing at least a portion of a user. The microphone receives an audio input from the user when certain criteria is met, such as when the image data representing at least a portion of the user is captured. The digital display provides visual information to the user provided in response to the captured image data or the audio input. The speaker provides audio information provides from a digital voice assistant in response to the captured image data or the audio input.

Abstract: In one embodiment, an apparatus includes one or more processors and a memory coupled to the processors that includes instructions executable by the processors. When executing the instructions, the processors present on a display of the apparatus a first screen of a graphical user interface. The first screen includes one or more first elements. The processors receive user input indicating a transition in the graphical user interface and, in response to the user input, transition from the first screen to a second screen of the graphical user interface and apply one or more visual transition effects to the transition. The second screen includes one or more second elements.

Abstract: In one embodiment, a method includes receiving, from a client device, a request corresponding to a particular view of a three-dimensional video comprising multiple views. The method also includes accessing a data stream corresponding to the video. The method further includes selecting, based on the request, one or more portions of the accessed data stream, at least one of the selected portions corresponding to the particular view. The method also includes transmitting the selected portion of the accessed data stream to the client device.

Abstract: In one embodiment, a method includes accessing first time-series data based on electromagnetic radiation in a first spectrum and second time-series data based on electromagnetic radiation in a second spectrum. The method also includes comparing the first time-series data with the second time-series data and determining, based on the comparison, (1) whether a stopping condition associated with a device has occurred or (2) whether a discarding condition associated with the first time-series data or the second time-series data has occurred.

Abstract: A method of camera pose and plane estimation may include detecting a marker within a 3-dimensional (3D) environment by detecting, using a Dynamic Vision Sensor (DVS), a first plurality of light sources arranged in a known shape and blinking at a first frequency, wherein the known shape corresponds to the marker, determining an orientation and an identity of the marker based upon detecting, using the DVS, a second plurality of light sources corresponding to the marker and blinking at a second frequency different from the first frequency. A camera pose for the DVS may be determined based upon the known shape, the orientation, and the identity of the marker using the processor.

Abstract: The present disclosure describes a system and method for a marker-based augmented reality system. The method includes acquiring image data from a camera, analyzing the image data to identify at least one marker, the at least one marker being associated with a physical location in a real-world environment, determining information represented via the at least one marker, the information represented via the at least one marker including at least one of content data, metadata, or server data, generating content based on the at least one of the content data, the metadata, or the server data, and presenting, via a display, the content overlaying a displayed representation of the real-world environment, the content being presented at one or more locations in the displayed representation of the real-world environment relative to the physical location associated with the at least one marker.

Abstract: A system and method include generating environment data from skylight sensor data. The environment data includes a value of a geospatially dependent parameter associated with light received from a predetermined celestial light source. At least two of a compass direction of the predetermined celestial light source when the skylight sensor data was received, a time at which the skylight sensor data was received, or a geospatial coordinate at which the skylight sensor data was collected are received. At least one of the compass direction of the predetermined celestial light source when the skylight sensor data was received, the time at which the skylight sensor data was received, or the geospatial coordinate at which the skylight sensor data was collected is determined, at least in part, from the environment data.

Abstract: A method for monitoring a health characteristic of a user based on one or more biological measurements may include selecting a context from a plurality of contexts, each context corresponding to a baseline health value, and each context being defined by a plurality of recorded events each comprising one or more of repeated biological states, repeated user activity, or space-time coordinates of the user, and then monitoring the health characteristic of the user based on one or more bio-sensing measurements in comparison to the baseline health value corresponding to the selected context.

Abstract: In particular embodiments, a method for determining a heart-rate variability (HRV) measurement of a user may include receiving, from a sensor of an electronic device of the user, heart sensor data, determining a noise level of the heart sensor data, and then adjusting the HRV measurement by an amount calculated based on the determined noise level. The sensor data may include data on a photoplethysmograph (PPG) signal over a noise-calculation time period.

Abstract: A system and method enable an electronic device to perform gaze or focal tracking operations. The electronic device includes a processor and a display screen. The processor is configured to in response to determining at least one of: a gaze of the user or a focal point of the eye of the user, control at least one of: an operation of the electronic device, or a focal point of an adjustable lens. The display screen is coupled to the processor, and configured to present an image of an object based on at least one of the gaze of the user or the focal point of the eye.

Abstract: In one embodiment, an apparatus includes a wearable computing device including one or more processors and a memory. The memory is coupled to the processors and includes instructions executable by the processors. When executing the instructions, the processors analyze a task of an application; analyze one or more characteristics of the wearable computing device; determine to delegate the task based on the analysis of the task and the analysis of the characteristics; delegate the task to be processed by one or more computing devices separate from the wearable computing device; and receive from the computing devices results from processing the delegated task.

Abstract: Detecting chronotropic incompetence includes determining, using a processor, a baseline cardiac health measure for a user based upon an estimate of activity level for the user, validating, using the processor, the estimate of activity level for the user with a validation factor determined from sensor data and determining, using the processor, a cardiac health measure for the user from the sensor data. A signal indicating chronotropic incompetence for the user can be provided by the processor based upon a comparison of the cardiac health measure for the user with the baseline cardiac health measure.

Abstract: A method for monitoring a stress level of a user may include determining, based on biological measurements on one or more physiological markers received in a first sampling mode, the stress level of the user, and then dynamically switching to a second sampling mode when it is determined that one or more of the physiological markers are above a threshold level, the second sampling mode being different from the first sampling mode.

Abstract: In one embodiment, a display screen includes one or more pixels that are configured to operate in multiple modes. The multiple modes include a first mode in which the one or more pixels modulate, absorb, or reflect visible light and a second mode in which the one or more pixels are substantially transparent to visible light. When the one or more pixels are in the second mode a component behind the display screen is viewable through the one or more pixels.