Abstract: Systems and methods are directed to generating a three-dimensional (3D) model of a first image set. The first image set (e.g., input image set) corresponds to different viewing angles of an object that is subject to 3D modeling. A volumetric density function is generated from the first image set. A second image set (e.g., a textured image set) is generated from the volumetric density function and from a predefined color function. The first image set is blended with the second image set to generate a third image set (e.g., an image set with temporary textures). To generate the 3D model, a 3D surface model is generated from the third image set. In addition, a texture map of the 3D surface model is generated from the first image set. A computing system is configured to render the 3D surface model and texture map for display.

Abstract: Systems and methods are directed to streaming multiview video from a sender system to a receiver system. A sender system may capture an interlaced frame of a multiview video rendered on a multiview display of the sender client device. The interlaced frame may be formatted as spatially multiplexed views defined by a multiview configuration having a first number of views. The sender system may deinterlace the spatially multiplexed views of the interlaced frame into separate views. The sender system may concatenate the separated views to generate a tiled frame of a tiled video. The sender system may transmit the tiled video to a receiver client device, where the tiled video is compressed. The receiver system may decompress and interlace the views of the tiled video into streamed interlaced frames and render the streamed interlaced frames on a multiview display of the receiver system.

Abstract: Systems and methods are directed to real-time multiview video conversion. This conversion may involve receiving a video stream including two-dimensional (2D) frames, where each 2D frame corresponds to a respective 2D video timestamp. In addition, a camera baseline and a center viewpoint are identified. These parameters may be user-specified or predetermined. A target timestamp for a view of a multiview frame may be determined based on the camera baseline and the center viewpoint. The view is generated from a subset of 2D frames having 2D video timestamps adjacent to the target timestamp. A multiview video is rendered for display, where the multiview video comprises the view of the multiview frame.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: Embodiments for device pairing using optical codes are described. One embodiment is a wearable device with an image sensor configured to capture an image including a first optical code from a first host device. The wearable device decodes the first optical code, and in response to the first optical code, initiates broadcast of a pairing advertisement. The host device displays a second optical code in response to the pairing advertisement, and the wearable device captures and processes the second optical code to determine a host pairing advertisement code. The wearable device then, in response to the second optical code, initiate broadcast of a second pairing advertisement including the host pairing advertisement code. In various embodiments, a secure wireless channel is then established and used for further secure communications.

Abstract: Systems and methods are directed to loading a view of the multiview image into memory. The view may be formatted as a bitmap defined by a pixel coordinate system. A distance between the view and a center point of view may be identified. Thereafter, the view may be rendered in a graphics pipeline as a sheared view according a shear function applied along an axis of the pixel coordinate system. A shear strength of the shear function correlates with the distance between the view and the center point of view.

Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: Embodiments for device pairing using optical codes are described. One embodiment is a wearable device with an image sensor configured to capture an image including a first optical code from a first host device. The wearable device decodes the first optical code, and in response to the first optical code, initiates broadcast of a pairing advertisement. The host device displays a second optical code in response to the pairing advertisement, and the wearable device captures and processes the second optical code to determine a host pairing advertisement code. The wearable device then, in response to the second optical code, initiate broadcast of a second pairing advertisement including the host pairing advertisement code. In various embodiments, a secure wireless channel is then established and used for further secure communications.

Abstract: Described herein are system and methods to improve the image quality of a multiview image. In some embodiments a zero disparity plane image is generated based on a view of a multiview by identifying portions of the multiview image that correspond to the zero disparity plane. The zero disparity plane image and view images of the multiview image may be transmitted to a time-multiplexed display. The time-multiplexed display may operate according to a two-dimensional (2D) mode and a multiview mode. The time-multiplexed display may be configured to display the zero disparity plane image and the view images as a composite image.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: A system and method of multiview style transfer apply a style transfer to individual views of a multiview image in a way that produces consistent results across all images. In some embodiments, the multiview style transfer includes receiving first and second images representative of first and second perspectives of a scene and first and second disparity maps corresponding to the first and second images, generating a first stylized image, generating a stylized shifted image based on the first stylized image and the first disparity map, generating a second stylized image based on a guided filter of the stylized shifted image and the second image, and generating a first and second stylized image based on the stylized shifted images and the disparity maps.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: Embodiments for device pairing using optical codes are described. One embodiment is a wearable device with an image sensor configured to capture an image including a first optical code from a first host device. The wearable device decodes the first optical code, and in response to the first optical code, initiates broadcast of a pairing advertisement. The host device displays a second optical code in response to the pairing advertisement, and the wearable device captures and processes the second optical code to determine a host pairing advertisement code. The wearable device then, in response to the second optical code, initiate broadcast of a second pairing advertisement including the host pairing advertisement code. In various embodiments, a secure wireless channel is then established and used for further secure communications.

Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.