Abstract: A method and device is provided that compensates for different reflectivity/absorption coefficients of objects in a scene/object when performing active depth sensing using structured light. A receiver sensor captures an image of a scene onto which a code mask is projected. One or more parameters are ascertained from the captured image. Then a light source power for a projecting light source is dynamically adjusted according to the one or more parameters to improve decoding of the code mask in a subsequently captured image. Depth information for the scene may then be ascertained based on the captured image based on the code mask. In one example, the light source power is fixed at a particular illumination while an exposure time for the receiver sensor is adjusted. In another example, an exposure time for the receiver sensor is maintained/kept at a fixed value while the light source power is adjusted.

Abstract: A receiver sensor captures a plurality of images, at two or more (different) exposure times, of a scene onto which a code mask is projected. The two or more of the plurality of images are combined by extracting decodable portions of the code mask from each image to generate a combined image. Alternatively, two receiver sensors, each at a different exposure time, are used to capture a plurality of images. The first and second images are then combined by extracting decodable portions of the code mask from each image to generate a combined image. Depth information for the scene may then be ascertained based on the combined image and using the code mask.

Abstract: In general, techniques are described for determining a vision-based quality metric for three-dimensional (3D) video. A device (12, 14) comprising a 3D analysis unit (24, 48) may implement these techniques to compute a 3D objective metric (36, 60). The 3D analysis unit (24, 48) estimates an ideal depth map (62, 70) that would generate a distortion limited image view using DIBR-based 3D video data (34) and then derives one or more distortion metrics (64, 72) based on quantitative comparison of the ideal depth map (62, 70) and a depth map (28, 58) used in the generation of the DIBR-based 3D video data (34). Based on the derived one or more distortion metrics (64, 72), the 3D analysis unit (24, 48) computes the objective metric (36, 60) to quantify visual quality of DIBR-based video data (34). The 3D objective metric (36, 60) may be used to alter or otherwise adjust depth estimation and encoding/decoding parameters to correct for expected visual discomfort.

Abstract: An apparatus, system, method, and computer program product for streaming 3D content from a wireless device to a remote 3D display for the viewing of the 3D content on a larger screen. In some aspects, a wireless streaming server may encode 3D motion picture content in a certain format, where each image frame includes a 2D view concatenated side-by-side with a complementary frame of depth information. The combination of the 2D view and the depth information are capable of being processed by a client display to generate a stereoscopic image representing a 3D view.

Abstract: Systems and methods for avoiding conflict in a wireless mobile display digital interface (WMDDI) environment including both host and client devices. In one aspect, the presently claimed invention includes a system and/or method that is configured for broadcasting a first multicast MAC address by a first host to at least one first client in a predetermined geographic area and broadcasting the first multicast MAC address by a second host to at least one second client in the predetermined geographic area. The system and/or method can be further configured for determining a priority between the first host and the second host when the second host receives multicast packets transmitted by the first host and changing to a second multicast MAC address by a least priority host of the first host and the second host.

Abstract: A method of interpolating a pixel value is disclosed and may include locating a missing pixel. Further, the method may include determining a plurality of closest pixels, determining a value for each of the plurality of closest pixels, and determining a distance between the missing pixel and each of the plurality of closest pixels. The method may also include classifying each of the plurality of closest pixels as either an edge-pixel or a non-edge pixel and determining a value of the missing pixel at least partially based on the value of each of the plurality of closest pixels, the distance between the missing pixel and each of the plurality of closest pixels, and a classification of each of the plurality of closest pixels.

Abstract: In general, techniques are described for preparing video data in accordance with a wireless display protocol. For example, a portable device comprising a module to store video data, a wireless display host module and a wireless interface may implement the techniques of this disclosure. The wireless display host module determines one or more display parameters of a three-dimensional (3D) display device external from the portable device and prepares the video data to generate 3D video data based on the determined display parameters. The wireless interface then wirelessly transmits the 3D video data to the external 3D display device. In this way, a portable device implements the techniques to prepare video data in accordance with a wireless display protocol.

Abstract: In general, techniques are described for transforming video data in accordance with a three dimensional (3D) input format. As one example, an apparatus, such as a mobile or portable device, that includes a transformation module, a parameter discovery module and at least one interface implements the techniques. The parameter discovery module determines an input format supported by a 3D display device. The parameter discover module then configures the transformation module to transform two-dimensional (2D) video data into 3D video data so as to generate the 3D video data in accordance with the determined input format. The at least one interface receives 2D video data. The transformation module transforms the 2D video data to 3D video data so that the 3D video data complies with the determined input format. In this manner, the apparatus implements the techniques to transform video data in accordance with a determined 3D input format.

Abstract: 3D image data can be modified based on user preference data received from a user. The user preference data may be received at a first device and used to adjust 3D image data generated by the first device for presentation by a display device, or the first device may receive the user preference data and transmit it to a display device such that the display device may adjust the 3D image data based on the user preference data. The 3D image data may be adjusted based on user preference data to support presentation of 3D imagery on the display device in a manner desired by a user. 3D user viewing preferences may include an amount of pop-out effect in images, a stereo baseline of images, a depth range of images, a spatial distribution of images, a degree of depth sharpness in images, or specification of a user's dominant eye.

Abstract: In general, techniques are described for encapsulating three dimensional video data in accordance with a transport protocol. As one example, an apparatus comprising a multimedia processing module, a transport protocol module and a wireless module implement the techniques. The multimedia processing module generates a video data segment, an audio data segment and a depth data segment of 3D video content. The transport protocol module encapsulates each of the video data, audio data and depth data segments in different ones of a plurality of packets according to a transport protocol and adds metadata to at least one of the plurality of packets for enhancing playback of the 3D video content. The wireless module transmits the packets to a 3D display device external from the apparatus.

Abstract: In embodiments, a one-to-one association is established between a client and a host in a wireless network, such as a wireless local area network or a wireless personal communication network. The client may be a display device. The host may be a cellular telephone. Active association corresponds to the host exclusively using a shared resource of the client. When the association is solid, requests from other hosts to establish an active association are denied. When the association is fragile, such requests are granted. In the case of a semi-solid association, a request from another host to establish an active association causes the client to generate a query to the host currently owning the active association. If the host currently owning the association grants a release, a new active association is established between the requesting host and the client. Otherwise, the request from the other host is denied.

Abstract: A method and device is provided that compensates for different reflectivity/absorption coefficients of objects in a scene/object when performing active depth sensing using structured light. A receiver sensor captures an image of a scene onto which a code mask is projected. One or more parameters are ascertained from the captured image. Then a light source power for a projecting light source is dynamically adjusted according to the one or more parameters to improve decoding of the code mask in a subsequently captured image. Depth information for the scene may then be ascertained based on the captured image based on the code mask. In one example, the light source power is fixed at a particular illumination while an exposure time for the receiver sensor is adjusted. In another example, an exposure time for the receiver sensor is maintained/kept at a fixed value while the light source power is adjusted.

Abstract: A receiver sensor captures a plurality of images, at two or more (different) exposure times, of a scene onto which a code mask is projected. The two or more of the plurality of images are combined by extracting decodable portions of the code mask from each image to generate a combined image. Alternatively, two receiver sensors, each at a different exposure time, are used to capture a plurality of images. The first and second images are then combined by extracting decodable portions of the code mask from each image to generate a combined image. Depth information for the scene may then be ascertained based on the combined image and using the code mask.

Abstract: A method sends a signal to render visual information on a display, and receives a user response to the rendered visual information. The user response includes a first delay. The method also queries an electronic system for data indicating a second delay. The second delay is a portion of the first delay and attributable to the electronic system. The method further using the data indicating the second delay to compensate for electronic system delay during interactions with a user.

Abstract: In general, techniques are described for transforming video data in accordance with human visual system feedback metrics. For example, an apparatus comprising a transformation module, a parameter discovery module and a human visual system (HVS) feedback module implements these techniques. The parameter discovery module configures the transformation module to generate three-dimensional (3D) video data in accordance with parameters defining capabilities supported by a 3D display device. The transformation module transforms video data to generate the 3D video data. The HVS feedback module determines, while the transformation module transforms the video data, one or more metrics using an HVS model that reflects a quality of 3D visualization of the generated 3D video data with respect to a human visual system and reconfigures the one or more modules based on the determined one or more metrics to refine the generation of the 3D video data.

Abstract: A disparity value between corresponding pixels in a stereo pair of images, where the stereo pair of images includes a first view and a second view of a common scene, can be determined based on identifying a lowest aggregated matching cost for a plurality of support regions surrounding the pixel under evaluation. In response to the number of support regions having a same disparity value being greater than a threshold number, a disparity value indicator for the pixel under evaluation can be set to the same disparity value.

Abstract: An apparatus, system, method, and computer program product for streaming 3D content from a wireless device to a remote 3D display for the viewing of the 3D content on a larger screen. In some aspects, a wireless streaming server may encode 3D motion picture content in a certain format, where each image frame includes a 2D view concatenated side-by-side with a complementary frame of depth information. The combination of the 2D view and the depth information are capable of being processed by a client display to generate a stereoscopic image representing a 3D view.

Abstract: In general, techniques are described for encoding static video data using a baseline video encoder. A device comprising a baseline video encoder, a wireless interface and a control unit may implement the techniques. The baseline video encoder encodes a portion of this static video data at a first quality. The wireless interface wirelessly transmits the encoded first portion to a remote display device. The control unit identifies a region of interest in the portion of the video data to be re-encoded at a second quality, where the second quality is higher than the first quality. The baseline video encoder re-encodes the identified region of interest at the second quality without re-encoding any other regions of the portion of the video data at the second quality. The wireless interface wirelessly transmits the re-encoded identified region of interest to the remote display device.

Abstract: 3D image data can be modified based on user preference data received from a user. The user preference data may be received at a first device and used to adjust 3D image data generated by the first device for presentation by a display device, or the first device may receive the user preference data and transmit it to a display device such that the display device may adjust the 3D image data based on the user preference data. The 3D image data may be adjusted based on user preference data to support presentation of 3D imagery on the display device in a manner desired by a user. 3D user viewing preferences may include an amount of pop-out effect in images, a stereo baseline of images, a depth range of images, a spatial distribution of images, a degree of depth sharpness in images, or specification of a user's dominant eye.

Abstract: A method, system and computer program product for a wireless mobile display digital interface (WMDDI) association procedure that allows establishing and joining more than one multicast group to facilitate the interoperability of multiple client devices based on host and client capabilities. The protocol provides for the exchange and update of capabilities and multicast addresses for layered multicast transmission applications. The system is used for interoperating devices with different capabilities and provides for efficient transmissions by using different multicast addresses mapped to different layers of a bitstream. The protocol adapts to changes in capabilities, in joining/releasing of multicast addresses and in link quality.