Abstract: Techniques are disclosed for displaying a graphical element in a manner that simulates three-dimensional (3D) visibility (including parallax and shadowing). More particularly, a number of images, each captured with a known spatial relationship to a target 3D object, may be used to construct a lighting model of the target object. In one embodiment, for example, polynomial texture maps (PTM) using spherical or hemispherical harmonics may be used to do this. Using PTM techniques a relatively small number of basis images may be identified. When the target object is to be displayed, orientation information may be used to generate a combination of the basis images so as to simulate the 3D presentation of the target object.

Abstract: Techniques are disclosed for displaying a graphical element in a manner that simulates three-dimensional (3D) visibility (including parallax and shadowing). More particularly, a number of images, each captured with a known spatial relationship to a target 3D object, may be used to construct a lighting model of the target object. In one embodiment, for example, polynomial texture maps (PTM) using spherical or hemispherical harmonics may be used to do this. Using PTM techniques a relatively small number of basis images may be identified. When the target object is to be displayed, orientation information may be used to generate a combination of the basis images so as to simulate the 3D presentation of the target object.

Abstract: Techniques are disclosed for displaying a graphical element in a manner that simulates three-dimensional (3D) visibility (including parallax and shadowing). More particularly, a number of images, each captured with a known spatial relationship to a target 3D object, may be used to construct a lighting model of the target object. In one embodiment, for example, polynomial texture maps (PTM) using spherical or hemispherical harmonics may be used to do this. Using PTM techniques a relatively small number of basis images may be identified. When the target object is to be displayed, orientation information may be used to generate a combination of the basis images so as to simulate the 3D presentation of the target object.

Abstract: Techniques are disclosed for stabilizing a stream of spherical images captured by an image capture device to produce a stabilized spherical video sequence. The rotation of the image capture device during capture may be corrected in one or more desired axial directions in a way that is agnostic to the translation of the image capture device. The rotation of the image capture device may also be corrected in one or more desired axial directions in a way that is aware of the translation of the image capture device. For example, the assembled output spherical video sequence may be corrected to maintain the horizon of the scene at a constant location, regardless of the translation of the image capture device (i.e., a ‘translation-agnostic’ correction), while simultaneously being corrected to maintain the yaw of the scene in the direction of the image capture device's translation through three-dimensional space (i.e., a ‘translation-aware’ correction).

Abstract: An electronic device may include a display having an array of display pixels and having display control circuitry that controls the operation of the display. The display control circuitry may adaptively adjust the display output based on ambient lighting conditions. For example, in cooler ambient lighting conditions such as those dominated by daylight, the display may display neutral colors using a relatively cool white. When the display is operated in warmer ambient lighting conditions such as those dominated by indoor light sources, the display may display neutral colors using a relatively warm white. Adapting to the ambient lighting conditions may ensure that the user does not perceive color shifts on the display as the user's vision chromatically adapts to different ambient lighting conditions. Adaptively adjusting images in this way can also have beneficial effects on the human circadian rhythm by displaying warmer colors in the evening.

Abstract: The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, pyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

Abstract: Systems and methods for generating high dynamic images from interleaved Bayer array data with high spatial resolution and reduced sampling artifacts. Bayer array data are demosaiced into components of the YUV color space before deinterleaving. The Y component and the UV components can be derived from the Bayer array data through demosiac convolution processes. A respective convolution is performed between a convolution kernel and a set of adjacent pixels of the Bayer array that are in the same color channel. A convolution kernel is selected based the mosaic pattern of the Bayer array and the color channels of the set of adjacent pixels. The Y data and UV data are deinterleaved and interpolated into frames of short exposure and long exposures in the second color space. The short exposure and long exposure frames are then blended and converted back to a RGB frame representing a high dynamic range image.

Abstract: Embodiments of the present invention are operable to generate a set of weights derived through crowdsourcing procedures for use in automatically performing white balancing operations on images captured by a digital camera system. Embodiments of the present invention are operable to generate a set of images which are illuminated with known and different illuminants. Using crowdsourcing procedures, embodiments of the present invention gather user feedback concerning which images from the set of images adjusted by the known illuminants are considered to be the most aesthetically pleasing. Images selected by the users are then stored within a database of selected images. Using a learning engine, embodiments of the present invention may then produce a set of weights based on the user selected images for use in determining a likely illuminant when performing automatic white balancing operations performed on the camera system.

Abstract: The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

Abstract: Embodiments of the present invention are operable to perform automatic white balancing operations on images captured by a camera system through the use of weights derived through crowdsourcing procedures. Embodiments of the present invention use crowdsourced weight data resident on the camera system in combination with sampled image data of a captured image to determine a likely illuminant source. When performing automatic white balancing operations on the captured image, embodiments of the present invention may also compute a confidence score which may present the user with a choice to either use the likely illuminant determined using the crowdsourced weights or the camera system's default or normal automatic white balancing correction algorithm.

Abstract: Systems and methods to improve photo taking using an image capture device having a wide field of view (FOV) camera. In some embodiments, when the device is held in landscape orientation, a wide diagonal FOV may be displayed to the user on a preview screen of the device, and the landscape image may be captured in a wide, 16:9 aspect ratio. However, when the device is held in portrait orientation, the effective diagonal FOV of the device may be decreased via software and/or hardware, and a 4:3 aspect ratio image may be displayed and captured. In other embodiments, the captured portrait orientation image may be scaled, shifted, and/or cropped before being displayed to the user on the device's preview display screen, in such a manner that the user will naturally be inclined to hold the device in a position that will produce a more optimal self-portrait image.

Abstract: The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

Abstract: Techniques are disclosed for displaying a graphical element in a manner that simulates three-dimensional (3D) visibility (including parallax and shadowing). More particularly, a number of images, each captured with a known spatial relationship to a target 3D object, may be used to construct a lighting model of the target object. In one embodiment, for example, polynomial texture maps (PTM) using spherical or hemispherical harmonics may be used to do this. Using PTM techniques a relatively small number of basis images may be identified. When the target object is to be displayed, orientation information may be used to generate a combination of the basis images so as to simulate the 3D presentation of the target object.

Abstract: An electronic device may include a display having an array of display pixels and having display control circuitry that controls the operation of the display. The display control circuitry may adaptively adjust the display output based on ambient lighting conditions. For example, in cooler ambient lighting conditions such as those dominated by daylight, the display may display neutral colors using a relatively cool white. When the display is operated in warmer ambient lighting conditions such as those dominated by indoor light sources, the display may display neutral colors using a relatively warm white. Adapting to the ambient lighting conditions may ensure that the user does not perceive color shifts on the display as the user's vision chromatically adapts to different ambient lighting conditions. Adaptively adjusting images in this way can also have beneficial effects on the human circadian rhythm by displaying warmer colors in the evening.

Abstract: An electronic device may include a display having an array of display pixels and having display control circuitry that controls the operation of the display. The display control circuitry may adaptively adjust the display output based on ambient lighting conditions. For example, in cooler ambient lighting conditions such as those dominated by daylight, the display may display neutral colors using a relatively cool white. When the display is operated in warmer ambient lighting conditions such as those dominated by indoor light sources, the display may display neutral colors using a relatively warm white. Adapting to the ambient lighting conditions may ensure that the user does not perceive color shifts on the display as the user's vision chromatically adapts to different ambient lighting conditions. Adaptively adjusting images in this way can also have beneficial effects on the human circadian rhythm by displaying warmer colors in the evening.

Abstract: The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

Abstract: Systems and methods to improve photo taking using an image capture device having a wide field of view (FOV) camera are described herein. In some embodiments, when the device is held in landscape orientation, a wide diagonal FOV may be displayed to the user on a preview screen of the device, and the landscape image may be captured in a wide, 16:9 aspect ratio. However, when the device is held in portrait orientation, the effective diagonal FOV of the device may be decreased via software and/or hardware, and a 4:3 aspect ratio image may be displayed and captured. In other embodiments, the captured portrait orientation image may be scaled, shifted, and/or cropped before being displayed to the user on the device's preview display screen, in such a manner that the user will naturally be inclined to hold the device in a position that will produce a more optimal self-portrait image.

Abstract: An electronic device may include a display having an array of display pixels and having display control circuitry that controls the operation of the display. The display control circuitry may adaptively adjust the display output based on ambient lighting conditions. For example, in cooler ambient lighting conditions such as those dominated by daylight, the display may display neutral colors using a relatively cool white. When the display is operated in warmer ambient lighting conditions such as those dominated by indoor light sources, the display may display neutral colors using a relatively warm white. Adapting to the ambient lighting conditions may ensure that the user does not perceive color shifts on the display as the user's vision chromatically adapts to different ambient lighting conditions. Adaptively adjusting images in this way can also have beneficial effects on the human circadian rhythm by displaying warmer colors in the evening.

Abstract: Systems and methods for generating high dynamic images from interleaved Bayer array data with high spatial resolution and reduced sampling artifacts. Bayer array data are demosaiced into components of the YUV color space before deinterleaving. The Y component and the UV components can be derived from the Bayer array data through demosiac convolution processes. A respective convolution is performed between a convolution kernel and a set of adjacent pixels of the Bayer array that are in the same color channel. A convolution kernel is selected based the mosaic pattern of the Bayer array and the color channels of the set of adjacent pixels. The Y data and UV data are deinterleaved and interpolated into frames of short exposure and long exposures in the second color space. The short exposure and long exposure frames are then blended and converted back to a RGB frame representing a high dynamic range image.

Abstract: A touch screen system includes a touch screen that provides touch information in response to a touch event. The touch screen system also includes a rapid response display controller having a reactive interpretation unit that provides an initial display representation of the touch information and a reactive feedback unit that provides the initial display representation to the touch screen for an initial display. The touch screen system further includes a routine response display controller that additionally receives the touch information and provides a final display representation of the touch information to the touch screen for a final display. A method of touch screen display management is also included.