Abstract: This disclosure pertains to devices, methods, and computer readable media for performing positional sensor-assisted panoramic photography techniques in handheld personal electronic devices. Generalized steps that may be used to carry out the panoramic photography techniques described herein include, but are not necessarily limited to: 1.) acquiring image data from the electronic device's image sensor; 2.) performing “motion filtering” on the acquired image data, e.g., using information returned from positional sensors of the electronic device to inform the processing of the image data; 3.) performing image registration between adjacent captured images; 4.) performing geometric corrections on captured image data, e.g., due to perspective changes and/or camera rotation about a non-center of perspective (COP) camera point; and 5.) “stitching” the captured images together to create the panoramic scene, e.g., blending the image data in the overlap area between adjacent captured images.

Abstract: Techniques (methods and devices) that permit a user to define multimedia transitions in terms of user-supplied assets are described. The user supplies the assets necessary to generate the transition such as, for example, an asset movie, an asset matte movie and a background matte movie. (The specific assets required may vary depending upon the transition to be generated.) These assets are then automatically combined (e.g., through compositing) to render a completed multimedia object in which the defined transition is used to visually transition a first image or frame to a second image or frame. The same techniques used in some generic transformation of images or movies are also disclosed.

Abstract: Systems, methods, and a computer readable medium for performing an improved blowout prevention process in an image capture device are provided to compensate for occurrences of exposure “blowouts,” i.e., areas in a captured image where pixel brightness exceeds the sensor's dynamic range of capturing capability. In one embodiment, the captured image's histogram may be analyzed to determine if the image is indicative of the presence of exposure blowouts. Once it has been determined that there likely are blowouts in the image, an exposure bias for the image capture device may be set accordingly. Particularly, the exposure value (EV) for the image capture device may be gradually corrected, e.g., by one-eighth of a stop per captured frame, until the image histogram is no longer indicative of blown out regions, at which point the image capture device's exposure value may gradually be corrected back to “normal,” i.e., non-exposure bias compensated, levels.

Abstract: In personal electronic devices including digital imaging capability, methods, devices and computer readable media are described for determining when image capture operations may benefit from using high dynamic range imaging (HDRI) operations. In general, techniques are disclosed for analyzing an image's luminosity and/or color/tonal histograms to automatically determine when HDRI operations can benefit scene capture. If the determination that HDRI operations can improve scene capture, the user is so notified.

Abstract: The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user's eyes may either be inferred or calculated directly by using a device's front-facing camera. With the position of the user's eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device's display may be created and interacted with by the user.

Abstract: Systems, methods, and a computer readable medium for an improved automatic exposure algorithm attempt to classify an image into a particular “scene category,” and, based on the determined scene category, meter the scene according to a generated metering weighting matrix. In one embodiment, the average luminance is calculated for a central exposure metering region of the image and a plurality of peripheral exposure metering regions surrounding the central exposure metering region. Based on comparisons of the average luminance values of the peripheral exposure regions to the average luminance of the central exposure region, a target metering weighting matrix may be generated. In another embodiment, the scene category corresponds to a predetermined metering weighting matrix.

Abstract: In many videoconferencing applications, bandwidth is at a premium, and thus, it is important to encode a given video frame intelligently. It is often desirable that a larger amount of information be spent encoding the more important parts of the video frame, e.g., human facial features, whereas the less important parts of the video frame can be compressed at higher rates. Thus, there is need for an apparatus, computer readable medium, processor, and method for intelligent skin tone and facial feature aware videoconferencing compression that can “suggest” intelligent macroblock compression ratios to a video encoder. The suggestion of compression rates can be based at least in part on a determination of which macroblocks in a given video frame are likely to contain skin tones, likely to contain features (e.g., edges), likely to contain features in or near skin tone regions, or likely to contain neither skin tones nor features.

Abstract: Disclosed herein are methods and systems for providing a user interface (UI) having a selector controllable by a physical input device. The response of the selector is adaptively adjusted to facilitate executing desired operations within the UI. A response factor defines how far the selector moves for a given movement of the physical input device. The response factor is increased so the selector can be moved a large distance, but is dynamically decreased to provide fine-tuned control of the selector for selecting densely grouped screen elements. Screen elements can be endowed with gravity, making them easy to select, or with anti-gravity, making them more difficult to select. The disclosure methods also provide tactile feedback such as vibration or braking of the physical input device to assist a user in executing desired operations.

Abstract: A graphical user interface (GUI) element permits a user to control an application in both a coarse manner and a fine manner. When a cursor is moved to coincide or overlap the displayed GUI element, parameter adjustment is made at a first (coarse) granularity so that rapid changes to the target parameter can be made (e.g., displayed zoom level, image rotation or playback volume). As the cursor is moved away from the displayed GUI element, parameter adjustment is made at a second (fine) granularity so that fine changes to the target parameter can be made. In one embodiment, the further the cursor is moved from the displayed GUI element, the finer the control.

Abstract: Disclosed are methods and systems for multimedia scripting, including evaluating a script at runtime and invoking a process for editing multimedia in dependence upon the script. Multimedia may include a still image and video images. Multimedia scripting may also include accepting text entered into a text-input graphical user interface as a script for runtime evaluation, accepting from a non-text-based graphical user interface a designation of scripts for runtime evaluation, and effecting a disposition of the edited multimedia in dependence upon a script, such as storing the multimedia as a file, presenting the multimedia, or encoding the edited multimedia as an email attachment.

Abstract: Techniques (methods and devices) that permit a user to define multimedia transitions in terms of user-supplied assets are described. The user supplies the assets necessary to generate the transition such as, for example, an asset movie, an asset matte movie and a background matte movie. (The specific assets required may vary depending upon the transition to be generated.) These assets are then automatically combined (e.g., through compositing) to render a completed multimedia object in which the defined transition is used to visually transition a first image or frame to a second image or frame. The same techniques used in some generic transformation of images or movies are also disclosed.