Abstract: An electronic device and an image composition method thereof are provided. The electronic device selects a plurality of key images from a plurality of images corresponding to a scene according to a first image characteristic, and selects at least two portions from the plurality of key images according to a second image characteristic. Each of the at least two portions corresponds to different regions of the scene. Then, the electronic device generates a composite image corresponding to the scene by combining the at least two portions and provide the composite image and at least two of the key images from which the at least two portions are selected to a user.

Abstract: Methods and apparatus for deriving a saliency measure for images and video are described. In an embodiment, a process includes decomposing, by a processor, an image into elements, wherein elements cluster the image and each element consists of spatially connected pixels. The processor then calculates a first image measure indicative of each element's uniqueness in the image on a per element basis, and calculates a second image measure indicative of each element's spatial distribution in the image on a per element basis. The processor then provides a per element saliency measure by combining the first image measure and the second image measure.

Abstract: Disclosed is a method for photographing a panoramic image including the steps of recognizing movement of a corresponding photographing apparatus by comparing a current real-time input image with a previous image through a motion estimation mechanism with exposure compensation, determining a time to photograph each next picture by determining whether movement in a photography direction reaches a preset threshold value, and photographing each next picture by manual or automatic operation at the determined time.

Abstract: A method and a system for three-dimensionally reconstructing a non-rigid body based on a multi-depth-map are provided. The method comprises: obtaining a plurality of depth maps by shooting the non-rigid body in different postures and from different angles; transforming each depth map to one group of three-dimensional point clouds and obtaining a plurality of matching point pairs among a plurality of groups of three-dimensional point clouds; conducting a position transformation for each matching point and obtaining a transformation parameter corresponding to the each matching point after the position transformation; mosaicing all transformation parameters to obtain a mosaicing result and constructing an energy function according to the mosaicing result; and solving the energy function to obtain a solution result and reconstructing a three-dimensional model of the non-rigid body according to the solution result.

Abstract: Methods and apparatus for supporting zoom operations using a plurality of optical chain modules, e.g., camera modules, are described. Switching between use of groups of optical chains with different focal lengths is used to support zoom operations. Digital zoom is used in some cases to support zoom levels corresponding to levels between the zoom levels of different optical chain groups or discrete focal lengths to which optical chains may be switched. In some embodiments optical chains have adjustable focal lengths and are switched between different focal lengths. In other embodiments optical chains have fixed focal lengths with different optical chain groups corresponding to different fixed focal lengths. Composite images are generate from images captured by multiple optical chains of the same group and/or different groups. Composite image is in accordance with a user zoom control setting. Individual composite images may be generated and/or a video sequence.

Abstract: A method and system include replicating an image representing a sequence of bytes on a local storage medium on a target device by determining a similarity between images and reconstructing a new image using equivalent blocks from one or more similar images locally available on the target device or available on donor devices to reduce network link usage and transfer time in replicating the image.

Abstract: A method for reverse video playback and a computer-readable medium are provided for playing a video stream backward. The video stream includes a plurality of groups of pictures which includes a plurality of frames. The frames include one I-frame and at least one frame which is a non-I-frame. The said method includes decoding from the I-frame to a last one frame in a group of pictures according to the time sequence, outputting the last one frame, saving at least one frame which is not outputted in the group of pictures to a storage module, pre-decoding the frames which is not outputted and saved in the group of picture, outputting the frame which is in the storage module.

Abstract: There is provided an effect control device including an effect control unit that controls an effect added to a target image based on information regarding a direction of a sound.

Abstract: An image processing apparatus that outputs a transformed image obtained by performing geometric transformation on an input image identifies, on the basis of inverse parameters of the geometric transformation, a plurality of sets of coordinates in the input image corresponding to a plurality of sets of coordinates in the transformed image, store, among the plurality of sets of coordinates in the transformed image, one or more sets of coordinates that satisfy a certain condition and the identified sets of coordinates corresponding to the one or more sets of coordinates in a memory while associating the one or more sets of coordinates and the identified sets of coordinates with each other, and generates the transformed image on the basis of data stored in the memory.

Abstract: An apparatus and a method for generating image data in a portable terminal are provided. The apparatus method includes when a request for photographing an image is made, detecting a motion of the portable terminal and generating motion information, generating coordinates corresponding to a plurality of image data based on the motion information, combining the plurality of image data based on the coordinates to generate combined image data, and displaying the combined image data.

Abstract: In one implementation, at least two images are captured from a respective at least two cameras of a telepresence system. The at least two cameras have horizontally overlapping fields of view such that the at least two images horizontally overlap. A processor identifies, by image processing of the overlap of the at least two images, portions of each of the at least two images. The portions spatially correspond to adjacent displays and do not include the overlap. Subsequent images captured by the at least two cameras are displayed on the adjacent displays in a video conference. The displayed images are for the portions of the field of view corresponding to the adjacent displays.

Abstract: Methods and apparatus for performing zoom in and zoom out operations are described using multiple optical chains in a camera device. At least one optical chain in the camera device includes a moveable light redirection device, said light redirection device being one of a substantially plane mirror or a prism. Different zoom focal length settings correspond to different scene capture areas for the optical chain with the moveable light redirection device. Overlap between scene areas captured by different optical chains increases during zoom in and decreases during zoom out. Images captured by different optical chains are combined and/or cropped to generate a composite image corresponding to a zoom focal length setting.

Abstract: A method registers a deformable image to a fixed image by first acquiring the deformable image and the fixed image. Multi-resolution multi-level image pyramids are generated for the deformable and fixed images. Levels of the multi-resolution multi-level image pyramids are processed in a coarse to fine order, and for each deformable and fixed image at each level partitioning the deformable and fixed image into overlapping blocks, and labeling each block with a label by solving, iteratively and in parallel, until a termination condition is reached, a binary maximum flow problem, within ?-expansion, for each block and performing boundary fusion for the blocks, and then registering each block according to the labels to form the fixed image.

Abstract: An image processing apparatus capable of obtaining a sufficient HDR effect while keeping smoothness of an appearance of a video image in an HDR composition process. A first computation unit finds a first composition ratio of frames of images that are continuously taken at mutually different exposures based on luminance of at least one of the frames of images. A second computation unit finds a second composition ratio of the frames of images based on the luminance difference between the frames of images. A third computation unit finds a third composition ratio as a final composition ratio for compositing the frames of images based on the first composition ratio, the second composition ratio, and shutter speed at a time of taking the frames of images. A composition unit generates one frame of an image by compositing the frames of images based on the third composition ratio.

Abstract: There is provided a system and method for integrating multiple virtual rendering systems to provide an augmented reality. There is provided a method for integrating multiple virtual rendering systems for outputting a composite render to a display, comprising obtaining a first environment data from a first virtual rendering system using a first camera view, obtaining a second environment data from a second virtual rendering system using a second camera view, rendering the composite render by processing the first environment and the second environment, and outputting the composite render to the display. Additionally, the first environment data and second environment data may depend on synchronized or corresponding inputs, and display priority algorithms or masking algorithms may be used to determine virtual and real object display priority.

Abstract: Systems and methods for managing user interface elements using gestures are disclosed. In some implementations, a block representing a plurality of user interface elements is displayed on a touch screen of a device. A first gesture initiated at a position corresponding to the block representing the plurality of the user interface elements is received via the touch screen. A first path corresponding to the first gesture is stored in a memory. At least a portion of the plurality of user interface elements are displayed on the touch screen in positions along the first path.

Abstract: In some instances, an image may have dimensions that do not correspond to a slot to display the image. For example, an image content item may have dimensions that do not correspond to a content item slot. The image may be resized using seam carving to add or remove pixels of the image. A saliency map for the image may be used having saliency scores for each pixel of the image. Evaluation metrics may be used before, during, and after, seam carving to determine whether salient content is affected by the seam carving. In some instances, a seam cost threshold value may be used for adaptive step size during the seam carving. The resized image may then be outputted, such as for an image content item to be served with a resource.

Abstract: A system determines an otherwise unknown position and orientation of a camera in a working environment, relative to an associated coordinate system, based on visually identifiable unique objects in images taken by the camera. The system utilizes a database that includes or may be updated to include position coordinates for unique objects of interest. The system identifies a plurality of objects within images taken by the camera at a given location, and enters the database either to determine position coordinates for the respective identified objects or to add position coordinates to the data base for the respective identified objects, or both. The system may also update the database to include newly identified unique objects and objects that are altered between images, to determine position and orientation of the camera in a changing environment. Sensors may be included to add additional information relative to the position and orientation of the camera.

Abstract: An image capturing apparatus that couples a plurality of images so as to generate a composite image, comprises an image capturing unit which captures images of an object; a determination unit which determines, for each of a plurality of areas into which light receiving portions of the image capturing unit are separated, an exposure condition under which the image capturing unit is exposed; a first composition unit which couples to one another, area by area, the plurality of images that were shot under the exposure condition determined for each area by the determination unit, so as to generate a first plurality of composite images; and a second composition unit which composes the first plurality of composite images generated by the first composition unit so as to generate a single second composite image that has an extended dynamic range.

Abstract: Provided is an imaging apparatus which includes: a video reproducer reproducing a video and a heatmap of the video on a display in a selective manner between overlapping the video and the heatmap with each other and displaying the video and the heatmap on different areas, respectively; a sub-heatmap area setter setting a plurality of sub-heat map areas on the heatmap; and a video summarizer providing a video summary of the video selectively to a summary area selected from among the sub-heatmap areas or to an area different from the sub-heatmap areas, respectively, wherein the video reproducer also reproduces a portion of the video corresponding on an interest area selected from among the sub-heatmap areas, and the at least one summary area and the at least one interest area are a same area or different areas in the heatmap.

Abstract: In a system for determining liveness of an image presented for authentication, a reference signal is rendered on a display, and a reflection of the rendered signal from a target is analyzed to determine liveness thereof. The analysis includes spatially and/or temporally band pass filtering the reflected signal, and determining RGB values for each frame in the reflected signal and/or each pixel in one or more frames of the reflected signal. Frame level and/or pixel-by-pixel correlations between the determined RGB values and the rendered signal are computed, and a determination of whether an image presented is live or fake is made using either or both correlations.

Abstract: Techniques for enhancing an image using pixel-specific processing. An image can be enhanced by updating selected pixels through patch aggregation. Respective patch values for patches of any size of the image are determined. Patch values provide update information for updating the respective pixels in the patch. Relevant patch values for the selected pixel are identified by identifying associated patches of the pixel. Information from the relevant patch values of the selected pixel may be obtained by averaging the relevant patch values or determining the maximum or minimum patch value. Using this information, pixel-specific processing may be performed to determine an updated pixel value for the selected pixel. Pixel-specific processes may be executed for each of the selected pixels. These pixel-specific processes can be executed in parallel. Therefore, through the execution of pixel-specific processes, which may be performed concurrently, an enhanced image may be determined.

Abstract: An image processing apparatus includes an acquisition unit to acquire a plurality of divided images from one image. The divided images that neighbor one another do not have an overlapping region. An extraction unit extracts a candidate region of a specific region in the divided image. In a case when candidate regions extracted by the extraction unit neighbor one another at the boundary between the divided images that neighbor one another, a combining unit combines shape information of the candidate regions that neighbor one another. A determination unit determines whether the candidate regions form the specific region by using the shape information combined by the combining unit.

Abstract: Provided is an apparatus and method for generating a three-dimensional (3D) panoramic image using a single camera. The image processing apparatus may generate a two-dimensional (2D) reference panoramic image using a central area of each of a plurality of input image frames, and may extract a left-eye strip and a right-eye strip of when a similarity calculated in the plurality of input image frames based on the 2D reference panoramic image has a maximum value.

Abstract: A focus detection device includes: a plurality of first pixels having first color filters, via which a pair of first signals, to be used for split-pupil phase detection, are output; a plurality of second pixels having second color filters, via which a pair of second signals, to be used for the split-pupil phase detection, are output; a phase difference detection unit that detects a phase difference manifested by the first signals or a phase difference manifested by the second signals; and a defocus amount calculation unit that calculates a defocus amount by using a first conversion coefficient corresponding to the first color when the phase difference detection unit has detected the phase difference manifested by the first signals and by using a second conversion coefficient corresponding to the second color when the phase difference detection unit has detected the phase difference manifested by the second signals.

Abstract: Computer-implemented systems and methods for identifying an object in an image are provided. In one example, the method includes identifying a first object related to an electronic image. The image includes at least a second object. Based at least in part on the identity of the first object, social networking information related to the first object is used to programmatically identify the second object. The first object and/or the second object may be a person. In some embodiments, metadata associated with the image may be used to identify the second object. Based at least in part on the identifications, social networking information may be associated between the first object and the second object.

Abstract: A head-mounted display device includes an image processing unit configured to perform processing for generating an image, an image display unit including an image-light generating unit configured to generate image light representing the image, the image display unit being configured to enable a user to visually recognize the virtual image and an external image, an image pickup unit provided in the image display unit and configured to pick up an image in a visual field direction of the user, and a position detecting unit configured to specify an external apparatus present in the picked-up image picked up by the image pickup unit and detect a position in the picked-up image of the external apparatus. The image processing unit generates an image in which information concerning the external apparatus is displayed in a position corresponding to the position detected by the position detecting unit.

Abstract: A shooting apparatus includes an image pickup unit, a frame setting unit that sets frames for arranging a plurality of still images obtained from the picked-up image as a combination photograph before the still images are shot, an object determination unit that determines an object from the picked-up image before the still images are shot, a still image acquisition unit that acquires the still images including the object determined by the object determination unit while the image pickup unit is shooting a moving image, an arrangement unit that arranges the still images acquired by the still image acquisition unit in the frames set by the frame setting unit, and a combining unit that combines the still images acquired by the still image acquisition unit according to the arrangement by the arrangement unit to generate the combination photograph.

Abstract: Techniques for automatically removing slivers from orthomosaics. First, slivers may be identified, which may be based upon user-configurable characteristics such as width and length. Second, slivers may be replaced with portions of another image, such as an older image. Third, boundary slivers may optionally be removed. Fourth, remaining boundary or interior slivers can be inflated by expanding the sliver until it is no longer a sliver, which may include replacing a portion of an adjacent image portion with older imagery.

Abstract: An image data processing method comprises: extracting a depth map from an input image; separating the input image into a foreground area and a background area based on grayscales of the depth map; and modulating the maximum depth value of the input image to become smaller and the difference between depth values of a gray grayscale segment of the depth map to be greater than the difference between depth values of the foreground area and background area of the input image.

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Abstract: An ingestible image scanning pill captures high resolution images of the GI tract as it passes through. Images communicated externally have exact location determination. Image processing software discards duplicate information and stitches images together, line scan by line scan, to replicate a complete GI tract as if it were stretched out in a straight line. A fully linear image is displayed to a medical professional as if the GI tract had been stretched in a straight line, cut open, laid flat out on a bench for viewing—all without making any incisions in a live patient.

Abstract: In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating receipt of two or more images of a scene, where the two or more images are associated with different capture parameters. The method includes determining intensity gains at corresponding pixel locations of at least one image pair of the two or more images. The method further includes generating a blended image by blending pixels of images of the at least one image pair based at least on the intensity gains. A pixel associated with a pixel location of the blended image is generated by blending pixels associated with the pixel location of the images of the at least one image pair.

Abstract: A method for high dynamic range imaging using more than two capture intervals, where images are captured in a repeating sequence that avoids interlace bounce, and overlapping groups of combined images form composite frames for output, and an imaging system comprising an imaging array, processing means and a display, wherein the imaging array is operable to capture a succession of images by detecting incident light and the processing means is operable to process said images as required, and pass the processed images to the display for output.

Abstract: An unmanned aerial vehicle image processing system includes a digital camera mounted on an unmanned aerial vehicle, an autopilot controller installed in the unmanned aerial vehicle and pre-loaded with a base image, and a computer device. The autopilot controller programs a flight path as a series of mission lags to cover a target polygon on the base image in a lawnmower pattern for controlling the unmanned aerial vehicle to perform a flight mission in which the autopilot controller records plural GPS/INS data and triggers the digital camera to take plural photos which are further calibrated to generate plural calibrated photos corresponding to the plural GPS/INS data, respectively. The computer device processes the plural calibrated photos to generate plural projected photos by using the corresponding plural GPS/INS data, respectively, and stitches the plural projected photos to a mosaic image by a photo-stitching process.

Abstract: Techniques for dynamically grouping items include determining context associated with each group comprising one or more items; and determining current context at a device. In response to determining that prompted prompt is presented for input to indicate an item, a suggested group is determined based on the current context at the device and relevance of a context associated with the suggested group. The suggested group is presented. In some embodiments, prompted prompt is presented to name a suggested group; and, in response, data indicating the suggested group is stored as a permanent group associated with the name. In some embodiments, relevance is determined for each item of a group. A group avatar is generated based on M images associated with the items that have the most relevance.

Abstract: A surrounding area monitoring device for monitoring an area around a work machine displays an immediate range display image as a bird's eye view image indicating the immediate area surrounding the work machine from above the work machine and a wide range display image indicating a wide area including a predetermined range outside the immediate area, selectively. The wide range display image is displayed if a position of a worker is not located within a monitoring area. The immediate range display image is displayed if the position of the worker is located within the monitoring area. The immediate range display image is the bird's eye view image set around the schematic graphic image of the work machine. The wide range display image is an image including a reduced immediate range display image and an image showing the conditions outside the immediate area in the schematic graphic representation.

Abstract: Methods and systems for communicating with a mixed media communication. An image is captured via an image capturing device associated with a device. An audio message is captured related to the image via a microphone associated with the device. A communication is sent from the device to a second device, wherein the communication comprises the image and the audio message, such that the second device will automatically display the image and play the audio message upon accessing the communication.

Abstract: A method and system include replicating an image representing a sequence of bytes on a local storage medium on a target device by determining a similarity between images and reconstructing a new image using equivalent blocks from one or more similar images locally available on the target device or available on donor devices to reduce network link usage and transfer time in replicating the image.

Abstract: An ultraviolet image pattern is created on a recording medium having florescence properties and being a first color by electronically creating a first electronic pattern ink, the first electronic pattern ink including a second color and including holes, the holes representing areas in the first electronic pattern ink wherein the second color is absent; electronically creating an electronic image region having a pattern; electronically painting, using the first electronic pattern ink, a background of the electronic image region and the pattern of the electronic image region; electronically painting a predetermined portion of the holes with a third color, the third color matching the first color of the recording medium; and rendering, using marking materials, the electronic image region on the recording medium such that the florescence properties of the recording medium are only visible through the holes not painted with the third color when viewing the recording medium using ultraviolet illumination.

Abstract: Techniques for aligning images are disclosed. The frames might have been captured by a video camera on a hand held device, as one example. Collaboratively aligning related frames of image data is taught. Collaborative alignment determines a correspondence between pixels in pairs of the frames of image data, as well as a confidence in that correspondence. A coordinate system (or transformation) is assigned to each of the frames that is consistent with the correspondences between each of the frame pairs. The confidence in the respective correspondences may be used to provide a weighting to a correspondence when assigning the coordinate systems. Outlying frames may be discarded, and the process repeated for a robust solution.

Abstract: Methods and systems for generating data objects for multi-resolution geometry in a three-dimensional model are provided. A region of high resolution geometry in the three-dimensional model having a level of detail that is higher than a level of detail associated with geometry data surrounding the region of high resolution geometry can be identified. A boundary of the region of high resolution geometry can be extended and high resolution geometry can be generated within the extended boundary. The high resolution geometry can be spatially partitioned into a plurality of geospatial data objects according to a hierarchical spatial partitioning scheme. The geospatial data objects can be selectively stored in a memory. For instance, geospatial data objects associated with the extended boundary can be identified and excluded from a hierarchical tree data structure storing geometry data associated with the three-dimensional model.

Abstract: An image processor and an image combination method thereof are provided. The image processor includes a processing unit for performing the image combination method, and a storing unit for storing an original image and an output image. The image combination method includes the following steps. First, the original image is received from the storing unit. A first processing procedure scales down the original image to generate a first image. A second processing procedure crops the original image to generate a second image. The first image and the second image are combined to form and then be outputted the output image. Accordingly, the image processor and the image combination method are capable of providing the overview and local detailed content of the original image at the same time.

Abstract: A method, system, and computer-readable storage medium are disclosed for interpretation of free-form timelines into compositing instructions. An array comprising a plurality of items is generated. Each of the plurality of items comprises one or more instructions representing one or more operations occurring at a point in time in a video sequence. For each one of a plurality of patterns, the array is scanned to determine if one or more groups of items in the array match the pattern. For each group of items matching one of the plurality of patterns, the matching group of items is replaced in the array with a merged item. Each merged item comprises an ordered sequence of the one or more instructions in the corresponding matching group of items. A frame of the video sequence is composited dependent on the array comprising the one or more merged items.

Abstract: A client apparatus, a server, and a control method thereof are provided. The client apparatus includes a display, a user interface which receives a text input, a communication interface which transmits to the server information related to input text, a storage which receives a result of analysis of the information transmitted from the server and stores the same, and a controller which performs control operations so that, in response to the text input being received via the user interface after the result of the analysis received, the received text is converted based on a stored result of the analysis, before being displayed.

Abstract: Systems, methods and computer readable media for two-dimensional image processing based on third dimension data are described. Some implementations can include a method comprising obtaining first image data having a plurality of pixel values and obtaining second image data corresponding to each pixel value in the first image data. The method can also include receiving an indication of one or more control points in the first image data. The method can further include selectively filtering the first image data based on a distance from the control point and on one or more data values in the second image data corresponding to the corresponding control point. The method can also include outputting the selectively filtered first image data.

Abstract: In accordance with some embodiments, jitter accompanying video resizing, can be reduced or even eliminated by analyzing the content that is to be depicted and resizing based on the nature of the content being depicted. As a result, dominant objects in one frame can be handled in a way that reduces or eliminates video jitter or sliding.

Abstract: A method for ascertaining the position of an edge in or on an object surface region of interest by optical scanning. The reflectivity of the object surface region is evaluated. Light is emitted onto the object surface region under different illumination conditions, in particular different light incidence directions, and in each illumination condition a sequence S1 to Sn of camera images B is recorded. Each camera image B of a sequence S1 to Sn is recorded at another illumination intensity I. Subsequently in each case one reflectivity image R1 to Rn is produced from a plurality of or from all camera images B of a sequence S1 to Sn. Thereafter, a resulting reflectivity image E is produced from a plurality of or from all reflectivity images R1 to Rn by weighted addition, in which resulting reflectivity image E the position of an edge is determined.

Abstract: Methods, systems, and apparatus including computer program products for using extracted image text are provided. In one implementation, a computer-implemented method is provided. The method includes receiving an input of one or more image search terms and identifying keywords from the received one or more image search terms. The method also includes searching a collection of keywords including keywords extracted from image text, retrieving an image associated with extracted image text corresponding to one or more of the image search terms, and presenting the image.

Abstract: An example information processing device displays a partial area of a panoramic video on a display device. A display range of the panoramic video to be displayed on the display device is determined based on an input made on a predetermined input device. The information processing device accepts an input of additional information for the panoramic video being displayed on the display device. Moreover, input information is stored in a storage unit, the input information including the additional information and input range information with which it is possible to identify a display range when the additional information was accepted and/or a position within the display range. The information processing device outputs the additional information together with the panoramic video based on the input range information when the panoramic video is played with the additional information having been stored.