Abstract: An image processing apparatus that tracks a target object by estimating a position of the target object on each of a plurality of images. A first estimating unit estimates the position of the target object in at least one of images. A second estimating unit estimates the position of the target object in at least one of images, wherein estimating accuracy of the position of the target object in the second estimating process is lower than the estimating accuracy in the first estimation process. A correcting unit corrects the position of the target object estimated by the second estimation process on a second image, based on the position of the target object estimated by the first estimation process on a first image. The second image is an image captured at a different time from the first image.

Abstract: A method comprises segmenting first modality image data representing a model of one or more passageways within a patient; generating a first set of points based on the segmented image data; registering the first set of points to a second set of points obtained by a second modality by: determining a set of matches between the first and second sets of points, and discarding a first subset of the set of matches based on a heuristic to generate a modified set of matches by ignoring an associated set of matches between the first and second sets of points when computing a corrective motion for the second set of points—an ignored match is included in a second subset of the set of matches when computing a second corrective motion for the second set of points; and displaying a visual representation of the passageways based on the modified set of matches.

Abstract: A live streaming system communicatively connected to a first camera, where the first camera captures an original image. The live streaming system includes a controller and an electronic device. The controller can send a prompt signal via the image captured by the first camera. The electronic device communicates with the controller and the first camera, and includes a processor and a network interface device. The processor recognizes the prompt signal in the captured image, and in response thereto, processes the original image to generate a synthesized image; it further analyzes the prompt signal to determine the location of the synthesized image. The network interface device is electrically connected to the processor and live streams the synthesized image.

Abstract: A computer-implemented method for a multiple imager imaging system is disclosed. The method comprises capturing regular images; capturing depth sensor images; and performing a depth-based alignment operation to adjust factory alignment parameters based on depth sensor information.

Abstract: Embodiments of the present invention are directed towards reframing videos from one aspect ratio to another aspect ratio while maintaining visibility of regions of interest. A set of regions of interest are determined in frames in a video with a first aspect ratio. The set of regions of interest can be used to estimate an initial camera path. An optimal camera path is determined by leveraging the identified regions of interest using the initial camera path. Sub crops with a second aspect ratio different from the first aspect ratio of the video are identified. The sub crops are placed as designated using the optimal camera path to generate a cropped video with the second aspect ratio.

Abstract: An image processing apparatus includes an obtaining unit configured to obtain identification information for identifying a restriction area which is set in a three-dimensional coordinate system, the restriction area being an area in which display of a virtual object inserted in a virtual viewpoint image based on captured images obtained by a plurality of cameras that capture images in different angles and viewpoint information corresponding to a specification of a virtual viewpoint is restricted, wherein the virtual object is not included in the captured images obtained by the plurality of cameras, and a control unit configured to restrict the display of the virtual object in the virtual viewpoint image so that the display of the virtual object being in the restriction area, which is identified by the identification information obtained by the obtaining unit, is restricted.

Abstract: A display control device for outputting display data to frame buffers includes an input for receiving portions of the display data, different portions being in raw form and in compressed form. A data controller determines, for each received portion, whether it is in compressed form or raw form and controls the received portion to move along a first, bypass, path if it is determined that the received portion of display data is in raw form and to control the received portion of display data to move along a second path to a decompression engine if it is determined that the received portion of display data is in compressed form. The decompression engine decompresses the particular portion of compressed display data and forwards a corresponding portion of decompressed display data along a third path, the portions of data from the first and third paths then being output to the frame buffers.

Abstract: A pixel projection component for projecting a multi-vantage point light-field includes a distal layer with a plurality of apertures disposed therein, each of the plurality of apertures traversing the distal layer between a convex outer surface and a concave inner surface, and an intermediate layer comprising a plurality of light guides, the intermediate layer being mechanically coupled to the distal layer such that a proximal end of each light guide of the plurality of light guides is oriented to accept light transmissions from a corresponding light source and a distal end of each light guide is oriented to transmit the light transmission through a corresponding aperture of the plurality of apertures, such that the light is directed to targeted vantage points corresponding to the corresponding aperture, and causing different light transmissions to be transmitted to different vantage points.

Abstract: A method includes receiving first intraoral scan data of an intraoral site, the first intraoral scan data having been generated at a first time, receiving second intraoral scan data of the intraoral site, the second intraoral scan data having been generated at a second time that is later than the first time, and analyzing the second intraoral scan data of the intraoral site relative to the first intraoral scan data of the intraoral site. The method further includes identifying an area of interest (AOI) based on the analyzing and removing data for the AOI from at least one of the first intraoral scan data, the second intraoral scan data, or a three-dimensional (3D) model of the intraoral site generated from the first intraoral scan data and the second intraoral scan data.

Abstract: An apparatus obtains first transformation information, such as a first transformation matrix, to be used for coordinate transformation between a coordinate system in an overall image prepared beforehand and a coordinate system in a first captured image, by comparing a feature point extracted from the overall image and a feature point extracted from the first captured image. In a case where the first transformation information is updated, the apparatus generates a partial image from the overall image based on an image-taking position of a just preceding image, and compares a feature point extracted from the partial image with a feature point extracted from a captured image to be used for updating of the first transformation information, and accordingly obtains transformation information for updating. The apparatus updates the first transformation information by using the obtained transformation information for updating. Thus, accuracy of tracking processing is improved.

Abstract: The present technology relates to an information processing apparatus, an information processing method, and a program that can improve the estimation accuracy of a motion amount of an object. A cross-correlation analysis unit performs a cross-correlation analysis between a first image and a second image obtained by capturing the same object as an object of the first image before the first image, a first motion estimation unit estimates a first motion amount corresponding to a motion blur in the first image, and a second motion estimation unit estimates a second motion amount different from the first motion amount between the first image and the second image on the basis of a result of the cross-correlation analysis and an estimation result of the first motion amount. The present technology can be applied to, for example, an apparatus for measuring a pulse.

Abstract: According to some embodiments, a studio video feed, including a studio subject, may be received from a studio video camera. A remote video feed, including a remote subject, may be received from a remote video camera. The remote video feed may include, for example, the remote subject positioned in from of a solid-colored background. The remote subject may be overlaid into the studio video feed to produce a composite video signal, and at least one of the studio video feed and the remote video feed may be automatically adjusted to create an impression that the studio subject and the remote subject occupy a shared physical space.

Abstract: The present disclosure can obtain a high-quality composite image by determining a suitable boundary when input images are sequentially stitched together to generate the composite image. An image generating apparatus 1 generates a composite image by stitching sequentially input images together. A difference value calculating section 15 calculates difference values by using the pixel values of a reference image and the pixel values of a target image that partly overlap the reference image. The difference values represent the relative relationship between the reference image and the target image. A boundary determining section 16 determines a boundary for stitching the reference image and the target image together by using the difference values calculated by the difference value calculating section 15. Then, an image compositing section 18 generates the composite image by stitching the reference image and the target image together based on the boundary determined by the boundary determining section 16.

Abstract: An image display device includes: a storing section configured to store associating information that associates information indicating one or more providing sources of image data with each of one or more display areas set within a display screen; an obtaining section configured to obtain image data from a providing source corresponding to each of one or more display areas on the basis of the associating information stored in the storing section; a forming section configured to form display image data of a display image to be displayed on the display screen on the basis of the image data being obtained by said obtaining section for each of one or more display areas; and a display processing section configured to display the display image corresponding to the display image data formed by the forming section on the display screen.

Abstract: A system includes a ground segment and a monitoring system displaying first thread view for a first channel and displaying a second thread view for a second channel.

Abstract: An example news production system includes a scheduling system, a composite display, and a camera. The scheduling system accesses a news program schedule that specifies a sequence of actions to be performed by the news production system. The scheduling system reads entries from the news program schedule, identifies actions associated with each, and sends signals to cause the actions to be performed. The news production system may cause the composite display to render video content in accordance with a specified layout. A camera can capture video of a field of view that includes at least a portion of the composite display while the specified video content is rendered thereon. The news production system may also cause an output video stream to be based, at least in part, on the captured video.

Abstract: The disclosure relates to an image processing method and image processing device for a monitoring system including multiple camera devices, and a monitoring system. The image processing method includes: extracting a key frame from a video acquired by each of the plurality of camera devices; for each of the extracted key frames, determining a neighbor camera device having monitor area adjacent to the monitor area of the key frame, and acquiring from the neighbor camera device a corresponding video frame which is simultaneous to the key frame; blending the key frame extracted from each of the camera devices and the corresponding video frame to generate a panorama key frame; and generating a sequence formed by panorama key frames for the key frames as a video abstract of the monitoring system.

Abstract: In a graphics system, pixels may be provided to a graphics display at a pixel clock rate corresponding to an actual refresh rate nearest to and lower than a desired/target refresh rate. A number of additional pixels may be provided with the pixels for each image frame. The number is based at least on the actual refresh rate, target refresh rate, and a pixel-resolution of the image frame, such that providing pixels of an image frame and the number of additional pixels for each image frame at the pixel clock rate results in an effective refresh rate matching the target refresh rate. The additional pixels may be provided by adding one or more pixels at the end of each horizontal line of the image frame, or by adding an extra partial line in the vertical blanking interval. The additional pixels are not displayed and do not adversely affect normal operation.

Abstract: Methods, systems, and computer program products for generating revised videos. The method includes, for example, receiving, by one or more processor, first video data of an environment having at least one projection on a screen from a first point of view, and generating, by the one or more processor, revised video data of the environment having the at least one projection on the screen from the first point of view based on the first video data, the revised video data comprising a plurality of frames with the at least one projection on the screen disposed in the first area relative to the environment in a plurality of frames being revised based on data for projecting the at least one projection on the screen in the first video data.

Abstract: Exemplary embodiments of the present invention relate generally to the fields for indicating a location on an image in a multi-viewer display. In particular embodiments, the multi-viewer display may be a multi-viewer microscope.

Abstract: There is provided a method for authenticating a fingerprint. The method includes receiving an inputted fingerprint image; selecting a plurality of comparison target pixels from pixels in the inputted fingerprint image and selecting a plurality of comparison reference pixels from pixels in a pre-stored registered fingerprint image; and determining a similarity of an overlapping area where the inputted fingerprint image overlaps the registered fingerprint image whenever a matching arrangement of each of the comparison target pixels is made with respect to each of the comparison reference pixels. The method further includes, whenever it is determined that the overlapping area is similar, comparing the inputted fingerprint image and the registered fingerprint image within the overlapping area to calculate a correlation score with respect to the overlapping area and authenticating the inputted fingerprint image based on the calculated correlation score.

Abstract: In a system for determining liveness of an image presented for authentication, a reference signal is rendered on a display, and a reflection of the rendered signal from a target is analyzed to determine liveness thereof. The analysis includes spatially and/or temporally band pass filtering the reflected signal, and determining RGB values for each frame in the reflected signal and/or each pixel in one or more frames of the reflected signal. Frame level and/or pixel-by-pixel correlations between the determined RGB values and the rendered signal are computed, and a determination of whether an image presented is live or fake is made using either or both correlations.

Abstract: Devices, systems and methods are disclosed for determining if an image is displayed using multiple pages of content and loading and displaying the multiple pages in a single context. Bordering pixels may be compared between a first page and a second page to determine if the pixels match above a threshold. If they match above a threshold, the first page and the second page may be aligned, stitched together and displayed in a shared context, allowing a user to pan and zoom between the first page and the second page without interruption, margins, page breaks or the like. The first page and/or the second page may be compared to additional pages of content and each of the additional pages of content is included in the shared context if matching above the threshold.

Abstract: Similar medical images having a predetermined similarity to a region of interest in a medical image to be interpreted are received from a case search system. A display screen on which the received similar medical images are displayed is displayed on a display. The display screen includes display frames within which similar medical images are displayed. In response to an instruction for enlarging the similar medical images, corresponding regions of interest in the similar medical images are enlarged and displayed with the sizes of the display frames maintained unchanged on the display screen. In response to an instruction for causing a selected similar medical image among the enlarged and displayed similar medical images to move within a corresponding display frame, the other unselected similar medical image(s) is caused to move within a corresponding display frame synchronously with the movement of the selected similar medical image in the same movement direction.

Abstract: An image processing device includes an input unit, a selection unit, a matching unit, an estimation unit and a merging unit. The input unit sequentially inputs images. The selection unit selects a reference image from among the input images. The matching unit calculates a correspondence relationship between a feature point of the reference image and a feature point of a target image. The estimation unit estimates an equation that causes a coordinate system of the reference image to correspond to a coordinate system of the target image using positional information of a pair of the feature points whose correspondence relationship has been calculated by the matching unit by regarding a motion between the reference image and the target image as only a rotational motion of the imaging element. The merging unit merges the input image and the target image to generate the composite image based on the equation.

Abstract: A method of encapsulating an encoded bitstream representing one or more images includes providing description of images and/or sub-image picture, providing composed picture description, and outputting the bitstream. The description of images and/or sub-image pictures identifying portions of the bitstream representing the images and/or sub-images of the one or more images is provided. The composed picture description of at least one composed picture formed by one or more images and/or sub-image pictures also is provided. The bitstream, together with the composed picture description, is output as an encapsulated data file.

Abstract: Implementations relate to prioritized display of visual content in computer presentations. In some implementations, a computer-executed method includes obtaining first visual content and second visual content associated with the first visual content, where the first and second visual content include a plurality of pixels. The method provides a display of a computer presentation by a display device, where the first visual content is displayed in a presentation area of the computer presentation. The method determines that a first presentation priority of at least a portion of the first visual content is reduced based on a determination that less than a threshold amount of the at least a portion of the first visual content has changed. In response to determining that the first presentation priority is reduced, the method improves a visibility of a display of the second visual content in the computer presentation.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, to generate a scannable document. In one aspect, a method includes receiving a scan request, wherein the scan request includes a plurality of text images; for each text image of the plurality of text images: rectifying the text image to generate a text image with parallel image lines, generating a plurality of word bounding boxes that enclose one or more connected components in the text image, wherein each word bounding box is associated with a respective word, and generating, for each respective word in the text image, a plurality of points that represent the respective word; combining the plurality of text images to form a single text document; and providing the combined image as a scannable document.

Abstract: Methods and devices for acquiring, and aligning, an image with a textured three-dimensional (3D) model are described. In one implementation, aligning can include rendering an image in the 3D model at an estimated pose and then aligning the acquired image with the rendered image. In another implementation, aligning can include projecting the acquired image onto the 3D model at an estimated pose and then aligning the projected acquired image with the textured 3D model. In still another embodiment, aligning can include projecting the acquired image onto the textured 3D model, rendering a first image in the original 3D model and a second image in the 3D model onto which the acquired image has been projected, and then aligning the first and second images.

Abstract: A method, system and computer program product for encoding an image is provided. The image that needs to be represented is represented in the form of a Gaussian pyramid which is a scale-space representation of the image and includes several pyramid images. The feature points in the pyramid images are identified and a specified number of feature points are selected. The orientations of the selected feature points are obtained by using a set of orientation calculating algorithms. A patch is extracted around the feature point in the pyramid images based on the orientations of the feature point and the sampling factor of the pyramid image. The boundary patches in the pyramid images are extracted by padding the pyramid images with extra pixels. The feature vectors of the extracted patches are defined. These feature vectors are normalized so that the components in the feature vectors are less than a threshold.

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Abstract: A mobile terminal and controlling method thereof are disclosed, which facilitates a terminal to be used in further consideration of user's convenience. The present invention includes a display, a memory configured to store at least one image fragment, a 1st camera, and a controller, if the 1st camera is activated, displaying a preview screen of an image received from the 1st camera, the controller controlling the display to display a prescribed one of the stored at least one image fragment on a prescribed region of the preview screen. Accordingly, when a photo is taken using a terminal, a photo-taker can be included in the taken photo in a manner of being synthesized with the corresponding photo.

Abstract: A method implemented in an image editing device comprises determining a source region in a source image and determining a target region in a target image. At least one image characteristic of each of the source region and a region outside the target region is analyzed. The content in the source region is adjusted according to the at least one image characteristic of the source region and the at least one image characteristic of the region outside the target region. The adjusted content from the source region is inserted into the target region.

Abstract: A battery operated device, having a display with two or more available refresh rates, has its refresh rate selected so as to match the video frame rate of video data played back on the display. This selection is made by coordinating the resources in the device that are used to process the video from its reception through to its display.

Abstract: Apparatus for scanning and recognizing characters comprises: an optical sensor for capturing images, which optical sensor carries out continuous shooting of the scanned characters to obtain an image frame sequence containing the scanned characters, and the content of an image frame partly overlaps content of the previous image frame in the sequence; and a control module for processing the images and recognizing the characters. The control module divides the image frames in the image frame sequence into groups of image frames including reference frames, skip frames and predictive frames according to the overlapping contents, and combines the standard frames and the predictive frames into a panorama image, taking a group of image frames as a unit, and carries out character recognition after performing skew correction based on the panorama image, to obtain the character codes of the scanned characters. The skip frames can be skipped directly, increasing the splicing speed.

Abstract: Aspects of this disclosure relate to generating a composite image of an image of and another image that has a wider field of view. After an image is selected, the visual features in the image may be identified. Several images, such as panoramas, which have wider fields of view than an image captured by a camera, may be selected according to a comparison of the visual features in the image and the visual features of the larger images. The image may be aligned with each of the larger images, and at least one of these smaller-larger image pairs may be generated as a composite image.

Abstract: A method, system and computer program product for encoding an image is provided. The image that needs to be represented is represented in the form of a Gaussian pyramid which is a scale-space representation of the image and includes several pyramid images. The feature points in the pyramid images are identified and a specified number of feature points are selected. The orientations of the selected feature points are obtained by using a set of orientation calculating algorithms. A patch is extracted around the feature point in the pyramid images based on the orientations of the feature point and the sampling factor of the pyramid image. The boundary patches in the pyramid images are extracted by padding the pyramid images with extra pixels. The feature vectors of the extracted patches are defined. These feature vectors are normalized so that the components in the feature vectors are less than a threshold.

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Abstract: The invention relates to manipulation of sub-pictures (303) in a picture such as a mosaic screen (301). An apparatus comprises a sub-picture generator (105) connected to a mosaic screen generator (107), which generates the mosaic screen (301) from the sub-pictures. The mosaic screen (301) is by a video compressor (111) divided into uncompressed picture blocks such that each block only comprise video data from one sub-picture. The picture blocks are compressed using a block compression scheme such as MPEG-2. The apparatus further comprises a video manipulation processor (113), which manipulates the sub-pictures by manipulating the association between control data in the video signal and the compressed picture blocks. The video data of the compressed picture blocks are not affected whereby de-compression and new compression is avoided.

Abstract: An example game system causes an image, based on an operation performed on a terminal apparatus including a display section, to be displayed on a stationary display apparatus separate from the terminal apparatus, and also causes an image based on an operation performed on a controller to be displayed on the display apparatus. Further, in the game system, an image based on the operation performed on the terminal apparatus is displayed on the display section of the terminal apparatus. In this case, when displayed on the stationary display apparatus, the image based on the operation performed on the controller is displayed so as to be larger than the image based on the operation performed on the terminal apparatus.

Abstract: Systems and methods of conducting collaborative image capture may provide for transferring sensor data from a plurality of image capture devices to a designated master device, which may in turn determine rough alignment recommendations for the image capture devices. The image capture devices may receive the alignment recommendations and output them to a preview display for manual alignment and/or to an automated adjustment system for automated alignment. Additionally, the image capture devices may transfer preview image data to the master device, wherein fine alignment recommendations may be made based on the preview image data.

Abstract: There is disclosed a method for seamlessly replacing areas in a digital image with corresponding data from temporally close digital images depicting substantially the same scene. The method uses localized image registration error minimization over a fixed preliminary boundary. A least cost closed path which constitutes a boundary for the area to be replaced is calculated using dynamic programming. The replacement area is blended such that image data information from one image is seamlessly replaced with image data information from another image.

Abstract: Techniques are described herein for supporting independent viewer tailoring of same media source content via a common 2D-3D display. A first independently controllable version of video content is caused to be delivered to a first region of a screen. A second independently controllable version of the video content is caused to be delivered to a second region of the screen. The first region and the second region overlap at least in part. For example, the first and second independently controllable versions may be simultaneously displayed such that the first independently controllable version is displayed for a first viewer but not for a second viewer and such that the second independently controllable version may be displayed for the second viewer but not for the first viewer.

Abstract: The present invention provides methods and apparatus for generating and transmitting a multimedia, multi-vantage point platform for viewing audio and video data.

Abstract: A non-transitory computer readable storage medium stores one or more computer programs adapted to cause a processor based system to execute steps that include analyzing an image, identifying one or more faces in the image using a face recognition technique, designating at least one of the identified faces collectively as a first area of interest, and determining whether an insertion area exists in the image where additional content can be inserted without obstructing the first area of interest. Another computer program is adapted to cause a processor based system to execute steps that include determining whether the insertion area can be divided into two or more regions based on color. Methods and processor based apparatuses that perform one or more of these steps are also disclosed.

Abstract: A method for displaying video image of a television includes processing video signals corresponding to video images transmitted from an electronic device and determining whether the TV programs are displayed on a full displaying window or on a partial displaying window. The display is controlled to provide a first video image displaying window overlaying the full displaying window if the TV programs are displayed on the full displaying window or provide a second video image displaying window spaced from the partial displaying window if the TV programs are displayed on the partial displaying window. The video image is displayed in the first video image displaying window or the second video image displaying window. Any human faces in the video image displayed in the first video image displaying window cause the video image to be transparent except for the faces. A related TV is also provided.

Abstract: A system and method for viewing simultaneous videos on a single display device using polarization. The system includes a polarized display device capable of displaying multiple full-screen polarized images simultaneously, multiple polarized videos displayed on the display device, and at least one polarizing optical element. The polarizing optical element includes a direction of polarization generally equal to the direction of polarization of one of the polarized videos, so that only one polarized video is viewable through the polarizing optical element. The polarizing optical element may be a transparent window or a mirror. Multiple polarizing optical elementes may be used simultaneously, allowing for simultaneous viewing of multiple videos displayed on a single screen.

Abstract: The display controller includes a decoder, a control circuit, and a video output logic circuit. The decoder is configured to decode a first display command and output a decoding signal and first synchronizing information indicating the first display command is received. The control circuit is configured to generate a first control signal based on second synchronizing information and the decoding signal. The second synchronizing information is output from a second display controller and indicates a second display command is received. The video output logic circuit is configured to send a part of video data stored in a video source and a plurality of first timing control signals for displaying the part of the video data on a display to the display based on the first control signal.

Abstract: An image output system includes plural channels from each of which an image signal is output, a switching unit for switching the channel that outputs the image signal to an image output unit based on connection states of the plural channels, an information display generation unit for generating the image signal of an information display screen related to the currently outputting channel, and a display state storing unit for storing a display state related to the information display screen, the display state including a “display-ON” state and a “display-OFF” state. In a case where there is a change in the connection state of the currently outputting channel, when there is the information display screen whose display state is the “display-ON” state, the switching unit switches the channel after waiting for a predefined change in the display state related to the information display screen.

Abstract: There is provided an image processing device including an input image acquisition portion that acquires an input image, a past image acquisition portion that acquires a past image of a photographic subject in the input image, a mode selection portion that selects one of modes, using the input image, from among a plurality of modes including a first mode in which the photographic subject in the past image is overlapped with the photographic subject in the input image and a second mode in which the photographic subject in the past image is arranged side by side with the photographic subject in the input image, and a display control portion that superimposes the past image on the input image in accordance with the mode selected by the mode selection portion.