Abstract: Systems, methods, and non-transitory computer-readable media can obtain data associated with a computer-based experience. The computer-based experience can be based on interactive real-time technology. At least one virtual camera can be configured within the computer-based experience in a real-time engine. Data associated with an edit cut of the computer-based experience can be obtained based on content captured by the at least one virtual camera. A plurality of shots that correspond to two-dimensional content can be generated from the edit cut of the computer-based experience in the real-time engine. Data associated with a two-dimensional version of the computer-based experience can be generated with the real-time engine based on the plurality of shots. The two-dimensional version can be rendered based on the generated data.

Abstract: A method of illuminating a subject during photography is disclosed. The method includes illuminating a background lighting system during a first image capture, illuminating a subject lighting system during a second image capture, and illuminating the background lighting system during a third image capture. The time from the first image capture to the third image capture is less than about 100 milliseconds. Also disclosed is a method for generating a composite mask of a subject, including receiving the three images, determining any movements of the subject between the first and third images, estimating an intermediate position of the subject during the second image, and generating a composite mask at the estimated intermediate position.

Abstract: An embodiment of the invention may include a method, computer program product and computer system for image classification and masking. The method, computer program product and computer system may include computing device which may receive image data from one or more sources. The computing device may classify the image data utilizing visual recognition classification and identify one or more classified features, each classified feature being associated with one or more attributes. The computing device may analyze the classified image data to determine if one or more of images of the classified image data contains one or more sensitive attributes. In response to determining one or more images of the classified image data contains one or more sensitive attributes, the computing device may apply a masking technique and may generate one or more masked images.

Abstract: Provided is an information processing apparatus comprising: a first obtaining unit configured to obtain viewpoint information indicating change of a virtual viewpoint corresponding to a virtual viewpoint video generated on the basis of a plurality of images captured from a plurality of directions with a plurality of image capturing apparatuses; a second obtaining unit configured to obtain condition information indicating a condition associated with the amount of change of a background in the virtual viewpoint video; a determination unit configured to determine whether the viewpoint information obtained by the first obtaining unit satisfies the condition indicated by the condition information obtained by the second obtaining unit; and an output unit configured to output information according to the result of the determination by the determination unit.

Abstract: An object detection system includes a depth image detector and a moving object extractor. The depth image detector detects a depth image from an external environment. The moving object extractor extracts a moving object desired to be extracted from the depth image. The moving object extractor registers in advance the depth image in a memory as a background while the moving object to be extracted does not exist, and extracts only a pixel whose current depth is present on a nearer side than a depth of the background as a candidate for a pixel corresponding to the moving object to be extracted.

Abstract: The invention pertains to a method for realistic visualization of a 3D virtual dental model (1) in a 2D image (20) of a face, the method comprising estimating or assuming a lighting situation in the image of the face, determining boundaries of an inner mouth region in the image, computing, based on the boundaries of the inner mouth region, on a 3D face geometry and on the lighting situation, a shadowing in the inner mouth region, computing a lighting of the dental model (1) based at least on the computed shadowing, and visualizing the dental model (1) and the 2D image (20), wherein at least the inner mouth region in the image is overlaid with a visualization (21) of the dental model having the computed lighting.

Abstract: Methods, systems, computer readable media, and apparatuses for providing enhanced content are presented. Data including a first program, a first caption stream associated with the first program, and a second caption stream associated with the first program may be received. The second caption stream may be extracted from the data, and a second program may be encoded with the second caption stream. The first program may be transmitted with the first caption stream including first captions and may include first content configured to be played back at a first speed. In response to receiving an instruction to change play back speed, the second program may be transmitted with the second caption stream. The second program may include the first content configured to be played back at a second speed different from the first speed, and the second caption stream may include second captions different from the first captions.

Abstract: An image processing apparatus 200 includes: a first saturation information obtaining unit 306 configured to obtain saturation of a frame image; a second saturation information obtaining unit 309 configured to obtain saturation of a background image; and a threshold value determining unit 311 configured to determine a threshold value, which is used for checking a difference in color information, for each pixel, based on the saturation obtained by each of the first saturation information obtaining unit 306 and the second saturation information obtaining unit 309. A hue foreground area estimating unit 312 is configured to estimate a foreground area by use of the threshold value determined by the threshold value determining unit 311 as well as color information of the frame image and color information of the background image.

Abstract: Disclosed are a VR playing method, a VR playing device, and a VR playing system. When using a media playing device for playing, a 3D spherical object is first created in the development environment, and then a new texture material is built and shader options are created for the texture material. After selecting shading for the texture material, a multimedia panoramic material is acquired from the media playing device or an external storage device, and then the texture material and the multimedia panoramic material are loaded onto the surface of the 3D spherical object. Finally, a virtual camera module is arranged at the center of the 3D spherical object. The angle of the virtual camera is controlled to pick up content of the multimedia panoramic material to play on the media playing device.

Abstract: Embodiments described herein are directed to methods and systems for facilitating control of smoothness of transitions between images. In embodiments, a difference of color values of pixels between a foreground image and the background image are identified along a boundary associated with a location at which to paste the foreground image relative to the background image. Thereafter, recursive down sampling of a region of pixels within the boundary by a sampling factor is performed to produce a plurality of down sampled images having color difference indicators associated with each pixel of the down sampled images. Such color difference indicators indicate whether a difference of color value exists for the corresponding pixel. To effectuate a seamless transition, the color difference indicators are normalized in association with each recursively down sampled image.

Abstract: An unmanned aerial vehicle calibration method and system based on a color 3D calibration object. The method comprises: placing a color chequerboard 3D calibration object in a scene to be photographed; using an unmanned aerial vehicle to photograph images of the color chequerboard 3D calibration object from at least three different orientations; using a vanishing point theory to linearly solve the internal parameters of a camera of the unmanned aerial vehicle according to the photographed images of the color chequerboard 3D calibration object; and using a coordinate projection transformation method to determine a geometric constraint relationship between a spatial position and the images of the camera of the unmanned aerial vehicle according to the internal parameters of the camera of the unmanned aerial vehicle.

Abstract: The present disclosure relates to methods, devices, and systems for presentation of multimedia content. In an aspect of the present disclosure, a method includes receiving, at a processor of a mobile device, a plurality of images from a camera, at least one image of the plurality of images including an object. The method also includes displaying a camera video stream based on the plurality of images, displaying three dimensional (3D) augmented reality content in the camera video content, and displaying video content based on the 3D augmented reality content. The video content is associated with the object.

Abstract: Embodiments provide for perceptual data association from at least a first and a second sensor disposed at different positions in an environment, in respective series of local scene graphs that identify characteristics of objects in the environment that are updated asynchronously and merging the series of local scene graphs to form a coherent image of the environment from multiple perspectives.

Abstract: Disclosed is an apparatus comprising a processing device and a method for color correction of an image in a processing device, the method comprising: obtaining an image; determining a Laplacian matrix of the image; obtaining a first region of the image, the first region being indicative of a part of the image to be color corrected; obtaining a second region of the image; obtaining a first recoloring image based on the second region; determining a first corrected region of a first corrected image based on the Laplacian matrix and the first recoloring image; and obtaining and outputting a corrected image based on the first corrected region of the first corrected image.

Abstract: A digital medium environment is described to automatically generate a trimap and segment a digital image, independent of any user intervention. An image processing system receives an image and a low-resolution mask for the image, which provides a probability map indicating a likelihood that a pixel in the image mask corresponds to a foreground object in the image. The image processing system analyzes the image to identify content in the image's foreground and background portions, and adaptively generates a trimap for the image based on differences between the identified foreground and background content. By identifying content of the image prior to generating the trimap, the techniques described herein can be applied to a wide range of images, such as images where foreground content is visually similar to background content, and vice versa. Thus, the image processing system can automatically generate trimaps for images having diverse visual characteristics.

Abstract: Embodiments provide for perceptual data association received from at least a first and a second sensor disposed at different positions in an environment, in respective time series of local scene graphs that identify several characteristics of at least one object in the environment that are updated different rates; merging, at an output rate, characteristics for each given object from the several time series of local scene graphs that are updated at the output rate; merging, at the output rate, characteristics for each given object from the time series of local scene graphs that are updated at rates other than the output rate; and outputting, at the output rate, a time series of global scene graphs including the merged characteristics.

Abstract: Provided is a method for generating a foreground in a foreground generating apparatus, the method including: extracting a plurality of foregrounds by applying a plurality of background models to an image, the plurality of background models having different ranges of a pixel variance value; generating an intersection foreground based on an intersection region among the extracted plurality of foregrounds; generating a union foreground based on a union region among the extracted plurality of foregrounds; and generating a final foreground based on the intersection foreground and the union foreground.

Abstract: A system comprising a computer-readable storage medium storing at least one program and a computer-implemented method for facilitating automatic-guided image capturing and presentation are presented. In some embodiments, the method includes capturing an image of an item, removing automatically a background of the image frame, performing manual mask editing, generating an item listing, inferring item information from the image frame and automatically applying the inferred item information to an item listing form, and presenting an item listing in an augmented reality environment.

Abstract: Methods and systems are provided for generating mattes for input images. A neural network system can be trained where the training includes training a first neural network that generates mattes for input images where the input images are synthetic composite images. Such a neural network system can further be trained where the training includes training a second neural network that generates refined mattes from the mattes produced by the first neural network. Such a trained neural network system can be used to input an image and trimap pair for which the trained system will output a matte. Such a matte can be used to extract an object from the input image. Upon extracting the object, a user can manipulate the object, for example, to composite the object onto a new background.

Abstract: The present invention provides a method for video matting via sparse and low-rank representation, which firstly selects frames which represent video characteristics in input video as keyframes, then trains a dictionary according to known pixels in the keyframes, next obtains a reconstruction coefficient satisfying the restriction of low-rank, sparse and non-negative according to the dictionary, and sets the non-local relationship matrix between each pixel in the input video according to the reconstruction coefficient, meanwhile sets the Laplace matrix between multiple frames, obtains a video alpha matte of the input video, according to ? values of the known pixels of the input video and ? values of sample points in the dictionary, the non-local relationship matrix and the Laplace matrix; and finally extracts a foreground object in the input video according to the video alpha matte, therefore improving quality of the extracted foreground object.

Abstract: Restoring an image is achieved by restoring a block by executing at least one first restoring function and at least one second restoring function. The first restoring function may be implemented using software, and the second restoring function may be implemented using hardware. By assigning restoring functions to be either first restoring functions or second restoring functions, even an image having high resolution can be restored and reproduced in real-time.

Abstract: A content generation device (CGD), includes an opaque writing capture device (WCD), and an image capture device (ICD) and a mirror/antireflective pane with 45 degree beamsplitters. The ICD captures image content of a user performing drawing and/or writing on an opaque WCD, when the user is located external to the CGD and in front of the opaque WCD, and the capturing of the image content occurs from within the CGD and behind the opaque WCD. The opaque WCD concurrently captures user generated content corresponding to the drawing and/or writing. The CGD synchronously merges the image content and the user generated content to generate merged content and presents the merged content from within the CGD so that the presented merged content is viewable by the user through the opaque WCD. The CGD communicates the merged content to a multicast network operator for publication via one or more networks.

Abstract: Technologies for streaming device role reversal include a source computing device and a destination computing device coupled via a communication channel. The source computing device and destination computing device are each configured to support role reversal. In other words, the source computing device and the destination computing device are each capable of switching between receiving and transmitting digital media content over the established communication channel. The source computing device is configured to initiate the role reversal, pause transmit functionality of the source computing device, and enable receive functionality of the source computing device. The destination computing device is configured to receive a role reversal indication from the source computing device, locally process the content, transmit a content stream to the source computing device, and display the content stream on an output device of the source computing device. Other embodiments are described and claimed herein.

Abstract: Embodiments described herein are directed to methods and systems for facilitating control of smoothness of transitions between images. In embodiments, a difference of color values of pixels between a foreground image and the background image are identified along a boundary associated with a location at which to paste the foreground image relative to the background image. Thereafter, recursive down sampling of a region of pixels within the boundary by a sampling factor is performed to produce a plurality of down sampled images having color difference indicators associated with each pixel of the down sampled images. Such color difference indicators indicate whether a difference of color value exists for the corresponding pixel. To effectuate a seamless transition, the color difference indicators are normalized in association with each recursively down sampled image.

Abstract: Methods, systems, and products generate telepresence visualizations for a remote participant to a videoconferences. A central server superimposes the remote participant onto images or video of the teleconferencing environment. The central server thus generates an illusion that the remote participant is in the same conferencing environment as other conferees.

Abstract: This disclosure describes methods, apparatus, and systems related to a low peak-to-average power ratio (PAPR) long training field (LTF) sequences system. A device may determine a wireless communication channel with a first device in accordance with a wireless communication standard, the wireless communication channel having one or more streams. The device may determine one or more common sequences between the one or more streams. The device may generate a high efficiency preamble in accordance with a high efficiency communication standard. The device may generate one or more LTF sequences included in the preamble based on the one or more common sequences and one or more codes. The device may cause to send the high efficiency preamble over the wireless communication channel.

Abstract: An image processing apparatus includes an acquisition unit configured to acquire a bitmap image in which each of contained pixels has an alpha value indicating opacity of this pixel, and a rendering unit configured to render the bitmap image. The rendering unit is configured to, when rendering the bitmap image, refrain from performing alpha blending on a pixel contained in the bitmap image that has a specific alpha value and perform the alpha blending on a pixel contained in the bitmap image that has a different alpha value from the specific alpha value.

Abstract: A display device (2) includes a processor (13) that outputs drawing data and a timing controller (11) that outputs the drawing data input from the processor according to horizontal synchronization and vertical synchronization. When a still image region where drawing data has not been updated compared with a previous frame and a moving image region where drawing data has been updated compared with a previous frame are included in one frame, the processor transmits data update information, which is for specifying the position of the moving image region or a line including the moving image region, to the timing controller temporally earlier than drawing data of the line including the moving image region. The timing controller performs processing for lowering the frame rate of the still image region or processing for thinning out some of image lines of the still image region based on the data update information.

Abstract: An image decoding apparatus includes a request unit that requests an image transmission apparatus to transmit an image, a transmission unit that transmits range information indicating a range which is a partial range of the image and which is selected in accordance with a user operation to the image transmission apparatus, a receiving unit that, while the partial range of the image is selected, receives, from the image transmission apparatus, the entirety of the image when the image belongs to a first type and a portion of the image when the image belongs to a second type, by receiving one or more tiles, which corresponds to the partial range of the image and outside which a reference to is prohibited in inter-picture prediction, among a plurality of tiles included in the image, and a decoding unit that decodes the received entirety or portion of the image.

Abstract: A method and a system for depth selective segmentation of an object are provided. The method comprises the following steps. An image is captured in an invisible domain of the optical spectrum by illuminating a scene of interest under an illumination corresponding to said invisible domain of the optical spectrum by an invisible light illumination unit. A binary mask is obtained from the image according to a threshold. Part of the image is eliminated by applying the binary mask to the image, and resulting in another image. The threshold is changed and another binary mask is obtained. The latest obtained binary mask is applied to the latest captured image. The step of changing of the threshold, the step of obtaining a mask and the step of applying the latest obtained binary mask on the latest captured image are performed at least once.

Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.

Abstract: A moving image reproducing apparatus and a moving image controller are provided. The moving image reproducing apparatus includes a moving image data storer which stores moving image data including a target object having a transparency, at least one of a shade and a gloss on the target object, and a background image. The moving image controller fetches the moving image data from the moving image data storer, disposes an area having a color whose setting is changeable behind the moving image data, synthesizes the moving image data and the area, and sets the color of the area corresponding to the transparency as a color of the target object.

Abstract: A telecommunications system including a network; a plurality of user devices coupled to the network; a multipoint control unit coupled to the network and configured to supervise multipoint conferencing among the plurality of user devices, the multipoint control unit including a presentation mixer, the presentation mixer configured to remove one or more backgrounds from a presentation and mix a live video feed into the presentation as a substitute background; and a screen for displaying a resulting mixed presentation such that a full area of the screen is used to display the mixed presentation. In some embodiments, the presentation mixer is further configured to adjust a level of transparency of the substitute background.

Abstract: A method for operating an image processing device coupled to a color camera and a depth camera is provided. The method includes receiving a color image of a 3-dimensional scene from a color camera, receiving a depth map of the 3-dimensional scene from a depth camera, generating an aligned 3-dimensional face mesh from a plurality of color images received from the color camera indicating movement of a subject's head within the 3-dimensional scene and form the depth map, determining a head region based the depth map, segmenting the head region into a plurality of facial sections based on both the color image, depth map, and the aligned 3-dimensional face mesh, and overlaying the plurality of facial sections on the color image.

Abstract: Disclosed herein are systems and methods for persona identification using combined probability maps. An embodiment takes the form of a method that includes obtaining at least one frame of pixel data; processing the at least one frame of pixel data to generate a hair-identification probability map; and generating a persona image by extracting pixels from the at least one frame of pixel data based at least in part on the generated hair-identification probability map.

Abstract: A healing component that heals foreground pixels with background pixels is provided. In some embodiments, the healing component is programmed or otherwise configured to respond to a single healing request by identifying a plurality of regions within a selected area and healing each region of the plurality of regions independently of other regions.

Abstract: An image capture device includes: a housing; a first camera defined along a front surface of the housing; a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting; a second camera defined along the front surface of the housing; a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting, the captured images from the second camera being analyzed to identify and track an illuminated object in the interactive environment.

Abstract: The present invention is directed to a video display and user control for the video display. In the preferred embodiment, multiple video feeds are combined into a single video display, where one feed, preferably live, includes an object which is used by a computer to select a second and display a second feed, wherein the location and orientation of the second feed changes based on the location and orientation of the object in the first feed. At least a portion of the display gives the appearance of depth, such as through use of superimposed animation. The live image is controlled by the user's movement, causing at least a part of the display to move in concert with the user's motion, thereby creating an enhanced three dimensional effect for a superimposed display.

Abstract: An image compositing apparatus of the present invention includes first overlay image processing circuitry that stores the position and size of an area in which a first overlay image is displayed and, according thereto, changes the position and size of the first overlay image, second overlay image processing circuitry that processes a second overlay image similarly to the first overlay image processing circuitry, a circuit for detecting the absence of base image that decides the presence or absence of a base image, and a chromakey decision circuitry that decides a chromakey color portion of the base image. In a case where the circuit for detecting the absence of base image decides the absence of a base image, the image compositing apparatus outputs the first and second overlay images processed by the first overlay image processing circuitry and the second overlay image processing circuitry, respectively.

Abstract: Depth information can be used to assist with image processing functionality, such as various calibration approaches to determine and correct for misalignments between cameras. In at least some embodiments, depth information obtained from stereo imaging or distance sensing, for example, can be used to segment an image or frame of video into at least a foreground object and a background object. Once the foreground and background object has been determined, information about that objects can be used to determine a mapping, and once a subsequent stereoscopic image is captured using the cameras, the mapping can be applied to each image to account for misalignment effects due to a misaligned stereo camera pair before providing the stereoscopic image for display.

Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.

Abstract: An approach is provided for rendering content based on chunks and layers. A request is received to render content at a device. One or more layers of the content are determined. One or more patterns are determined corresponding to one or more of the layers. One or more chunks are determined based, at least in part, on the one or more patterns. At least one of the layers and corresponding one or more chunks are determined to be rendered separately from the other layers.

Abstract: A method for processing a 3D image signal and an image display device for implementing the method are provided. The 3D image signal processing method is implemented by the 3D image display device. Although an image signal transmission side transmits information to be included in a plurality of image signals, while omitting a portion of the information, a receiver can synthesize the transmitted information to reproduce an image. The device restores at least one image from a broadcast signal, and additionally generates an image at a virtual camera view from the restored image and displays it three-dimensionally. To this end, the image display device receives a broadcast signal and obtains at least one set of camera parameters from signaling information. Then, the image display device generates a virtual view image according to the camera parameters, and formats the virtual view image and the broadcast image included in the broadcast signal three-dimensionally.

Abstract: Embodiments of the present invention provide systems and methods for image capture with infrared emitters, with associated computer control and processing for providing consistent and high quality image data. Image data of consecutive frames from a camera is obtained, with a first frame being taken during an emission of infrared light directed at a scene to be captured by the camera and a second frame being taken without an emission of infrared light. The consecutive frames provide a dynamic control image of the captured scene. The image data may be used to support photometric sampling techniques used in building geometric models for subject recognition in camera imagery in variable lighting environments.

Abstract: Methods and apparatus are provided for training a neural device having an artificial nervous system by modulating at least one training parameter during the training. One example method for training a neural device having an artificial nervous system generally includes observing the neural device in a training environment and modulating at least one training parameter based at least in part on the observing. For example, the training apparatus described herein may modify the neural device's internal learning mechanisms (e.g., spike rate, learning rate, neuromodulators, sensor sensitivity, etc.) and/or the training environment's stimuli (e.g., move a flame closer to the device, make the scene darker, etc.). In this manner, the speed with which the neural device is trained (i.e., the training rate) may be significantly increased compared to conventional neural device training systems.

Abstract: A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.

Abstract: A display controller comprising a blending stage and a blending controller. The blending stage is provided for blending multiple image layers into one display output image and comprises a plurality of input channels for receiving pixel data for the multiple image layers. The blending stage further comprises multiple blenders for combining the pixel data received by at least two input channels of the plurality of input channels. The blending controller is coupled to the blending stage for controlling operation of the blending stage. The blending stage further comprises a controllable switch for coupling an output of at least one blender of the multiple blenders to a display output of the blending stage for regular on-the-fly blending or to an offline blending memory for storing a result of an offline blending task.

Abstract: A method for produces a video data stream for an expansion signal, wherein a base signal represents a first video quality degree and the expansion and base signals jointly represent a second video quality. Only second syntax elements of the expansion signal which are not describable by the first syntax element of the base signal are taken into account during encoding, the coding mode of a video encoding method which is encodable by all syntax elements is selected by means of statistical method, said second syntax elements are not representable by one or several first syntax elements and the method brings about to the production of the shortest video data stream for said second syntax elements. A decoding method for restoring the expansion signal from the video data stream, encoding and coding devices are also disclosed.

Abstract: Disclosed herein are systems and methods for extracting person image data comprising: obtaining at least one frame of pixel data and corresponding image depth data; processing the at least one frame of pixel data and the image depth data with a plurality of persona identification modules to generate a corresponding plurality of persona probability maps; combining the plurality of persona probability maps to obtain an aggregate persona probability map; and generating a persona image by extracting pixels from the at least one frame of pixel data based on the aggregate persona probability map.

Abstract: Methods, systems, and products generate telepresence visualizations for a remote participant to a videoconferences. A central server superimposes the remote participant onto images or video of the teleconferencing environment. The central server thus generates an illusion that the remote participant is in the same conferencing environment as other conferees.