Abstract: A method for virtually mimicking an arm movement of participant of a three dimensional (3D) video conference, the method may include (i) obtaining joints movement information about joints movements of an arm of a participant of the 3D video conference, based on a movement of the arm of the participant that was captured by a video taken by a camera of the participant, wherein arm of the participant is free of physical joint movement markers; (ii) generating, an arm skeletal model that represents the joins movement of the arm, based on the joints movement information; (iii) generating, by a machine learning process, a renderable 3D model of the arm that mimics the movement of the arm of the participant; and (iv) responding to the generating of the renderable 3D model, wherein the responding comprises at least one out of (a) rendering an avatar of the participant based on the renderable 3D model, (b) storing renderable 3D model information, or (c) sending the renderable 3D model information to another computeriz

Abstract: Embodiments are directed to presenting visualizations over a network. A presentation specification. An overlay may be generated that includes visualizations of presentation objects based on the presentation specification. A video stream of a view of a presenter captured by a presenter station may be provided. A composited video stream may be generated based on the overlay and the video stream. The composited video stream may be provided to a video conference service that distributes the composited video stream to the presenter station and to audience stations. Movements of the presenter may be tracked based on the video stream captured by the presenter station. Gestures may be determined based on the tracked movements. In response to a determined gesture being associated with an interactive feature, activating the interactive feature to update the overlay such that the updated overlay may be included in a recomposited video stream.

Abstract: A method is provided for selecting a transparency setting and color values of pixels in a virtual image. The virtual image can be formed by combining reference images taken at different angles to produce the virtual image that views an object at a new, uncaptured angle. The method includes determining for each pixel of the virtual image, what information it carries from the reference view images. The information of the pixel is used to define a pixel category, and the category is used to select, based on logical conditions, what information will be displayed by the pixel and to set the color of the pixels.

Abstract: A system and, related method, is disclosed for enabling Chroma key compositing using a smart device, wherein an image/video of a subject situated in front of a portable monochromatic background is captured, and simultaneously layered upon a different desired background replacement that will replace only the monochromatic background captured. The portable monochromatic background structure can be an inflatable structure affixed with a plurality of lighting modules configured to ensure a uniform light distribution across the monochromatic background and separately ensure a uniform light distribution on the subject during the image/video capture.

Abstract: Methods and systems provide for providing a virtual background within a communication session using dynamic chroma key reframing. In one embodiment, a method displays a user interface including at least one video feed corresponding to a participant of the communication session. The method receives a request to enable a selected or provided virtual background using chroma keying. The method then determines a background layer of the video feed. The method also determines edges for the background layer. Next, the method crops and reframes the video feed around the edges of the background layer. The method then removes the background layer from the video feed, and adds the selected or provided virtual background to the background layer of the video feed. Finally, the method displays the video feed within the communication session.

Abstract: A device displays a camera user interface for recording media images in a plurality of media recording modes. While displaying the camera user interface, the device captures media with one or more cameras. In response to capturing the media, in accordance with a determination that the captured media is consistent with a first media recording mode, the device displays a first prompt in the camera user interface that prompts a user to take one or more actions associated with the first media recording mode; and in accordance with a determination that the captured media is consistent with a second media recording mode, the device displays a second prompt in the camera user interface that prompts the user to take one or more actions associated with the second media recording mode, where the first media recording mode is different from the second media recording mode.

Abstract: Skinning parameters used to animate a virtual avatar can include mesh weights and joint transforms of a skeleton. Systems and methods are provided for determining skinning parameters using an optimization process subject to constraints based on human-understandable or anatomically-motivated relationships among skeletal joints. Input to the optimization process can include a high-order skeleton and the applied constraints can dynamically change during the optimization. The skinning parameters can be used in linear blend skinning (LBS) applications in augmented reality.

Abstract: The present disclosure provides a method for modifying pairs of images for improved three-dimensional displaying. The method comprises analyzing the images for detecting the angle of incidence of the illuminating light in the images, and modifying the luminance values of at least a section of at least one of the images of each pair based on the angle of incidence and anatomical details of a human face. Further, the present invention provides a respective apparatus.

Abstract: A chroma key and presentation system, a presentation method, and a presentation kit all for simultaneous use in the presence of an in-person audience and remote audience. The system comprising: a chroma key light source, configured in use to emit chroma key light; a display surface which may be used as a projector screen for displaying projected media for viewing by the in-person audience from a projector, the display surface being at least partially transparent to the chroma key light; a camera disposed on an opposing side of the display surface to the chroma key light source, wherein the camera is configured to receive chroma key light for use in generating a composite image for the remote audience; and a directional light control filter, configured to reduce chroma key light transmission in a direction away from the camera.

Abstract: Initiating a display screen for presenting information in a public environment. A camera is pointed toward the display screen is panned while capturing multiple image frames from the environment surrounding the camera. During the panning, respective pan and tilt angles of the camera are stored. The image frames and the respective pan and tilt angles are analysed to identify an image of the environment facing the display screen. An image sensor is associated with the display screen. An image feature captured from the image sensor is matched with an image feature captured from the camera of the environment facing the display screen.

Abstract: An apparatus for providing a foreground frame to be composited with a background frame in a chroma-keying arrangement, each of the foreground frame and the background frame comprising one or more regions that together form the respective frame. A detection module determines whether each frame region has a predetermined colour value and generates and stores chroma keying information based on the determination. Control circuitry then controls image processing to be performed on the region according to the stored chroma keying information.

Abstract: A video keying processing device is provided which comprises memory configured to store data and a processor configured to determine, which pixel portions, in a YUV color space of a first video comprising a foreground object and a background color, represent the foreground object and the background color of the first video. The processor is also configured to, for each pixel portion of the first video determined to represent the foreground object and the background color, convert YUV values of the pixel portion to red-green-blue (RGB) color component value and determine a blended display value for each RGB color component of the pixel portion based on a blending factor. The processor is also configured to generate a composite video for display using the blended display values of each pixel portion determined to represent the foreground object and the background color.

Abstract: This invention refers to a data encoding system, a software basis, a data recording medium, a data read/write system, and methods and apparatus to make them thereof, all of which are based on a Multiple Codes System of more than two colors dots. The Multiple Codes system of more than two colors dots comprises more than two distinct colors as multiple codes for directly representing bits of bytes of data encoded by the system. The visible multiple colors may comprise bytes of data written in a software language for being read by an operating system or a program. The system also includes a bit/byte system with a format and rules of using a group of specific number of bits per byte including 8 bit/byte, 16 bit/byte, 32 bit/byte, 64 bit/byte, 128 bit/byte . . . or other higher numbers of bit/byte.

Abstract: The DVD player includes: a reproducing unit reproducing audio data and video data; a first transmission unit converting, into first data in accordance with a first standard, the audio data and video data reproduced by the reproducing unit, and transmitting the first data to the television; a second transmission unit converting, into second data in accordance with a second standard, the audio data and video data reproduced by the reproducing unit, and transmitting the second data to the television; a display determination unit determining whether or not to display an error message regarding an error occurring in the first transmission unit based on whether or not the video is displayed using the first data; and a display control unit causing the message display unit to display the error message according to a result of the determination by the display determination unit.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: A chroma-key/matte display screen system with a touch input device that allows a user to interact with the display by selecting or pointing to composite images on the display. Touch input devices include camera based, infrared, membrane, and acoustic. Displays screens include CRT, various flat screen displays such as plasma, LCD, OLED, and various projection display systems.

Abstract: A method may include receiving a plurality of images of a face of a user, wherein each image of the face of the user is associated with one of a plurality of different expressions. The method may also include receiving a first video, wherein the first video comprises images of an actor including images of a face of the actor, wherein each image of the face of the actor is associated with one of the plurality of different expressions. Further, the method may include replacing the images of the face of the actor with corresponding images of the face of the user in a same expression to create a second video and transmitting the second video to the user.

Abstract: A video signal processing apparatus includes: a plurality of input sections to each of which a video signal from an imaging apparatus whose operation is controllable or is not controllable; an input selector selecting a video signal inputted through the input sections; a screen producer producing a plurality of areas by dividing a screen into portions in which the video signals selected by the input selector are displayed, the screen producer producing a first color frame for the area for the video signal representing a primary output, a second color frame for the area for the video signal representing a standby output, and a third color identifier for the area for the video signal from the controllable imaging apparatus; and an output section outputting the video signals and the frames or the identifier to a display device that displays the screen formed of the plurality of areas.

Abstract: A system that incorporates teachings of the present disclosure may include, for example, a set-top box having a processor operable to receive video content from a multimedia source, to detect at least one frame in the video content affected by a high intensity burst of light, and to determine a chrominance reference from frames in the video content unaffected by the high intensity burst of light. The processor is also operable to modify chrominance in the at least one frame according to the chrominance reference without altering spatial characteristics of objects in the at least one frame, to replace the at least one frame in the video content with the modified at least one frame to create updated video content, and to present the updated video content at a presentation device. Other embodiments are disclosed.

Abstract: A video decoder that separates and analyzes analog video signals includes a hue and saturation separator and a video signal determiner. The hue and saturation separator demodulates from a component video signal chroma signal, which includes a hue signal and a saturation signal. The video signal determiner determines at least one video signal characteristic of the component video signal dependent on the hue and saturation signal. The video signal determiner may include a mode determiner that determines the encoding standard of the video signal, and a color burst determiner that determines a location of a color burst signal with the video signal. The mode determiner may include a signal lock detector, a sequence matcher, and an encoding mode selector. The color burst determiner may include an absolute value determiner and a burst position determiner.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: In one embodiment, graphics from a general-purpose computer are mixed with video images from a video source. A first interface receives the graphics, the graphics including a plurality of graphics frames, at least some graphics frames including one or more regions having pixels set to one or more predetermined color values. A second interface receives video images from the video source, each video image corresponding to one of the plurality of graphics frames. A video mixer includes logic configured to recognize pixels in the at least some graphics frames that are set to the one or more predetermined color values, and in the one or more regions where the pixels are set to the one or more predetermined color values to mix pixels from the corresponding video image with the graphics frame, to create a plurality of mixed images. One or more output interfaces outputs the mixed images.

Abstract: Color correction of an autostereoscopic color display capable of displaying multiple views of one scene. Multiple viewing regions of the autostereoscopic color display are identified. The multiple viewing regions together comprise the whole of an operating viewing zone for the autostereoscopic color display. A respective plurality of color correction LUTs are constructed. At least one color correction LUT is constructed for each different viewing region. Color correction LUTs corresponding to current viewing regions are selected based on information regarding viewer location. The selected color correction LUTs are applied to the autostereoscopic color display.

Abstract: A video signal processing apparatus includes: a plurality of input sections to each of which a video signal from an imaging apparatus whose operation is controllable or is not controllable; an input selector selecting a video signal inputted through the input sections; a screen producer producing a plurality of areas by dividing a screen into portions in which the video signals selected by the input selector are displayed, the screen producer producing a first color frame for the area for the video signal representing a primary output, a second color frame for the area for the video signal representing a standby output, and a third color identifier for the area for the video signal from the controllable imaging apparatus; and an output section outputting the video signals and the frames or the identifier to a display device that displays the screen formed of the plurality of areas.

Abstract: A method, system and computer readable media for real-time chromakey matting using image statistics. To identify the chroma key spectrum, the system/method executes in three stages. In an off-line training stage, the system performs semi-automatic calibration of the chroma key parameterization. In the real-time classification stage, the system estimates the alpha matte on a GPU. Finally, an optional error minimization stage improves the estimated matte, accounting for misclassifications and signal noise. Given the resulting matte, standard alpha blending composites the virtual scene with the video feed to create the illusion that both worlds coexist.

Abstract: The method and apparatus for generating an adaptive chroma key includes taking into consideration foreground object information during the creation of a composite scene. The luminance and chrominance of an area of interest between a foreground key and a background scene are considered and accounted for during the created of the composite scene.

Abstract: Intelligent resource state memory recall techniques, and associated apparatus and methods, are disclosed. States of one or more video switcher resources in a resource state memory may be recalled to the same or different resources, depending on resource availability at the time of memory recall. A memory recall need not affect an on air signal. The memory may be recalled to recreate a desired program output, as defined in the memory, on a preview output of the video switcher, which leaves a current program output of the video switcher undisturbed when the memory is recalled.

Abstract: An aberration correction apparatus includes: a correction data holding section that holds correction data on a correction level used to correct chromatic aberration of magnification; a center position discrepancy data holding section that holds center position discrepancy data on the discrepancy between the center of an image area and the position of an aberration center of the chromatic aberration of magnification; an aberration center calculating section that selects one of the center position discrepancy data that corresponds to a combination of the discrepancy variation conditions in an imaging apparatus and calculates the position of the aberration center based on the selected center position discrepancy data; an image height calculating section; a magnification chromatic aberration correction level calculating section; and a pixel value correcting section.

Abstract: An apparatus which outputs an image using a plurality of chroma-key colors is provided. The apparatus includes a chroma-key-color-storage unit that stores multiple chroma-key colors; a microprocessor unit (MPU) that sets a block where the chroma-key color is applied using a pixel address of a foreground image; and a video controller that composes a background image and the foreground image using the block set by the MPU, and displays the composed image in the display unit.

Abstract: A method of processing on screen display data with an image post processor includes receiving a data stream from a video processor at a post processing device having at least one port, the data stream including on screen display data overlaid on a white background and the on screen display data overlaid on a black background, finding a difference between the on screen display data overlaid on white and the on screen display data overlaid on black, using the difference to determine a complement of an alpha blend value, performing image processing on the image data with the post processor by applying the complement of an alpha blend value to the image data to produce processed image data, and transmitting the processed image data and the on screen display data through a display port.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: In one embodiment, a method of tagging content can include: accessing a frame of a digital media production; identifying an object for tagging within the frame; defining a metadata tag for the object; and storing the metadata tag in association with the identified object and the frame in the digital media production. In one embodiment, a method of substituting content can include: receiving tagged digital media in a controller; identifying an object for substitution by searching through objects and metadata tags in the tagged digital media; retrieving a substitute object using the controller; and re-rendering the tagged digital media to produce a customized digital media using the substitute object in place of the identified object.

Abstract: Methods and apparatus to detect an internally generated signal mode of a local media playback device are disclosed. A disclosed method comprises tuning a harmonic frequency of a chrominance signal output by a local media playback device, and determining that the local media playback device is in an internally generated signal mode if the measured harmonic frequency exceeds a predetermined threshold.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map but not effective at presenting local detail. In contrast, street -side images show excellent detail but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: An asynchronous camera/projector system includes a projection screen, having a key color, a projector, oriented to provide a sequenced background image to the screen, and a camera, located in front of the screen, and oriented to capture a sequenced image of the screen and a real object positioned in front of the screen. The camera and projector operate out of phase, so that the camera does not record the background image.

Abstract: Various imaging processing techniques for displaying a pre-subpixel rendered image. The pre-subpixel rendered image can be transmitted directly to a display capable of displaying a subpixel rendered image. The pre-subpixel rendered image can also be stored for later transmission for output to the display. Additionally, the pre-subpixel rendered image can be embedded in an image data stream and later extracted and displayed.

Abstract: A system and method for removing background lighting variations from an image. The method includes capturing at least one first image including a first background and a subject wherein the at least one first image includes at least one background lighting variation, creating a virtual background model of the first background, creating a virtual background image that is substantially similar to the first background, and generating an output comprising at least one first image with at least one background lighting variation removed therefrom.

Abstract: The present disclosure provides a software method and application for creating and displaying image animations based on chroma-key video and image overlay effects, including image import, image processing, and video rendering of single images, in addition to the ability of sound, music, and text insertion, for use in computerized systems. The present disclosure furthermore provides a system and method to hide the complexity of multimedia processing steps by means of an intuitive, easy-to-use graphical user interface enabling the non-professional general public to enhance photos with multimedia animations in a fast and effective way and to make them publicly available on multimedia devices, such as smart phones, and web sites on the Internet.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map, but not effective at presenting local detail. In contrast, street-side images show excellent detail, but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps, and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: Methods and apparatus to detect an internally generated signal mode of a local media playback device are disclosed. A disclosed method comprises tuning a harmonic frequency of a chrominance signal output by a local media playback device, and determining that the local media playback device is in an internally generated signal mode if the measured harmonic frequency exceeds a predetermined threshold.

Abstract: An interactive video compositing device includes a chroma-key mixer, video switcher and control circuitry. The chroma-key mixer generates a composite image by combining a real-time image, such as one captured by a video recorder, with a prerecorded video image, such as a movie. The composite image includes the modified real-time image superimposed, or overlaid, onto the prerecorded image. The video switcher automatically selects either the composite image or the prerecorded image to be output to a display. The control circuitry controls the video switcher and other outputted signals based on data file information that corresponds to content of the prerecorded image or media. For example, the data files may contain information relating to the presence (or absence) of a particular character in a movie scene, thus allowing for the output and display, at appropriate times, of the real-time composite image instead of the prerecorded image.

Abstract: An interactive video compositing device includes a chroma-key mixer, video switcher and control circuitry. The chroma-key mixer generates a composite image by combining a real-time image, such as one captured by a video recorder, with a prerecorded video image, such as a movie. The composite image includes the modified real-time image superimposed, or overlaid, onto the prerecorded image. The video switcher automatically selects either the composite image or the prerecorded image to be output to a display. The control circuitry controls the video switcher and other outputted signals based on data file information that corresponds to content of the prerecorded image or media. For example, the data files may contain information relating to the presence (or absence) of a particular character in a movie scene, thus allowing for the output and display, at appropriate times, of the real-time composite image instead of the prerecorded image.

Abstract: Methods and apparatus to detect an internally generated signal mode of a local media playback device are disclosed. A disclosed method comprises tuning a harmonic frequency of a chrominance signal output by a local media playback device, and determining that the local media playback device is in an internally generated signal mode if the measured harmonic frequency exceeds a predetermined threshold.

Abstract: An interactive video compositing device includes a chroma-key mixer, video switcher and control circuitry. The chroma-key mixer generates a composite image by combining a real-time image, such as one captured by a video recorder, with a prerecorded video image, such as a movie. The composite image includes the modified real-time image superimposed, or overlaid, onto the prerecorded image. The video switcher automatically selects either the composite image or the prerecorded image to be output to a display. The control circuitry controls the video switcher and other outputted signals based on data file information that corresponds to content of the prerecorded image or media. For example, the data files may contain information relating to the presence (or absence) of a particular character in a movie scene, thus allowing for the output and display, at appropriate times, of the real-time composite image instead of the prerecorded image.

Abstract: A method, system, and device for generating a clean clipping signal ? for a chromakey function or a video composition, including identifying background colors formed by a solid color background, shadows cast by still and moving subjects, a non-uniform reflection caused by spot lighting and non-flat backdrop or flaw wall, and translucent foreground objects, with a 3D volume in a 3D color space; determining parameters defining same by using a dirty alpha ?; generating a clean clipping signal ?shd background colors, and a clean clipping signal ?tsl for translucency colors; identifying foreground colors formed by the still and moving subjects with a 3D volume in a 3D color space; classifying colors into transition colors; and generating an area map for mapping each pixel into background, shadow, translucent, foreground, and transition areas.

Abstract: A chroma key color determining section is operable to determine a chroma key color in an image of a plurality of input images. A image synthesizing section is operable to overlap the images with each other by switching the images with respect to each pixel based on an output of the chroma key color determining section. The plurality of images are switched by switching all of pixels of the image input to the chroma key color determining section into the chroma key color images.

Abstract: In an apparatus for composing image data of a main picture and image data of a sub-picture by a chroma key process, an attribute of an image contained in the sub-picture is detected, a partial area of the sub-picture is set as a chroma key mask area in accordance with the attribute detection result, and composing the image data of the main picture and the image data of the sub-picture by executing the chroma key process for an area other than the chroma key mask area without executing the chroma key process for the chroma key mask area in the sub-picture.

Abstract: A set of customizing operations for digital content is determined in accordance with network condition of a current network communication channel between a content server and one or more receiving devices, wherein the digital content is provided by the content server for transport to the receiving device and includes multiple frames of digital video data. The set of customizing operations specify multiple sequences or paths of customized video data in accordance with available video frame rates, and a customized video data sequence is selected from among the specified multiple sequences of customized video data in accordance with estimated received video quality and network condition for each receiving device.

Abstract: An apparatus which outputs an image using a plurality of chroma-key colors is provided. The apparatus includes a chroma-key-color-storage unit that stores multiple chroma-key colors; a microprocessor unit (MPU) that sets a block where the chroma-key color is applied using a pixel address of a foreground image; and a video controller that composes a background image and the foreground image using the block set by the MPU, and displays the composed image in the display unit.