Abstract: Embodiments of the disclosure provided herein generally relate to methods and video system components that have integrated background differentiation capabilities that allow for background replacement and/or background modification. In some embodiments, undesired portions of video data generated in a video environment are separated from desired portions of the video data by taking advantage of the illumination and decay of the intensity of electromagnetic radiation, provided from an illuminator, over a distance. Due to the decay of intensity with distance, the electromagnetic radiation reflected from the undesired background has a lower intensity when received by the sensor than the electromagnetic radiation reflected from the desired foreground. The difference in the detected intensity at the one or more wavelengths can then be used to separate and/or modify the undesired background from the desired foreground for use in a video feed.

Abstract: An object detecting system comprising: a first distance measuring device, configured to measure a first distance between a first part of an object and the first distance measuring device; a second distance measuring device, configured to measure a second distance between a second part of the object and the second distance measuring device; a uniform light source, configured to emit uniform light to the object; an optical sensor, configured to sense optical data of the object generated based on the uniform light; and a control circuit, configured to calculate a location of the object according to the first distance, the second distance and the optical data.

Abstract: Embodiments of the disclosure provided herein generally relate to methods and video system components that have integrated background differentiation capabilities that allow for background replacement and/or background modification. In some embodiments, undesired portions of video data generated in a video environment are separated from desired portions of the video data by taking advantage of the illumination and decay of the intensity of electromagnetic radiation, provided from an illuminator, over a distance. Due to the decay of intensity with distance, the electromagnetic radiation reflected from the undesired background has a lower intensity when received by the sensor than the electromagnetic radiation reflected from the desired foreground. The difference in the detected intensity at the one or more wavelengths can then be used to separate and/or modify the undesired background from the desired foreground for use in a video feed.

Abstract: Techniques are disclosed for characterizing and defining the location of a copy space in an image. A methodology implementing the techniques according to an embodiment includes applying a regression convolutional neural network (CNN) to an image. The regression CNN is configured to predict properties of the copy space such as size and type (natural or manufactured). The prediction is conditioned on a determination of the presence of the copy space in the image. The method further includes applying a segmentation CNN to the image. The segmentation CNN is configured to generate one or more pixel-level masks to define the location of copy spaces in the image, whether natural or manufactured, or to define the location of a background region of the image. The segmentation CNN may include a first stage comprising convolutional layers and a second stage comprising pairs of boundary refinement layers and bilinear up-sampling layers.

Abstract: Described herein are systems and methods that search videos and other media content to identify items, objects, faces, or other entities within the media content. Detectors identify objects within media content by, for instance, detecting a predetermined set of visual features corresponding to the objects. Detectors configured to identify an object can be trained using a machine learned model (e.g., a convolutional neural network) as applied to a set of example media content items that include the object. The systems provide user interfaces that allow users to review search results, pinpoint relevant portions of media content items where the identified objects are determined to be present, review detector performance and retrain detectors, providing search result feedback, and/or reviewing video monitoring results and analytics.

Abstract: Provided is a system for efficiently creating snippets or clips from media assets without re-encoding the entire portion of already encoded media content falling within the snippet boundaries. The system partitions and encodes the original media asset as set of slices with each slice encoding a different temporal chunk of the media asset. The system identifies a first slice that encodes a duration of the media asset spanning the snippet start time, and a second slice that encodes a duration of the media asset spanning the snippet end time. The system produces a snippet start slice from decoding, clipping, and re-encoding the first slice and a snippet end slice from decoding, clipping, and re-encoding the second slice. The system generates the snippet from the snippet start slice, an unmodified subset of the set of slices between the first slice and the second slice, and the snippet end slice.

Abstract: A mode setting part 112 has a function to selectively set 2D and 3D display output modes. A play control part 132 changes the manner in which to control switching between display images in accordance with the display output mode set by the mode setting part 112. The play control part 132 changes the opacities of first and second display images with time so that when the two display images are cross-faded, the sum of the opacities of the first and second display images in a 3D display output mode is equal to or smaller than the sum of the opacities of the first and second display images in a 2D display output mode during a cross-fading period.

Abstract: Disclosed are various embodiments for generating personalized streaming media based on a streaming media received from a broadcast source. In one embodiment, a media service receives a request to generate the personalized streaming media from a client. In response to the request, the media service application determines the content of the streaming media and identifies files in a file system of a user that include content related to the streaming media. Upon identifying the related files, the media service application embeds the content of the related files in a relevant portion of the streaming media to generate the personalized streaming media. The media service application then transmits the personalized streaming media to the client.

Abstract: An electronic equipment for analyzing an image inside a light-proof container having a portable electronic device with a display screen therein is provided. The electronic equipment analyzes the gray values of each two adjacent pixels of the image to determine a number of boundary points of an area which is illumined by the display screen, linearly fits a number of straight-lines based on the boundary points in different directions, and determines an area bound by the intersections formed by the straight-lines.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: A control device controls a television. The control device includes a touch module. The control device displays a menu containing a number of soft keys on a screen. The soft keys are activated to control the television to carry out corresponding functions. All positions on the menu are associated with all positions on the touch module correspondingly. As a result, a user can select desired soft keys to carry out corresponding functions by viewing the menu on the television and touching the touch module, rather than viewing the touch module.

Abstract: There is provided an image processing apparatus including: a plurality of signal processing circuits that compose video signals; and a communication path that connects the plurality of signal processing circuits, wherein any one of the plurality of signal processing circuits composes a video signal obtained by composition by the signal processing circuit, and a video signal obtained by composition by another signal processing circuit supplied from the another signal processing circuit via the communication path.

Abstract: A method is for monitoring the electrical integrity of lines of photosites of an imaging device with matrix array of photosites. The control lines of photosites may include for each line of photosites an emission of elementary electrical control signals for the photosites of the line. The method may include diagnosis of the elementary electrical control signals emitted.

Abstract: A guided natural language interface, a method for guiding a user in specifying a color problem with a document image, and a set of templates for use in the interface and method are provided. The interface includes computer readable memory which stores a set of issue description templates, each template being configured for guiding a user in formulating a problem statement characterizing, in natural language, a problem related to color identified in an input document. A natural rendering engine receives information input by a user and/or information input from an associated problem detector, and instantiates one of the templates in response thereto. The natural language rendering engine is configured for presenting the problem statement to the user as it is refined and communicating information based on the refined problem statement to an associated problem corrector.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: A video processing device can determine whether an input pixel includes a keyed video parameter prior to filtering the input pixel. A non-keyed substitute pixel can be generated for the input pixel that includes the keyed video parameter. The non-keyed substitute pixel can be filtered if the input pixel included the keyed video parameter, otherwise the input pixel can be filtered.

Abstract: An apparatus for tracking a pointing device in use by a foreground subject in a sequence of video fields having a foreground component and a background component, where the pointing device is the leftmost or rightmost object within the foreground component. The apparatus determines the boundaries of a cropped video field within each of the video fields and determines a pixel value and scan line representing the leftmost and rightmost positions of the foreground subject and pointing device for that cropped video field. The apparatus determines the centerline of the foreground subject for each cropped video field, and using the centerline, determines whether the pointing device is on the right side of the cropped video field or the left side of the cropped video field. The position of the pointing device is stored after receipt of a signal generated by the foreground subject.

Abstract: A terminal including a communication unit configured to receive a broadcasting signal, a display unit configured to display a broadcast content included in the received broadcasting signal and to display at least one widget application, and a control unit configured to determine if the received broadcasting signal includes a caption related to the broadcast content, to determine if the caption is to be displayed at a position that will overlap with at least a portion of the displayed widget application when the caption is included in the broadcasting signal, and to move a position of the widget application on the display unit if the caption is determined to be displayed at the position that will overlap with said at least the portion of the displayed widget application.

Abstract: A method for forming a video summary for a digital video having a time sequence of video frames, comprising using a processor to perform the steps of: determining a set of key video frames for the digital video; ranking the key video frames responsive to a predefined criterion; forming key video snippets corresponding to one or more highest-ranked key video frames according to a predefined set of criteria, including a criterion which specifies the total time duration for the video summary and a criterion which specifies the minimum time duration for each of the key video snippets; assembling the key video snippets to form a video summary; and storing a representation of the video summary in a processor-accessible memory.

Abstract: A mix-effects bank architecture of a video switcher having a plurality of video processing units; and an internal switcher routing matrix. The internal switcher routing matrix routing, a video source currently providing a video feed to an auxiliary output and a desired new source for the auxiliary output to a video processing unit that is not contributing towards video processing and routing an output of said video processing unit to said auxiliary output. The video processing unit that is not contributing towards video processing performs a transitional effect for the auxiliary output.

Abstract: A method for determining key video frames for a digital video having a time sequence of video frames, comprising using a processor to perform the steps of: analyzing the digital video to determine an importance value as a function of time; forming a warped time representation by temporal relocation of the video frames responsive to the importance value as a function of time; subdividing the warped time digital video sequence representation into a set of equal intervals; selecting a key video frame for each interval by analyzing the video frames within each interval; and storing an indication of the key video frames in a processor-accessible memory.

Abstract: A projector for masking out one or more objects between the projector and a screen. The projector includes an image capture sensor configured to produce a captured screen image. The projector further includes a processing device configured to receive a video-in signal, create a masking image that corresponds to at least a portion of the captured screen image, and produce a video-out signal, wherein the video-out signal comprises a combination of the video-in signal and the masking image. A panel controller in the projector receives the video-out signal and causes at least one or more pixels of at least one panel to be closed based upon the masking image such that any objects positioned between the projector and the screen are masked from any light projected by the projector.

Abstract: A video broadcast of a live event is enhanced by providing graphics in the video in real time to depict the fluid flow around a moving object in the event and to provide other informative graphics regarding aerodynamic forces on the object. A detailed flow field around the object is calculated before the event, on an offline basis, for different speeds of the object and different locations of other nearby objects. The fluid flow data is represented by baseline data and modification factors or adjustments which are based on the speed of the object and the locations of the other objects. During the event, the modification factors are applied to the baseline data to determine fluid flow in real time, as the event is captured on video. In an example implementation, the objects are race cars which transmit their location and/or speed to a processing facility which provides the video.

Abstract: An apparatus determines a cursor position in an illumination field of a projector. An obstruction is detected in the illumination field. The cursor position is determined as the point on the obstruction furthest from where the obstruction crosses a border of the illumination field. A distance to the point on the obstruction is determined and compared to a distance to a point not on the obstruction. Gestures are recognized as a function of movement of the obstruction and the determined distances.

Abstract: The method and apparatus for generating an adaptive chroma key includes taking into consideration foreground object information during the creation of a composite scene. The luminance and chrominance of an area of interest between a foreground key and a background scene are considered and accounted for during the created of the composite scene.

Abstract: Intelligent resource state memory recall techniques, and associated apparatus and methods, are disclosed. States of one or more video switcher resources in a resource state memory may be recalled to the same or different resources, depending on resource availability at the time of memory recall. A memory recall need not affect an on air signal. The memory may be recalled to recreate a desired program output, as defined in the memory, on a preview output of the video switcher, which leaves a current program output of the video switcher undisturbed when the memory is recalled.

Abstract: A method and apparatus for calibrating a color temperature of a projector that creates a light of a desired color by mixing primary lights. The method includes setting target values for the mixed light, measuring color coordinate values for the primary lights, calculating the target brightness values for the primary lights using the target values and the measured color coordinate values, and calibrating the output of the primary lights output from the projector based on the calculated target brightness values.

Abstract: A method of processing on screen display data with an image post processor includes receiving a data stream from a video processor at a post processing device having at least one port, the data stream including on screen display data overlaid on a white background and the on screen display data overlaid on a black background, finding a difference between the on screen display data overlaid on white and the on screen display data overlaid on black, using the difference to determine a complement of an alpha blend value, performing image processing on the image data with the post processor by applying the complement of an alpha blend value to the image data to produce processed image data, and transmitting the processed image data and the on screen display data through a display port.

Abstract: A video processing device may process video input comprising a plurality of streams, wherein images corresponding to at least some of the plurality of streams may be displayed concurrently. The video processing device may determine, prior to processing of a pixel in one of the plurality of streams whether the pixel comprises one or more keyed video parameters; and if the pixel comprises at least one keyed parameter, one or more other pixels may be selected, and a video parameter corresponding to the at least one keyed video parameter of the pixel may be generated based on the selected one or more other pixels. The generated video parameter may then be utilized instead of the at least one keyed video parameter during the processing of the pixel. This may comprise luma and/or chroma based scaling. Outputs of the processing of the pixel may be post-processed, by clamping at least one of the video parameters.

Abstract: Using a background-side image which is a shot of an arbitrary background and a material-side image which is a shot of a composition material against the same background, two images are compared to extract an image material to be composited. Images shot in any scenery can thus be used to extract a composition material, being part of the images, without using a certain background such as a blue screen.

Abstract: An image synthesizing apparatus is provided. The image synthesizing apparatus includes: a key image selector, a background selector, a key processor, an image synthesizer, a frame memory, a part designator, and a writing device. In the image synthesizing apparatus, the image signal that has been selected by the key image selector is sent to the key processor, the image signal that has been processed by the key processor is sent to the writing device and written into the frame memory, and image signals read from every storage region of the frame memory are sent to the image synthesizer.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: High definition media content processing techniques are described in which enhanced media content rendering techniques may be performed to output high definition media content. In an implementation, luma keying may be provided to define clear pixels in a composite output using an optimum set of graphics processing instructions. In another implementation, techniques are described which may provide clear rectangles in a composite output of one or more video streams. Clear rectangles to appear in the composite output are configured by a media playback application. A texture is arrived at to represent a union of each of the clear rectangles and is applied to form the clear rectangles in the composite output. In another implementation, capture techniques are described in which an image to capture is resolved as strips to an intermediate texture and then from the texture to a capture buffer in system memory.

Abstract: A system and method of geometrical predistortion of a graphical source signal is provided in which the graphical source signal is merged with an input video signal for display on a display device. The input video signal is received at a hardware scaler device and a predistorted video signal is generated there from. A warping map is calculated using a programmed processor and a graphics source signal is then predistorted, in software, using the warping map to generate a warped graphical overlay signal. The predistorted video signal from the hardware scaler is then merged with the warped graphical overlay signal from the programmed processor.

Abstract: An ambient, beautiful, entertaining visual experience that can be displayed on a TV requiring little or no user interaction beyond initiation. Multiple image layers that may be still or moving video, photos, etc, or a combination thereof can be overlaid on each other.

Abstract: A projection apparatus comprises a receiver, a processor, and a frame projector. A sensor detects a horizontal position of a user in front of a screen and transmits a horizontal position signal. The receiver receives the horizontal position signal. The processor generates an on screen display (OSD), and superimposes the OSD onto a projection frame. The frame projector projects the superimposed frame onto the screen. During projection, the OSD covers the face of the user.

Abstract: A surround visual field that has a characteristic or characteristics that relate to an audio/visual presentation is described. In one embodiment, the surround visual field is projected on an area partially surrounding or surrounding video content being displayed on a device. This surround visual field may be comprised of a plurality of elements that further enhance the visual effect of the content being displayed. For example, one embodiment of the invention provides for elements within the surround visual field to move in relation to motion within the video content being displayed. Other characteristics of the video content may also be supplemented by the surround visual field or the surround visual field may simply be authored to correspond to the content itself.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map but not effective at presenting local detail. In contrast, street -side images show excellent detail but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: A system and method for scaling a composite overlay image, wherein the composite overlay image comprises a plurality of pixels and each pixel comprises at least one color channel and at least one alpha channel, and further wherein at least one pixel of the composite overlay image has an alpha value of zero and a color value that is not well defined. First, a set of pixels of the composite overlay image are identified as pixels to be dilated. The color channels of the identified pixels are then dilated to form dilated composite overlay image. Finally, the dilated composite overlay image is scaled.

Abstract: A method for determining key video frames for a digital video having a time sequence of video frames, comprising using a processor to perform the steps of: analyzing the digital video to determine an importance value as a function of time; forming a warped time representation by temporal relocation of the video frames responsive to the importance value as a function of time; subdividing the warped time digital video sequence representation into a set of equal intervals; selecting a key video frame for each interval by analyzing the video frames within each interval; and storing an indication of the key video frames in a processor-accessible memory.

Abstract: Various imaging processing techniques for displaying a pre-subpixel rendered image. The pre-subpixel rendered image can be transmitted directly to a display capable of displaying a subpixel rendered image. The pre-subpixel rendered image can also be stored for later transmission for output to the display. Additionally, the pre-subpixel rendered image can be embedded in an image data stream and later extracted and displayed.

Abstract: A panel-type television whose colors and image qualities of OSD portions are kept intact and the qualities of images other than the OSD portions are adjusted is provided. The panel-type television includes an image quality adjustment circuit 30a that performs a specified image quality adjustment processing on input image signals; a delay circuit 30b that delays input image signals by the time needed for the image quality adjustment circuit 30a to perform image quality adjustment processing; and a switching 30c that switches between the image quality adjustment circuit 30a and the delay circuit 30b so that image signals are input to either of the circuits according to the control of a microcomputer 60, wherein the microcomputer 60 inputs image signals for OSD display areas to the delay circuit 30c and image signals other than those for OSD display areas to the image quality adjustment circuit 30a.

Abstract: The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map, but not effective at presenting local detail. In contrast, street-side images show excellent detail, but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps, and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

Abstract: A video mixer is employed to form a transition between two video compositions, for example a fade or a wipe. A video storage device is associated with the video mixer and plays out a video signal, the timing of which is controlled in dependence upon the progress of the transition made by the said video mixer.

Abstract: Systems and methods provide object-based image inpainting. The object-based inpainting can recover part of a missing object or can synthesize visual objects that are entirely missing. In one implementation, an exemplary system generates a target visual object to be inpainted into an image, by geometrically matching key features with a model visual object that can be selected from the same or another image. Borders of the target object are refined through pixel-based contour deformation and textures for the target object are obtained either by pixel interpolation or by patch-based modeling of pre-existing texture in the image. Graph-cut segmentation rectifies image overlap as the target object is embedded in the image. Poisson editing filters visual seams, and edge filling completes visual gaps around the border of the target object.

Abstract: A device for realizing on screen display (OSD) in video signals includes a comparator (430) and an outputting control unit (440). The comparator (430) is used for receiving OSD signals and identification signals on a background color selected to be transparent in the OSD signals, identifying the background color in the OSD signals based on the identification signals, and generating a control signal based on the identification. The outputting control unit (440) is connected to the comparator (430), and is used for receiving UV components of the OSD signals, UV components of the video signals, and the control signal, and for selectively outputting UV data of the video signals or UV data of the OSD signals according to the control signal. The device simulates translucent OSD by preparing the Y and UV components of displayable YUV signals respectively from the video signals and the OSD signals.

Abstract: An exemplary method includes receiving a trimap for an image that specifies a background region, a foreground region and an unknown region for the image wherein a boundary exists between the foreground region and the unknown region and wherein another boundary exists between the unknown region and the background region, solving a set of Poisson equations having boundary conditions for the two boundaries to provide a matte that distinguishes a foreground region from a background region in the unknown region, and refining the matte by solving a set of Poisson equations for a local unknown region. Various other exemplary technologies are also presented.

Abstract: A digital image processing apparatus for applying pixel-based color correction to an input image to generate an output image is described herein. The apparatus includes color correction logic arranged to provide two or more color correction processes. Each color correction process has a respective associated locus in a color space and a respective associated color mapping operation. The color correction processes are arranged as a succession of processes so that the results of a color correction process form the input to a next such process in the succession. Each color correction process is operable to detect whether each pixel lies within the respective locus in color space and, if so, to apply the color mapping operation to that pixel. Each color correction process after the first process in the succession is configured to inhibit color mapping in respect of the loci associated with previous processes in the succession.