Abstract: An electronic device and a method for training or applying a neural network model are provided. The method includes the following steps. An input data is received. Convolution is performed on the input data to generate a high-frequency feature map and a low-frequency feature map. One of upsampling and downsampling is performed to match a first size of the high-frequency feature map and a second size of the low-frequency feature map. The high-frequency feature map and the low-frequency feature map are concatenated to generate a concatenated data. The concatenated data is inputted to an output layer of the neural network model.

Abstract: Video conferencing systems are popular means for remote parties to interact in real-time. A user may wish to emphasize certain visual elements of the video conference, for example, a company's logo or the contents of a whiteboard may be important to remain clearly seen by the viewers of the video conference. As elements are obscured, a previously captured image of the obscured visual element may be overlaid on top of the obscuring image to visual remove the obscuring object. Additionally, certain visual elements may be enhanced, such that a small visual element may appear larger or clearer within the video image.

Abstract: A method is provided, including: receiving, from a client device, a request to spectate a live event by a remote spectator; assigning the remote spectator to a seat in a physical venue; streaming a first video feed, captured by a first camera in the physical venue, to the client device for rendering to a first display for viewing by the remote spectator, wherein the first video feed provides a field of view of the physical venue; rendering a second video feed, from a second camera that captures the seat in the physical venue, to a display device in the physical venue; wherein when the field of view provided by the first video feed includes the display device in the physical venue, then the rendering of the second video feed on the display device that is shown in the field of view is altered, showing the remote spectator in the seat.

Abstract: Methods and systems for real-time video processing can be used in video conferencing to modify image quality of background. One example method includes the steps of receiving a video including a sequence of images, identifying at least one object of interest (e.g., a face) in one or more of the images, detecting feature reference points of the at least one object of interest, and tracking the at least one object of interest in the video. The tracking may comprise aligning a virtual face mesh to the at least one object of interest in one or more of the images. Further, a background is identified in the images by separating the at least one object of interest from each image based on the virtual face mesh. The background is then modified in each of the images by blurring, changing a resolution, colors, or other parameters.

Abstract: Method and server for managing placement of a digital signage content based on metric thresholds. The server stores parameters associated to a plurality of locations. The parameters for each location comprise at least one metric and a corresponding threshold for each metric. The server determines a plurality of candidate locations among the plurality of locations for displaying the content. For each candidate location, the server processes the at least one metric and corresponding threshold of the candidate location to determine if each metric among the at least one metric is within the corresponding threshold. The server identifies one or more target location among the plurality of candidate locations for displaying the content. Each metric among the at least one metric of the one or more target location is within the corresponding threshold. The locations may include digital signage players, geographical areas, displays controlled by a player.

Abstract: An information processing apparatus includes a processor and a memory. The memory contains instructions that, when executed by the processor, cause the processor to perform as a first obtaining unit, a second obtaining unit, and a first determination unit. The first obtaining unit is configured to obtain image data representing an image. The second obtaining unit is configured to obtain distance information corresponding to the image data. The first determination unit is configured to determine, based on accuracy of the distance information, a candidate for a lighting effect applicable to the image in applying a lighting effect based on the distance information to the image.

Abstract: Input image data having a plurality of pixel values represented in a two-dimensional matrix form of columns and rows is received. The input image data is transformed into a plurality of input rows. The pixel values in each input row correspond to the pixel values in a predetermined subset of the columns of the input image data and all of the rows of each column of the subset of columns. A plurality of subsets of pixel values in the plurality of input rows is determined. The number of pixel values in each row of a subset of pixel values equal in number to a number of filter values in a filter. Each input row of each subset of pixel values is convolved with the filter values of the filter to determine a corresponding output value and stored in a memory.

Abstract: The present technology relates to a display device, a display control method, and a program that enable various states of the device to be expressed in a limited region. A television receiver set includes an indicator unit disposed at least in a part of a periphery of a display unit on which a predetermined image is displayed and including an indicator configured to be lit at a predetermined luminance, and a display control unit configured to perform control such that the predetermined image displayed on the display unit is associated with lighting of the indicator. The present invention can be applied to a display device such as a television receiver set.

Abstract: Maintenance methods of digital signage applied to a player of the digital signage are provided, wherein the player performs playback software to play multimedia information through the digital signage. The method includes the steps of: detecting processor usage statuses of one or more processes corresponding to the playback software; determining whether a predetermined condition is satisfied based on the processor usage statuses of the one or more processes; activating a screen analysis module to detect whether a screen image is abnormal in response to determining that the predetermined condition is satisfied; and activating a troubleshooting module to automatically perform an automatic troubleshooting procedure in response to the screen detection module detecting that the screen image is abnormal.

Abstract: An image of a check is captured by an imaging device and a digital image of the check on a replacement background may be created. The check may be placed on any background while the image of the check is being captured. The replacement background replaces, in the digital image, the background that the check is placed on while its image is being captured. The replacement background may comprise a predetermined image or color(s). The image of the check and the replacement background may be provided into a digital image file that may be transmitted to an institution system for deposit of the check into an account.

Abstract: Device for providing a playable sequence in renderable manner comprises: a providing unit for providing defined functions, said functions for applying playable effects to objects, a time unit for adding time boundaries to said functions, to provide time bounded functions, an ordering unit for ordering said time bounded functions into a sequence, and a translation unit for applying translations to said objects in accordance with said effects.

Abstract: Disclosed herein are an apparatus for writing a motion script and an apparatus and method for self-teaching of a motion. The method for self-teaching of a motion, in which the apparatus for writing a motion script and the apparatus for self-teaching of a motion are used, includes creating, by the apparatus for writing a motion script, a motion script based on expert motion of a first user; analyzing, by the apparatus for self-teaching of a motion, a motion of a second user, who learns the expert motion, based on the motion script; and outputting, by the apparatus for self-teaching of a motion, a result of analysis of the motion of the second user.

Abstract: A multimedia file and methods of generating, distributing and using the multimedia file are described. Multimedia files in accordance with embodiments of the present invention can contain multiple video tracks, multiple audio tracks, multiple subtitle tracks, data that can be used to generate a menu interface to access the contents of the file and ‘meta data’ concerning the contents of the file. Multimedia files in accordance with several embodiments of the present invention also include references to video tracks, audio tracks, subtitle tracks and ‘meta data’ external to the file. One embodiment of a multimedia file in accordance with the present invention includes a series of encoded video frames and encoded menu information.

Abstract: A device and method capable of performing image following type audio control or image non-following type audio control are implemented. Images in different directions are selectively displayed on the display unit, and an output audio is controlled in accordance with an image display. A data processing unit executes image following type audio control of moving an audio source direction in accordance with movement of the display image of the display unit and image non-following type audio control of not moving the audio source direction in accordance with the movement of an image in units of individual controllable audio elements. The data processing unit acquires audio control information from an MP4 file or a media presentation description (MPD) file and executes either the image following type audio control or the image non-following type audio control in accordance with the acquired audio control information in units of individual controllable audio elements.

Abstract: An Internet-based application allows a trainee to record a performance of a scene containing roles A and B with performers for the scene's roles alternately speaking their respective lines. The system displays the lines in a teleprompter style, and based on the experience level of the trainee, may blank out increasing portions of the teleprompter-style lines. If the trainee is assigned role A, the system will present each role A line to be spoken by the trainee with a time progress bar indicating the speed/timing or time remaining for that line. The trainee's performance is recorded by a computer. The teleprompter timer ensures that the trainee's performance is coordinated with a take of role B, even though the trainee's take and the role B take are actually recorded at different times. The takes are played in tandem for evaluating effectiveness of the training.

Abstract: An exemplary method includes a virtual reality media provider system acquiring, from a plurality of capture devices physically disposed at different vantage points in relation to a scene, a distinct set of two-dimensional (2D) color data and depth data (2D data) for each capture device included in the plurality of capture devices, each distinct set of 2D data representing a distinct unmeshed view of the scene from a respective vantage point of a respective capture device included in the plurality of capture devices, acquiring metadata for each distinct set of 2D data, packaging each distinct set of 2D data into a transport stream such that the transport stream includes data representing each distinct unmeshed view of the scene from each respective vantage point of each respective capture device, and providing the metadata and the transport stream for streaming to a media player device.

Abstract: A display apparatus including: a display; a user input configured to issue a command for executing a GUI; and a processor configured to process a first image including an object to be displayed on the display, and process the GUI corresponding to an outline of the object to be displayed on the display in response to receiving the command for executing the GUI from the user input while the first image is displayed.

Abstract: A method of displaying an illumination includes: based on illumination information, determining, using a least one processor, an illumination area to which an illumination assigned in a virtual space is projected; and visualizing, using the at least one processor, an illumination effect produced by the illumination with respect to a determined boundary area in the illumination area, the determined boundary area including a boundary and a portion of the determined illumination area that is less than all of the determined illumination area.

Abstract: A system comprises a first device having video data provided thereon. A first application is operable on the first device and associates control data with the video data, wherein the control data contains information for creating auxiliary data which is to be presented with the video data subsequent to the video data being broadcast to one or more second devices across the network. A control center is in communication with the first application for receiving the video data and the associated control data from the first device and is operable to broadcast the video data and the associated control data to one or more second devices. A media player is provided on the respective second devices which is operable in response to reading the control data to create the auxiliary data on the respective second device to launch the auxiliary data while the media player is playing the video data.

Abstract: A method of image processing, the method including performing linear processing of an input data signal encoded with a nonlinear function to generate a linear representation of the input data signal including linearized image data, and using an integrated circuit to generate a processed linear image by nonlinearly quantizing the linearized image data to generate nonlinear quantized data, generating a memory address based on the nonlinear quantized data, and accessing a lookup table based on the generated memory address.

Abstract: A method and system for airing broadcast signals is disclosed. Preferably, the system includes a production truck interface panel receiving a broadcast signal. A transmission relay circuit relays the signal from the interface panel to a broadcast network, and preferably including a broadcast signal detection circuit, and a signal processing circuit. The detection circuit determines a signal type of the broadcast signal, and the signal processing circuit processes the determined signal type. The system preferably further includes an operations control station displaying the determined type of broadcast signal.

Abstract: Various aspects of a video processing system and method are provided for object tracking in a sequence of image frames are disclosed herein. The video processing system includes one or more circuits in an electronic device that acquires the sequence of image frames, which comprises at least a current image frame and a next image frame including an object. A distribution of first pixel values in a first image space associated with a first region, which corresponds to the object in the current image frame, is determined. Based on the distribution, the current image frame is transformed to a modified current image frame that includes at least a second region that corresponds to the first region and is associated with second pixel values in a second image space. Based on one or more features extracted as a template associated with the second region, the object is tracked in the next image frame.

Abstract: There is provided a receiver device including a first input terminal, a second input terminal, a first distribution circuit, a second distribution circuit, a first high-frequency processing unit, and a second high-frequency processing unit.

Abstract: Methods and systems for real-time video processing can be used in video conferencing to modify image quality of background. One example method includes the steps of receiving a video including a sequence of images, identifying at least one object of interest (e.g., a face) in one or more of the images, detecting feature reference points of the at least one object of interest, and tracking the at least one object of interest in the video. The tracking may comprise aligning a virtual face mesh to the at least one object of interest in one or more of the images. Further, a background is identified in the images by separating the at least one object of interest from each image based on the virtual face mesh. The background is then modified in each of the images by blurring, changing a resolution, colors, or other parameters.

Abstract: Systems and methods for encoding aviation data for improved transmittability are provided. One example system includes one or more processors and a computer-readable medium that stores instructions that when executed by one or more processors cause the one or more processors to obtain a plurality of aviation datasets that respectively describe a plurality of conditions associated with an aircraft; and format the plurality of aviation datasets into a plurality of video frames. Each of the plurality of video frames includes a plurality of encoding units at respective positions within such video frame. To format the plurality of aviation datasets into the plurality of video frames, the one or more processors format at least a portion of each of the plurality of aviation datasets as at least one of the plurality of encoding units within each video frame. For each of the plurality of aviation datasets, the at least one encoding unit within each video frame is at a same respective position from frame to frame.

Abstract: For efficient data storage utilization and recycling, gradually degrading data according to data classes and using degrading data policies, predefined degrading rules, and data access patterns for conserving storage space prior.

Abstract: Apparatus for identifying one or more still images in one or more moving image contents. An identifying unit is configured to identify one or more still images included in the moving image contents having one or more features that closely resemble particular features. A display controller is configured to cause the display on a timeline associated with the moving image contents of the location of an identified still image in at least one of the moving image contents.

Abstract: A method and system for airing broadcast signals is disclosed. Preferably, the system includes a production truck interface panel receiving a broadcast signal. A transmission relay circuit relays the signal from the interface panel to a broadcast network, and preferably including a broadcast signal detection circuit, and a signal processing circuit. The detection circuit determines a signal type of the broadcast signal, and the signal processing circuit processes the determined signal type. The system preferably further includes an operations control station displaying the determined type of broadcast signal.

Abstract: Virtual video editing is disclosed. In some embodiments, a definition of a virtual clip of a source file is received from a user and saved for future playback of the virtual clip. The virtual clip is not encoded as a separate file. Rather, a portion of the source file specified in the definition of the virtual clip is played back when the virtual clip is played.

Abstract: A block of a video frame may be predicted and decoded using a local affine motion prediction scheme. At least three points within the video frame are selected, each point being adjacent to a respective corner of the current block to be encoded. For each point, a motion search is performed for a template block centered about the point within a reference frame to find a template reference block. The template reference block has a center point that forms an anchor point pair with the corresponding point adjacent to the current block. Using coordinates of the anchor point pairs, affine coefficients for an affine transformation are generated. Using the affine transformation, a prediction block for the current block is generated and used to encode the current block within a bitstream. Providing the local affine motion prediction scheme can improve the prediction of certain blocks with complex motion, increasing compression.

Abstract: A device testing capability is presented herein. The device testing capability supports automated testing of media devices (e.g., cameras, microphones, speakers, or the like) for verifying that the media devices are functioning properly. The device testing capability may support automated verification by an endpoint that one or more media devices or one or more sets of media devices associated with endpoint are functioning properly. For example, the device testing capability may support automated verification by a computer that a camera associated with the computer is functioning properly. For example, the device testing capability may support automated verification by a computer that a speaker and a microphone that are associated with the computer are functioning properly. The device testing capability may support automated verification, by a management system, of the proper functioning of media devices associated with endpoints in a set of endpoints.

Abstract: A method of raising contrast of an OLED display panel converts an original RGB signal into a HSI color space constructed by a hue component, a saturation component and an intensity component, and implements histogram statistics to the intensity component to obtain a histogram of the intensity component, and obtains a conversion parameter according to the histogram of the intensity component, and obtains the new low driving voltage with calculation of the conversion parameter in combination with the original low driving voltage, and meanwhile, keeps the hue component and the saturation component unchanged, and implements enhancement treatment to the intensity component to obtain a new intensity component, and then, converts the hue component, the saturation component and the new intensity component into a RGB color space to obtain a new R?G?B? signal supplied to a pixel driving circuit.

Abstract: An information processing apparatus includes a tracking unit configured to identify a tracking region including a tracking object in an image, an identification unit configured to identify a motion region inside the tracking region in the image, a derivation unit configured to derive a ratio of the motion region relative to the tracking region, and a determination unit configured to determine whether to continue tracking the tracking object based on the derived ratio.

Abstract: The invention provides a motion prediction method. First, a plurality of candidate units corresponding to a current unit of a current frame is determined. A plurality of motion vectors of the candidate units is then obtained. A plurality of scaling factors of the candidate units is then calculated according to a plurality of respective temporal distances depending on a plurality of reference frames of the motion vectors. The motion vectors of the candidate units are then scaled according to the scaling factors to obtain a plurality of scaled motion vectors. The scaled motion vectors are ranked, and a subset of highest ranking motion vectors are identified to be included in a candidate set. Finally, a motion vector predictor for motion prediction of the current unit is then selected from the candidate units.

Abstract: This disclosure relates to systems and methods for controlling a light box system. The light box system can be used to create lighting for a virtual environment. The light box system, also referred to as a light box, can be formed from a plurality of walls that form a room-like structure. Each wall of the light box can include a plurality of light projection elements. The light projection elements can be light emitting diodes (LED) that can project light within the interior of the light box. The light projection elements can output light towards the interior of the light box in order to generate calculated light output for a virtual environment. The lighting characteristics of the virtual environment can be modified to change the calculated lighting output for a virtual environment.

Abstract: Apparatus for identifying one or more still images in one or more moving image contents. An identifying unit is configured to identify one or more still images included in the moving image contents having one or more features that closely resemble particular features. A display controller is configured to cause the display on a timeline associated with the moving image contents of the location of an identified still image in at least one of the moving image contents.

Abstract: A virtual camera within a volumetric model of a real world environment during an event occurring within the real world environment can be identified. The virtual camera can be associated with at least one of a location and an orientation within the real world environment. A virtual stream for the virtual camera can be constructed. The field of view of the stream can include video obtained from two cameras present within the real world environment and video not captured by a camera within the real world environment. The video field point of view can correspond to at least one of the location and orientation of the virtual camera. The virtual stream of the virtual camera can be presented within an interface of computing device responsive to the constructing.

Abstract: Methods and systems for operation upon one or more data processors for detecting image spam by detecting an image and analyzing the content of the image to determine whether the incoming communication comprises an unwanted communication.

Abstract: Media content typically includes closed captioning information such as subtitles in domestic and foreign languages. Techniques and mechanisms provide that closed captioning information may be toggled on/off using menu options and preferences as well as automatically managed by intelligently monitoring the environment surrounding a device. Device sensors such as microphones and vibration monitors determine the noise level of an environment as well as the spectral characteristics of the noise to determine whether the noise profile would interfere with the video playback experience. A particular environmental noise profile could automatically trigger the display of closed captioning information or present an easy access, otherwise unavailable toggle to display closed captioning information associated with a video stream.

Abstract: A mobile terminal includes a memory configured to store at least one 2-dimensional (2D) image and at least one 3-dimensional (3D) image. A display unit is configured to display the images. A controller is configured to control the display unit to display a list including the at least one 2D image and the at least one 3D image when a command for displaying the list is input, and to control at least one image being one of the 2D image or the 3D image distinguishably displayed from another of the 2D image or the 3D image.

Abstract: A block of a video frame may be predicted and encoded using a local affine motion prediction scheme. At least three points within the video frame are selected, each point being adjacent to a respective corner of the current block to be encoded. For each point, a motion search is performed for a template block centered about the point within a reference frame to find a template reference block. The template reference block has a center point that forms an anchor point pair with the corresponding point adjacent to the current block. Using coordinates of the anchor point pairs, affine coefficients for an affine transformation are generated. Using the affine transformation, a prediction block for the current block is generated and used to encode the current block within a bitstream. Providing the local affine motion prediction scheme can improve the prediction of certain blocks with complex motion, increasing compression.

Abstract: The present invention provides a salience-based media manipulation method and system for inserting contents into video presentations. The method includes establishing an advertisement-element pool containing a plurality of advertisement elements provided for insertion; obtaining an input video presenting at least one scenes and containing a plurality of original frames; and performing shot grouping and primary scene analysis on the input video to acquire scenes with static background and limited camera motion. The method also includes detecting white-space candidates in the acquired scenes for inserting at least one advertisement element and adjusting alignment between the white-space candidates and the at least one advertisement element. The adjusted alignment increases a salience gain of the advertisement elements and limit salience change of the scenes without insertion.

Abstract: The DJ controller 10 has a load operation member 82 that loads audio signals to each channel, a synchronization button 84 that realizes a beat synchronization function, and a channel fader 85 that reproduces the loaded audio signals by the fader start function corresponding to each channel.

Abstract: An imaging apparatus includes a shooting rate setting unit configured to set a shooting rate, a shooting unit configured to shoot a moving image at the shooting rate set by the shooting rate setting unit, an acquisition unit configured to acquire a shooting duration time from a start of shooting, a calculation unit configured to calculate a playback time based on a playback rate in a case of playing back the moving image shot by the shooting unit, and a display control unit configured to display the shooting duration time acquired by the acquisition unit and the playback time calculated by the calculation unit together on a display unit while the shooting is conducted by the shooting unit.

Abstract: Systems and methods which provide generation of image depth maps which more accurately represent the local depth discontinuity within images through use of image global depth maps adapted based upon image global motion and/or localized depth analysis utilizing relative relationships of attributes across depth discontinuities in the image are disclosed. Embodiments utilize a full global depth map which is larger than or equal to the image being converted in order to accommodate image global motion, in generating an image global depth map. In operation according to embodiments, an image global depth map is identified within the full global depth map, such as based upon global motion within the image. Localized depth analysis, using pixel attribute relative relationships, is applied with respect to the image global depth map according to embodiments to generate an image depth map which more accurately reflects the local depth discontinuities within the image.

Abstract: Methods and systems for real-time video processing can be used in video conferencing to modify image quality of background. One example method includes the steps of receiving a video including a sequence of images, identifying at least one object of interest (e.g., a face) in one or more of the images, detecting feature reference points of the at least one object of interest, and tracking the at least one object of interest in the video. The tracking may comprise aligning a virtual face mesh to the at least one object of interest in one or more of the images. Further, a background is identified in the images by separating the at least one object of interest from each image based on the virtual face mesh. The background is then modified in each of the images by blurring, changing a resolution, colors, or other parameters.

Abstract: Some embodiments of the invention provide a method for indicating hierarchy of objects in a graphical user interface (GUI) of a computer system. The method uses a first color to display a first set of objects at a first level of the hierarchy. The method then uses a second color, different from the first color, to display a second set of objects at a second level of the hierarchy. The first and second colors are two different colors in the visible light spectrum in some embodiments, while they are two different shades of the same color in other embodiments.

Abstract: The image forming apparatus includes an input luminance range recognition unit, an output luminance range recognition unit, and a luminance range expansion unit. The input luminance range recognition acquires input luminance information from multi-gradation monochrome image data, generates a luminance histogram, and determines, based on a minimum luminance value and a maximum luminance value of the luminance histogram, an input luminance range. The output luminance range recognition unit determines an output luminance range. The luminance range expansion unit performs a mapping process for mapping input luminance information of pixels within the image range into the output luminance range, and expands the input luminance range to a maximum luminance range.

Abstract: Certain embodiments teach a variety of experience or “sentio” codecs, and methods and systems for enabling an experience platform, as well as a Quality of Experience (QoS) engine which allows the sentio codec to select a suitable encoding engine or device. The sentio codec is capable of encoding and transmitting data streams that correspond to participant experiences with a variety of different dimensions and features. As will be appreciated, the following description provides one paradigm for understanding the multi-dimensional experience available to the participants, and as implemented utilizing a sentio codec. There are many suitable ways of describing, characterizing and implementing the sentio codec and experience platform contemplated herein.

Abstract: The present invention relates to a system and method for processing a video input signal providing for tracking a selected portion in a predefined audiovisual presentation and integrating selected user images into the selected portion of the predefined audiovisual presentation.