Abstract: A video edit may include two videos arranged in a sequence. Motion within the one or both of the videos may be assessed. A transition effect may be selected based on the motion assessed within the video(s), and the video edit may be modified to include the transition effect between the videos. The transition effect may emphasize the motion assessed within the video(s) and/or create continuity of motion during transition between the two videos within the video edit.

Abstract: An apparatus and digital signal processing means are disclosed for excision of co-channel interference from signals received in crowded or hostile environments using spatial/polarization diverse arrays, which reliably and rapidly identifies communication signals with transmitted features that are self-coherent over known framing intervals due to known attributes of the communication network, and exploits those features to develop diversity combining weights that substantively excise that co-channel interference from those communication signals, based on differing diversity signature, timing offset, and carrier offset between the network signals and the co-channel interferers. In one embodiment, the co-channel interference excision is performed in an appliqué that can be implemented without coordination with a network transceiver.

Abstract: A processor performs, in accordance with a single instruction, multiplication processing and comparison processing. The multiplication processing includes obtaining a multiplication result by multiplying together a first data element and a first value. The comparison processing includes comparing the multiplication result with a second data element. The first data element is stored in a first register, the second data element is stored in a second register, and the first value is stored in a third register.

Abstract: A method for automatically splitting visual sensor data comprising consecutive images, the method being executed by at least one processor of a host computer, the method comprising: a) assigning a scene number to each image, wherein a scene comprises a plurality of images taken in a single environment, wherein assigning a scene number to each image is performed based on a comparison between consecutive images; b) determining an accumulated effort for the images in each scene, wherein the accumulated effort is determined based on the number of objects in the images of the scene, wherein the number of objects is determined using one or more neural networks for object detection; and c) creating packages of images, wherein the images with the same scene number are assigned to the same package unless the accumulated effort of the images in the package surpasses a package threshold.

Abstract: A method for identifying a data segment includes receiving a first data segment associated with a first recording time; receiving a second data segment associated with a second recording time, comparing: the first recording time with the second recording time, a first time reference value with a second time reference value, and a first length enumeration for first data packets with a second length enumeration for second data packets; determining, based on the comparing, a match between the first data segment and the second data segment; and identifying the first data segment as the same as the second data segment based on the determining.

Abstract: Systems and techniques are described herein for processing media content. For example, a process can include obtaining a first media frame and a second media frame. The process can include generating, using a first change detector, a first tag indicating a change above a first change threshold has occurred in the second media frame relative to the first media frame. The process can further include generating, using a machine learning model, a second tag indicating that media content of the second media frame is associated with a particular type of media content. The process can further include determining, based the first tag and the second tag, that the media content of the second media frame is associated with the particular type of media content.

Abstract: Systems, methods and computer readable mediums are presented for encoding a stream of input video frames, in which the input video frames are down sampled and the down sampled frames are encoded in a first encoding pass to generate a set of first pass coded frames forming a single first pass I frame and a plurality of first pass P frames formed into first pass sub-groups of pictures (SUB-GOPs). First pass encoding statistics are generated for individual first pass SUB-GOPs, and the statistics are used to encode the input video frames in a second encoding pass to generate a set of second pass coded frames.

Abstract: An image processing apparatus includes an acquisition unit, a setting unit, and a display unit. The acquisition unit is configured to acquire captured time-series images. The setting unit is configured to set a direction of measuring a flow quantity of targets in the time-series images. The display unit is configured to display information representing the flow quantity of the targets that is estimated based on a plurality of images acquired from the time-series images and the direction of measuring the flow quantity, together with information indicating the direction of measuring the flow quantity.

Abstract: Provided is an electronic device that implements image-capturing with a wide angle of view with a compact housing. An electronic device according to the present disclosure includes: a display unit (2) configured to be deformable; and at least one first imaging unit (3) arranged on an opposite side of a display surface of the display unit (2) and configured to image incident light transmitted through the display unit. The display unit (2) may be foldable. Furthermore, at least a part of the display unit (2) may be bendable. Moreover, in the first imaging unit (3), an optical system used for image-capturing may be switchable in accordance with a shape of the display unit (2).

Abstract: A method of substitutional neural residual compression is performed by at least one processor and includes estimating motion vectors, based on a current image frame and a previous reconstructed image frame, obtaining a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame, and subtracting the obtained predicted image frame from the current image frame to obtain a substitutional residual. The method further includes encoding the obtained substitutional residual, using a first neural network, to obtain an encoded representation, and compressing the encoded representation.

Abstract: An image capture device includes an image sensor and a processor. The image sensor is configured to capture a first plurality of frames, a second plurality of frames, and a third plurality of frames. The processor includes a first denoising layer and a second denoising layer. The first denoising layer includes a first denoiser, a second denoiser, and a third denoiser. The first denoiser is configured to denoise the first plurality of frames and output a first denoised frame. The second denoiser is configured to denoise the second plurality of frames and output a second denoised frame. The third denoiser is configured to denoise the third plurality of frames and output a third denoised frame. The second denoising layer includes a fourth denoiser. The fourth denoiser is configured to output a denoised frame based on the first denoised frame, the second denoised frame, and the third denoised frame.

Abstract: An adaptive screen encoding method comprising: using a computer, creating and storing, in computer memory, a plurality of conditions for use by a server configured to determine which of picture coding type to select; detecting a current picture by a sender for a content type including textual content, graphical content, and natural image content; determining a percentage of static macroblocks corresponding to the current picture; selecting the picture coding type based on the content type, the plurality of conditions, and the percentage of static macroblocks, wherein the method is performed by one or more special-purpose computing devices.

Abstract: A patient monitoring system includes a first imager configured to capture first image data of a target area within a first field of view. A second imager is configured to capture second image data of the target area within a second field of view. An emitter is configured to emit light within a predetermined wavelength range. A controller is configured to determine a facial region of a person in the first image data, determine a region of interest in the second image data that coincides with the facial region in the first image data, calculate a pixel value within the region of interest, adjust at least one of the emitter and the second imager is the pixel value is outside a predetermined pixel value range, and determine vital signs information from at least one of the first image data and the second image data.

Abstract: An image decoding device including an intra prediction unit for, when a coding mode for a coding block is an intra coding mode, carrying out an intra-frame prediction process on each of processing blocks to generate a prediction image, each of the processing blocks being the coding block or a sub-block obtained by dividing the coding block, wherein, when an intra prediction parameter indicates a vertical prediction process and a size of the processing block is less than a predetermined size, the intra prediction unit performs a specific processing and when the intra prediction parameter indicates the vertical prediction process and the size of the processing block is greater than or equal to the predetermined size, the intra prediction unit performs a specific processing.

Abstract: An example apparatus for encoding video frames includes a frame analyzer to execute a look ahead analysis on a received set of frames. The frame analyzer includes a look ahead video analyzer to down-sample the set of frames and encode the down-sampled frames with a constant quantization parameter (QP). A number of generated bits for each of the frames is used as a complexity measurement for each of the frames. The apparatus further includes an encoder to encode the input frame using an adjusted bit allocation based on a relative complexity of the input frame in relation to a complexity of the set of frames.

Abstract: A method, apparatus, and computer program product provide for compression of volumetric video in a manner that is more efficient and requires less metadata updates. A method can include converting a volumetric video scene into a canonical representation comprising a plurality of frames comprising a video atlas and corresponding metadata. Each frame can be divided into a plurality of tiles based on different tile characteristics, which can be used to analyze and characterize the different tiles for atlas packing purposes. Tiles can be clipped or merged or otherwise edited in the atlas. Tiles can be decomposed to metadata suitable for later rendering of the tile. Tiles having a similar enough color attribute or depth attribute during the entire group of photos can be rendered as a single instance, clipped entirely, and rendered based upon a reference tile and the stored metadata.

Abstract: An embodiment combines the concepts of image enhancement and voice-sound command and control to enhance the experience of viewing images by tracking where the viewer is indicating with his/her voice. The result is to make the viewing experience more like viewing the original scene, or to enhance the viewing experience in new ways beyond the original experience, either automatically, or by interacting with a photographer's previously specified intentions for what should happen when the viewer identifies, with his/her voice sounds, including, but not limited to, words, voice tone, voice inflection, voice pitch, or voice loudness, a particular portion of an image or images taken by that photographer.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for utilizing a critical edge detection neural network and a geometric model to determine camera parameters from a single digital image. In particular, in one or more embodiments, the disclosed systems can train and utilize a critical edge detection neural network to generate a vanishing edge map indicating vanishing lines from the digital image. The system can then utilize the vanishing edge map to more accurately and efficiently determine camera parameters by applying a geometric model to the vanishing edge map. Further, the system can generate ground truth vanishing line data from a set of training digital images for training the critical edge detection neural network.

Abstract: The disclosure relates to a method of processing a sequence of image frames to reduce its length. One implementation may involve extracting coefficients (e.g., Discrete Cosine Transform coefficients) from components of individual frames, and comparing the resulting coefficients for sequential frames to identify frames having the least change from a prior frame. Also, scene change values for each frame may be calculated and placed in a sorted list to facilitate identification of frames for removal. Frame removal may be conducted in rounds, where a group of pictures (GOP) may only have one frame removed for any given round.

Abstract: Provided are a transition type determination method, an electronic device and a storage medium. The method includes: acquiring a picture matching degree of a candidate transition type with a transition position between two adjacent video clips, and acquiring a music matching degree of the candidate transition type; determining, based on the acquired image matching degree and the acquired music matching degree, a matching degree of the candidate transition type at the transition position; and determining, according to the matching degree, whether to determine the candidate transition type as a target transition type, where the target transition type is used for a transition effect between the two adjacent video clip.

Abstract: Systems, methods and non-transitory computer readable media for generating looped video clips are provided. A still image may be received. The still image may be analyzed to generate a series of images. The series of images may include at least first, middle and last images. The first image may be substantially visually similar to the last image, and the middle image may be visually different from the first and last images. The series of images may be provided. Playing the series of images in a video clip that starts with the first image and finishes with the last image, and repeating the video clip from the first image immediately after completing the playing of the video clip with the last image may create visually smooth transaction in which the transition from the last image to the first image is visually indistinguishable from the transactions between frames within the video clip.

Abstract: A method is provided to better detect a scene change to provide a prediction to an encoder to enable more efficient encoding. The method uses a Motion Compensated Temporal Filter (MCTF) that provides motion estimation and is located prior to an encoder. The MCTF provides a Motion Compensated Residual (MCR) used to detect the scene change transition. When a scene is relatively stable, the MCR score is also relatively stable. However, when a scene transition is in process, the MCR score behavior changes, Algorithmically, the MCR score is used by comparing the sliding mean of the MCR score to the sliding median. This comparison highlights the transition points. In the case of a scene cut, the MCR score exhibits a distinct spike. In the case of a fade or dissolve, the MCR score exhibits a transitional period of degradation followed by recovery. By implementing the above detection using the MCR, the location of the I-pictures in the downstream encoding process can be accurately determined for the encoder.

Abstract: Embodiments provide a computer-implemented method for rendering advertisements in a Mixed Reality space, including: profiling a plurality of users in a smart home sharing the MR space; building a social network graph between the plurality of users; building a user embedding matrix based on the social network graph; recommending a plurality of first advertisements for one or more target users; building a joint embedding matrix across the plurality of users and the plurality of first advertisements; identifying a particular position and a particular time period for the one or more target user, while the remaining users are not viewing the particular position during the particular time period; selecting one or more advertisements from the plurality of first advertisements based on the joint embedding matrix; and rendering the one or more advertisements to the one or more target users at the particular position during the particular time period.

Abstract: Disclosed are a method and apparatus for summarization of unsupervised video with efficient key frame selection reward functions. Frame-level visual features are extracted from an input video. An attention weight is computed and an importance score is represented as a frame tracking probability for selecting a key frame using the attention weight. A temporal consistency reward function and a representativeness reward function are obtained so as to select the key frame, based on a visual similarity distance and temporal distance between key frames, and an attention-based video summarization network is trained to predict an importance score for selecting a key frame of a video summary by using the temporal consistency reward function and the representativeness reward function.

Abstract: A system including a scene detection engine (SDE) and a method for automatically detecting and marking logical scenes in media content using artificial intelligence are provided. The SDE detects boundaries of shots in media content. The SDE generates an image similarity matrix by extracting color features from a middle frame of each shot. The SDE generates an audio similarity matrix by extracting audio features of each shot. The SDE generates a resultant similarity matrix from the image and audio similarity matrices. The SDE executes a clustering algorithm using the resultant similarity matrix with reduced or no noise to generate an ordered sequence of shots that define a boundary of each scene of the media content. The SDE executes a linear traversal algorithm on the shots that define the boundary of each scene for correcting errors in the defined boundary of each scene.

Abstract: The present invention relates to a technical field of user interface display, and in particular to a method, system, and device for adaptive configuration of a user interface, and a medium. The method of the present invention includes: respectively making a correspondence between one or more user interface components and one area of a plurality of areas of a panel; performing a stretching operation on the plurality of areas and the one or more user interface components, and performing a moving operation on the plurality of areas, to generate an adaptive panel and one or more adaptive user interface components adapted to user equipment; and respectively placing the one or more adaptive user interface components in corresponding areas of the adaptive panel to generate an adaptive user interface. The present invention simplifies design steps of user interface, enhances operability, and implements adaptive configuration of the user interface.

Abstract: Example methods and apparatus disclosed herein detect advertisements embedded in online media. An example apparatus includes memory, computer readable instructions, and processor circuitry to execute the computer readable instructions to render a graphical representation of progress associated with presentation of primary media distributed by an online media provider to a consumer device, the primary media including an event notification, the graphical representation to have a length and to depict the event notification at a location on the graphical representation. The example apparatus also includes processor circuitry to execute the computer readable instructions to determine a first time associated with the event notification based on the length of the graphical representation and the location of the event notification and determine a second time associated with a media feature of the primary media.

Abstract: An embodiment of an image processor for immersive video includes technology to re-order patches from a plurality of views based on one or more of relative position and orientation related information for a desired synthesized view, select a set of views to be used in each view synthesis pass, perform two or more view synthesis passes for the synthesized view to provide two or more intermediate view synthesis results, and mask and merge the two or more intermediate view synthesis results to provide a final view synthesis result. Other embodiments are disclosed and claimed.

Abstract: A method of enrichment of at least one source multimedia content for rendering on a device is disclosed. A rendering zone has a width/height ratio different from the width/height ratio of the source multimedia content. In one aspect, the method comprises identifying, from the source multimedia content, of at least one enrichment content intended to be rendered in a region of the rendering zone distinct from a region for rendering the source multimedia content. And these enriching the source multimedia content, taking into account of the at least one identified enrichment content and delivering at least one enriched multimedia content comprising at least one piece of enrichment data representative of a rendering of the enrichment content in a region of the rendering zone distinct from a region for rendering the source multimedia content.

Abstract: A system includes an image sensor, an imaging pipeline, and a display device. The image sensor is configured to capture a first frame of pixel data. The imaging pipeline is coupled to the image sensor to receive the first frame of pixel data. The imaging pipeline includes an adaptive noise filter. The adaptive noise filter is configured to filter a pixel based on noise in the pixel. The imaging pipeline is configured to output a second frame of pixel data. The second frame of pixel data includes pixels filtered by the adaptive noise filter. The display device is coupled to the imaging pipeline to receive the second frame of pixel data. The display device is configured to display the second frame of pixel data.

Abstract: Scene changes should be done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers, and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 80 frames.

Abstract: A system may be configured to perform object counting in high volume traffic. In some aspects, the system may determine object detection information defining an absence of an object within the region of interest in a current video frame, and determine that a location associated with the object is within a placeholder-eligible area within the region of interest based on first tracker information determined in a previous video frame. Further, the system may determine second tracker information including a bounding representation for the object based at least in part on the location and object detection information, and determine, based on the second tracker information, an object count representing a number of the objects that have entered the region of interest and/or a number of the objects that have exited the region of interest.

Abstract: An e-commerce system and method for presenting product information to a viewer, where a video feed and product information associated with a product that relates to the content in the video feed can be displayed or presented to the viewer on one or more remote display devices.

Abstract: A video signal processing device includes: a video signal dividing unit configured to divide a video signal into first to k-th (k is an integer of 2 or greater) partial video signals for each frame; a video change detection unit configured to determine, for each of the first to k-th partial video signals, whether or not a video based on the partial video signals has changed between respective frames, and generate first to k-th video change detection signals representing the respective detection results; and a video sameness determination unit configured to generate a video sameness signal indicating that the video signal has not changed, if the number of video change detection signals that indicate the video has not changed, among the first to k-th video change detection signals, is greater than a prescribed number.

Abstract: A processor may receive a media frame collection. The media frame collection may include two or more frames. The processor may identify, from the media frame collection, a location of an entity. The processor may determine whether the location of the entity is within a threshold location in regard to the other two or more frames in the media frame collection. The processor may display the one or more frames that exceed the threshold location to a user.

Abstract: Described are methods, systems, and computer-readable media to automatically crop videos using personalized parameters. Some implementations include a computer-implemented method that comprises obtaining an input video, determining a per-frame crop score for one or more candidate crop regions in each frame of the input video, generating a face signal for the one or more candidate crop regions, adjusting each per-frame crop score based on the face signal, determining a minimal cost path that represents crop region locations based on motion cost and the adjusted per-frame crop score, generating crop keyframing corresponding to the crop region locations along the minimal cost path, wherein the crop keyframing includes a start frame, an end frame, and crop region location, and outputting a modified video that has one or more of an output aspect ratio or an output orientation that is different than a corresponding aspect ratio or an orientation of the input video.

Abstract: System and method of analyzing a video, comprising dividing the video into a set of successive basic units; generating semantic tags for the basic units using a set of hierarchical classifier nodes that comprise a parent classifier node and a plurality of child classifier nodes, wherein the basic units are each routed through selected child classifier nodes based on classification of the basic units by the parent classifier node; and generating a semantic topic for the video based on the semantic tags generated for the basic units.

Abstract: A method and device for communicating video for synchronization between a portable wearable camera and a wireless hub device are described. The portable wearable camera may capture first video data. Also, the portable wearable camera may transmit the first video data to the wireless hub device via a first wireless connection, and may capture second video data. When the first wireless connection between the wearable camera and the wireless hub device is unable to support full resolution video playback, the portable wearable camera may store the second video data. Further, the portable wearable camera may receive a request from the wireless hub device for the second video data via a second wireless connection, and may capture third video data. Further, the portable wearable camera may transmit, to the wireless hub device, the third video data via the first wireless connection and the second video data via the second wireless connection.

Abstract: Embodiments of the present disclosure disclose a method and apparatus for searching a video segment, a device and a medium, and relate to the field of video data search. The method includes: sampling video frames from a target video and videos to be searched in a video library, and extracting features from the sampled frames; matching the target video and the videos to be searched according to the extracted features to determine a candidate video to be searched that matches the target video; determining at least one candidate video segment from the determined candidate video, and calculating a degree of matching between the target video and each candidate video segment based on the extracted features of each sampled frame; and determining a video segment matching the target video in the videos to be searched according to the calculated degree of matching between the target video and each candidate video segment.

Abstract: Aspects of the disclosure provide for a method. In some examples, the method includes receiving a video stream comprising multiple frames, analyzing the video stream to compare data values representing an image pixel at a specified location in a first of the frames to data values representing an image pixel at the specified location in a second of the frames, determining that the video stream is frozen responsive to the data values representing the image pixel at the specified location in the first of the frames being the same as the data values representing the image pixel at the specified location in the second of the frames, and taking action responsive to determining that the video stream is frozen.

Abstract: A method for detecting a human skeleton is provided. The method includes: receiving a video frame, wherein the video frame comprises a human body; determining whether the video frame comprises prediction information; determining whether a first intra-coded macroblock (IMB) ratio of a target area comprising the human body in the video frame is greater than a first threshold when the video frame comprises the prediction information; and using a motion vector (MV) to estimate skeleton information of the human body when the first IMB ratio of the target area is not greater than the first threshold.

Abstract: A laser beam spot shape correcting method includes a laser beam irradiating step of irradiating a concave mirror with a laser beam, an imaging step of imaging reflected light by a beam profiler, an image forming step of forming an XZ plane image or a YZ plane image from an XY plane image imaged in the imaging step, and a comparing step of comparing the image formed in the image forming step with an XZ plane image or a YZ plane image of an ideal laser beam. A phase pattern displayed on a display unit of a spatial light modulator is changed such that the XZ plane image or the YZ plane image formed in the image forming step coincides with the XZ plane image or the YZ plane image of the ideal laser beam.

Abstract: A system for separating audio based on sound producing objects includes a processor configured to receive video data and audio data. The processor is also configured to perform object detection using the video data to identify a number of sound producing objects in the video data and predict a separation for each sound producing object detected in the video data. The processor is also configured to generate separated audio data for each sound producing object using the separation and the audio data.

Abstract: Systems, methods, and storage media for processing digital video are disclosed. Exemplary implementations may: receive digital video data at one or more digital video inputs; identify each of the plurality of video frames as one of a keyframe and an intermediate frame; use one or more first sets of software instructions to send at least one of the keyframes and the intermediate frames to one or more processing scripts; use the one or more processing scripts to implement an asynchronous batch processing system on at least one of the keyframes and the intermediate frames by applying one or more second sets of software instructions; and receive an output from the one or more second sets of software instructions.

Abstract: A de-interlacing processing method, a de-interlacing processing device and a computer-readable storage medium are provided. The method includes acquiring image content characteristic information of a pixel point to be interpolated; and determining according to the image content characteristic information whether a de-interlacing algorithm based on motion adaptive or a de-interlacing algorithm based on motion compensation is adopted to perform de-interlacing processing.

Abstract: Methods and apparatus to detect commercial advertisements associated with media presentations are disclosed. An example method involves receiving a video frame and detecting a change in box-formatting between the video frame and a subsequent video frame. A transition between the video frame and the subsequent video frame is indicated as a commercial advertisement transition based on the detected change in box-formatting.

Abstract: Ad break boundaries, which identify start and end points of a commercial break, are identified by detecting the absence of voices and/or facial images of one or more primary cast members of a currently scheduled program.

Abstract: The present disclosure provides a method for extracting a face detection image, wherein the method includes: obtaining a plurality of image frames by an image detector, performing a face detection process on each image frame to extract a face area, performing a clarity analysis on the face area of each image frame to obtain a clarity degree of a face, conducting a posture analysis on the face area of each image frame to obtain a face posture angle, generating a comprehensive evaluation index for each image frame in accordance with the clarity degree of the face and the face posture angle of each image frame, and selecting a key frame from the image frames based on the comprehensive evaluation index. Such that the resource occupancy rate during image data processing may be reduced, and the quality of the face detection process may be improved.

Abstract: Some embodiments relate to a system and method to increase the speed of a computer determination whether a video contains a particular content. In some embodiments, the quantity of data in the video is first reduced while preserving the searched-for content. Optionally, first, the size of the data is reduced by reducing the resolution, for example resolution may be reduced without searching and/or processing the full data set. Additionally or alternatively, low quality and/or empty data is removed from the dataset. Additionally or alternatively, redundant data may be searched out and/or removed. Optionally, after data reduction, the reduced dataset is analyzed to determine if it contains the searched-for content. Optionally, an estimate is made of the probability of the full dataset containing the searched-for content.

Abstract: Provided is a system for editing video contents automatically, the system including an input interface module configured to receive a user input; a video sequence setting module configured to define a set of consecutive frames of original video content as a single original video sequence in response to receiving a video edit activation input from the input interface nodule, and to divide the original video content into a first original video sequence to an n-th original video sequence, n denoting an integer greater than or equal to 2; a video sequence shuffling module configured to create shuffled video content by randomly shuffling a subset video sequence including at least a portion of a k-th original video sequence to follow after a (k+1)-th original video sequence or to precede a (k?1)-th original video sequence, k denoting an integer greater than or equal to 1 and less than or equal to n?1; and a shuffled video content storage module configured to store sequence arrangement information that is informatio