Abstract: A pixel is appropriately interpolated regarding a histogram image in which a distance histogram is allocated to each pixel position. A signal processing apparatus according to the present technology includes a histogram generation unit that inputs a histogram image in which a distance histogram indicating results of a plurality of times of distance measurement as frequency information for each distance is allocated to each pixel position and generates a distance histogram of an interpolation target position in the histogram image on the basis of distance histograms of a plurality of pixel positions near the interpolation target position.

Abstract: A device includes a memory and one or more processors. The memory is configured to store an image enhancement network of an image enhancer. The one or more processors are configured to predict an image compression quality of an image of a stream of images. The one or more processors are also configured to configure the image enhancer based on the image compression quality. The one or more processors are further configured to process, using the image enhancement network of the configured image enhancer, the image to generate an enhanced image.

Abstract: An object tracking apparatus (2000) detects an object from video data (12) and performs tracking processing of the detected object. The object tracking apparatus (2000) detects that a predetermined condition is satisfied for a first object (20) and a second object (30), using the video data (12). Thereafter, the object tracking apparatus (2000) performs tracking processing of the second object (30) in association with the first object (20).

Abstract: Metadata for one or more highlights of a video stream may be extracted from one or more card images embedded in the video stream. The highlights may be segments of the video stream, such as a broadcast of a sporting event, that are of particular interest. According to one method, video frames of the video stream are stored. One or more information cards embedded in a decoded video frame may be detected by analyzing one or more predetermined video frame regions. Image segmentation, edge detection, and/or closed contour identification may then be performed on identified video frame region(s). Further processing may include obtaining a minimum rectangular perimeter area enclosing all remaining segments, which may then be further processed to determine precise boundaries of information card(s). The card image(s) may be analyzed to obtain metadata, which may be stored in association with at least one of the video frames.

Abstract: A method for specifying layout of subpictures in video pictures is provided. A video decoder receives data from a bitstream to be decoded as a current picture of a video. For a current subpicture of a set of subpictures of the current picture, the video decoder determines a position of the current subpicture based on a width and a height of the current picture and a previously determined width and height of a particular subpicture in the set of subpictures. The video decoder reconstructs the current picture and the current subpicture based on the determined position.

Abstract: A method and device for communicating video for synchronization between a portable wearable camera and a wireless hub device are described. The portable wearable camera may capture first video data. Also, the portable wearable camera may transmit the first video data to the wireless hub device via a video data channel, and may capture second video data. When the video data channel between the wearable camera and the wireless hub device is unable to support full resolution video playback, the portable wearable camera may store the second video data. Further, the portable wearable camera may receive a request via a control channel, from the wireless hub device, for the second video data, and may capture third video data. Further, the portable wearable camera may transmit, to the wireless hub device, the third video data via the video data channel and the second video data via the control channel.

Abstract: A video editing method applied to an electronic device is provided. The electronic device includes a processor and a human-machine interface, the processor is configured to execute a program to generate video data, and the human-machine interface is configured to receive an input signal. The video editing method includes: obtaining the video data; monitoring the input signal; setting an editing condition; and recording the video data to generate a video clip when the input signal meets the editing condition. A video editing system is further provided.

Abstract: The present disclosure generally relates to user interfaces related to sources of video data. User interfaces enables users to configure and interact with the sources of video data, such as for displaying a live video feed and a recorded video from an external source of video data. In some embodiments, a device provides user interfaces for displaying video from a video source and controlling external devices related to the source.

Abstract: Techniques for a dynamic encoder-time scaling service for live and on-demand adaptive streaming are described. As one example, a computer-implemented method includes determining a first resolution for a first fragment of a video file based on a first encoding complexity of the first fragment at a bitrate, encoding the first fragment at the first resolution for the bitrate to generate an encoded first fragment, determining a second different resolution for a second fragment of the video file based on a second different encoding complexity of the second fragment at the bitrate, encoding the second fragment at the second different resolution for the bitrate to generate an encoded second fragment, receiving a request for a manifest for the video file from a client device, generating the manifest for the client device that identifies a single video representation for the bitrate that comprises the encoded first fragment and the encoded second fragment, and sending the manifest to the client device.

Abstract: Decoding methods and encoding methods based on an adaptive intra refresh mechanism and related devices are provided. In one aspect, a decoding method includes: receiving a bit stream of a current frame; and determining whether the current frame supports an adaptive intra refresh technology. The determining comprises one of: if there is extension data in the bit stream of the current frame and the extension data carries an adaptive intra refresh video extension identifier (ID), obtaining virtual boundary position information carried in the extension data, and determining whether the current frame supports an adaptive intra refresh technology based on the virtual boundary position information; or if there is no adaptive intra refresh video extension ID in the extension data in the bit stream of the current frame, determining that the current frame does not support the adaptive intra refresh technology.

Abstract: A video recording method applied to an electronic device is provided. The electronic device includes a processor configured to execute a program to generate video data. The video recording method includes: monitoring an operating parameter of the processor; setting a first condition; and starting obtaining the video data when the operating parameter meets the first condition. A video recording system is also provided.

Abstract: An electronic device is provided. The electronic device includes a communication circuit, and at least one processor operatively connected to the communication circuit, wherein the at least one processor is configured to establish, via the communication circuit, a communication connection with a display device, identify channel information about a first channel on which the communication connection is established, identify image information about an image displayed in the display device, and based on the channel information about the first channel and the image information, identify whether the electronic device is capable of transmitting a data frame each communication cycle which corresponds to a frame rate provided in the display device.

Abstract: An object tracking system that includes a sensor that is configured to capture frames of at least a portion of a global plane for a space. The system is configured to receive a first frame from the sensor. The first frame includes a region-of-interest (ROI) marker within the space. The system is further configured to identify pixel locations within the first frame corresponding with the ROI marker and to define a zone for subsequent frames from the sensor corresponding with the pixel locations. The system is further configured to receive a second frame from the sensor, to detect an object within the zone, and to identify the object. The system is further configured to determine a person is within the second frame and to modify a digital cart that is associated with the person based on the identified object.

Abstract: A method of compressing image data representing one or more images, the method including obtaining pixel data from the image data, the pixel data representing an pixel array within the one or more images, applying a transformation to the pixel data to determine a set of frequency coefficients indicative of frequency coefficients of the pixel array, encoding a selected subset of the set of frequency coefficients, generating an index indicative of the encoded frequency coefficients and generating compressed image data using the encoded frequency coefficients and the index.

Abstract: Methods and apparatus, including computer program products, for processing a stream of image frames captured by a camera system. When an image frame from the stream of image frames is dropped, a current camera movement is determined. A substitute image frame for the dropped image frame is generated. The substitute image frame comprises a reference to a previous image frame and includes one or more motion vectors estimated solely based on the determined current camera movement. Remaining image frames in the stream of image frames are encoded and the substitute image frame is inserted at the place of the dropped image frame in the stream of encoded image frames.

Abstract: A method for whole-process trace leaving of video manuscript gathering, editing, and check, including: extracting a key frame from video clipping information, generating histogram data by using the key frame, and obtaining video modification information based on the histogram data; and on-chaining, by using timestamps as blockchain nodes, the video modification information completed at different time points to form a trace chain arranged according to the timestamp, to implement whole-process trace leaving for video clipping. The technical solutions of the present invention resolve a difficulty in whole-process trace leaving for video manuscript editing and issuing, and in addition, by using the blockchain techniques, implement tamper-proofing and security of trace information, thereby effectively improving security of gathering and editing in the media industry.

Abstract: A method and an apparatus for detecting a region of interest (ROI), an electronic device, and a readable storage medium are provided. In the method for detecting a ROI, a target video frame image is divided into a plurality of image blocks and chrominance components of pixels of each image block are acquired. A ROI of the target video frame image is detected by determining a region type of each image block according to a ratio of pixels in an image block meeting a preset chrominance condition to pixels of the image block.

Abstract: Machine natural language processing to analyze language in apparatus, systems, and methods of using are provided. Audio from camera footage can be transcribed in one exemplary method includes extracting at least one audio segment from a body camera video track, detecting voice activity to identify starting and ending timestamps of voice, transcribing the at least one audio segment to identify and separate audio of at least a first speaker, and scoring the audio of the first speaker to identify interactions of interest. Audio could be analyzed and scored to record verbal performance, respectfulness, wellness, etc. and speakers from the audio can be detected.

Abstract: An image decoding method according to the present invention may comprise: determining a division type of a coding block; on the basis of the determined division type, dividing the coding block into a first prediction unit and a second prediction unit; deriving movement information of each of the first prediction unit and the second prediction unit; and on the basis of the derived movement information, acquiring prediction samples for the first prediction unit and the second prediction unit.

Abstract: A video edit may include two videos arranged in a sequence. Motion within the one or both of the videos may be assessed. A transition effect may be selected based on the motion assessed within the video(s), and the video edit may be modified to include the transition effect between the videos. The transition effect may emphasize the motion assessed within the video(s) and/or create continuity of motion during transition between the two videos within the video edit.

Abstract: An apparatus and digital signal processing means are disclosed for excision of co-channel interference from signals received in crowded or hostile environments using spatial/polarization diverse arrays, which reliably and rapidly identifies communication signals with transmitted features that are self-coherent over known framing intervals due to known attributes of the communication network, and exploits those features to develop diversity combining weights that substantively excise that co-channel interference from those communication signals, based on differing diversity signature, timing offset, and carrier offset between the network signals and the co-channel interferers. In one embodiment, the co-channel interference excision is performed in an appliqué that can be implemented without coordination with a network transceiver.

Abstract: A processor performs, in accordance with a single instruction, multiplication processing and comparison processing. The multiplication processing includes obtaining a multiplication result by multiplying together a first data element and a first value. The comparison processing includes comparing the multiplication result with a second data element. The first data element is stored in a first register, the second data element is stored in a second register, and the first value is stored in a third register.

Abstract: A method for identifying a data segment includes receiving a first data segment associated with a first recording time; receiving a second data segment associated with a second recording time, comparing: the first recording time with the second recording time, a first time reference value with a second time reference value, and a first length enumeration for first data packets with a second length enumeration for second data packets; determining, based on the comparing, a match between the first data segment and the second data segment; and identifying the first data segment as the same as the second data segment based on the determining.

Abstract: A method for automatically splitting visual sensor data comprising consecutive images, the method being executed by at least one processor of a host computer, the method comprising: a) assigning a scene number to each image, wherein a scene comprises a plurality of images taken in a single environment, wherein assigning a scene number to each image is performed based on a comparison between consecutive images; b) determining an accumulated effort for the images in each scene, wherein the accumulated effort is determined based on the number of objects in the images of the scene, wherein the number of objects is determined using one or more neural networks for object detection; and c) creating packages of images, wherein the images with the same scene number are assigned to the same package unless the accumulated effort of the images in the package surpasses a package threshold.

Abstract: Systems, methods and computer readable mediums are presented for encoding a stream of input video frames, in which the input video frames are down sampled and the down sampled frames are encoded in a first encoding pass to generate a set of first pass coded frames forming a single first pass I frame and a plurality of first pass P frames formed into first pass sub-groups of pictures (SUB-GOPs). First pass encoding statistics are generated for individual first pass SUB-GOPs, and the statistics are used to encode the input video frames in a second encoding pass to generate a set of second pass coded frames.

Abstract: Systems and techniques are described herein for processing media content. For example, a process can include obtaining a first media frame and a second media frame. The process can include generating, using a first change detector, a first tag indicating a change above a first change threshold has occurred in the second media frame relative to the first media frame. The process can further include generating, using a machine learning model, a second tag indicating that media content of the second media frame is associated with a particular type of media content. The process can further include determining, based the first tag and the second tag, that the media content of the second media frame is associated with the particular type of media content.

Abstract: Provided is an electronic device that implements image-capturing with a wide angle of view with a compact housing. An electronic device according to the present disclosure includes: a display unit (2) configured to be deformable; and at least one first imaging unit (3) arranged on an opposite side of a display surface of the display unit (2) and configured to image incident light transmitted through the display unit. The display unit (2) may be foldable. Furthermore, at least a part of the display unit (2) may be bendable. Moreover, in the first imaging unit (3), an optical system used for image-capturing may be switchable in accordance with a shape of the display unit (2).

Abstract: An image processing apparatus includes an acquisition unit, a setting unit, and a display unit. The acquisition unit is configured to acquire captured time-series images. The setting unit is configured to set a direction of measuring a flow quantity of targets in the time-series images. The display unit is configured to display information representing the flow quantity of the targets that is estimated based on a plurality of images acquired from the time-series images and the direction of measuring the flow quantity, together with information indicating the direction of measuring the flow quantity.

Abstract: A method of substitutional neural residual compression is performed by at least one processor and includes estimating motion vectors, based on a current image frame and a previous reconstructed image frame, obtaining a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame, and subtracting the obtained predicted image frame from the current image frame to obtain a substitutional residual. The method further includes encoding the obtained substitutional residual, using a first neural network, to obtain an encoded representation, and compressing the encoded representation.

Abstract: An image capture device includes an image sensor and a processor. The image sensor is configured to capture a first plurality of frames, a second plurality of frames, and a third plurality of frames. The processor includes a first denoising layer and a second denoising layer. The first denoising layer includes a first denoiser, a second denoiser, and a third denoiser. The first denoiser is configured to denoise the first plurality of frames and output a first denoised frame. The second denoiser is configured to denoise the second plurality of frames and output a second denoised frame. The third denoiser is configured to denoise the third plurality of frames and output a third denoised frame. The second denoising layer includes a fourth denoiser. The fourth denoiser is configured to output a denoised frame based on the first denoised frame, the second denoised frame, and the third denoised frame.

Abstract: An adaptive screen encoding method comprising: using a computer, creating and storing, in computer memory, a plurality of conditions for use by a server configured to determine which of picture coding type to select; detecting a current picture by a sender for a content type including textual content, graphical content, and natural image content; determining a percentage of static macroblocks corresponding to the current picture; selecting the picture coding type based on the content type, the plurality of conditions, and the percentage of static macroblocks, wherein the method is performed by one or more special-purpose computing devices.

Abstract: A patient monitoring system includes a first imager configured to capture first image data of a target area within a first field of view. A second imager is configured to capture second image data of the target area within a second field of view. An emitter is configured to emit light within a predetermined wavelength range. A controller is configured to determine a facial region of a person in the first image data, determine a region of interest in the second image data that coincides with the facial region in the first image data, calculate a pixel value within the region of interest, adjust at least one of the emitter and the second imager is the pixel value is outside a predetermined pixel value range, and determine vital signs information from at least one of the first image data and the second image data.

Abstract: An image decoding device including an intra prediction unit for, when a coding mode for a coding block is an intra coding mode, carrying out an intra-frame prediction process on each of processing blocks to generate a prediction image, each of the processing blocks being the coding block or a sub-block obtained by dividing the coding block, wherein, when an intra prediction parameter indicates a vertical prediction process and a size of the processing block is less than a predetermined size, the intra prediction unit performs a specific processing and when the intra prediction parameter indicates the vertical prediction process and the size of the processing block is greater than or equal to the predetermined size, the intra prediction unit performs a specific processing.

Abstract: An example apparatus for encoding video frames includes a frame analyzer to execute a look ahead analysis on a received set of frames. The frame analyzer includes a look ahead video analyzer to down-sample the set of frames and encode the down-sampled frames with a constant quantization parameter (QP). A number of generated bits for each of the frames is used as a complexity measurement for each of the frames. The apparatus further includes an encoder to encode the input frame using an adjusted bit allocation based on a relative complexity of the input frame in relation to a complexity of the set of frames.

Abstract: A method, apparatus, and computer program product provide for compression of volumetric video in a manner that is more efficient and requires less metadata updates. A method can include converting a volumetric video scene into a canonical representation comprising a plurality of frames comprising a video atlas and corresponding metadata. Each frame can be divided into a plurality of tiles based on different tile characteristics, which can be used to analyze and characterize the different tiles for atlas packing purposes. Tiles can be clipped or merged or otherwise edited in the atlas. Tiles can be decomposed to metadata suitable for later rendering of the tile. Tiles having a similar enough color attribute or depth attribute during the entire group of photos can be rendered as a single instance, clipped entirely, and rendered based upon a reference tile and the stored metadata.

Abstract: An embodiment combines the concepts of image enhancement and voice-sound command and control to enhance the experience of viewing images by tracking where the viewer is indicating with his/her voice. The result is to make the viewing experience more like viewing the original scene, or to enhance the viewing experience in new ways beyond the original experience, either automatically, or by interacting with a photographer's previously specified intentions for what should happen when the viewer identifies, with his/her voice sounds, including, but not limited to, words, voice tone, voice inflection, voice pitch, or voice loudness, a particular portion of an image or images taken by that photographer.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for utilizing a critical edge detection neural network and a geometric model to determine camera parameters from a single digital image. In particular, in one or more embodiments, the disclosed systems can train and utilize a critical edge detection neural network to generate a vanishing edge map indicating vanishing lines from the digital image. The system can then utilize the vanishing edge map to more accurately and efficiently determine camera parameters by applying a geometric model to the vanishing edge map. Further, the system can generate ground truth vanishing line data from a set of training digital images for training the critical edge detection neural network.

Abstract: The disclosure relates to a method of processing a sequence of image frames to reduce its length. One implementation may involve extracting coefficients (e.g., Discrete Cosine Transform coefficients) from components of individual frames, and comparing the resulting coefficients for sequential frames to identify frames having the least change from a prior frame. Also, scene change values for each frame may be calculated and placed in a sorted list to facilitate identification of frames for removal. Frame removal may be conducted in rounds, where a group of pictures (GOP) may only have one frame removed for any given round.

Abstract: Provided are a transition type determination method, an electronic device and a storage medium. The method includes: acquiring a picture matching degree of a candidate transition type with a transition position between two adjacent video clips, and acquiring a music matching degree of the candidate transition type; determining, based on the acquired image matching degree and the acquired music matching degree, a matching degree of the candidate transition type at the transition position; and determining, according to the matching degree, whether to determine the candidate transition type as a target transition type, where the target transition type is used for a transition effect between the two adjacent video clip.

Abstract: Systems, methods and non-transitory computer readable media for generating looped video clips are provided. A still image may be received. The still image may be analyzed to generate a series of images. The series of images may include at least first, middle and last images. The first image may be substantially visually similar to the last image, and the middle image may be visually different from the first and last images. The series of images may be provided. Playing the series of images in a video clip that starts with the first image and finishes with the last image, and repeating the video clip from the first image immediately after completing the playing of the video clip with the last image may create visually smooth transaction in which the transition from the last image to the first image is visually indistinguishable from the transactions between frames within the video clip.

Abstract: A system including a scene detection engine (SDE) and a method for automatically detecting and marking logical scenes in media content using artificial intelligence are provided. The SDE detects boundaries of shots in media content. The SDE generates an image similarity matrix by extracting color features from a middle frame of each shot. The SDE generates an audio similarity matrix by extracting audio features of each shot. The SDE generates a resultant similarity matrix from the image and audio similarity matrices. The SDE executes a clustering algorithm using the resultant similarity matrix with reduced or no noise to generate an ordered sequence of shots that define a boundary of each scene of the media content. The SDE executes a linear traversal algorithm on the shots that define the boundary of each scene for correcting errors in the defined boundary of each scene.

Abstract: Disclosed are a method and apparatus for summarization of unsupervised video with efficient key frame selection reward functions. Frame-level visual features are extracted from an input video. An attention weight is computed and an importance score is represented as a frame tracking probability for selecting a key frame using the attention weight. A temporal consistency reward function and a representativeness reward function are obtained so as to select the key frame, based on a visual similarity distance and temporal distance between key frames, and an attention-based video summarization network is trained to predict an importance score for selecting a key frame of a video summary by using the temporal consistency reward function and the representativeness reward function.

Abstract: Embodiments provide a computer-implemented method for rendering advertisements in a Mixed Reality space, including: profiling a plurality of users in a smart home sharing the MR space; building a social network graph between the plurality of users; building a user embedding matrix based on the social network graph; recommending a plurality of first advertisements for one or more target users; building a joint embedding matrix across the plurality of users and the plurality of first advertisements; identifying a particular position and a particular time period for the one or more target user, while the remaining users are not viewing the particular position during the particular time period; selecting one or more advertisements from the plurality of first advertisements based on the joint embedding matrix; and rendering the one or more advertisements to the one or more target users at the particular position during the particular time period.

Abstract: A method is provided to better detect a scene change to provide a prediction to an encoder to enable more efficient encoding. The method uses a Motion Compensated Temporal Filter (MCTF) that provides motion estimation and is located prior to an encoder. The MCTF provides a Motion Compensated Residual (MCR) used to detect the scene change transition. When a scene is relatively stable, the MCR score is also relatively stable. However, when a scene transition is in process, the MCR score behavior changes, Algorithmically, the MCR score is used by comparing the sliding mean of the MCR score to the sliding median. This comparison highlights the transition points. In the case of a scene cut, the MCR score exhibits a distinct spike. In the case of a fade or dissolve, the MCR score exhibits a transitional period of degradation followed by recovery. By implementing the above detection using the MCR, the location of the I-pictures in the downstream encoding process can be accurately determined for the encoder.

Abstract: The present invention relates to a technical field of user interface display, and in particular to a method, system, and device for adaptive configuration of a user interface, and a medium. The method of the present invention includes: respectively making a correspondence between one or more user interface components and one area of a plurality of areas of a panel; performing a stretching operation on the plurality of areas and the one or more user interface components, and performing a moving operation on the plurality of areas, to generate an adaptive panel and one or more adaptive user interface components adapted to user equipment; and respectively placing the one or more adaptive user interface components in corresponding areas of the adaptive panel to generate an adaptive user interface. The present invention simplifies design steps of user interface, enhances operability, and implements adaptive configuration of the user interface.

Abstract: Example methods and apparatus disclosed herein detect advertisements embedded in online media. An example apparatus includes memory, computer readable instructions, and processor circuitry to execute the computer readable instructions to render a graphical representation of progress associated with presentation of primary media distributed by an online media provider to a consumer device, the primary media including an event notification, the graphical representation to have a length and to depict the event notification at a location on the graphical representation. The example apparatus also includes processor circuitry to execute the computer readable instructions to determine a first time associated with the event notification based on the length of the graphical representation and the location of the event notification and determine a second time associated with a media feature of the primary media.

Abstract: An embodiment of an image processor for immersive video includes technology to re-order patches from a plurality of views based on one or more of relative position and orientation related information for a desired synthesized view, select a set of views to be used in each view synthesis pass, perform two or more view synthesis passes for the synthesized view to provide two or more intermediate view synthesis results, and mask and merge the two or more intermediate view synthesis results to provide a final view synthesis result. Other embodiments are disclosed and claimed.

Abstract: A method of enrichment of at least one source multimedia content for rendering on a device is disclosed. A rendering zone has a width/height ratio different from the width/height ratio of the source multimedia content. In one aspect, the method comprises identifying, from the source multimedia content, of at least one enrichment content intended to be rendered in a region of the rendering zone distinct from a region for rendering the source multimedia content. And these enriching the source multimedia content, taking into account of the at least one identified enrichment content and delivering at least one enriched multimedia content comprising at least one piece of enrichment data representative of a rendering of the enrichment content in a region of the rendering zone distinct from a region for rendering the source multimedia content.

Abstract: A system includes an image sensor, an imaging pipeline, and a display device. The image sensor is configured to capture a first frame of pixel data. The imaging pipeline is coupled to the image sensor to receive the first frame of pixel data. The imaging pipeline includes an adaptive noise filter. The adaptive noise filter is configured to filter a pixel based on noise in the pixel. The imaging pipeline is configured to output a second frame of pixel data. The second frame of pixel data includes pixels filtered by the adaptive noise filter. The display device is coupled to the imaging pipeline to receive the second frame of pixel data. The display device is configured to display the second frame of pixel data.

Abstract: Scene changes should be done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers, and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 80 frames.