Abstract: In various examples, a 3D surface structure such as the 3D surface structure of a road (3D road surface) may be observed and estimated to generate a 3D point cloud or other representation of the 3D surface structure. Since the representation may be sparse, one or more densification techniques may be applied to densify the representation of the 3D surface structure. For example, the relationship between sparse and dense projection images (e.g., 2D height maps) may be modeled with a Markov random field, and Maximum a Posterior (MAP) inference may be performed using a corresponding joint probability distribution to estimate the most likely dense values given the sparse values. The resulting dense representation of the 3D surface structure may be provided to an autonomous vehicle drive stack to enable safe and comfortable planning and control of the autonomous vehicle.

Abstract: One embodiment provides a method, including: capturing, using a camera sensor of an information handling device, an image associated with a user; identifying, in a conferencing application, a background image for a video stream of the user; determining, based on comparing the background image to the image of the user, a contextual discrepancy for a superimposition of the image of the user over the background image; and adjusting, based on the determining, one or more aspects of the background image or one or more aspects of the image of the user to negate the contextual discrepancy. Other aspects are described and claimed.

Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.

Abstract: Techniques are described for facilitating client-side augmented reality overlay of secondary content during live events. Regions for overlaying secondary content are identified along with attributes for each region. A client device may then used the attributes to overlay secondary content in each region prior to playback.

Abstract: Systems and methods for video processing are described. Embodiments of the present disclosure identify an image that depicts an expression of a face; encode the image to obtain a latent code representing the image; edit the latent code to obtain an edited latent code that represents the face with a target attribute that is different from an original attribute of the face and with an edited expression that is different from the expression of the face; modify the edited latent code to obtain a modified latent code that represents the face with the target attribute and a modified expression, wherein a difference between the expression and the modified expression is less than a difference between the expression and the edited expression; and generate a modified image based on the modified latent code, wherein the modified image depicts the face with the target attribute and the modified expression.

Abstract: The present disclosure relates to a video processing method and apparatus, a readable medium and an electronic device. The method includes: dividing a target video to obtain a target video clip; determining, according to video frame images contained in the target video clip, a quality score corresponding to the target video clip; displaying the quality score corresponding to the target video clip at a time position corresponding to the target video clip on a quality score display timeline, where the time position corresponding to the target video clip is a time position where the target video clip appears in the target video. Thus, it can provide a user with a visual display result about the quality score of the target video clip, and provide a reference for the user's video clip selection, which saves the time the user spends viewing the target video clip.

Abstract: Systems and techniques are described for processing media content, such as samples of sparse media content whose sample durations can be unknown at the time of decoding the samples, include obtaining, at a current time instance, a current fragment comprising at least a current time component. From the current time component, a modified duration is obtained for at least one media sample, the modified duration indicating a time duration by which a presentation of a previous media sample of a previous fragment is to be extended or reduced in relation to the current time instance. The at least one media sample is presented for a time duration based on the modified duration.

Abstract: The application provides a virtual video live streaming processing method and apparatus, an electronic device, and a computer-readable storage medium, and relates to the field of virtual video live streaming technologies. The virtual video live streaming processing method includes: obtaining text data and determining to-be-synthesized video data corresponding to the text data; synthesizing a live video stream in real time according to the to-be-synthesized video data and pushing the live video stream to a live streaming client; determining target video data from the to-be-synthesized video data that has not been synthesized into a live video stream in response to a live streaming interruption request during receiving a live streaming interruption request; and synthesizing an interruption transition video stream according to the target video data and pushing the interruption transition video stream to the live streaming client.

Abstract: A video editing device includes: a video storage unit for storing in an unedited state a plurality of raw videos obtained by capturing videos of one event by a plurality of video capturing devices and used for creation of a video work relating to the event; and an editing unit for creating an edited video relating to the event through use of the plurality of raw videos as requested by a user. The editing unit is configured to: add metadata that allows content appearing in each scene to be indicated to each of the plurality of raw videos stored in the video storage unit; calculate, when an editing standard is input from outside, degrees of matching between the editing standard and the plurality of raw videos based on the metadata; and create the edited video through use of some of the plurality of raw videos extracted based on the degrees of matching.

Abstract: An electronic device includes a display; a camera; a memory; and a processor operatively connected to the display, the camera, and the memory where the memory stores instructions which, when executed, enable the processor to determine a number of at least one source frame per unit second based on a specified maximum exposure time, receive light reflected from an external object by using the camera, for an exposure time determined according to a specified exposure value, generate source frames based on the received light, and generate a time-lapse image including at least one target frame indicating movement of the external object based on source frames, and the instructions cause the processor to generate the source frames at a speed different from a speed at which the time-lapse image including the at least one target frame is played.

Abstract: Embodiments are directed to segmentation and hierarchical clustering of video. In an example implementation, a video is ingested to generate a multi-level hierarchical segmentation of the video. In some embodiments, the finest level identifies a smallest interaction unit of the video—semantically defined video segments of unequal duration called clip atoms. Clip atom boundaries are detected in various ways. For example, speech boundaries are detected from audio of the video, and scene boundaries are detected from video frames of the video. The detected boundaries are used to define the clip atoms, which are hierarchically clustered to form a multi-level hierarchical representation of the video. In some cases, the hierarchical segmentation identifies a static, pre-computed, hierarchical set of video segments, where each level of the hierarchical segmentation identifies a complete set (i.e., covering the entire range of the video) of disjoint (i.e.

Abstract: Procedural model digital content editing techniques are described that overcome the limitations of conventional techniques to make procedural models available for interaction by a wide range of users without requiring specialized knowledge and do so without “breaking” the underlying model. In the techniques described herein, an inverse procedural model system receives a user input that specifies an edit to digital content generated by a procedural model. Input parameters from these candidate input parameters are selected by the system which cause the digital content generated by the procedural model to incorporate the edit.

Abstract: Video frames of a video may be marked with visual patterns to identify individual video frames. The video may be changed by applying one or more effects to the video. The accuracy with which the changes were made to the video by the effect(s) may be determined using the visual patterns marked on the video frames.

Abstract: A method, including: receiving videos generated from sessions of a video game respectively associated to first client devices; for each video, determining location metadata that identifies spatial locations in a virtual environment of the video game at which gameplay depicted by the video occurs, the spatial locations defining a path of the gameplay; during a session of the video game associated to a second client device, determining a current spatial location in the virtual environment of gameplay occurring in the session; filtering the videos based on the current spatial location to identify one or more videos having paths that intersect a region proximate to the current spatial location; presenting, over the network, the identified one or more of the videos at the second client device; continuously tracking updates to the current spatial location and responsively updating the filtering of the videos based on said updates to the current spatial location.

Abstract: Embodiments are directed to segmentation and hierarchical clustering of video. In an example implementation, a video is ingested to generate a multi-level hierarchical segmentation of the video. In some embodiments, the finest level identifies a smallest interaction unit of the video—semantically defined video segments of unequal duration called clip atoms. Clip atom boundaries are detected in various ways. For example, speech boundaries are detected from audio of the video, and scene boundaries are detected from video frames of the video. The detected boundaries are used to define the clip atoms, which are hierarchically clustered to form a multi-level hierarchical representation of the video. In some cases, the hierarchical segmentation identifies a static, pre-computed, hierarchical set of video segments, where each level of the hierarchical segmentation identifies a complete set (i.e., covering the entire range of the video) of disjoint (i.e.

Abstract: An event detection method can include encoding a plurality of training video snippets into low dimensional descriptors of the training video snippets in a code space. The low dimensional descriptors of the training video snippets can be decoded into corresponding reconstructed video snippets. One or more parameters of the encoding and decoding can be adjusted based on one or more a loss functions to reduce a reconstruction error between the one or more training video snippets and the corresponding one or more reconstructed video snippets, to reduce a class entropy of the plurality of event classes of the code space, to increase fit of the training video snippet, and/or to increase compactness of the code space. The method can further include encoding one or more labeled video snippets of a plurality of event classes into low dimensional descriptors of the labeled video snippets in the code space.

Abstract: A computer-implemented method of identifying whether a target video comprises an abridged version of a reference video includes evaluating condition a) that the target video does not comprise all shots of the reference video; condition b) that the target video includes groups of consecutive shots also included in the reference video; and condition c) that all shots which are present in both the target video and the reference video are in the same order. The method further includes identifying whether the target video comprises an abridged version of the reference video; and outputting a result of the identifying. The target video is identified as comprising an abridged version of the reference video on condition that conditions a), b) and c) are met. Also provided is a data processing apparatus for performing the method; and a computer program and computer readable storage medium comprising instructions to perform the method.

Abstract: A three-dimensional representation of a scene captured in an action shot base video may be determined. The three-dimensional representation may identify a camera pose. A representation of an object may be determined from a multi-view representation of the object that includes images of the object and that is navigable in one or more dimensions. An action shot video of the scene that includes a rendering of the object determined based on the representation and the camera pose may be generated.

Abstract: A method, a communication device and a computer program product for selecting an active camera from a front facing camera and a rear facing camera for use during a video communication session. The method includes receiving, via a processor, first communication input associated with a non-video communication session. In response to detecting a switch from the non-video communication session to a video communication session, a first context is determined at the communication device based on the first communication input. The first context is associated with using an active camera selected at the communication device to capture and share video data with the second communication device. The selected active camera is one of the front facing camera and the rear facing camera. The method further includes selecting, as the active camera, one of the front facing camera or the rear facing camera that is associated with the first context.

Abstract: Provided are a method and apparatus for providing image playing rate information. The method including receiving, from a user terminal, a target image request signal, transmitting, to the user terminal, a target image in a first state or the target image in a second state, based on whether the target image request signal satisfies a specified standard, obtaining, from the user terminal, state information and image playing information of the target image for each specified time, and providing user-wise playing rate information of the target image, based on the state information and image playing information of the target image may be provided.

Abstract: Various example implementations are directed to methods and apparatuses for facilitating conferenced communications. In one of various examples involving audio signals received from a plurality of participants of a digital audio conference, a logic circuit is to process the audio signals via respective audio input circuits respectively associated with each of the endpoint devices, and, in response to a subset of the different audio signals deemed or qualified as having a loudest audio input, encodes audio from only the subset for broadcasting to participants of the digital audio conference.

Abstract: An electronic image stabilization (EIS) method includes: obtaining video frames derived from an output of an image sensor, wherein each of the video frames has a full field of view (FOV) of the image sensor; obtaining motion information of the video frames; dynamically estimating, by a processing circuit, EIS margins according to FOV variation of a plurality of cropped images within the video frames respectively; and applying stabilization correction to the cropped images according to the motion information and the EIS margins, to generate a plurality of stabilized images.

Abstract: Provided are systems and methods for automatic video processing that employ machine learning models to process input video and understand user video content in a semantic and cultural context. This recognition enables the processing system to recognize interesting temporal events, and build narrative video sequences automatically, for example, by linking or interleaving temporal events or other content with film-based categorizations. In further embodiments, the implementation of the processing system is adapted to mobile computing platforms which can be distributed as an “app” within various app stores. In various example, the mobile apps turn everyday users into professional videographers. In further embodiments, music selection and dialog based editing can likewise be automated via machine learning models to create dynamic and interest professional quality video segments.

Abstract: A communication device provides selective subject-based presentation of a received segmented video feed. A processor receives the video feed from a video presentation session and determines that the video feed is a subject-based segmented video feed having a primary segment within which a primary subject is presented, and at least one secondary segment having at least one secondary subject. The segments can be individually selected for local presentation on a display device. The processor determines a user preference for local viewing options of the video presentation session from among (i) presenting the primary segment and the secondary segment, (ii) presenting only the primary segment, and (iii) presenting one or more of the at least one secondary segments, but not the primary segment. The processor provides a resulting video feed on the display device presenting only content of specific segments of the received video feed that correspond to the user preference.

Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.

Abstract: Disclosure herein includes descriptions of a method for transmission of digital audio over analog video data with a single cable. The method comprising receiving, by a video transmitter, a digital video signal and one of a digital or an analog audio signal. Sampling, by an audio analog-to-digital converter (ADC), the audio signal if it is an analog audio signal.

Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.

Abstract: In various embodiments, a group photograph system coordinates and creates a group photograph of participants of a video conferencing session. Using inputs from the participants, the group photograph system captures images of individual participants and selectively assembles a group photograph based on the rating of each individual participant. In one embodiment, the group photograph system sends a countdown signal to a first participant and a second participant wherein the first participant and the second participant are part of a group photograph within a video conferencing session wherein the countdown signal represents an amount of time before a first participant image is captured of the first participant. In another embodiment, the group photography system captures the first participant image and a second participant image of the first participant and the second participant, respectively and creates a first group photograph which includes the first participant image and the second participant image.

Abstract: Provided is a method for processing images. The method can include: acquiring a target face image, and performing face key point detection on the target face image to acquire a face key point detection result; determining a face visible area which is not subject to an occluder and a face invisible area which is subject to the occluder in the target face image; and acquiring a target fusion image by fusing a virtual special effect and a face part matched in the target face image based on the face key point detection result, the face visible area and the face invisible area.

Abstract: Disclosed is a method and system for enabling storytelling on a computing device. A processor: (a) analyzes a first set of media items associated with the user, each media item having associated metadata; (b) identifies one or more related characteristics among the media items in the first set; (c) forms a cluster of media items associated with an event based on the identified one or more related characteristics; (d) repeats steps (a) and (b) for a second set of media items, each media item in the second set having associated metadata and related to a social connection of the user; (e) adds media items in the second set, from a social media site associated with the second set, to the cluster; (f) edits selected media items in the cluster to fit into selected templates; and (g) creates a mixed-media module comprising the templates organized into a desired sequence.

Abstract: When a producer processing unit, such as a video decoder, of a media processing system is producing a data output for use by a consumer processing unit, such as a display processor, the producer processing unit also generates metadata for the data output that it is producing and provides that metadata for use by the consumer processing unit. The consumer processing unit then uses the metadata provided by the producer processing unit when processing the data output to which the metadata relates.

Abstract: Systems, methods and devices are provided for managing media content storage priority and retention in a single- or multi-user environment. Indications of previous user activity are received regarding multiple portions of content stored via one or more storage devices. The previous user activity may include previous user deletion selections and/or previous user viewing selections of one or more of the multiple portions of content. A retention priority may be assigned to portions of media content based on the previous user activity. Responsive to receiving an indication of low available storage space on the one or more storage devices, a quantity of storage space on the one or more storage devices to make available is determined based on the previous user activity. Deletion of one or more portions of currently stored content is initiated based on the determined quantity of storage space to make available.

Abstract: Disclosed are a video automatic editing method and system based on machine learning. The video automatic editing system based on machine learning includes at least one processor, and the at least one processor includes a video acquirer configured to acquire input video, a highlight frame extractor configured to extract at least one highlight frame from the input video using a highlight extraction model pre-trained through machine learning, and a highlight video generator configured to generate highlight video from the at least one extracted highlight frame.

Abstract: A server configured to receive video clips from a mobile device, such as eyewear. The server has an electronic processor enabled to execute computer instructions to process the video clips to identify one or more characteristics in the frames of the video clips. The processor selects the video clips having the identified characteristics in the frames and creates a set of the selected video clips having the identified characteristics in the frames. The processor automatically trims, or allows a user of the mobile device to edit and trim the video clips having the identified characteristics to create trimmed video clip segments. The processor enables a user of the mobile device to view, post, send, and export a selected said video clip segment to another user.

Abstract: A monitoring system and a method for operating the monitoring system in an inmate tracking system in a controlled environment is disclosed. The monitoring system receives video and audio data from devices located within the controlled environment and organizes the video and audio data within profiles that allow for searches of the video and audio to be performed. The monitoring system analyzes the video and audio data and generates the profiles to include identified objects associated with the video and audio data.

Abstract: A method, system, apparatus, and/or device for adjusting or removing frames in a set of frames. The method, system, apparatus, and/or device may include: associating a first frame of a set of frames with motion data that is captured approximately contemporaneously with the first frame; when a sampling rate of the motion data is greater than a frame rate of the set of frames, aggregating a first sample of the motion data captured at the first frame and a second sample of the motion data captured between the first frame and a second frame of the set of frames to obtain a movement value; when the movement value does not exceed a first threshold value, accepting the first frame from the set of frames; and when the movement value exceeds the first threshold value, rejecting the first frame from the set of frames.

Abstract: To improve user operability. Provided is a Next change operating section that receives a changing operation on each item in a Next control data set being in a control state of a Next-use M/E of a switcher (vision mixer). When a changing operation is received in the Next change operating section, that is, when there is a changing operation, a control section changes contents of the Next control data set, and in accordance with the changed contents of the Next control data set, sends a control signal concerning the Next-use M/E to the switcher. A user can simply and easily change the contents of the Next control data set by operating the Next change operating section, and operability can be improved.

Abstract: A method for embedding an advertisement in a video and a computer device, which is configured to: determine a target image, where the target image is an image that is in M frames of images of a target video and that includes a first print advertisement, and M is a positive integer; determine a target area, where the target area is an area in which the first print advertisement is located in the target image; insert a to-be-embedded second print advertisement into the target area to replace the first print advertisement; and convert a style of the target image in which the second print advertisement is embedded, where a style of the second print advertisement in the target image after style conversion is consistent with a style of an image pixel outside the area in which the second print advertisement is located in the target image.

Abstract: A video-based competition platform supports video-based competitions between possibly geographically distributed competitors. The video-based competition platform enables users of electronic communication devices to create, compete, view, and vote in video-based competitions. In at least some embodiments, a video-based competition is presented to a user with two or more video clips played in conjunction. The video clips may be synchronized to a time base and/or common audio clip.

Abstract: A method of generating a modified video file using one or more processors is disclosed. The method comprises detecting objects that are represented in an original video file using computer vision object-detection techniques, determining object motion characteristics for the detected objects, based on a specific object motion characteristic for a specific detected object meeting certain requirements, selecting a corresponding audio or visual effect, and applying the corresponding visual effect to the original video file to create the modified video file.

Abstract: Method, apparatus and computer readable media for receiving a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options, generating an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services, determining from the 3D-2D conversion option whether a 3D-2D conversion is to be performed, performing a scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, generating a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted, and generating a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.

Abstract: This disclosure relates to the embedding of visual objects into the image content of a video by a visual embed specialist, whilst maintaining the security of the video. A low-resolution version of the video content is sent by the video owner to the specialist for analysis to identify parts of the video that are suitable for visual object insertion. A high resolution version of those identified parts of the video is then sent to the specialist for visual object insertion. The specialist may then return the modified parts of the video and the content owner create a final version of the high-resolution video by replacing the relevant parts of the high-resolution video with the modified parts.

Abstract: A method for generating a tag of a video, an electronic device, and a storage medium are related to a field of natural language processing and deep learning technologies. The detailed implementing solution includes: obtaining multiple candidate tags and video information of the video; determining first correlation information between the video information and each of the multiple candidate tags; sorting the multiple candidate tags based on the first correlation information to obtain a sort result; and generating the tag of the video based on the sort result.

Abstract: A video image editing device or the like, capable of editing a wraparound video image generated by using a plurality of video images captured by multi-viewpoint cameras to be comfortably viewable by viewers, is provided. Based on information about the positions and the sizes of X subjects, a polynomial expression regarding the position of the subject and a polynomial expression regarding the size of the subject are generated. Correction or interpolation of the positions of the H subjects is performed by a polynomial approximation curve using the polynomial expression regarding the position of the subject, correction or interpolation of the sizes of the N subjects is performed by a polynomial approximation curve using the polynomial expression regarding the size of the subject, and the sizes of the N subjects are expanded or contracted with an expansion/contraction parameter p.

Abstract: An example video editing UI control apparatus includes: an editing UI display unit; a user input confirmation unit; and an editing UI processing unit. The editing UI display unit visualizes and displays an editing UI comprising a main editing UI and a detailed adjustment UI on a display device. The detailed adjustment UI is displayed by including first and second buttons with a fixed form. The user input confirmation unit confirms user input information based on a user input that is provided as a touch input through the display device. The editing UI processing unit confirms a main editing input value based on the user input information provided by the user input confirmation unit, sets a detailed adjustment input value of the detailed adjustment UI by considering the confirmed main editing input value, and processes an input of the detailed adjustment UI based on the set detailed adjustment input value.

Abstract: A jump counting method for jump rope is provided. The jump counting method comprises: S1, obtaining an original video data of a jump rope movement, and extracting an audio data and an image data from the original video data; S2, calculating the number of jumps of the rope jumper according to an audio information and an image information extracted from the audio data and the image data; and S3, outputting and displaying the calculation result.

Abstract: Techniques are described that enable a user to share videos having dynamic overlays on a social networking system. In some examples, a server computing device may receive, at a first time from a first client device, a first video. For instance, the server computing device may begin receiving the first video after the first client device has concluded capturing the first video, but has not yet completed customizing the first video. The server computing device may receive, at a second time after the first time and from the first client device, a dynamic overlay including customizations to be applied to the first video. The dynamic overlay may be transmitted separately from the first video. In examples, the server computing device generates a second video by applying the dynamic overlay to the first video. The server computing device then provides the second video to a second client device.

Abstract: A computerized-method for a mucosal assessment of a mucosal disease in a Gastrointestinal Tract (GIT) of a subject, including receiving a stream of images of at least a portion of the GIT, parsing the stream into a plurality of segments, wherein each segment corresponds to a region of the at least portion of the GIT, obtaining a set of values for each segment, wherein the set of values refers to the pathological involvement of the segment in the mucosal disease and to severity of mucosal manifestation of the mucosal disease in the segment, and based on said set of values for each segment, generating a representation indicating the location and severity of the mucosal manifestation of the mucosal disease in the entirety of the at least portion of the subject's GIT, thereby allowing to assess the condition of the mucosal disease in the at least portion of the GIT.

Abstract: Aspects of the subject disclosure may include, for example, a system for indicating a program boundary in an adaptive bitrate media stream, where the system includes a memory and a processor that performs operations including generating multiple transcoded media output streams of different bit rates from an input linear media stream, fragmenting the multiple transcoded media output streams into chunks, detecting a program boundary in the input linear media stream, and supplying a program change indicator in a manifest file for implementing program change features in mobile communication devices. Other embodiments are disclosed.

Abstract: A list of supplemental media items may be provided to potentially include one or more supplemental media items in a sequence of media items. For example, a list of B-roll footage may be provided to a user creating a video edit, and the video edit may be modified to include the B-roll footage selected by the user. The list of B-roll footage may include B-roll footage that is suggested for inclusion in the video edit.