Abstract: Techniques for content-based indexing of videos at web-scale are described. As one example, a computer-implemented method includes receiving a video file, splitting the video file into video frames and audio for the video frames, determining audial features for the audio, clustering each of a plurality of subsets of the audial features into a respective audio centroid for a shared set of bases, determining a first adjacency matrix of distances between the respective audio centroids, determining visual features for the video frames, clustering each of a plurality of subsets of the visual features into a respective video centroid, and determining a second adjacency matrix of distances between the respective video centroids.

Abstract: A camera image processor receives frames from an image sensor of the camera. While continuing to receive frames from the image sensor, the camera image processor detecting an action within one or more frames of the received frames, for example using a convolution neural network trained to recognize one or more actions. While continuing to receive frames from the image sensor, the camera image processor captures the one or more frames with the detected action, for example as a still image, or as a slow-motion portion of a video that includes the received frames.

Abstract: A method for providing galvanic vestibular stimulation corresponding to accelerations in scenes of a video. Embodiments include (1) receiving a three dimensional video signal including three dimensional video angular velocity information, (2) receiving a three dimensional head orientation signal including three dimensional head angular velocity information, (3) calculating resultant three dimensional angular velocity information based on the video angular velocity information and the head angular velocity information, (4) calculating three dimensional acceleration information based on the resultant three dimensional angular velocity information, and (5) generating three dimensional galvanic vestibular stimulation signals corresponding to the resultant three dimensional angular acceleration information, wherein the three dimensional stimulation signals will stimulate three dimensional acceleration sensations corresponding to accelerations on the user viewing the displayed scenes.

Abstract: An information processing system includes a user-specified video creation unit configured to create a user-specified video to be distributed to a user terminal from a free-viewpoint video created based on a plurality of captured images captured by a plurality of cameras, an accepting unit configured to accept an instruction of changing setting of a virtual camera from the user terminal, a determination unit configured to determine whether a user needs assistance in setting a viewpoint of the virtual camera based on the instruction from the user accepted by the accepting unit, and a switching unit configured to switch an image being displayed on the user terminal to another image when the determination unit determines that the user needs assistance in setting the viewpoint.

Abstract: A method for synchronizing a plurality of media files with an audio track comprises obtaining the plurality of media files and the audio track including a plurality of audio samples. Each media file is associated with a metadata and each audio sample is indexed with a corresponding timecode. The method comprises detecting, while the audio track is being played, a media file transition trigger that identifies a current audio sample of the audio track as an audio sample to transition from a first media file to a second media file. The method comprises obtaining a timecode indexed with the identified audio sample corresponding to the detected media file transition trigger and associating the timecode with the metadata of the second media file to link the second media file with the audio sample. The method comprises generating a synchronized multimedia file having the linked second media file with the audio sample.

Abstract: The present disclosure relates to a communication technique that combines, with IoT technology, 5G communication system for supporting a higher data transfer rate than a 4G system, and a system therefor. The present disclosure can be applied to intelligent services, such as smart homes, smart buildings, smart cities, smart cars or connected cars, health care, digital education, retail businesses, security and safety related services, etc. on the basis of 5G communication technologies and IoT related technologies. Disclosed, in the present invention, are a method and an apparatus for determining the size of a transport block in a communication or broadcasting system.

Abstract: Techniques are presented for modifying images of an object in video, for example to correct for lens distortion, or to beautify a face. These techniques include extracting and validating features of an object from a source video frame, tracking those features over time, estimating a pose of the object, modifying a 3D model of the object based on the features, and rendering a modified video frame based on the modified 3D model and modified intrinsic and extrinsic matrices. These techniques may be applied in real-time to an object in a sequence of video frames.

Abstract: Systems and methods for generating individualized content trailers. Content such as a video is divided into segments each representing a set of common features. With reference to a set of stored user preferences, certain segments are selected as aligning with the user's interests. Each selected segment may then be assigned a label corresponding to the plot portion or element to which it belongs. A coherent trailer may then be assembled from the selected segments, ordered according to their plot elements. This allows a user to see not only segments containing subject matter that aligns with their interests, but also a set of such segments arranged to give the user an idea of the plot, and a sense of drama, increasing the likelihood of engagement with the content.

Abstract: The present disclosure relates to systems and methods for editing a video. The method may include obtaining a video document including audio information. The method may also include processing the audio information to identify at least one desired audio segment of the audio information that has at least one desired acoustic feature representation. Further, the method may include editing the video document to generate a video abstraction at least based on the identified at least one desired audio segment of the audio information.

Abstract: An image capture device may provide playback of audio content during capture of visual content. Moments within the audio content may be associated with cue markers. The visual content may be synchronized with the audio content provided during capture, and a video edit may be automatically generated based on the moments associated with the cue markers.

Abstract: The disclosed computer-implemented method may include accessing a pre-rendered multimedia item. The pre-rendered multimedia item may have branching logic associated with it, where the branching logic includes branching points that direct non-sequential playback of the pre-rendered multimedia item. The method may also include initializing playback of the pre-rendered multimedia item and accessing, at the branching points, various trigger conditions that direct playback order of different segments of the pre-rendered multimedia item. The method may then include updating, based on the trigger conditions, at least some portion of custom state data. The method may further include playing back the segments of the pre-rendered multimedia item according to the updated state data. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A system and method for collaboratively creating an automatically assembled movie is presented herein. The system and method includes identifying a predefined movie script, wherein the predefined movie script defines or includes a plurality of character roles, and for each of the plurality of character roles, includes at least one clip request. Users of the system and method are invited to join a movie making group, and once joined, are assigned to one of the character roles. For each of the character roles, the system and method will receive a raw or pre-processed media clip recorded by the user's device and which corresponds with the clip request. The pre-processed media clips are then automatically processed by the system and method according to script rules by applying filters or visual effects. The processed media files are the automatically combined according to script rules to create the final movie.

Abstract: Provided are a method and apparatus for determining background music of a video, a terminal device, and a storage medium. The method includes: acquiring a scene selection instruction, and performing video capturing based on the scene selection instruction; after the video capturing is completed and a music selection instruction for the captured video is detected, displaying a music replacement interface; and determining background music of the captured video according to music selected on the music replacement interface.

Abstract: A sensor data processing apparatus can be coupled to multiple image sensors of different types. The apparatus adjusts frame transmission rates based on the number of sensors and type of image data sourced by the sensors to optimize utilization of bandwidth on a number of transport channels. The apparatus can be configured to transport selected frames in the image data that are identified as critical frames at a higher rate than non-selected frames in the image data.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to access multimedia data that has a hierarchical track structure that includes at least a first track at a first level of the hierarchical track structure comprising first media data, wherein the first media data comprises a first sequence of temporally-related media units, and a second track at a second level in the hierarchical track structure that is different than the first level of the first track, the second track comprising metadata specifying a temporal track derivation operation. The temporal track derivation operation is performed on a set of media units comprising at least the first sequence of temporally-related media units to temporally modify the set of media units to generate second media data for the second track, wherein the second media data comprises a second sequence of temporally-related media units from the set of media units.

Abstract: A method of combining data, the method comprising: receiving video data, the video data corresponding to recorded video having a video duration determined by a user; selecting backing audio data, the backing audio data corresponding to backing audio having a predetermined duration; determining a difference between the predetermined duration and the video duration; and modifying the backing audio data by adjusting the predetermined duration based on the video duration to create an adjusted predetermined duration, the adjusted predetermined duration being such that the backing audio and recorded video may be simultaneously output in synchronisation.

Abstract: A medical apparatus and a method of manufacturing the medical apparatus, which have an advantage in cost performance, are provided even if optical fibers are used therein. The medical apparatus includes, therein, a first optical fiber 6322 configured to transmit an optical signal, a second optical fiber 651 configured to transmit an optical signal, and a first optical connector 66 configured to connect the first optical fiber 6322 and the second optical fiber 651.

Abstract: Disclosed are a video editing method and apparatus, a device and a readable-storage medium. The method includes: acquiring a first video, separating a first video signal of the first video and an audio signal of the first video, collecting a second video signal, and synthesizing the collected second video signal with the audio signal to obtain a second video, clipping the first video and the second video to obtain a plurality of first short videos and a plurality of second short videos respectively; and selecting, according to the audio signal, a first target short video and a second target short video from the multiple first short videos and the multiple second short videos, and stitching the first target short video and the second target short video.

Abstract: Devices, systems and methods are disclosed for improving story assembly and video summarization. For example, video clips may be received and a theme may be determined from the received video clips based on annotation data or other characteristics of the received video data. Individual moments may be extracted from the video clips, based on the selected theme and the annotation data. The moments may be ranked based on a priority metric corresponding to content determined to be desirable for purposes of video summarization. Select moments may be chosen based on the priority metric and a structure may be determined based on the selected theme. Finally, a video summarization may be generated using the selected theme and the structure, the video summarization including the select moments.

Abstract: Multiple video clips may be selected for use in generating a video edit. A graphical user interface for editing the multiple video clips may include a combined progress length element. The combined progress length element may visually represent combined progress length of the multiple video clips.