Abstract: Techniques for displaying comments relative to a video frame are described herein. The disclosed techniques include receiving a frame of a video; receiving bullet screen data comprising a plurality of comments associated with the frame; receiving a mask frame data segment corresponding to the frame; determining a mask area based on the mask frame data segment, wherein the mask area corresponds to a main area of the frame; and displaying the plurality of comments relative to the frame in areas other than the mask area.

Abstract: This application provides techniques for generating a video cover. The techniques comprise monitoring whether the browser enters a target page; initializing a main thread and creating a frame extraction thread and an image evaluation thread; monitoring a target action on the target page extracting a plurality of target frames from the local video file using the webassembly video parser running by the frame extraction thread; determining image evaluation parameters of each of the plurality of target frame using the trained image evaluation model running by the image evaluation thread; obtaining the image evaluation parameters of each of the plurality of target frames from the image evaluation thread by the main thread, selecting one or more candidate frames from the plurality of target frames based on the image evaluation parameters of each of the plurality of target frames, and generating the video cover based on the one or more candidate frames.

Abstract: The present disclosure describes techniques for generating a mask frame data segment corresponding to a video frame. The disclosed techniques include obtaining a frame of a video; identifying a main area of the frame using an image segmentation algorithm; and generating a mask frame data segment corresponding to the frame based on the main area of the frame, wherein the generating a mask frame data segment corresponding to the frame based on the main area of the frame further comprises generating the mask frame data segment based on a timestamp of the frame in the video, a width and a height of the main area of the frame.

Abstract: The present disclosure describes techniques of processing information flow and synchronously displaying image s, mask frames and comment information. According to the present disclosure, a system processes a first information stream uploaded by a stream pushing terminal to obtain a frame image and mask frame data, the mask frame data corresponding to the frame image and identifying a timestamp offset indicative of a time difference between the mask frame data and a playing timestamp of the frame image. The system synthesizes the frame image and the mask frame data to generate a second information stream; and output the second information stream to a client for synchronously displaying the image frame, a corresponding mask frame, and the comment information.

Abstract: The present disclosure describes techniques for implementing user interface interaction. The disclosed techniques comprise playing a video on an interface; monitoring user input performed on the interface; determining a target frame based at least in part on the user input; determining a location where the user input is performed on the interface; determining whether the location of the user input is in a predetermined area of the target frame, wherein the predetermined area is associated with at least one object in the target frame; and implementing an operation associated with the at least one object in response to determining that the location of the user input is in the predetermined area of the target frame.

Abstract: Techniques for processing a multimedia file in real-time are described herein. The disclosed techniques include receiving a plurality of fragments of a multimedia file by a data stream conversion service, wherein the data stream conversion service receives a first fragment containing metadata of the multimedia file and then receives other fragments of the multimedia file in a predetermined order; sending a notification message to a message queue by the data stream conversion service in response to receiving the first fragment, wherein the notification message includes the metadata of the multimedia file and a corresponding Hyper Text Transfer Protocol (HTTP) interface address; obtaining the notification message from the message queue by an encoding and decoding service; and processing the other fragments of the multimedia file based at least in part on the notification message by the encoding and decoding service.

Abstract: The present disclosure describes techniques for implementing user interface interaction. The disclosed techniques comprise playing a video on an interface; monitoring user input performed on the interface; determining a target frame based at least in part on the user input; determining a location where the user input is performed on the interface; determining whether the location of the user input is in a predetermined area of the target frame, wherein the predetermined area is associated with at least one object in the target frame; and implementing an operation associated with the at least one object in response to determining that the location of the user input is in the predetermined area of the target frame.

Abstract: The present disclosure describes techniques of processing information flow and synchronously displaying image frames, mask frames and comment information. According to the present disclosure, a system processes a first information stream uploaded by a stream pushing terminal to obtain a frame image and mask frame data, the mask frame data corresponding to the frame image and identifying a timestamp offset indicative of a time difference between the mask frame data and a playing timestamp of the frame image. The system synthesizes the frame image and the mask frame data to generate a second information stream; and output the second information stream to a client for synchronously displaying the image frame, a corresponding mask frame, and the comment information.

Abstract: The present disclosure describes techniques for generating a mask frame data segment corresponding to a video frame. The disclosed techniques include obtaining a frame of a video; identifying a main area of the frame using an image segmentation algorithm; and generating a mask frame data segment corresponding to the frame based on the main area of the frame, wherein the generating a mask frame data segment corresponding to the frame based on the main area of the frame further comprises generating the mask frame data segment based on a timestamp of the frame in the video, a width and a height of the main area of the frame.

Abstract: Techniques for displaying comments relative to a video frame are described herein. The disclosed techniques include receiving a frame of a video; receiving bullet screen data comprising a plurality of comments associated with the frame; receiving a mask frame data segment corresponding to the frame; determining a mask area based on the mask frame data segment, wherein the mask area corresponds to a main area of the frame; and displaying the plurality of comments relative to the frame in areas other than the mask area.

Abstract: Techniques for processing a multimedia file in real-time are described herein. The disclosed techniques include receiving a plurality of fragments of a multimedia file by a data stream conversion service, wherein the data stream conversion service receives a first fragment containing metadata of the multimedia file and then receives other fragments of the multimedia file in a predetermined order; sending a notification message to a message queue by the data stream conversion service in response to receiving the first fragment, wherein the notification message includes the metadata of the multimedia file and a corresponding Hyper Text Transfer Protocol (HTTP) interface address; obtaining the notification message from the message queue by an encoding and decoding service; and processing the other fragments of the multimedia file based at least in part on the notification message by the encoding and decoding service.